arXiv Science⌕ Search

arXiv · 1402.1194

Compressing IP Forwarding Tables: Towards Entropy Bounds and Beyond

Abstract

Lately, there has been an upsurge of interest in compressed data structures, aiming to pack ever larger quantities of information into constrained memory without sacrificing the efficiency of standard operations, like random access, search, or update. The main goal of this paper is to demonstrate how data compression can benefit the networking community, by showing how to squeeze the IP Forwarding Information Base (FIB), the giant table consulted by IP routers to make forwarding decisions, into information-theoretical entropy bounds, with essentially zero cost on longest prefix match and FIB update. First, we adopt the state-of-the-art in compressed data structures, yielding a static entropy-compressed FIB representation with asymptotically optimal lookup. Then, we re-design the venerable prefix tree, used commonly for IP lookup for at least 20 years in IP routers, to also admit entropy bounds and support lookup in optimal time and update in nearly optimal time. Evaluations on a Linux kernel prototype indicate that our compressors encode a FIB comprising more than 440K prefixes to just about 100--400 KBytes of memory, with a threefold increase in lookup throughput and no penalty on FIB updates. This technical report contains a number of important corrections and revisions to the original manuscript.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Gábor Rétvári, János Tapolcai, Attila Kőrösi, András Majdán, Zalán Heszberger. 2014-02-05. Compressing IP Forwarding Tables: Towards Entropy Bounds and Beyond. https://doi.org/10.1145/2486001.2486009

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Breaking the $2^n$ barrier for directed hamiltonicity

We give a randomized algorithm for Directed Hamiltonian Cycle on $n$-vertex directed graphs that runs in $O^*(1.9133^n)$ time. For general directed graphs, this is the first improvement in the exponential base over the classical $O(2^n n^2)$-time algorithms of Bellman and Held--Karp (1962). To obtain this improvement, we reduce Hamiltonicity to weighted parity counting using the isolation lemma of Mulmuley, Vazirani, and Vazirani (STOC 1987). If a Hamiltonian path from $s$ to $t$ exists, assigning random polynomially bounded integer weights to the arcs gives a unique minimum-weight Hamiltonian path from $s$ to $t$ with constant probability. In particular, the path count at its total weight is odd. To compute these parities, we give a $(2-2^{-d})^n n^{O(1)}$-time algorithm for instances in which the arcs entering each vertex have at most $d$ distinct polynomially bounded integer weights. The algorithm applies the random linearization idea of Arvind and Guruswami (IPEC 2021) to the Laplacian determinant construction of Björklund, Kaski, and Koutis (ICALP 2017). To keep $d$ small, we randomly delete and duplicate arcs and partition the incoming copies at each vertex into $d$ groups, assigning a common weight to all arcs in each group. We prove that, if the input graph has a Hamiltonian path from $s$ to $t$, then with positive, albeit exponentially small, probability one can select one group at each vertex so that their union contains an odd number of such paths.

cs.DS↗

A deterministic polynomial-time algorithm for the Bilu--Linial signing problem on bipartite graphs

We give a deterministic polynomial-time algorithm for the Bilu--Linial signing problem on bipartite graphs. For every finite simple bipartite graph of maximum degree at most an integer $Δ\ge3$, the algorithm assigns signs to its edges so that the signed adjacency matrix has operator norm strictly less than $2\sqrt{Δ-1}$. Our algorithm builds on the randomized recursive repair framework of Jadbabaie, Saberi, and Sra~\cite{JSS26}, with deterministic rules for sign selection and vertex deletion.

cs.DS↗

Inclusion-wise extremal knapsack problems are (mostly) hard to approximate

We study two inclusion-wise extremal variants of the 0-1 Knapsack Problem (KP). Given $n$ items with integer weights and nonnegative costs or profits, the Minimum-Cost Maximal Knapsack Packing Problem seeks a minimum-cost packing for capacity $c$ to which no item can be added, while the Maximum-Profit Minimal Knapsack Cover Problem seeks a maximum-profit cover for threshold $d$ from which no item can be removed. Both problems are weakly $\mathrm{NP}$-hard and pseudo-polynomially solvable, as is the classical KP, but their approximability is fundamentally different: unless $\mathrm{P}=\mathrm{NP}$, with positive values neither problem admits a polynomial-time $2^{p(n)}$-approximation for any polynomial $p$; allowing zero values rules out every multiplicative factor. Even with unit costs for packing and unit profits for covering, neither admits an $n^{1-\varepsilon}$-approximation for any fixed $\varepsilon>0$, whereas a trivial $n$-approximation exists. We identify restrictions that restore approximability. If every item weighs at least a fixed fraction of the capacity, respectively of the threshold, both problems can be solved exactly in polynomial time. For the cover problem, if each weight $w_i$ satisfies $w_i-1\geδ(d-1)$, we give an approximation scheme for arbitrary profits whose running time is polynomial in $n$, $1/\varepsilon$, and $1/δ$. If values equal weights, a fully polynomial-time approximation scheme (FPTAS) was already known for the packing problem; we give an FPTAS for the cover problem, improving on the previously known factor $2$. If value-to-weight ratios differ by at most a factor $κ$, we obtain a $(1+\varepsilon)κ$-approximation for both problems.

cs.DS↗