arXiv · 2611.10929
Augur: An Online Learning-based Hardware Data Prefetcher using Reservoir Computing
Abstract
Machine-learning-based hardware prefetchers can learn complex access patterns, but practical deployment demands online adaptation, low-latency inference, and modest hardware cost. We present Augur, a hardware delta prefetcher based on next-generation reservoir computing (NGRC) that meets all three requirements. Augur formulates delta prediction as a history-based regression problem. It constructs a fixed-size reservoir from hashed delta features over a short context window and predicts the next delta using a single dot product. The model is updated online via one-step SGD and requires no offline pre-training, no per-benchmark tuning, and no floating-point arithmetic. Replacing the integer multiplications traditionally used to generate nonlinear reservoir features with bitwise AND operations removes all feature-generation multipliers with no loss in performance. Because Augur regresses a continuous delta, it needs no action set chosen offline for a fixed set of workloads. Augur pairs the reservoir with a simple Markov-based delta predictor for simple delta patterns, and with a selective issuance policy that filters and throttles wasteful prefetches; this policy accounts for about 40% of Augur's advantage and also improves Pythia. Evaluated on 169 traces spanning GAP, Ligra, PARSEC, SPEC CPU 2006, SPEC CPU 2017, and AI workloads, Augur outperforms the state-of-the-art ML-based delta prefetcher by 2.9%, 4.5%, and 5.3% in geomean speedup on 1-, 4-, and 8-core systems, respectively, while achieving ~2x higher prefetch accuracy and 37.8 percentage points fewer overpredictions. Augur is practical to implement at 33 KB storage, 0.32 sq. mm area, and 32.7 mW in 12 nm.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Satvik Maurya, David Trilla, Swamit Tannu, Alper Buyuktosunoglu. 2026-11-16. Augur: An Online Learning-based Hardware Data Prefetcher using Reservoir Computing. https://arxiv.science/abs/2611.10929
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.