arXiv subjects

Anirudh Agrawal

Publications and source records attributed to Anirudh Agrawal.

3 recordsLinked to original sources

arXiv2026

Data-Efficient Scaling-Law Discovery for Recommendation Systems via Coupled Hyperparameter Scaling

Large-scale ranking and recommendation models of Web platforms benefit from increased compute much as large language models do, and their scaling behavior is broadly power-law in form. Yet ranking models have heterogeneous architectures which makes their scaling law less straightforward than that of LLMs. We address how to discover the scaling law of an arbitrary ranking model efficiently. We introduce a scaling layer, which groups primitive architecture parameters into semantically coherent groups and defines how they co-vary, inducing a mapping from a low-dimensional space of hyper-hyperparameters into the full architecture space. On top of it, Axia fits scaling-informed surrogates, selects configurations by a posterior-based acquisition criterion, and returns a Pareto frontier from which per-model operating points are validated -- replacing exhaustive sweeps with a small number of informative runs. A fleet-level evaluation protocol, computed on a fixed representative model set under matched trial budgets, makes refinements to either component measurable. Our contribution is an automated system that learns model-specific complexity-quality relationships and gives uncertainty-aware guidance for allocating compute across a heterogeneous model ecosystem. Across 34 model iterations in two development cycles on Meta's ads ranking and retrieval system, the workflow yielded a mean 0.66% offline normalized-entropy improvement and 0.36% cumulative online lift.

cs.LG↗

arXiv2026

Tail reliability in probabilistic electricity price forecasts: comparing model combination and conformal prediction in the GB day-ahead market

Probabilistic forecasts of day-ahead electricity prices are increasingly used to manage price risk, yet competing models are usually ranked on aggregate scores that average over the price regimes in which uncertainty matters most. This study evaluates probabilistic forecasts of hourly EPEX SPOT GB day-ahead prices over a full held-out calendar year, applying a common pre-auction information boundary and rolling-origin design to linear quantile regression, a quantile regression forest (QRF), a LEAR-QRA benchmark and an encoder-decoder quantile long short-term memory (LSTM) network. Two routes to more reliable intervals are then compared: conformal recalibration and Quantile Regression Averaging (QRA). Aggregate scores separate the LSTM and QRF only weakly, with a non-significant 4.4% difference in continuous ranked probability score (CRPS), but their conditional behaviour differs sharply. Above 200 GBP/MWh the LSTM covered 0.12 of outcomes and QRF 0.71, consistent with the forest retaining realised spikes in its leaf distributions while the network learned a smooth upper tail. Conformal recalibration corrected marginal coverage but did not improve the interval score or materially repair spike coverage. QRA combining the LSTM, QRF and LEAR-QRA forecasts reduced CRPS to 5.14 GBP/MWh and raised coverage above 200 GBP/MWh to 0.65 at unchanged interval width. Recalibration and combination therefore address different failures and are not substitutes.

stat.AP↗

arXiv2026

Design Once, Deploy at Scale: Template-Driven ML Development for Large Model Ecosystems

Modern computational advertising platforms typically rely on recommendation systems to predict user responses, such as click-through rates, conversion rates, and other optimization events. To support a wide variety of product surfaces and advertiser goals, these platforms frequently maintain an extensive ecosystem of machine learning (ML) models. However, operating at this scale creates significant development and efficiency challenges. Substantial engineering effort is required to regularly refresh ML models and propagate new techniques, which results in long latencies when deploying ML innovations across the ecosystem. We present a large-scale empirical study comparing model performance, efficiency, and ML technique propagation between a standardized model-building approach and independent per-model optimization in recommendation systems. To facilitate this standardization, we propose the Standard Model Template (SMT) -- a framework that generates high-performance models adaptable to diverse data distributions and optimization events. By utilizing standardized, composable ML model components, SMT reduces technique propagation complexity from $O(n \cdot 2^k)$ to $O(n + k)$ where $n$ is the number of models and $k$ the number of techniques. Evaluating an extensive suite of models over four global development cycles within Meta's production ads ranking ecosystem, our results demonstrate: (1) a 0.63% average improvement in cross-entropy at neutral serving capacity, (2) a 92% reduction in per-model iteration engineering time, and (3) a $6.3\times$ increase in technique-model pair adoption throughput. These findings challenge the conventional wisdom that diverse optimization goals inherently require diversified ML model design.

cs.AI↗