arXiv Science⌕ Search

arXiv subjects

Aaditya Ramdas

Publications and source records attributed to Aaditya Ramdas.

At least 19 recordsLinked to original sources
arXiv2026

Beyond least-favorable distribution pairs: asymptotically instance-optimal robust hypothesis testing

When testing a composite null $\mathcal{P}$ against a composite alternative $\mathcal{Q}$, it has been known since Huber and Strassen (1973) that if a least favorable distribution (LFD) pair exists, then a version of its likelihood ratio yields a minimax optimal test, and Huber (1965) derived a similar result in the sequential setting for a specific robust testing problem that is the focus of the current paper; the same likelihood ratio is log-optimal in the worst case; its expected logarithm under the alternative equals $\inf_{P \in \mathcal{P},S \in \mathcal{Q}} KL(S\|P)$, whose inverse also determines the stopping time of the test under the alternative. These results focus on optimizing worst-case performance, but the resulting methods have lower power if the data come from simpler alternatives. This paper studies an arguably more practical goal of achieving asymptotic \emph{instance optimality} for ``power-one'' sequential tests, which remarkably may even be possible when $\mathcal{Q} = \mathcal{P}^c$. This means that when the data are drawn from any $S \in \mathcal{P}^c$, the test has power one, and its stopping time is determined by the larger information number $\inf_{P \in \mathcal{P}} KL(S\|P)$, which governs the performance of an oracle that knows $S$. To demonstrate this point, our paper focuses on the case of testing a TV ball around a discrete distribution with $d$ components, and designs a computationally and memory efficient algorithm that is also asymptotically instance-optimal. Specifically, we consider two different asymptotic settings: one is the "Wald setting", where the type-1 error level $α$ approaches zero for a fixed alternative $S$ and the second is the "Farrell setting", where $α$ is fixed and $\inf_{P \in \mathcal{P}} KL(S\|P)$ approaches $0$. Our sequential test is simultaneously optimal in both regimes.

math.ST↗
arXiv2026

Gaussian-efficient testing by betting on the mean of bounded data

Given $[0,1]$-valued random variables $X_1,\dots,X_n$ such that $\mathbb{E}[X_i | X_1,\dots,X_{i-1}]= μ$ for all $i$, we propose a new nonasymptotic confidence interval for $μ$ that is obtained by inverting terminal e-values generated by a novel betting strategy. When the data are iid, its limiting width matches that of the central limit theorem (``Gaussian-efficient''), finally surpassing the inefficient limits of previous betting intervals. Our main conceptual advance involves designing betting fractions that track the conditional rejection probability of the most powerful terminal test in a limiting Gaussian experiment. When one predictable variance estimator is shared across candidate means, the deterministic inversion is an interval for every data sequence and its two endpoints can be found easily. The width can be improved further with external randomization. In simulations, our method yields the tightest intervals to date; for every distribution tested and all sufficiently large $n$, our deterministic version beats STaR-Bets and is competitive with Gaffke, while the randomized improvement beats both. It thus combines finite-sample validity under martingale dependence, easy endpoint computation, Gaussian-efficient inference for iid data, and excellent empirical performance. We further combine GE-betting with a mixture of constant-fraction bets to attain both Gaussian and large-deviation efficiency under iid sampling while retaining martingale validity. We also extend the construction and its efficiency theory to sampling without replacement, where it again achieves state-of-the-art empirical performance.

stat.ME↗
arXiv2026

A general recipe for data-adaptive anytime-valid envelopes for iterative algorithms

Most convergence guarantees for iterative stochastic algorithms are stated at a fixed iteration count and do not justify stopping at a data-dependent time. Recent anytime-valid envelopes do, but deterministic ones are typically too conservative for practical stopping, and existing data-adaptive ones are derived case-by-case, each concerned with a specific algorithm and a specific noise model and boundary construction. This paper provides a general recipe for sharp, data-adaptive anytime-valid envelopes for a large class of iterative algorithms. Our approach has two key steps: an optimization module derives a one-step recursion that performance measures of many such algorithms satisfy, reducing the error analysis to time-uniform concentration for predictably weighted sums of noise. Then, a statistical module ports the sub-$ψ$ condition to vector-valued processes, uniformly over predictable weights, and derives off-the-shelf boundaries via mixtures, stitching, and product betting martingales. Combining the two yields readymade envelopes for many iterative algoithms including but not limited to stochastic gradient descent (SGD), Oja's algorithm, temporal difference learning, Q-learning, and Bures-Wasserstein SGD, many with no prior data-adaptive anytime-valid guarantees. Specifically, for SGD, our framework recovers, often under weaker conditions, or significantly sharpens every existing envelope we are aware of. Our constructions come with explicit implementation details and are substantiated by numerical experiments.

stat.ML↗
arXiv2026

A uniform improvement to conformal risk control via a generalization of e-closure

We extend the recently introduced e-closure principle for multiple testing to general state and action spaces and to arbitrary, including continuously indexed, families of risks. A collection of e-values indexed by states and risks certifies a menu of actions, and every data-dependent selection from this menu controls each expected loss at its prescribed level. Conversely, every valid procedure is certified by its own normalized losses, which often leave part of the risk budget unused. We introduce a method called recertification, which spends this unused budget. Using known distributional structure, it enlarges the certifying e-values while preserving validity and selects a less conservative action from the enlarged menu. One particularly compelling application is to the popular framework of conformal risk control (CRC) with a known loss family. Here, recertification redistributes unused risk budget among the held-out points of each hypothetical augmented sample. The resulting controller is valid under every finite exchangeable law and less (usually strictly) conservative than CRC. For convex losses on an interval of actions, repeated recertification converges geometrically to an admissible controller. As a second example involving false discovery rate control with e-values, recertifying randomized e-BH yields a closed-form procedure that rejects a superset of randomized e-BH for every realization of the randomization and maximizes the expected number of rejections under the same constraints. Recertifying with the larger e-collection of closed e-BH gives a second closed-form procedure that rejects a superset of the first. Experiments on CIFAR-100 hierarchical classification and simulations demonstrate improved budget utilization and gains in informativeness and power over the corresponding baselines.

stat.ME↗
arXiv2026

Truthful and Admissible Principal--Agent Testing with Nuisance Parameters

Statistical contracts reward experimenters according to the evidence produced by a costly study, so the reward rule influences both who participates and what they report. Principal--agent testing theory explains how to prevent ineffective proposals from being profitable. We ask when such contracts can also elicit honest parameter reports if the decision concerns a mean effect but the variance or distributional shape is unknown. Under risk neutrality and a fixed participation cost, we construct menus of e-values --- nonnegative normalized rewards with expected value at most one under every null --- such that (i) agents who know they are null have no incentive to participate, (ii) every alternative type earns positive expected profit and is thus incentivized to participate, (iii) truthful reporting uniquely maximizes expected their reward, (iv) and each contract is admissible: its payouts cannot be pointwise improved while retaining null validity. For Gaussian observations, we treat separately agents who know both mean and variance and agents who know only their mean; in the latter case, truthfulness holds at every variance without requiring a nuisance prior. Multi-sample extensions preserve these incentives and can reward accumulating evidence. Beyond Gaussian models, we show that two independent nonnegative observations suffice to elicit any finite mean above a positive null threshold, without any further distributional knowledge, but one observation cannot combine strict mean elicitation with individual admissibility on this class. Finally, we distinguish the existence of useful tests from the identification needed for truthful contracts. Boundedness is not required, and finitely many null constraints do not by themselves guarantee admissible elicitation.

stat.ME↗
arXiv2026

Variance-adaptive Chernoff bounds: nonasymptotically valid, asymptotically sharp confidence sets for unbounded means

Consider the classical statistical problem of sub-Gaussian mean estimation under martingale dependence: given $n$ observations with conditional mean $μ$ and a known conditional sub-Gaussian proxy $s>0$, we seek a nonasymptotically valid confidence interval for $μ$. The usual Chernoff interval has half-width $s\sqrt{2\log(2/α)/n}$; it neither adapts to the actual standard deviation $σ\le s$ nor attains the Gaussian quantile $z_{1-α/2}$. We construct an analytically closed-form nonasymptotically-valid interval under martingale dependence whose endpoints, at every iid law with $σ> 0$, agree almost surely to first order with $\bar X_n\pmσz_{1-α/2}/\sqrt n$. The two new building blocks are a sub-Gaussian exponential supermartingale with an \emph{empirical} quadratic variance and a cubic correction term, and a sub-Gaussian continuation supermartingale, the former delivering variance adaptivity ("Empirical-Bernstein'' for unbounded data), the latter also providing the Gaussian quantile ("Empirical-Berry-Esseen'' for unbounded data). The same constructions yield a closed-form time-uniform confidence sequence with asymptotically unimprovable half-width $σ\sqrt{2\log\log n/n}$. We also give closed-form multivariate ellipsoids with the true-covariance chi-square limit, and extend the scalar Gaussian and LIL constructions to handle heavy-tailed settings where one only knows a bound on any absolute central moment of order greater than two. Experiments show substantial width reductions when the true variance is smaller than the implied variance bound, at small loss in the boundary cases. The surprising (to us) takeaway message is: given any more than two moments, one can construct fully data dependent nonasymptotic confidence sets for the mean that are asymptotically efficient.

math.ST↗
arXiv2026

Principal-agent hypothesis testing under adaptive experimentation

Principal-agent hypothesis testing studies statistical contracts in which a principal rewards an agent according to data the agent generates. Existing work focuses on the single-shot setting, where the agent produces a single dataset. We extend the framework to sequential settings, where evidence accumulates over time, rewards may be deferred to the end or disbursed incrementally, and the agent may stop the contract at a strategically chosen stopping time. We call a contract null-deterring if no ''null agent'' (those whose data-generating distribution lies in the null hypothesis) can profit in expectation under any stopping rule, and our main conceptual result shows that such contracts are characterized by e-processes. We then turn to the agent's best response and identify the optimal stopping rule through the Snell envelope of the reward process. We develop simpler, more interpretable approximations that often require the agent to have only partial knowledge of its distribution.

stat.ME↗
arXiv2026

Anchored multiple testing: a transparent use of e-closure to improve FDR procedures

The recent e-closure method can recover every procedure that controls FDR (and other expectation losses). But the recovered e-collection is ``self-referential'' and gives no insight on how to improve the procedure (if improvable), and some recent improvements have been somewhat opaque. We introduce an elementary new technique called anchoring that exploits looseness in existing FDR proofs to enlarge a baseline multiple-testing procedure's self-referential local e-value. The resulting e-closure thus transparently retains every baseline discovery (and usually adding more) and controlling the false discovery rate under the same conditions as the baseline. To show that this principle is broadly applicable, we use it to improve a large suite of multiple testing procedures: (i) Anchored-BH dominates the Benjamini-Hochberg (BH) procedure under PRDS while being incomparable to Goeman's recent closed-BH, (ii) Anchored-BY dominates the Benjamini-Yekutieli (BY) procedure under arbitrary dependence while being incomparable to closed-BY, (iii) For two-sided Gaussian p-values (under appropriate covariance conditions), Anchored-2BH dominates running BH twice at half the level on two one-sided p-values, (iv) Anchored-dBH dominates dependence-adjusted BH, (v) Anchored e-BH dominates e-BH and is incomparable to closed e-BH, (vi) Anchored SeqStep+ improves the original (including selective and adpative variants) while preserving ordered rejection structures. All of these are accomplished in sorting or quadratic time. The appendix shows how to dominate Shifted-BH (for two-sided arbitrarily correlated Gaussians) and NDBH (for negatively dependent p-values), IndBH (for graph-dependent p-values), conformal multiple testing and the support line procedure for boundary FDR control.

stat.ME↗
arXiv2026

The dynamic generalized covariance measure for conditional independence testing with nonstationary time series

Identifying relationships among stochastic processes is a core objective in many fields, such as economics. While the standard toolkit for multivariate time series analysis has many advantages, it can be difficult to capture nonlinear dynamics using linear vector autoregressive models. This difficulty has motivated the development of methods for causal discovery and variable selection for nonlinear time series, which routinely employ tests for conditional independence. In this paper, we introduce the first framework for conditional independence testing that works with a single realization of a nonstationary nonlinear process. The proposed test is designed to have power against alternatives in which the expected conditional covariance is non-zero for at least some times. We also discuss an approach for gaining power against a broader range of alternatives. The key technical ingredients of our framework are time-varying nonlinear regression, estimation of local long-run covariance matrices of products of error processes, and a distribution-uniform strong Gaussian approximation.

stat.ME↗
arXiv2026

Combining e-values using demi-supermartingales

We present a new method for combining e-variables through demi-supermartingales, which settles an old conjecture in the literature on nonparametric mean testing. It also provides an explicit concentration bound for a certain Kullback--Leibler-type statistic arising in the stochastic multi-armed bandit literature. All of these combination results hold for independent e-variables as well as for the class of co-valid e-variables, whose dependence structure lies somewhere between independence and sequential validity. The results are further generalized to compound e-variables. The proofs proceed by analyzing elementary symmetric polynomials and their behavior as nonnegative demi-supermartingales.

stat.ME↗
arXiv2026

Tiny but uniform improvements of adaptive BH procedures via compound e-values

After the seminal Benjamini--Hochberg (BH) procedure for controlling the false discovery rate (FDR) was proposed, dozens of papers have attempted to improve its power by adapting to the unknown proportion of nulls. We observe that most null-proportion estimates are simply compound e-values in disguise, and thus most adaptive FDR procedures can be interpreted as instances of the e-weighted BH (ep-BH) procedure of Ignatiadis, Wang, and Ramdas [2024], i.e., the BH procedure weighted by compound e-values. This lens helps us show that most existing procedures are inadmissible, and we provide uniform improvements to them. While the improvements are small in practice, they still come for free (without additional assumptions), and help unify the literature. We also use our "leave-one-out ep-BH method" to design a new method with finite-sample FDR control for the simultaneous t-test setting.

stat.ME↗
arXiv2026

Rao-Blackwellized e-variables

We show that for any concave utility, the expected utility of an e-variable can only increase after conditioning on a sufficient statistic, echoing the classic Rao-Blackwell theorem. The simplest form of the result has a straightforward proof using Jensen's inequality, but we prove more sophisticated versions. We provide several applications of this insight, including a derivation of the log-optimal e-variable for testing the variance in a linear regression model.

math.ST↗
arXiv2026

Multiple testing in multi-stream sequential change detection

Multi-stream sequential change detection involves simultaneously monitoring many data streams and raising an alarm when their distributions change. We study the multiple testing issues that arise naturally in this setting. We first point out a fundamental tension between the criteria used in change detection and multiple testing: any procedure with finite average run length (ARL) must have worst-case false discovery rate (FDR) and family-wise error rate equal to one. Given this conflict, we find a middle ground by introducing the error over patience (EOP) class of Type I error metrics, which measure error relative to expected monitoring time. To control the EOP, we propose procedures combining e-detectors, which generalize Shiryaev-Roberts and CUSUM methods, with the recent e-Benjamini-Hochberg and e-Bonferroni methods for multiple testing. Our EOP guarantees hold uniformly over changepoints and stopping times with finite expectation, allowing dependence when each e-detector remains valid using information from all streams. If finite ARL is forfeited, using e-processes instead yields ordinary FDR and per-family error control at stopping times. We also prove power and delay bounds for Gaussian changes, establish first-order minimax optimality, and compare our procedures with existing methods in numerical experiments.

math.ST↗
arXiv2026

Cover meets Robbins while Betting on Bounded Data: $\ln n$ Regret and Almost Sure $\ln\ln n$ Regret

Consider betting against a sequence of $[0,1]$-valued observations using bets that are fair if the data have a conditional mean $m_0 \in (0,1)$. Cover's universal portfolio algorithm achieves a worst-case regret of $O(\ln n)$ compared to the best constant bet in hindsight, and this logarithmic order is unimprovable against adversarial data. We construct an explicit full-support Robbins mixture that combines insights from Robbins and Cover. It retains $O(\ln n)$ regret on every path while also eventually satisfying $R_n\le(1+o(1))\ln\ln V_n$ on every path with bounded mixture wealth and $V_n\to\infty$, where $V_n$ is an intrinsic variance process. It also attains the optimal asymptotic wealth growth rate under iid alternatives. Under the conditional-mean claim and almost-sure divergence of $V_n$, the sharper regret bound holds almost surely, and its leading constant $1$ is unimprovable. We also give explicit finite-time, path-wise regret bounds. A simple hedging principle shows how splitting initial wealth between two strategies achieves a best-of-both-worlds guarantee by retaining the smaller of their regrets and the larger of their growth rates. We contrast our results to those for unbounded data in Agrawal and Ramdas (2026). Their worst-case regret is unbounded. However, hedging yields almost-sure iterated-logarithmic regret together with optimal growth. Finally, our wealth process witnesses a sharp game-theoretic upper law of iterated logarithm, analogous to Shafer and Vovk (2005).

cs.LG↗
arXiv2026

Strategic Multi-Agent Resource Allocation via Statistical Contracts

We study a class of strategic hypothesis testing problems in which a principal aims to allocate resources among competing agents who possess data or data-generating mechanisms that may be relevant to the principal's goals. Each agent can pay a participation cost to opt into a statistical contract, in which case they generate data from a private distribution and receive an allocation based on a predetermined (and publicly known) mechanism. Each agent is either "null" or "non-null" and the principal's goal is to design the contract to limit the allocation to the former while maximizing transactions with the latter. Using e-values, we define a "continuous-closure," a set of allocations which prevents null agents from profiting in expectation and provides post-hoc risk control for general loss functions under arbitrary dependence. When the loss is the fraction of resources allocated to null agents, the region admits polynomial-time linear optimization. We also give explicit, interpretable closed-form approximations, and we analyze participation from a non-null agent's perspective, giving conditions under which entry into the contract is profitable. Finally, we extend the framework to support online arrival of the agents, in which case the principal has to make irrevocable on-the-fly decisions, and provide a method which gives time-uniform error-control in this setting.

cs.MA↗
arXiv2026

How to post-train on a surrogate: Envelope sampling mitigates reward hacking

Large language models (LLMs) are commonly post-trained against LLM judges and other cheap surrogates because the true reward, such as human preference, is too expensive to query at scale. This practice often leads to reward hacking, where reinforcement learning against a miscalibrated surrogate leads to undesirable side effects. In this work, we study a setting in which a small number $n$ of model outputs are annotated with ground-truth labels (e.g., from expert review) and used to recalibrate the LLM judge before optimizing against it. Prior approaches to judge recalibration are costly or heuristic, and it is known that on-policy sampling fails when the surrogate is miscalibrated on a rare set of outputs. In this work, we propose envelope sampling, a theoretically-grounded method for judge recalibration that seeks to minimize an upper bound on the regret of the post-trained model under the assumption that the human reward and re-calibrated reward lie in an $L^2$ ball around the judge. We give practical algorithms to sample from the envelope by rejection or by fine-tuning against a modified reward, and experiments on clinical note generation and on a controlled sycophancy task show that recalibrating on envelope samples mitigates reward hacking where recalibrating on base-model samples does not.

cs.LG↗
arXiv2026

Optimal Transportation and Alignment Between Gaussian Measures

Optimal transport (OT) and Gromov-Wasserstein (GW) alignment provide interpretable geometric frameworks for comparing, transforming, and aggregating heterogeneous datasets---tasks ubiquitous in data science and machine learning. Because these frameworks are computationally expensive, large-scale applications often rely on closed-form solutions for Gaussian distributions under quadratic cost. This work provides a comprehensive treatment of Gaussian, quadratic cost OT and inner product GW (IGW) alignment, closing several gaps in the literature to broaden applicability. First, we treat the open problem of IGW alignment between uncentered Gaussians on separable Hilbert spaces by giving an exact variational characterization through a quadratic optimization over isometries and co-isometries (orthogonal matrices in finite dimensions), for which we derive tight analytic upper and lower bounds. If at least one Gaussian measure is centered, the solution reduces to a fully closed-form expression, which we further extend to an analytic solution for the IGW barycenter between centered Gaussians. We also present a reduction of Gaussian multimarginal OT with pairwise quadratic costs to a tractable optimization problem and prove that every second-order stationary point of this problem is globally optimal. To demonstrate utility, we compare embedding distributions of already-trained language-model distillations and cluster synthetic users using covariance spectra of their text embeddings.

cs.LG↗
arXiv2026

Gradient descent dynamics for deep equilibrium models

Deep equilibrium models (DEQs) have recently emerged as a powerful paradigm for training infinitely deep weight-tied neural networks that achieve state of the art performance across many modern machine learning tasks. Despite their practical success, theoretically understanding the gradient descent dynamics for training DEQs remains an area of active research. In this work, we rigorously study the gradient descent dynamics for DEQs in the simple setting of linear models and single-index models, filling several gaps in the literature. We prove a matrix conservation law for linear DEQs which implies that the parameters remain trapped on spheres along gradient flow and use this property to show that gradient flow remains well-conditioned for all time. We then prove linear convergence of gradient descent to a global minimizer for linear DEQs and deep equilibrium single-index models under appropriate initialization and with a sufficiently small step size. In these simple settings, we also study the effect of common Neumann approximations used to reduce the cost of backpropagation; for linear DEQs, we show that increasing the number of terms in the Neumann approximation can prevent convergence to zero risk, even with exact forward solves. For nonlinear single-index DEQs, we prove linear convergence for fixed Neumann approximations, including Jacobian-free backpropagation under suitable assumptions. Finally, we validate our theoretical findings through experiments.

cs.LG↗