General Synthetic-Powered Inference

Meshi Bashari; Yonghoon Lee; Roy Maor Lotan; Edgar Dobriban; Yaniv Romano

Home/Archive/arXiv

arXiv · 2509.20345

General Synthetic-Powered Inference

Meshi Bashari·Yonghoon Lee·Roy Maor Lotan·Edgar Dobriban·Yaniv Romano

View original source ↗Read source document ↗Export metadata ↓

Abstract

The rapid proliferation of high-quality synthetic data -- generated by advanced AI models or collected as auxiliary data from related tasks -- presents both opportunities and challenges for statistical inference. This paper introduces a GEneral Synthetic-Powered Inference (GESPI) framework that wraps around a broad class of statistical inference procedures to safely enhance sample efficiency by combining synthetic and real data. Our framework leverages high-quality synthetic data to boost statistical power, yet adaptively defaults to the standard method using only real data when synthetic data are of low quality. The error rate of our method remains below a user-specified bound without any distributional assumptions on the synthetic data, and decreases as the quality of the synthetic data improves. This flexibility enables seamless integration with conformal prediction, risk control, hypothesis testing, and multiple testing procedures, all without modifying the base inference method. We demonstrate the benefits of our method on challenging tasks with limited labeled data, including AlphaFold protein structure prediction, and comparing large reasoning models on complex math problems.

Explore related subjects

stat.ME cs.LG stat.ML

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Meshi Bashari, Yonghoon Lee, Roy Maor Lotan, Edgar Dobriban, Yaniv Romano. 2026-06-04. General Synthetic-Powered Inference. https://arxiv.org/abs/2509.20345

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

A robust, scalable K-statistic for quantifying immune cell clustering in spatial proteomics data

Spatial summary statistics based on point process theory are widely used to quantify the spatial organization of cell populations in single-cell spatial proteomics data. Among these, Ripley's K is a popular metric for assessing whether cells are spatially clustered or are randomly dispersed. However, the key assumption of spatial homogeneity is frequently violated in spatial proteomics data, leading to overestimates of cell clustering and colocalization. To address this, we propose a novel method, termed KAMP (K adjustment by Analytical Moments of the Permutation distribution), for quantifying the spatial organization of cells in spatial proteomics samples. KAMP leverages background cells in each sample along with a new closed-form representation of the first and second moments of the permutation null distribution of Ripley's K. Our method is robust to inhomogeneity, computationally efficient even in large datasets, and provides approximate p-values to test spatial clustering and colocalization. Methodological developments are motivated by a spatial proteomics study of women with ovarian cancer; in the subset with sufficient B cells and macrophages, KAMP provides exploratory, scale-specific evidence linking B cell-macrophage colocalization with overall patient survival. Notably, we also find evidence that using K without correcting for sample inhomogeneity may bias hazard ratio estimates in downstream analyses.

stat.ME↗

arXiv2026

A Heavily Right Strategy for Statistical Inference with Dependent Studies in Arbitrary Dimensions

We leverage recent advances in heavy-tail approximations for global hypothesis testing with dependent studies to construct approximate confidence regions without modeling or estimating their dependence structures. A non-rejection region is a confidence region but it may not be convex. Convexity is appealing because it ensures any one-dimensional linear projection of the region is a confidence interval, easy to compute and interpret. We show why convexity fails for nearly all heavy-tail combination tests proposed in recent years, including the influential Cauchy combination test. These insights motivate a heavily right strategy: truncating the left half of the Cauchy distribution to obtain the Half-Cauchy combination test. The harmonic mean test also corresponds to a heavily right distribution with a Cauchy-like tail, namely a Pareto distribution with unit power. We prove that both approaches guarantee convexity when individual studies are summarized by Hotelling $T^2$ or $χ^{2}$ statistics (regardless of the validity of this summary) and provide efficient, exact algorithms for implementation. Applying these methods, we develop a divide-and-combine strategy for mean estimation in any dimension and construct simultaneous confidence intervals in a network meta-analysis for treatment effect comparisons across multiple clinical trials. We also present many open problems and conclude with epistemic reflections.

stat.ME↗

arXiv2026

Recent advances in the Bradley--Terry Model: theory, algorithms, and applications

This article surveys recent advances in the Bradley-Terry (BT) model and its extensions. We focus on statistical and computational aspects, with particular emphasis on the regime in which both the number of objects and the volume of comparisons tend to infinity-a setting relevant to large-scale applications. The main topics include asymptotic theory for statistical estimation and inference, together with the corresponding computational algorithms. We also review applications of these models in sports analytics, social choice, psychometrics, and machine learning. Finally, we discuss several key challenges and outline directions for future research.

stat.ME↗