Beyond Point Predictions: Distribution-Informed Prediction-Powered Inference

Maoyu Zhang; Jingfei Zhang; Xuming He

Home/Archive/arXiv

arXiv · 2609.32006

Beyond Point Predictions: Distribution-Informed Prediction-Powered Inference

Maoyu Zhang·Jingfei Zhang·Xuming He

View original source ↗Read source document ↗Export metadata ↓

Abstract

Prediction-powered inference (PPI) typically relies on point predictions on unlabeled data. When predictive distributions are available as in a wide range of applications, including predictions from LLMs, we introduce distribution-informed prediction-powered inference (DiPPI), a general framework for further improving statistical efficiency by using predictive distributions as auxiliary information in the spirit of PPI. We characterize the optimal use of this information through score calibration, derive the oracle efficiency for a finite-dimensional representation of the predictive distribution, and provide theoretical guarantees for positive learning with the cross-fitted DiPPI estimator. Through simulations and three real-data applications, we show that DiPPI achieves better efficiency than PPI methods based on point predictions. These gains arise when the predictive distribution contains score-relevant information that is partially lost in point predictions.

Explore related subjects

stat.ME

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Maoyu Zhang, Jingfei Zhang, Xuming He. 2026-09-25. Beyond Point Predictions: Distribution-Informed Prediction-Powered Inference. https://arxiv.org/abs/2609.32006

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Univariate-Guided Interaction Modeling

We propose a procedure for sparse regression with pairwise interactions, by generalizing the Univariate Guided Sparse Regression (UniLasso) methodology. A central contribution is our introduction of TripletScan, which screens a pair $(j,k)$ using the coefficient of $X_jX_k$ in the local regression of the response on $1$, $X_j$, $X_k$, and $X_jX_k$. The retained products are incorporated either jointly with the main effects through UniLasso, yielding uniPairs, or after a first-stage main-effects fit, yielding uniPairs-2stage. For the UniLasso components of the procedures, we prove false-positive exclusion and uniform coefficient-error bounds. In simulations and an HIV drug-resistance application, the proposed procedures produce substantially smaller fitted models than competing interaction methods while retaining competitive predictive performance.

stat.ME↗

arXiv2026

Factoring A-Optimality into D-Optimality and Sphericity

The D criterion measures the volume of the joint confidence ellipsoid for the linear model coefficients and ignores its shape, so designs with the same D value can estimate individual effects with different variances. Meanwhile, A-optimality minimizes average coefficient variance. With both criteria expressed as information values, A equals D multiplied by a sphericity index for the same ellipsoid. In a fixed coefficient basis, sphericity further factors into coefficient-variance balance and a determinant-based correlation component. In five published screening comparisons, the A-optimal design has a larger correlation component despite slightly poorer variance balance; in three it also has a smaller D value. In a seven-run family of designs that all tie under D, the two with equal coefficient variances have the lowest A value. Both sphericity components can be calculated directly from standard errors and estimate correlations available in statistical software. After whitening by a prediction moment matrix, the same determinant-sphericity factorization applies to the I-criterion.

stat.ME↗

arXiv2026

Testing the equality of parameters in fixed and increasing dimension

This paper proposes a general and unified framework for testing the equality of a broad class of parameters, defined as a smooth function of expectations of symmetric kernels, across multiple independent populations. We consider two test statistics, a Wald-type statistic and an ANOVA-type statistic. The asymptotic distribution of the first one is derived under a fixed-dimension regime, whereas the second one is studied under both fixed and increasing-dimension regimes, where the parameter dimension diverges with the sample size. Based on these limiting distributions, we construct test procedures enabling asymptotically exact inference without parametric assumptions. Additionally, an alternative null distribution estimator based on a weighted bootstrap approximation is studied, which is applicable to the ANOVA-type statistic under a fixed-dimension regime. The finite-sample performance and computational efficiency of the proposed procedures are evaluated through an extensive simulation study and a real dataset application.

stat.ME↗