arXiv Science⌕ Search

arXiv · 2610.12215

Robust variance estimation for multiple imputation using predictive mean matching or parametric imputation models

Abstract

Multiple imputation (MI) is widely used for handling missing data in medical research, with variance commonly estimated using Rubin's rules (RR). RR is simple to apply, but under uncongeniality between the imputation and analysis procedures, its variance estimate can be either too small or too large, leading to miscalibrated confidence intervals. Robins and Wang (RW) developed an estimating-equation variance estimator that does not require congeniality under the conditions of their parametric imputation framework. Practical use of RW, however, has been limited by the lack of accessible software and by the additional variance calculations required for modern imputation workflows. We develop an R package, rw, construct RW variance components for normal and logistic conditional imputation models fitted through mice, and propose an approximate RW variance procedure for predictive mean matching (PMM). The PMM procedure preserves the original imputations and selected donors. For the variance calculation, we define differentiable donor probabilities and use expected analysis scores to approximate the cross-moment between analysis and imputation scores. Analysis scores are summed by recorded donor to account for donor reuse. We evaluate the proposed methods in benchmark simulations based on the original RW setting and in validation-study simulations motivated by electronic health record data. RR coverage was up to approximately 23 percentage points below the nominal 95% level in some settings and above nominal in others. The proposed RW estimators generally produced coverage closer to the nominal level in larger samples under both parametric and PMM imputation, while retaining the same completed-data point estimates as RR.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Suyang Yu, Lucy D'Agostino McGowan, Brian D. Williamson. 2026-10-08. Robust variance estimation for multiple imputation using predictive mean matching or parametric imputation models. https://arxiv.org/abs/2610.12215

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Inference in generalized linear models with robustness to misspecified variances

Generalized linear models usually assume a common dispersion parameter, an assumption that is seldom true in practice. Consequently, standard parametric methods may suffer appreciable loss of type I error control. As an alternative, we present a semi-parametric group-invariance method based on sign flipping of score contributions. Our method requires only the correct specification of the mean model, but is robust against any misspecification of the variance. We present tests for single as well as multiple regression coefficients. The test is asymptotically valid but shows excellent performance in small samples. We illustrate the method using RNA sequencing count data, for which it is difficult to model the overdispersion correctly. The method is available in the R library flipscores.

stat.ME↗

Sample-Efficient "Clustering and Conquer" Procedures for Parallel Large-Scale Ranking and Selection

This work aims to improve the sample efficiency of parallel large-scale ranking and selection (R&S) problems by leveraging correlation information. We modify the commonly used "divide and conquer" framework in parallel computing by adding a correlation-based clustering step, transforming it into "clustering and conquer". Theoretically, we develop a novel gradient-based analysis framework and show that this seemingly simple modification substantially improves the performance of large-scale R&S procedures. Our approach enjoys two key advantages: (1) it does not require highly accurate correlation estimation or precise clustering, and (2) it can be seamlessly integrated with various existing fixed-precision and fixed-budget R&S procedures while achieving optimal sample complexity. We also introduce a new parallel clustering algorithm tailored to large-scale settings. Finally, in large-scale AI applications such as neural architecture search, our methods demonstrate superior performance.

stat.ME↗

A Dynamic Factor Model for Multivariate Counting Process Data

We propose a dynamic multiplicative factor model for process data arising from complex problem-solving items, an emerging type of data in large-scale educational assessment. The proposed model can be viewed as an extension of the classical frailty models developed in survival analysis for multivariate recurrent event times, but with two important distinctions: (i) the factor (frailty) is of primary interest; (ii) covariates are internal and embedded in the factor. It allows us to explore low-dimensional structure with meaningful interpretation. We show that the proposed model is generically identifiable and that the maximum likelihood estimators are consistent and asymptotically normal. Furthermore, to obtain a parsimonious model and to improve the interpretation of parameters, variable selection and estimation for both fixed and random effects are developed through suitable penalisation. The computation is carried out using a stochastic EM algorithm with elliptical slice sampling in the stochastic E-step and coordinate descent in the M-step. Simulation studies demonstrate that the proposed approach effectively recovers the true structure. The proposed method is applied to the analysis of the log file of an item from the Programme for the International Assessment of Adult Competencies (PIAAC), and meaningful relationships are identified.

stat.ME↗