arXiv Science⌕ Search

arXiv · 2610.24564

Correcting Bartlett factor-score error for latent covariates in partially linear double machine learning

Abstract

Substituting Bartlett factor scores for latent covariates leaves factor-score error that does not vanish as the sample grows and biases the adjusted structural coefficient. We propose Croon-DML, which subtracts the factor-score error covariance implied by the measurement model from the cross-fitted estimating equation of partially linear double/debiased machine learning (DML), and establish identification, Neyman orthogonality with respect to the conditional means, consistency, and asymptotic normality. Residual bias after correction comes from learning the conditional means of the factor scores: signal learning error, and noise fitting, in which the learner also fits the factor-score error. Signal learning error largely cancels when the three conditional means share a common penalty, and noise fitting by a linear smoother can be computed from its weights alone, so we also subtract it (Croon-DML-R). Across 12 Monte Carlo conditions, Croon-DML reduced the absolute bias of uncorrected DML by 66-95%, and the bias of Croon-DML-R with a common penalty differed from that of an oracle estimator using the true latent variables by at most 0.004. In an illustration with public longitudinal data, the correction was 15% of the latent-covariate adjustment; its size reflected the latent-covariate coefficients rather than the residualized reliabilities.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Eunjeong Song, Sehee Hong. 2026-10-17. Correcting Bartlett factor-score error for latent covariates in partially linear double machine learning. https://arxiv.org/abs/2610.24564

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Estimating treatment effects with a unified semi-parametric difference-in-differences approach

Difference-in-differences (DID) approaches estimate causal effects with observational data before and after an intervention. DID traditionally estimates the average treatment effect among the treated and assumes parallel trends in outcome means. With skewed outcomes, a transformation is often needed to compare means; however, transformations may be difficult to choose and results may be sensitive to the choice and must be interpreted on the transformed scale. Recent DID methods estimate alternative treatment effects that offer additional insights. However, each estimator requires a different parallel trends assumption. We introduce a new DID method that estimates average, quantile, probability, and novel Mann-Whitney treatment effects among the treated with a single unifying parallel trends assumption. The method uses a semi-parametric cumulative probability model (CPM): a linear model for a latent variable on covariates, where the latent variable results from an unspecified transformation of the outcome. Our approach makes a single parallel trends assumption on the expectation of the latent variable conditional on covariates. Hence, we avoid specifying outcome transformations and separate estimand-specific assumptions. We introduce the method; describe identification, estimation, and inference; conduct simulations evaluating its performance; and apply it to assess the impact of Medicaid expansion on CD4 count among people with HIV.

stat.ME↗

A Stable Lasso

The Lasso has been widely used as a method for variable selection, valued for its simplicity and empirical performance. However, Lasso's selection stability deteriorates in the presence of correlated predictors. Several approaches have been developed to mitigate this limitation. In this paper, we provide a brief review of existing approaches, highlighting their limitations. We then propose a technique to improve the selection stability of Lasso by integrating a weighting scheme into the Lasso penalty function, where the weights are defined as an increasing function of a correlation-adjusted ranking that reflects the predictive power of predictors. Empirical evaluations on both simulated and real-world datasets demonstrate the efficacy of the proposed method. Additional numerical results demonstrate the effectiveness of the proposed approach in stabilizing other regularization-based selection methods, indicating its potential as a general-purpose solution.

stat.ME↗

Copula-Based Time Series for Non-Gaussian and Non-Markovian Stationary Processes

In the copula-based approach to univariate time series modeling, the finite-dimensional temporal dependence of a stationary time series is captured by a copula. Recent studies investigate how copula-based time series models can be generalized to have long-term autoregressive effects. We study a generalization that comes from a Markov sequence of order p and a q-dependent sequence. We derive the relation of the model to Gaussian-ARMA models and to the Gaussian-GARCH(1,1) model. We investigate distributional properties of the process and discuss the maximum likelihood estimation (MLE). Additionally we analyze the copula moving aggregate process of order one, or MAG(1), as it is a basic building block. Last, we assess the model in a probabilistic forecasting study on a data series for German wind power production.

stat.ME↗