arXiv Science⌕ Search

arXiv subjects

Eunjeong Song

Publications and source records attributed to Eunjeong Song.

7 recordsLinked to original sources

Measurement Error and Nonlinear Confounding: Structural Equation Modeling Versus Double Machine Learning

A latent confounder measured by fallible indicators can be adjusted for with structural equation modeling (SEM), which corrects measurement error but requires a specified functional form, or with double machine learning (DML), which learns the form but ignores measurement error. We derive both population biases and the crossover reliability, the composite reliability above which DML with the indicators or their mean as inputs is less biased than linear SEM; it depends on the nonlinear share of confounding and falls when covariates predict the confounder. A 46-condition Monte Carlo study confirmed both biases and the predicted ordering. With gradient boosting, learning the conditional means raised the DML bias by up to 0.05 and moved the finite-sample crossover upward. A quadratic SEM was unbiased when its form was correct and removed two thirds of the linear-SEM bias under a saturating nonlinearity but little of it under a cubic one.

stat.ME↗

Correcting Bartlett factor-score error for latent covariates in partially linear double machine learning

Substituting Bartlett factor scores for latent covariates leaves factor-score error that does not vanish as the sample grows and biases the adjusted structural coefficient. We propose Croon-DML, which subtracts the factor-score error covariance implied by the measurement model from the cross-fitted estimating equation of partially linear double/debiased machine learning (DML), and establish identification, Neyman orthogonality with respect to the conditional means, consistency, and asymptotic normality. Residual bias after correction comes from learning the conditional means of the factor scores: signal learning error, and noise fitting, in which the learner also fits the factor-score error. Signal learning error largely cancels when the three conditional means share a common penalty, and noise fitting by a linear smoother can be computed from its weights alone, so we also subtract it (Croon-DML-R). Across 12 Monte Carlo conditions, Croon-DML reduced the absolute bias of uncorrected DML by 66-95%, and the bias of Croon-DML-R with a common penalty differed from that of an oracle estimator using the true latent variables by at most 0.004. In an illustration with public longitudinal data, the correction was 15% of the latent-covariate adjustment; its size reflected the latent-covariate coefficients rather than the residualized reliabilities.

stat.ME↗

Diagnosing the Demographic Distributions of LLM-Based Synthetic Persona Data: Reference-Distribution Dependence and Post Hoc Adjustment

We examine how strongly demographic-distribution diagnostics of LLM-based synthetic persona data depend on the official statistics chosen as the reference. We compared the sex $\times$ age-group $\times$ province joint distribution of the 1,000,000 Nemotron-Personas-Korea (NPK) records with Korean official statistics using total variation distance (TVD). Against the resident-registration population for April 2026, the time of use, the upper bound on the share discrepancy of any subgroup defined by the three variables was 1.81 percentage points, the margin of error of a survey with about 2,900 respondents. This value, however, depended on the reference date and population definition of the official statistics. The closest candidate examined, the 2024 census distribution for Korean nationals, gave 0.56 percentage points; no monthly resident-registration reference was closer. The reference distributions themselves also moved: between January 2025, when NPK's distance was smallest, and April 2026, the resident-registration distribution moved by more than twice that minimum distance, as did the census Korean-national distribution between 2024 and 2025. Raking reduced the range of the distance across reference months to about one fifth. Cell poststratification was applicable because none of the 204 cells was empty, and neither scheme produced extreme weights. Demographic alignment is necessary but not sufficient for response validity, and even this basic diagnostic depends on the choice of reference distribution. Providers should therefore disclose the source, reference date, population definition, and joint-cell allocation procedure of the official statistics used for demographic attributes, and users should repeat the diagnosis and adjustment against statistics current at the time of use.

cs.CY↗

Latent Class Analysis of Digital Content Use Contexts in AI-Generated Synthetic Personas

AI-generated synthetic personas are increasingly used for content planning and virtual-user simulation, yet the digital content use contexts embedded in their narratives remain underexamined. Using all 1,000,000 records of NVIDIA's Nemotron-Personas-Korea, this study coded mentions of five engagement modes-viewing, discovering and sharing, interacting, reading, and listening-with an openly released Korean coding dictionary and applied latent class analysis with a three-step approach accounting for classification error. Four classes emerged: viewing-centered (20.8%), reading-centered (3.8%), listening-centered (2.1%), and low-mention (73.3%). Age showed the strongest association: the odds of the viewing-centered versus low-mention class were multiplied by 0.15 per 10-year increase, while mentions of any non-viewing mode declined from 49.4% among those under 30 to 2.3% among those aged 70 and over. Sex differences in predicted class probabilities were below 1 percentage point, and provincial differences reached at most 5.0 percentage points. These classes describe narrative configurations, not consumer segments, and provide a basis for assessing diversity in synthetic persona use contexts.

cs.CY↗

Can Large Language Model-Generated Responses Support Assessment Development? A Human-Calibrated Rasch Benchmark

Large language models (LLMs) are proposed as synthetic respondents for pilot testing, but their usefulness depends on whether they supply the evidence assessment development requires. We calibrated rating scale models on 14 digital-use skill items from 6,245 adults and used the human item parameters to evaluate responses generated for 1,300 demographically matched personas. LLM responses had high internal consistency ($α\approx .94$) but used the lowest category in 0.2-0.3% of responses versus 13.7-21.5% for humans, and no persona chose it on every item. These gaps changed the response-category judgment on both subscales and the PC targeting judgment; on the human-calibrated scales, 12 of 14 items had infit below 0.70, indicating responses more predictable than the Rasch model expects. Preregistered changes to the prompt, category order, and persona information did not restore the human lower range. High internal consistency is insufficient evidence that LLM responses can replace human pilot data.

stat.AP↗

Reference-State Bootstrap Correction and Kernel Characterization of Residual-Based Fit Indices in Structural Equation Models

Sampling error affects the finite-sample values of residual-based fit indices. We show that the unweighted comparative fit index ($CFI_u$) rests on a quadratic-kernel maximum mean discrepancy and that a Gaussian-kernel comparative fit index (KCFI) converges to $CFI_u$ as bandwidth increases. Because kernel discrepancies lack an analytic sampling correction, we extend expected-discrepancy bootstrap methods to a fitted-correlation reference state: the sample is transformed to reproduce the fitted correlation matrix, then resampled and refitted to estimate the exact-fit sampling component. Across 18 confirmatory factor analysis conditions, this correction reduced the root mean square error (RMSE) of both indices by 62%-87%. Under normality it matched an analytic residual-covariance estimator of $CFI_u$ within .0001, and in small samples it outperformed ordinary bootstrap correction in accuracy and availability. Corrected KCFI had lower RMSE than identically corrected $CFI_u$ in all 29 nonnormal conditions, even against a common target, but in six heavy-tailed small-sample conditions the analytic estimator was more accurate than both. The results validate the reference-state correction where it is needed and delimit where the analytic estimator is preferable.

stat.ME↗

Recovering Nonlinear Functions of Latent Variables: A Plausible-Value Neural Network Framework

When factor scores replace true latent scores in nonlinear prediction, measurement error attenuates the recoverable variance of any $k$th-order component of the regression function by $ρ^k$ -- the $k$th power of the score's coefficient of determination -- for any linear score type. This study derives the bound via Hermite polynomial expansion and proposes PV-ANN -- plausible values (posterior draws preserving latent variance) combined with artificial neural networks (learning functional form without prespecification). The bound governs recovery of the latent-scale function, not prediction of the outcome from observed indicators, for which factor scores are already sufficient; the two metrics are therefore predicted to dissociate. An 18-condition simulation supports both predictions: in the nonlinear low-reliability conditions PV-ANN closes about four fifths of the function-shape recovery gap between a factor-score learner and one given the true latent values, and the margin widens as reliability falls, while predictive accuracy is not improved, as the theory requires. A Big Five application illustrates the intended exploratory workflow and delineates boundary conditions under weak signal and measurement model misspecification.

stat.ME↗