arXiv Science⌕ Search

arXiv · 2610.27354

A plug-in estimator of the non-iterative conditional expectation g-formula using long short-term memory models

Abstract

The non-iterative conditional expectation (NICE) plug-in estimator of the g-formula can be used to estimate the causal effects of sustained treatment strategies, even in the presence of treatment-confounder feedback, under the assumptions of exchangeability, positivity, and consistency. In practical applications, parametric models are commonly used to estimate the joint distribution of confounders, treatments, and outcomes over time. As an alternative to parametric models, long short-term memory (LSTM) models, designed to capture both short-term patterns and long-range dependencies in sequential data, may better accommodate complex temporal dependencies among time-varying confounders, treatments, and outcomes. However, the validity of statistical inferences of a plug-in estimator based on LSTM models has not yet been investigated. Here, we provide proof of principle that, under a complex data generation mechanism that resembles data from a cohort of persons with HIV and sufficiently large sample sizes, an LSTM-based NICE g-formula plug-in estimator results in less bias than parametric estimators while achieving near-nominal coverage for 95\% confidence intervals. This work is intended to spur the development of a theoretical framework that encompasses deep learning plug-in estimators for causal inference based on high-dimensional longitudinal data.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Jing Li, Sophia M. Rein, Zilong Wang, Zixiao Wang, Sean McGrath, James M. Robins, Thomas Kolokotrones, Rajarshi Mukherjee, Miguel A. Hernán. 2026-10-19. A plug-in estimator of the non-iterative conditional expectation g-formula using long short-term memory models. https://arxiv.org/abs/2610.27354

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

On the Spherical Dirichlet Distribution: Corrections and Results

This article revisits the spherical-Dirichlet distribution (SDD) introduced by Guardiola (2020) and clarifies the correction to its density presented in an earlier version of this preprint. The principal issue concerns Equation (3) of the original publication, which expresses the density in local Euclidean coordinates rather than with respect to spherical surface-area measure. We derive the corrected intrinsic density and revisit its moments, covariance matrix, mode, and limiting properties. We show that the two density representations describe the same probability distribution, preserving the moment formulas and likelihood-based parameter estimation. However, the mode and uniformity conditions depend on the reference measure and require corresponding clarification. Reported simulation and text mining estimates are revisited and updated. The resulting presentation reconciles the original construction with its intrinsic spherical properties.

stat.ME↗

A sensitivity analysis for the average derivative effect

In observational studies, exposures are often continuous rather than binary or discrete. At the same time, sensitivity analysis is an important tool that can help determine the robustness of a causal conclusion to a certain level of unmeasured confounding, which can never be ruled out in an observational study. Sensitivity analysis approaches for continuous exposures have now been proposed for several causal estimands. In this article, we focus on the average derivative effect (ADE). We obtain closed-form bounds for the ADE under a sensitivity model that constrains the odds ratio (at any two dose levels) between the latent and observed generalized propensity score. We propose flexible, efficient estimators for the bounds that are compatible with machine learning algorithms as well as point-wise and simultaneous (over the sensitivity parameter) confidence intervals. We examine the finite sample performance of the methods through simulations and illustrate the methods on a study assessing the effect of parental income on educational attainment and a study assessing the price elasticity of petrol.

stat.ME↗

Graphical Model-based Inference on Persistent Homology

Persistent homology is a cornerstone of topological data analysis, offering a multiscale summary of topology with robustness to nuisance transformations, such as rotations and small deformations. Persistent homology has seen broad use across domains such as computer vision and neuroscience. Most statistical treatments, however, use homology primarily as a feature extractor, relying on statistical distance-based tests or simple time-to-event models for inferential tasks. While these approaches can detect global differences, they rarely localize the source of those differences. We address this gap by taking a graphical model-based approach: we associate each vertex with a population latent position in a conic space and model each bar's key events (birth and death times) using an exponential distribution, whose rate is a transformation of the latent positions according to an event occurring on the graph. The low-dimensional bars have simple graph-event representations, such as the formation of a minimum spanning tree or the triangulation of a loop, and thus enjoy tractable likelihoods. Taking a Bayesian approach, we infer latent positions and enable model extensions such as hierarchical models that allow borrowing strength across groups. Applications to a neuroimaging study of Alzheimer's disease demonstrate that our method localizes sources of difference and provides interpretable, model-based analyses of topological structure in complex data. The code is provided and maintained at https://github.com/zitian-wu/graphPH.

stat.ME↗