arXiv ScienceSearch

arXiv subjects

Guanglei Hong

Publications and source records attributed to Guanglei Hong.

4 recordsLinked to original sources

Two-Phase Treatment with Noncompliance: Identifying the Cumulative Average Treatment Effect via Multisite Instrumental Variables

When evaluating a two-phase intervention, the cumulative average treatment effect (ATE) is often the primary causal estimand of interest. However, some individuals who do not respond well to the Phase I treatment may subsequently display noncompliant behaviors. At the same time, exposure to the Phase I treatment is expected to directly influence an individual's potential outcomes, thereby violating the exclusion restriction. Building on an instrumental variable (IV) strategy for multisite trials, we clarify the conditions under which the cumulative ATE of a two-phase treatment can be identified by employing the random assignment of the Phase I treatment as the instrument. Our strategy relaxes both the conventional exclusion restriction and sequential ignorability assumptions. We assess the performance of the new strategy through simulation studies. Additionally, we reanalyze data from the Tennessee class size study, in which students and teachers were randomly assigned to either small or regular class types in kindergarten (Phase I) with noncompliance emerging in Grade 1 (Phase II). Applying our new strategy, we estimate the cumulative ATE of receiving two consecutive years of instruction in a small versus regular class.

stat.ME

Ratio of Mediator Probability Weighting for Estimating Natural Direct and Indirect Effects

Decomposing a total causal effect into natural direct and indirect effects is central to revealing causal mechanisms. Conventional methods achieve the decomposition by specifying an outcome model as a linear function of the treatment, the mediator, and the observed covariates under identification assumptions including the assumption of no interaction between treatment and mediator. Recent statistical advances relax this assumption typically within the linear or nonlinear regression framework. I propose a non-parametric approach that also relaxes the assumption of no treatment-mediator interaction while avoiding the problems of outcome model specification that become particularly acute in the presence of a large number of covariates. The key idea is to estimate the marginal mean of each counterfactual outcome by assigning a weight to every experimental unit such that the weighted distribution of the mediator under the experimental condition approximates the counterfactual mediator distribution under the control condition. The weight is a ratio of the conditional probability of a mediator value under the control condition to that of the same mediator value under the experimental condition. A non-parametric approach to estimating the weight on the basis of propensity score stratification promises to increase the robustness of the direct and indirect effect estimates. The outcome is modeled as a function of the direct and indirect effects with minimal model-based assumptions. This method applies regardless of the distribution of the outcome or the functional relationship between the outcome and the mediator, and is suitable for handling a large number of pretreatment covariates. RMPW software packages are available in Stata (https://ideas.repec.org/c/boc/bocode/s458301.html) and R (https://cran.r-project.org/web/packages/rmpw/index.html).

stat.ME

Evaluating Organizational Effectiveness: A New Strategy to Leverage Multisite Randomized Trials for Valid Assessment

Determining which organizations are more effective in implementing an intervention program is essential for theoretically and empirically characterizing exemplary practice and for intervening to enhance the capacity of ineffective ones. Yet sites differ in their local ecological conditions including client composition, alternative programs, and community context. Applying the causal inference framework, this study proposes a formal mathematical definition for the local relative effectiveness of an organization attributable solely to malleable organizational practice. Capitalizing on multisite randomized trials, the identification leverages observed control group outcomes that capture some of the confounding impacts of otherwise unmeasured contextual variation. We propose a two-step mixed-effects modeling (2SME) procedure that adjusts for pre-existing between-site variation. A series of Monte Carlo simulations reveals its superior performance in comparison with conventional methods. We apply the new strategy to an evaluation of Job Corps centers nationwide serving disadvantaged youths.

stat.AP

Post-Treatment Confounding in Causal Mediation Studies: A Cutting-Edge Problem and A Novel Solution via Sensitivity Analysis

In causal mediation studies that decompose an average treatment effect into a natural indirect effect (NIE) and a natural direct effect (NDE), examples of post-treatment confounding are abundant. Past research has generally considered it infeasible to adjust for a post-treatment confounder of the mediator-outcome relationship due to incomplete information: it is observed under the actual treatment condition while missing under the counterfactual treatment condition. This study proposes a new sensitivity analysis strategy for handling post-treatment confounding and incorporates it into weighting-based causal mediation analysis without making extra identification assumptions. Under the sequential ignorability of the treatment assignment and of the mediator, we obtain the conditional distribution of the post-treatment confounder under the counterfactual treatment as a function of not just pretreatment covariates but also its counterpart under the actual treatment. The sensitivity analysis then generates a bound for the NIE and that for the NDE over a plausible range of the conditional correlation between the post-treatment confounder under the actual and that under the counterfactual conditions. Implemented through either imputation or integration, the strategy is suitable for binary as well as continuous measures of post-treatment confounders. Simulation results demonstrate major strengths and potential limitations of this new solution. A re-analysis of the National Evaluation of Welfare-to-Work Strategies (NEWWS) Riverside data reveals that the initial analytic results are sensitive to omitted post-treatment confounding.

stat.ME