arXiv Science⌕ Search

arXiv subjects

Peng Ding

Publications and source records attributed to Peng Ding.

At least 19 recordsLinked to original sources
arXiv2026

Two-stage least squares with treatment-covariate interactions for treatment effect heterogeneity

Treatment effect heterogeneity with respect to covariates is common in instrumental variable (IV) analyses. An intuitive approach, which we call the interacted two-stage least squares (2sls), is to regress the outcome on the treatment, covariates, and treatment-covariate interactions, using the IV, covariates, and IV-covariate interactions as instruments. We clarify the causal interpretation of the interacted 2sls under the local average treatment effect (LATE) framework when the IV is valid conditional on the covariates. Our main findings are twofold. First, we show that the coefficients on the treatment-covariate interactions from the interacted 2sls identify treatment effect heterogeneity with respect to covariates among compliers for any outcome-generating process if and only if the product of the IV propensity score and the covariates is linear in the covariates, a requirement we call the linear IV-covariate interactions condition. Second, when the covariate vector has dimension K and includes a constant term, we show that the linear IV-covariate interactions condition requires the IV propensity score to take at most K distinct values. The condition holds when (a) the covariates take exactly K distinct values, or (b) the IV is randomly assigned independently of the covariates, but is restrictive beyond these cases. These results underscore the difficulty of interpreting regression coefficients from specifications with treatment-covariate interactions when the covariates are not saturated and the IV is not unconditionally randomized, absent correct specification of the outcome model. We then connect these results to the literature on LATE estimation, and show that under the linear IV-covariate interactions condition, the interacted 2sls with covariates demeaned by their complier means recovers the LATE as a single coefficient.

stat.ME↗
arXiv2026

Bias-aware meta-analysis: beyond fixed-effect and random-effects meta-analyses

Meta-analysis aims to synthesize multiple studies to obtain a summary estimate of a population parameter of interest. However, existing meta-analysis methods require strong assumptions that render them not robust to bias and heterogeneity of the studies. In particular, fixed-effect meta-analysis assumes a common parameter across the studies, whereas random-effects meta-analysis models heterogeneity as independent and identically distributed random effects, which still implies a common parameter marginally over the random effects. Due to their limitations, we propose a bias-aware meta-analysis framework that allows for heterogeneous studies with fixed, unknown biases. With no bias, our bias-aware meta-analysis reduces to fixed-effect meta-analysis; with a given bound on the bias, we can still use the fixed-effect meta-analysis point estimator and standard error, but we must inflate the critical value for confidence intervals from the standard normal quantile to a folded normal quantile. We recommend reporting the maximum bias for significance, the maximum value of the bias such that the confidence intervals exclude the null value. We propose a formal model checking procedure and recommend reporting the minimum bias for compatibility, the minimum value of the bias such that the bias-aware meta-analysis model is compatible with the observed data. We discuss the practical implementation of our method and, in particular, the approaches to calibrating the maximum bias for significance. We also compare our method with traditional fixed-effect and random-effects meta-analyses.

stat.ME↗
arXiv2026

A Duality of the F Distribution

The F distribution arises naturally in linear regression or analysis of variance. Elementary textbooks state the result in terms of the standard normal random vector and fixed projection matrices. More advanced textbooks and research articles have extended the result to spherically symmetric random vectors. We complement the literature with a dual result that the F distribution arises with a fixed vector and random projection matrices generated by a left-spherical random matrix.

math.ST↗
arXiv2026

Stdlib or Third-Party? Empirical Performance and Correctness of LLM-Assisted Zero-Dependency Python Libraries

Third-party Python libraries introduce dependency-management overhead, supply-chain risk, and deployment friction. We study when eliminating a dependency preserves enough correctness and performance to justify the gains in footprint, deployability, and trust surface. Our testbed is zerodep, 44 single-file, stdlib-only Python modules spanning 12 categories, each benchmarked against its reference library. Three performance regimes emerge. Stdlib-only implementations achieve parity (within 2x) in the majority of cases; many outperform their references by 5x-115x where architectural overhead dominates; and a clear cliff appears for C-extension-backed computation (image processing, binary serialization, low-level crypto), confirmed by PyPy JIT and profiling experiments. Beyond speed, stdlib modules reduce installed footprint by orders of magnitude (median 31 KB vs. 700 KB), import 2.2x faster, and eliminate 88 transitive dependencies maintained by 128 distinct PyPI accounts. Analysis of the LLM-assisted development process across all 44 modules shows that specification completeness, not model capability, is a strong predictor of generation success, and that contract-linked review reduces review volume by 5x while eliminating compatibility regressions. Together, these results turn dependency elimination from an anecdotal coding style into an evidence-based engineering tradeoff.

cs.SE↗
arXiv2026

Memory-Augmented Phase-Field Modeling: Onsager Formulation, Internal-Variable Lifting, and Structure-Preserving Computation

In this work, we develop a general memory-augmented phase-field (MAPF) framework based on Onsager's variational principle, in which memory effects are incorporated through a general relaxation kernel while preserving the thermodynamic consistency of the underlying system. Rather than treating fractional models as fundamental formulations, we show that they can be interpreted as reduced descriptions associated with specific power-law memory kernels. The proposed MAPF equations provide a unified modeling framework for non-Markovian phase-field dynamics. To facilitate analysis and computation, we further introduce an equivalent internal-variable representation that transforms the original nonlocal-in-time dynamics into an extended Markovian gradient system. This formulation preserves key structural properties, including energy dissipation and mass conservation, and enables the development of efficient structure-preserving numerical schemes. In particular, we construct an energy-stable scalar auxiliary variable approach combined with a fast rank-one implementation that exploits the relaxation-spectrum-induced coupling structure, resulting in a computationally efficient algorithm with reduced storage requirements. The proposed framework establishes a systematic connection between memory-dependent phase-field modeling, internal-variable thermodynamics, and structure-preserving numerical computation. Numerical experiments demonstrate the accuracy, stability, and efficiency of the proposed methods for phase-field dynamics with long-time memory effects.

math.NA↗
arXiv2026

Imputation is all you need: double robustness, semiparametric efficiency, and automatic covariate balance for estimating the average treatment effect

Imputation-based causal estimation is typically viewed as relying exclusively on an outcome model, in contrast to augmented inverse-probability weighting, whose consistency is protected by fitting two nuisance models. This paper argues that this view can be misleading by highlighting a hidden dual weighting structure in least-squares sieve regression imputation. Although only outcome regressions are explicitly fitted, the resulting imputation estimator admits an exact weighting representation whose induced weights balance every function in the sieve space and the corresponding population weighting functions are the $L^2$ projections of the inverse propensity scores onto the same sieve space. This projection structure yields an implicit form of double robustness and, under standard sieve approximation and growth conditions, asymptotic linearity with the efficient influence function. Thus, weighting, covariate balance, double robustness, and semiparametric efficiency can all emerge from imputation alone through the geometry of least-squares projection.

math.ST↗
arXiv2026

Causal inference in two-sided randomization designs: factorial regression, two-way clustering, and covariate adjustment

We study randomized experiments involving two interacting populations, such as buyers and sellers in a marketplace. In the two-sided experiments we consider, we randomize the two populations separately and independently. For a pair consisting of one member from each population, the two assignments jointly determine one of four exposure conditions. Under a local interference assumption, we consider a broad class of linear estimands, including total, interaction, and buyer- and seller-side spillover effects. Our first main result establishes that researchers can estimate these effects using ordinary least squares and conduct asymptotically valid design-based inference using the conventional two-way cluster-robust variance estimator, clustered at the buyers' and sellers' levels. Our second main result develops a sharper variance estimator for a single linear estimand that better preserves dependence within the buyer and seller dimensions and is asymptotically less conservative than the two-way clustered estimator and existing alternatives. Our third main result establishes the theory for covariate adjustment and recommends a two-way analysis-of-variance-type covariate representation to ensure efficiency gains.

econ.EM↗
arXiv2026

Introducing the CP-plot for Causal Inference with Observational Studies

Under the canonical setting of observational studies for causal inference, we derive a set of exact representations for pairwise differences among weighted average treatment effects as covariances between the conditional average treatment effect and the propensity score, up to positive scaling factors. These covariance representations bridge the two core concepts in causal inference with observational studies. They immediately imply that (i) the average treatment effect is bracketed by the average treatment effects on the treated and on the controls, with the direction determined by the sign of the covariance between the conditional average treatment effect and the propensity score, and (ii) the average treatment effect under the overlap weight, the weight that is proportional to the conditional variance of the treatment given the covariates, is bracketed by the average treatment effects on the treated and controls when the corresponding covariances have a common sign within both the treated and control groups. We further extend these results to weighted local average treatment effects in the instrumental variable framework. Building on this theory, we recommend the ``CP-plot'' of the estimated conditional average treatment effect against the estimated propensity score, and implement it in the R package \texttt{CPplot}.

stat.ME↗
arXiv2026

Inverse regression for causal inference with multiple outcomes

With multiple outcomes in empirical research, a common strategy is to define a composite outcome as a weighted average of the original outcomes. However, the choices of weights are often subjective and can be controversial. We propose an inverse regression strategy for causal inference with multiple outcomes. The key idea is to regress the treatment on the outcomes, which is the inverse of the standard regression of the outcomes on the treatment. Although this strategy is simple and even counterintuitive, it has several advantages. First, testing for zero coefficients of the outcomes is equivalent to testing for zero treatment effects, even though the inverse regression is deemed misspecified. Second, the coefficients of the outcomes provide data-driven weights for defining a composite outcome. Interestingly, these weights maximize the standardized effect size, a measure commonly used for univariate outcomes in empirical studies. We also discuss the associated inference issues. Third, this strategy is applicable to general study designs. We illustrate the theory in both randomized experiments and observational studies. We implement the proposed method in our R package invreg, available at https://github.com/zhangwei0125/invreg.

stat.ME↗
arXiv2026

Principled analysis of crossover designs: causal effects, efficient estimation, and robust inference

Crossover designs randomly assign each unit to receive a sequence of treatments. By comparing outcomes within the same unit, these designs can effectively eliminate between-unit variation and facilitate the identification of both instantaneous effects of current treatments and carryover effects from past treatments. They are widely used in traditional biomedical studies and are increasingly adopted in modern digital platforms. However, standard analyses of crossover designs often rely on strong parametric models, making inference vulnerable to model misspecification. This paper adopts a design-based framework to analyze general crossover designs. We make two main contributions. First, we use potential outcomes to formally define the causal estimands and assumptions on the data-generating process. For any given type of crossover design and assumptions on potential outcomes, we outline a procedure for identification and estimation, emphasizing the central role of the treatment assignment mechanism in design-based inference. Second, we unify the analysis of crossover designs using least squares, with restrictions on the coefficients and weights on the units. Based on the theory, we recommend the specification of the regression function, weighting scheme, and coefficient restrictions to assess identifiability, construct efficient estimators, and estimate variances in a unified fashion. Crucially, the least squares procedure is simple to implement, and yields not only consistent and efficient point estimates but also valid variance estimates even when the working regression model is misspecified.

stat.ME↗
arXiv2026

Rerandomization for covariate balance mitigates $p$-hacking caused by strategically selecting covariates in regression adjustment

Rerandomization enforces covariate balance across treatment groups in the design stage of experiments. Despite its intuitive appeal, its theoretical justification remains unsatisfying because its benefits of improving efficiency for estimating the average treatment effect diminish if we use regression adjustment in the analysis stage. To strengthen the theory of rerandomization, we show that it mitigates false discoveries resulting from $p$-hacking caused by strategically selecting covariates in regression adjustment to get more significant $p$-values. Moreover, we show that rerandomization with a sufficiently stringent threshold can resolve such $p$-hacking. As a byproduct, our theory offers guidance for choosing the threshold in rerandomization in practice.

math.ST↗
arXiv2026

Misspecified regressions with mixed regressors: robust inference and causal interpretation

For analytic convenience, existing statistical frameworks either assume random or fixed regressors. However, it is a little awkward that they do not cover the practical case of estimating the average treatment effect in experiments with randomized treatments and non-randomized, fixed pretreatment covariates. We unify the literature by providing the theory for regressions with mixed regressors that contain both random and fixed components. Importantly, our theory allows for misspecification of the regression functions. We first establish general results for estimating equations with both random and fixed components and then use it to analyze misspecified linear regression, with applications to completely randomized experiments. We focus on the causal interpretation of the regression coefficients and standard errors even when the models are wrong. We start with the theory for independent data and then extend the discussion to clustered data.

math.ST↗
arXiv2026

Identifiability of the instrumental variable model with the treatment and outcome missing not at random

The instrumental variable model of Imbens and Angrist (1994) and Angrist et al. (1996) identifies the local average treatment effect, also known as the complier average causal effect (CACE). In practice, however, the treatment and outcome are often missing, and when they are missing not at random (MNAR), the CACE is generally not identifiable without further assumptions, because the underlying data distribution itself cannot be recovered. We study when the CACE remains identifiable under MNAR. Through an exhaustive search over missingness mechanisms, we characterize all those that identify the CACE without auxiliary information, in two scenarios: (1) missing data in either the treatment or the outcome alone, and (2) missing data in both the treatment and outcome under prospective data collection. Along the way, we unify existing results and establish many new ones, giving a complete picture of identifiability in each case. Our theory suggests that before any practical data analysis under the instrumental variable model, it is important to check whether the CACE is identifiable under the proposed missingness mechanism; moreover, because the true mechanism is typically unknown and untestable, it is more robust to conduct sensitivity analyses across multiple plausible missingness mechanisms.

stat.ME↗
arXiv2026

Benign overfitting beyond prediction: The ordinary least squares interpolator

Recent advances in deep learning have highlighted the phenomenon of benign overfitting in overparameterized statistical models, sparking significant interest in understanding its foundations. Owing to its simplicity and practical relevance, the ordinary least squares (OLS) interpolator has become a key object of study for gaining theoretical insight into this phenomenon. While the properties of OLS are well understood in classical underparameterized settings, its behavior in the overparameterized regime -- unlike that of ridge regression or the lasso -- remains comparatively less explored. We contribute to this growing literature by deriving new algebraic and statistical results for the minimum $\ell_2$-norm OLS interpolator. In contrast to much of the existing work, which focuses on prediction risk, we center our analysis on parameter estimation and inference, which are fundamental for many statistics and causal inference applications. Specifically, we establish overparameterized analogues of (i) the leave-$k$-out formulas, (ii) the omitted variable bias formula, and (iii) the Frisch-Waugh-Lovell theorem. Under the Gauss-Markov model, we further extend the Gauss-Markov theorem and analyze variance estimation under homoskedasticity in the overparameterized setting. Collectively, these results provide a systematic framework for studying parameter estimation and inference in overparameterized linear models, offering a novel perspective on benign overfitting beyond its implications for prediction.

math.ST↗
arXiv2026

Estimating within-cluster and between-cluster spillover effects in randomized saturation designs

Randomized saturation designs are two-stage experiments: they first randomly assign treatment probabilities over the clusters and then randomly assign the treatment to the units within the clusters. The existing literature on randomized saturation designs focuses on estimating within-cluster spillover effects by assuming away between-cluster spillover effects. However, the units may interact across clusters in many practical randomized saturation designs. A leading example is that some units are geographically close to each other, so spillover effects arise across clusters. Based on the potential outcomes framework, we formulate the causal inference problem of estimating within-cluster and between-cluster spillover effects in randomized saturation designs. We clarify the causal estimands and establish the statistical theory for estimation and inference. We also apply our method to analyze a recent randomized saturation design of cash transfer on household expenditure in Kenya.

stat.ME↗
arXiv2026

ToolRegistry: A Protocol-Agnostic Tool Management Library for Function-Calling LLMs

Every LLM tool call is structurally an RPC -- a function name, JSON arguments, and a serialized result -- yet each protocol (native Python, MCP, OpenAPI, LangChain) is integrated from scratch. We present ToolRegistry, a system that makes this RPC nature explicit: a single Tool object acts as a universal stub regardless of transport, while the registry serves as the RPC client runtime for dispatch, schema generation, and execution. The system ships as three packages -- a core registry, a server exposing tools over MCP and OpenAPI, and a hub of production-ready implementations -- and invokes tools through pluggable thread or process backends. The system now also provides tag-based permission policies, BM25F-powered progressive tool disclosure for large registries, think-augmented function calling, multi-provider schema support (OpenAI, Anthropic, Gemini), declarative JSONC/YAML configuration, and a near-zero-dependency core built on stdlib-only vendored modules. In our benchmarks the library cuts integration code by 60-80%, and choosing the right concurrency mode (thread vs. process) yields up to 3.1x throughput over the alternative for a given workload. ToolRegistry is open-source at https://github.com/Oaklight/ToolRegistry; documentation lives at https://toolregistry.readthedocs.io/.

cs.SE↗
arXiv2026

Sensitivity Analysis for the Test-Negative Design

The test-negative design has become popular for evaluating the effectiveness of post-licensure vaccines using observational data. In addition to its logistical convenience on data collection, the design is also believed to control for the differential health-care-seeking behavior between vaccinated and unvaccinated individuals, an important while often unmeasured confounder between the vaccination and infection. Hence, the design has been employed routinely to monitor seasonal flu vaccines and more recently to measure the COVID-19 vaccine effectiveness. Despite its popularity, the design has been questioned, in particular about its ability to fully control for the unmeasured confounding. In this paper, we explore deviations from a perfect test-negative design, and propose various sensitivity analysis methods for estimating the effect of vaccination measured by the causal odds ratio on the subpopulation of individuals with good health-care-seeking behavior. We start with point identification of the causal odds ratio under a test-negative design, comparing different forms of identification assumptions and their corresponding estimands. We then propose two approaches for conducting sensitivity analysis, addressing the influence of the unmeasured confounding in two different ways. Specifically, one approach investigates partial control for unmeasured confounding in the test-negative design, while the other examines the impact of unmeasured confounding on both vaccination and infection. Furthermore, we combine these approaches to provide narrower bounds on the true causal odds ratio, and further sharpen the bounds by restricting the treatment effect heterogeneity. Finally, we apply the proposed methods to evaluate the effectiveness of COVID-19 vaccines using observational data from test-negative designs.

stat.ME↗
arXiv2026

Affinity Tailor: Dynamic Locality-Aware Scheduling at Scale

Modern large multicore systems often run multiple workloads that share CPUs under schedulers such as Linux CFS. To keep CPUs busy, these schedulers load-balance runnable work, causing each workload to execute on many cores. This weakens locality at the microarchitectural level: workloads lose reuse in caches, branch predictors, and prefetchers, and interfere more with one another - especially on chiplet-based systems, where spreading execution across cores also spreads it across LLC boundaries. A natural alternative is strict CPU partitioning, but hard partitions leave capacity idle when workloads do not fully use their reserved CPUs. We present Affinity Tailor, a userspace-guided kernel scheduling system built on a key insight: the kernel can preserve locality for workloads that share CPUs by treating demand-sized, topologically compact CPU sets as affinity hints rather than hard partitions. A userspace controller estimates each workload's CPU demand online and assigns a preferred CPU set sized to that demand, chosen to be as disjoint as possible from other workloads while spanning as few LLC domains as possible. The kernel then uses this set as an affinity hint, steering threads toward those CPUs while still allowing execution elsewhere when needed to preserve utilization. Deployed at Google, Affinity Tailor delivers geometric-mean per-CPU throughput gains of 12% on chiplet-based systems and 3% on non-chiplet systems over Linux CFS. Furthermore, faster execution reduces memory residency, yielding per-GB throughput gains of 3-7%. Our findings suggest that future schedulers should treat spatial locality as a first-class objective, even at the expense of work-conservation.

cs.OS↗