arXiv subjects

Christopher Stith

Publications and source records attributed to Christopher Stith.

3 recordsLinked to original sources

arXiv2026

Causal Foundation Models

Causal inference is the practice of estimating the effect of a treatment or intervention from data. It traditionally requires a bespoke pipeline for every new problem: first proposing a causal mechanism, selecting a compatible estimator, and finally training it. Meanwhile, across diverse settings and modalities, much of machine learning has shifted to the paradigm of foundation models: networks pretrained once at scale and applied to new tasks without fine-tuning. Causal foundation models (CFMs) bring this paradigm to causal inference. CFMs are pretrained neural networks that estimate causal quantities, such as the average treatment effect, on entirely new datasets using in-context learning without requiring model updates. This work provides a practical introduction to this emerging area. We summarize the necessary background in causal inference and machine learning before discussing CFMs. Throughout, we include example code and Jupyter notebooks.

cs.LG↗

arXiv2026

Causal Foundation Models with Continuous Treatments

Causal inference, estimating causal effects from observational data, is a fundamental tool in many disciplines. Of particular importance across a variety of domains is the continuous treatment setting, where the variable of intervention has a continuous range. This setting is far less explored and represents a substantial shift from the binary treatment setting, with models needing to represent effects across a continuum of treatment values. In this paper, we present the first causal foundation model for the continuous treatment setting. Our model meta-learns the ability to predict causal effects across a wide variety of unseen tasks without additional training or fine-tuning. First, we design a novel prior over data-generating processes with continuous treatment variables in order to generate a rich causal training corpus. We then train a transformer to reconstruct individual treatment-response curves given only observational data, leveraging in-context learning to amortize expensive Bayesian posterior inference. Our model achieves state-of-the-art performance on individual treatment-response curve reconstruction tasks compared to causal models which are trained specifically for those tasks. Inference code (including trained model weights) can be found at https://github.com/layer6ai-labs/CCPFN-inference .

cs.LG↗

arXiv2024

Linear hyperbolic equations in a double null foliation

The Bianchi identities for the Weyl curvature tensor of a spacetime $(M, g)$ solving the vacuum Einstein equations in a double null foliation exhibit a hyperbolic structure, which can be used to obtain detailed nonlinear estimates on the null Weyl tensor components. The aim of this paper is twofold. First we discuss existence and uniqueness for solutions of first-order linear hyperbolic systems of equations in a double null foliation on an arbitrary spacetime, with initial data posed on a past null hypersurface $\underline C_0 \cup C_0$. We prove a global existence and uniqueness theorem for these systems. Then we discuss the relationship between these systems, the Bianchi equations, and the linearized Bianchi equations (the linearized Bianchi equations are obtained from the usual Bianchi equations by replacing the null Weyl tensor components with unknown tensorfields). We derive a novel algebraic constraint which must be satisfied, at every point in the spacetime, by tensorfields satisfying the linearized Bianchi equations.

gr-qc↗