arXiv Science⌕ Search

arXiv · 2609.28291

Cooperating against Catastrophe

Abstract

We study a continuous-time game in which two firms choose how quickly to advance their capabilities while an exogenous safety threshold advances at a fixed rate. When the capability frontier (max of firms' capabilities) exceeds the safety threshold, all firms are exposed to common disaster that arrives at a hazard rate increasing in the capability-safety difference. We characterize Markov perfect equilibria in terms of the disaster risk, how quickly safety advances, and flow payoffs: when they are low, only racing is an equilibrium; when they are intermediate, racing and pacing coexist; when they are high, only pacing survives. Across all subgame perfect equilibria, low risk induces perpetual racing while high risk rules it out and we bound the probability of disaster across all SPE. If internal capabilities are hidden with a fixed lag until deployment, it is harder to sustain pacing which highlights the importance of transparency about internal capabilities.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Drew Fudenberg, Andrew Koh. 2026-09-23. Cooperating against Catastrophe. https://arxiv.org/abs/2609.28291

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Constraint Preferences: Inattention and Aggregation

We study robust decision problems when individuals have maxmin preferences whose belief sets are neighborhoods around reference models, commonly known as "constraint preferences." We first show that a more disciplined form of rationally inattentive behavior is equivalent to the behavior implied by a subclass of constraint preferences. We then introduce an aggregation principle that requires collective beliefs to satisfy every individual's constraint. This requirement links collective beliefs to the information-processing technologies that generate individual constraints. Applications reveal how these technologies determine asset prices, when prediction-market prices become self-confirming, and how much dynamic mechanisms can reduce information rents.

econ.TH↗

Insuring the Fallback: Capital, Monitoring, and the Certification of Preserved Human Capability under Improving AI

When generative AI makes the deliverable uninformative, a professional-services provider can still certify the preserved human capability to catch the machine's errors, through a liability pledge whose expected cost falls in that capability. The pledge is credible only up to what can be collected, and that ceiling is set by an underwriter, which bears part of the pledge and audits the insured. The range of client stakes over which one certificate separates has a width bounded by the provider's own capital plus the audited share of the underwriter's capacity, so unmonitored capacity adds nothing to it. Blind capital instead relocates that range upward, through a cross-subsidy that exists only under class rating. Monitoring converts capital into width, removes the cross-subsidy, raises the return to preserving skill, and, because audit information leaks, makes the certificate redundant beyond an interior precision.

econ.TH↗

Complementary Information Sources

A decision maker may have several information sources available and choose which one to consult only after learning the decision problem she faces. When is one such set of sources uniformly more valuable than another? For unrestricted Bayesian decision problems, we show that the answer can be stated entirely in terms of Blackwell comparisons. Form a tagged mixture by drawing a source independently of the state and revealing both its identity and its signal. One source set is more valuable in every decision problem if and only if each tagged mixture of the second source set is Blackwell dominated by some tagged mixture of the first. The result applies to compact, possibly infinite source sets and general signal spaces. It also has an exact quantitative counterpart: the largest normalized value shortfall is the directed Le Cam deficiency between the source sets' tagged hulls. The analogous program for monotone decision problems reveals a boundary. We call the passage from problem-by-problem source-set superiority to a problem-independent pairwise dominance a lifting. The Blackwell lifting does not extend directly to the Lehmann order: mixing sources that individually satisfy the monotone likelihood ratio property (MLRP) need not preserve MLRP, and even when it does, no fixed Lehmann-dominating mixture need exist. Requiring one source to serve a finite bundle of monotone decision problems restores the equivalence.

econ.TH↗