arXiv Science⌕ Search

arXiv subjects

Andrew Koh

Publications and source records attributed to Andrew Koh.

At least 19 recordsLinked to original sources

Organizing Intelligence

When will advances in AI lead to economic transformation? We develop a model of how intelligence, the ability to achieve goals, matters for organizations, the key unit of economic production. Agents (human or AI) with multidimensional capabilities sort endogenously into competing firms. A firm's productivity depends on its agents' capabilities; we distinguish competence, which shifts productivity levels, from coordination, which governs how productivity scales with size. Two differences between AI and humans drive transformation: AI expertise is reproducible while humans' are in fixed supply, and AIs may not face the same human limits on coordination. We analyze how equilibrium market structure, productivity, employment, and wages evolve as AI capabilities improve. When AI is more capable than the average human, organizations of complementary humans can nonetheless outperform AI. Increases in AI competence can change the composition of workers within firms and decrease firm size. As AI coordination improves, however, this can break the Coasean ceiling on firm size and the market structure undergoes a phase transition toward large, concentrated AI-heavy firms. Changes in human employment are gradual when AI displaces workers within mixed human-AI firms, or sudden when AI firms outcompete human firms. We decompose wage changes into a technology effect, which changes the value of humans within existing firms, and a reorganization effect as firms adjust size and composition. Reorganization can reverse the technology effect on wages.

econ.TH↗

Balanced Social Learning

When is social learning efficient if agents have heterogeneous preferences over a set of actions? When myopic agents generate information only about the action they choose, efficiency requires balance such that all high-value actions are discovered. We characterize the value of policies that control the flow of past information to future agents. Under full transparency of past information, the probability of efficient outcomes is approximately one if and only if the prior and preferences are balanced and the log-likelihood ratio distribution satisfies a set of intuitive moment conditions. Noisy bad news is a canonical example. By contrast, approximate efficiency is obtainable on the set of arbitrary adaptive information policies if and only if the prior alone is balanced. Moreover, it suffices to use adaptive evidence policies which permanently and fully disclose subsets of past information. When the prior is imbalanced and approximate efficiency is unattainable, we characterize the value of adaptive information and show that it is uniformly approximated by the value of adaptive evidence as the impact of each individual signal on beliefs vanishes.

econ.TH↗

Cooperating against Catastrophe

We study a continuous-time game in which two firms choose how quickly to advance their capabilities while an exogenous safety threshold advances at a fixed rate. When the capability frontier (max of firms' capabilities) exceeds the safety threshold, all firms are exposed to common disaster that arrives at a hazard rate increasing in the capability-safety difference. We characterize Markov perfect equilibria in terms of the disaster risk, how quickly safety advances, and flow payoffs: when they are low, only racing is an equilibrium; when they are intermediate, racing and pacing coexist; when they are high, only pacing survives. Across all subgame perfect equilibria, low risk induces perpetual racing while high risk rules it out and we bound the probability of disaster across all SPE. If internal capabilities are hidden with a fixed lag until deployment, it is harder to sustain pacing which highlights the importance of transparency about internal capabilities.

econ.TH↗

The Economics of Recursive Self-Improvement

We model the economics of recursive self-improvement (RSI) and assess its plausibility and impacts. First, we build a sequence of increasingly rich models of AI progress to highlight the feedback loops behind RSI. We represent our models as directed graphs and show that net acceleration in AI capabilities depends on the product of elasticities across each feedback loop. Second, we distinguish between "narrow" and "broad" AI capabilities, capturing the possibility that AI systems improve narrowly at optimizing AI R&D benchmarks without improving at broader economically valuable tasks. Third, we document existing estimates of key parameters and provide a wish list of empirical objects that AI companies can measure and feasibly share publicly. Finally, we calibrate the model with existing data. A back-of-the-envelope calculation suggests that feedback loops are not currently strong enough to generate a self-sustaining acceleration, though they appear to be strengthening. We conclude by assessing the plausibility and implications of such an acceleration.

econ.GN↗

Mechanism Design for Alignment and Control

We develop a framework for mechanism design with AI agents whose alignment (preferences) and capabilities (feasible actions and information) are unknown. We want such agents to act on our behalf so mechanisms must incentivize both honesty and obedience. A one-sided imitation structure---capabilities can be concealed but not counterfeited---yields a revelation principle, a characterization of implementable policies via nested cyclical monotonicity, and conditions under which eliciting higher-order beliefs can discipline multiple agents. We apply our framework to stylized examples of (i) sandbagging in which a more capable agent pretends to be less capable; (ii) an alignment--interpretability trade-off, where the two are substitutes in the instrument but complements in value; (iii) discipline via peer scoring; (iv) coupling rewards to induce competition among multiple agents; and (v) scalable oversight and reward shaping.

econ.TH↗

Racing to Ruin

We study R&D competition in the shadow of disaster: advancing the technology frontier raises the risk of permanently ending all firms' payoffs. Under perfect monitoring and common knowledge of rationality, the equilibrium frontier is bounded below by the optimal stopping time of a monopolist, and above by that of a representative firm that persistently but mistakenly believes its rival is about to stop. We then analyze how the frontier is shaped by transparency (speed of monitoring) and trust (belief in the rationality of rival firms).

econ.TH↗

Persuasion and Optimal Stopping

We develop a duality-based first-order approach to dynamic persuasion in optimal stopping problems with general action-, state-, and time-dependent preferences. A direct-communication reduction recasts the design problem as a semi-static program over joint distributions of stopping beliefs and times; strong duality and a near-necessary first-order condition then reduce it to a one-dimensional differential equation in a multiplier that prices the agent's continuation incentive, characterizing the optimum as a \emph{concavification} of a multiplier-augmented payoff. We demonstrate the method in three applications: dynamic binary persuasion, where optimal policies combine \emph{suspense generation} with \emph{action-targeting}; a structural result by which the principal's time-risk preferences alone determine whether suspense is optimal; and dynamic linear persuasion, where the optimum is \emph{dynamic tail-censorship}.

econ.TH↗

Data-Driven Automation

We build a dynamic model of data-driven automation in which data (i) is heterogeneous and task-specific; (ii) accumulates endogenously as a byproduct of economic activity; and (iii) exhibits spillovers such that data generated by one task can augment the productivity of another. Along the transition path of automation, data plays a dual role in simultaneously augmenting the productivity of already-automated tasks and expanding the automation frontier. We derive tight conditions for the economy to be partially versus fully automated in the long-run. In the latter case, automation exhibits rich short-run dynamics that depend on the pattern of data spillovers but is always slow in the long-run: the share of tasks produced by labor decays asymptotically as a power law in time. We show that the economy is generically inefficient and analyze how a planner optimally tilts the direction of data accumulation. With endogenous capital accumulation, data-driven automation generates explosive growth but stagnant long-run wages.

econ.TH↗

Technology Speed Limits

We study optimal technology regulation when private learning occurs both through doing (scaling up the technology) and through waiting (as time passes). We show that an adaptive speed limit -- a cap on the rate at which the technology can increase per-unit time -- delivers optimal worst-case guarantees over all learning processes and/or preferences, and is the only time-consistent mechanism that does so.

econ.TH↗

Full-Stack Alignment: Co-Aligning AI and Institutions with Thick Models of Value

Beneficial societal outcomes cannot be guaranteed by aligning individual AI systems with the intentions of their operators or users. Even an AI system that is perfectly aligned to the intentions of its operating organization can lead to bad outcomes if the goals of that organization are misaligned with those of other institutions and individuals. For this reason, we need full-stack alignment, the concurrent alignment of AI systems and the institutions that shape them with what people value. This can be done without imposing a particular vision of individual or collective flourishing. We argue that current approaches for representing values, such as utility functions, preference orderings, or unstructured text, struggle to address these and other issues effectively. They struggle to distinguish values from other signals, to support principled normative reasoning, and to model collective goods. We propose thick models of value will be needed. These structure the way values and norms are represented, enabling systems to distinguish enduring values from fleeting preferences, to model the social embedding of individual choices, and to reason normatively, applying values in new domains. We demonstrate this approach in five areas: AI value stewardship, normatively competent agents, win-win negotiation systems, meaning-preserving economic mechanisms, and democratic regulatory institutions.

cs.LG↗

Robust Technology Regulation

We analyze how uncertain technologies should be robustly regulated and how regulation should evolve with new information. An adaptive sandbox comprising a zero marginal tax up to an evolving quantity limit is (i) robust: it delivers optimal payoff guarantees when the agent's learning process and/or preferences are chosen adversarially; (ii) dominant: it outperforms other robust and regular mechanisms across all agent learning processes and preferences; (iii) time-consistent: it is the only robust mechanism that can be implemented without commitment. Robustness is important: absent robust regulation, worst-case payoffs can be arbitrarily poor and are induced by weak but growing optimism that encourages excessive risk-taking. Our results offer optimality foundations for existing policy and speak directly to current debates around managing emerging technologies.

econ.TH↗

An Economy of AI Agents

In the coming decade, artificially intelligent agents with the ability to plan and execute complex tasks over long time horizons with little direct oversight from humans may be deployed across the economy. This chapter surveys recent developments and highlights open questions for economists around how AI agents might interact with humans and with each other, shape markets and organizations, and what institutions might be required for well-functioning markets.

econ.GN↗

Inertial Coordination Games

We analyze inertial coordination games: dynamic coordination games with an endogenously changing state that depends on (i) a persistent fundamental players privately learn about over time; and (ii) past play. The speed of learning determines long-run equilibrium dynamics: the risk-dominant action is played in the limit if and only if learning is slow such that posterior precisions grow sub-quadratically. This generalizes results from static global games and endows them with a learning foundation. Conversely, when learning is fast such that posterior precisions grow super-quadratically, shocks can propagate and generate self-fulfilling spirals.

econ.TH↗

Flexible Demand Manipulation

We develop a simple framework to analyze how targeted persuasive advertising shapes market power and welfare. A designer flexibly manipulates the demand curve by influencing individual valuations at a cost. A monopolist prices against this manipulated demand curve. We fully characterize the form of optimal advertising plans under ex-ante and ex-post welfare measures. Flexibility per se is powerful, and can substantially harm or benefit consumers vis-a-vis uniform advertising. We discuss implications for regulation, intermediation, and the joint design of manipulation and information.

econ.TH↗

Informational Puts

We analyze how dynamic information should be provided to uniquely implement the largest equilibrium in binary-action coordination games. The designer offers an informational put: she stays silent if players choose her preferred action, but injects asymmetric and inconclusive public information if they lose faith. There is (i) no multiplicity gap: the largest (partially) implementable equilibrium can be implemented uniquely; and (ii) no commitment gap: the policy is sequentially optimal. Our results have sharp implications for the design of policy in coordination environments.

econ.TH↗

Attention Capture

We develop a unified analysis of how information captures attention. A decision maker (DM) faces a dynamic information structure and decides when to stop paying attention. We characterize the convex$\unicode{x2013}$order frontier and extreme points of feasible stopping times, as well as dynamic information structures which implement them. This delivers the form of optimal attentional capture as a function of the designer and DM's relative time preferences. Intertemporal commitment is unnecessary: sequentially optimal information structures always exist by inducing stochastic interim beliefs. We further analyze optimal attention capture under non instrumental value of information. Our results speak directly to the attention economy.

econ.TH↗

Leveraging Audio-Tagging Assisted Sound Event Detection using Weakified Strong Labels and Frequency Dynamic Convolutions

Jointly learning from a small labeled set and a larger unlabeled set is an active research topic under semi-supervised learning (SSL). In this paper, we propose a novel SSL method based on a two-stage framework for leveraging a large unlabeled in-domain set. Stage-1 of our proposed framework focuses on audio-tagging (AT), which assists the sound event detection (SED) system in Stage-2. The AT system is trained utilizing a strongly labeled set converted into weak predictions referred to as weakified set, a weakly labeled set, and an unlabeled set. This AT system then infers on the unlabeled set to generate reliable pseudo-weak labels, which are used with the strongly and weakly labeled set to train a frequency dynamic convolutional recurrent neural network-based SED system at Stage-2 in a supervised manner. Our system outperforms the baseline by 45.5% in terms of polyphonic sound detection score on the DESED real validation set.

eess.AS↗

Language-Based Audio Retrieval with Converging Tied Layers and Contrastive Loss

In this paper, we tackle the new Language-Based Audio Retrieval task proposed in DCASE 2022. Firstly, we introduce a simple, scalable architecture which ties both the audio and text encoder together. Secondly, we show that using this architecture along with contrastive loss allows the model to significantly beat the performance of the baseline model. Finally, in addition to having an extremely low training memory requirement, we are able to use pretrained models as it is without needing to finetune them. We test our methods and show that using a combination of our methods beats the baseline scores significantly.

cs.SD↗