arXiv ScienceSearch

arXiv · 2607.27544

Lucky or Good? Outcome Noise, Effective Sample Size, and the Attribution of Skill

Abstract

When do outcome records carry enough signal to support reliable inferences about skill? When they do not, what should evaluators substitute? The framework answering the first question characterizes any decision domain with two parameters: the noise reflected in each outcome and the effective number of independent outcomes that are available over an observation window. When domains are positioned in a two-dimensional space of noise versus number of outcomes, those in which capital, prestige, and political power are routinely allocated on the basis of realized outcomes (e.g., mutual fund management, venture capital, executive performance) fall in the region where outcome records contain too little signal to support reliable individual-level inferences. Evaluating actors when outcome records are insufficient can be done by adopting the populationlevel empirical validation methods long used in medicine: has the actor adopted the practices that, at the population level, are associated with better outcomes?

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Karl T. Ulrich. 2026-07-30. Lucky or Good? Outcome Noise, Effective Sample Size, and the Attribution of Skill. https://arxiv.org/abs/2607.27544

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

The Burst Market: The Next Leap for Humanity

Many useful human contributions remain unexchanged because exchange frictions exceed their value. This conceptual paper proposes the Burst Market (BM): a market for brief, paid, immediate human services delivered through live video. BM seeks to lower the minimum viable exchange through PIVOT: Provider-set price, Immediate access, Video interaction, Open participation, and Time-metered payment. A four-part friction map covers buyer access, provider market access, capability packaging, and assurance and governance. BM identifies seven rebalances, including AI job disruption versus underused human capability, and serves both scarce and underused capacity. As generative market infrastructure, BM may let people create services that established occupations and platforms cannot foresee. Seven conceptual propositions organize its mechanisms and predictions. If these effects emerge at scale, BM could represent the next leap for humanity.

econ.GN

Local Media and the Shaping of Social Norms: Evidence from the Ebola outbreak

Media's influence on norms and behavior is widely recognized. Less is known about the role played by media being local. I examine this in a high-stakes context, the Ebola outbreak in Guinea. I exploit quasi-random variation in access to radio and the timing of a public-health campaign aired on community radio. I find that 12-17% of Ebola cases could have been prevented if places with access to a neighboring community radio station had instead had their own. Impacts are driven by radio being local rather than by ethno-linguistic belonging. Local media facilitates coordination in behaviors observed and sanctioned locally.

econ.GN

A minimal model of money creation under regulatory constraints

We propose a minimal model of the secured interbank network able to shed light on recent money markets puzzles. We find that excess liquidity emerges due to the interactions between the reserves and liquidity ratio constraints; the appearance of evergreen repurchase agreements and collateral re-use emerges as a simple answer to banks' counterparty risk and liquidity ratio regulation. In line with prevailing theories, re-use increases with collateral scarcity. In our agent-based model, banks create money endogenously to meet the funding requests of economic agents. The latter generate payment shocks to the banking system by reallocating their deposits. Banks absorbs these shocks thanks to repurchase agreements, while respecting reserves, liquidity, and leverage constraints. The resulting network is denser and more robust to stress scenarios than an unsecured one; in addition, the stable bank trading relationships network exhibits a core-periphery structure. Finally, we show how this model can be used as a tool for stress testing and monetary policy design.

econ.GN