arXiv Science⌕ Search

arXiv subjects

Mark Esposito

Publications and source records attributed to Mark Esposito.

6 recordsLinked to original sources

AI, Specialization, and the Organization of Knowledge Work: Evidence from Legal Services

Artificial intelligence makes specialized knowledge cheaper to use, but its effects on professional-service firms depend on how clients reallocate work and how suppliers respond. We develop a framework linking individual self-provision, enterprise make-or-buy decisions, and pricing by specialist firms. As AI improves lower-priced alternatives, clients may reallocate work across outside providers without bringing it in-house. If the departing work is more price-sensitive than the work that remains, premium firms may raise their optimal markups even as their share of work declines. We examine these margins in U.S. legal services. Across 89 federal districts, a difference-in-differences analysis finds a 6.6-percentage-point increase in non-prisoner self-representation relative to prisoner petitions by fiscal 2025, remaining substantial after adjusting for pre-existing trends. In contrast, lawyer employment shows no clear post-2022 shift toward client firms. Legal-AI benchmarks reveal continuing limitations in reliably completing complex, multi-step work, offering one possible explanation. Meanwhile, the largest law firms reported 13% revenue growth in 2025 despite nearly flat billable hours, while lower-priced firms experienced stronger demand growth. Reported AI integration is also stronger among firms with lower revenue per lawyer. These patterns highlight the importance of changes in work allocation and supplier competition, even as much of the underlying reallocation predates generative AI. The findings illustrate why cheaper expertise need not produce either widespread internalization or declining prices for premium professional services.

econ.GN↗

AI and the Two Margins of Work: Why Job Losses Show Up Before Job Creation

Technological change acts on labor demand at two margins: adjustment within established activities and the creation of additional activities, often by new firms. Payroll statistics record the first promptly and the second late. In the computing era, firms that entered in 1978 or later held 42 percent of payroll by 1998 and entering cohorts kept about 80 percent of their payroll after five years; in the industries most exposed to automation, incumbents contracted before entrants accumulated, a sequence that is precise early in the period and suggestive by its end. We develop a model in which one AI capability lowers the full cost of acceptable output in existing production and makes additional projects worth attempting, with founder effort separate from hired hours. If operating products re-scale instantly, automation displaces no aggregate hours; if they take time, hours fall first and recover as incumbents re-expand and new products arrive, with the long-run sign set by income effects. Establishment job flows through the first quarter of 2026 show no gradient on language-model exposure on either margin, which is what the model predicts under the observed adoption path and also what no effect on payroll would look like; studies with founding-task exposure find entry rising 10 to 20 percent. We propose a net reinstatement ratio and show that statistics which record new work late overstate displacement for years.

econ.GN↗

Reliability of AI Agents: Rater Effects, Drift, and the Return to an Evaluation Program

Firms increasingly evaluate deployed AI agents using repeated human ratings, yet observed score changes may reflect the measurement process as much as changes in the agent itself. Firms also rarely know how long an evaluation remains informative as deployed systems evolve. We study reliability as a latent state using 2,611 rubric-scored production interviews from a deployed voice-and-video interviewing agent, overlapping human reviewers, the agent's change log, and support tickets. Reviewer severity varied substantially: two reviewers assessing the same batches differed by 0.79 standard deviations on the composite index, and a shift in reviewer composition flattened the raw trend. After adjusting for reviewer effects and smoothing batch-level estimates, evaluated reliability increased by 0.53 standard deviations from March to August 2026. Reliability also shifted materially across logged deploys. At the estimated rate of unaccounted movement, forecast uncertainty reaches the magnitude of the largest observed deploy contrast after about five weeks, although this horizon is imprecisely estimated and based on a small number of step-like changes. An independent operational outcome moved in the same direction: interview-related support tickets fell by about 10% per month relative to technical-issue tickets. These data do not identify a causal effect of evaluation on performance. Instead, they show that longitudinal AI evaluation requires three checks: comparability across raters, evidence currency under drift, and corroboration with consequential operational outcomes.

econ.GN↗

The Benchmark Ceiling: Human Judgment, Evaluation Scarcity, and the Political Economy of AI Capability Measurement

Benchmarks are the primary instruments through which AI capability is measured, compared, and governed. This paper argues that the validity of frontier AI benchmarks is a function of the quality of human judgment embedded in their construction, and that this quality is structurally scarce in ways that standard scaling narratives obscure. As foundation models approach ceiling performance on existing evaluation suites, discriminating signal concentrates in the hardest benchmark items, precisely those requiring elite expert judgment to design. We term this the benchmark ceiling problem: the progressive exhaustion of evaluation signal as models saturate the easy majority of items while the difficult tail, authored by a thin stratum of highly expert evaluators, remains the only source of genuine discrimination. The paper develops this argument in three steps. First, we present a formal model of benchmark signal depreciation. Benchmark scores are public signals of latent model quality, but their precision depends endogenously on benchmark validity. As frontier capability rises and as contamination or strategic optimization increases, fixed benchmarks depreciate as measurement instruments. The model shows that valid signal concentrates in hard-tail items, that the replacement cost of such items rises convexly with frontier capability, and that private benchmark producers underinvest in validity relative to the social optimum. Second, drawing on platform data from micro1 covering over one thousand credentialed professionals, we document the scarcity premium associated with high-judgment, low-codifiability evaluation labor. Third, we develop the political economy and governance implications.

cs.CY↗

Prioritization of Risks from Artificial Intelligence: A Delphi Study of 272 International Experts

Artificial intelligence poses many risks, ranging from familiar present-day harms to unprecedented and potentially catastrophic ones. Effective risk management requires prioritization: we must understand which risks are most severe, who is most vulnerable, and who is most responsible for addressing them. We report results from a three-round Delphi study conducted late 2025 with 272 international AI experts. Experts rated 24 AI risks on harm probability and severity, sector and actor vulnerability, actor responsibility, and overall concern. Experts estimated the five most severe harms in the next 5 years were likely to come from dangerous capabilities, competitive dynamics, weapons & cyberattacks (including CBRNE), power centralization, and false information. In a business-as-usual scenario, experts judged 18 of 24 risks as having a more than 10% probability of catastrophic outcomes (e.g., more than 1 million deaths or more than USD 100B in financial loss) in the next 5 years (2025-2030). In a scenario where pragmatic mitigations are implemented, experts still judged five risks as having a more than 10% probability of catastrophic outcomes: dangerous capabilities, weapons & cyberattacks, environmental harm, inequality & unemployment, and power centralization. All 24 risks were judged as being more than 5% likely to cause catastrophic outcomes. AI users and the general public were judged the most vulnerable to these risks, but experts assigned the highest responsibility for addressing them to general-purpose AI developers and governance actors (including governments, regulators, and standards bodies). Across most risks, experts identified information, finance, and national security as the most vulnerable sectors. These findings can guide AI risk prioritization and clarify expert expectations about who should bear responsibility for mitigation.

cs.CY↗

No Last Mile: A Theory of the Human Data Market

The standard framing treats structured human-data work as transitional, a bridge between today's imperfect models and a future state where automation is complete. We challenge this view by modeling structured human data as a persistent production input: evaluation, rubric-based judgment, auditing, exception handling, and continual updates that convert raw model capability into dependable, deployable performance. These activities accumulate into a reusable AI capability stock that raises productivity by improving reliability on existing tasks and by expanding the frontier of task families for which AI can be used at high confidence. Crucially, this capability stock depreciates as tasks and contexts drift, standards evolve, and new edge cases emerge. In a tractable baseline model, an interior steady state implies a closed-form, strictly positive long-run labor share devoted to structured human-data work whenever depreciation is positive, a "no last mile" result in which maintenance demand persists even as models improve. We then microfound aggregate capability with a portfolio of task families featuring diminishing returns, frontier entry, and complementarity, generating reallocation toward low-maturity and bottleneck families and a Roy-style mechanism for within-structured wage dispersion. Finally, we map model objects to observable proxies using standard data layers, and provide a conservative calibration suggesting a 5-7% steady-state structured labor share in the long run.

econ.GN↗