arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 2610.17085

Superintelligence and the Triple Risk of an AI Race

Matthew Rendall·Max Hellrigel-Holderbaum·Leonard Dung
View original source ↗Read source document ↗Export metadata ↓

Abstract

On many estimates, artificial general intelligence (AGI) is likely to emerge within the next few decades or even sooner. Once it does, it may quickly surpass human intelligence, possibly by a huge margin. Some believe that the country that develops AGI first could attain global dominance. This prospect risks setting off intense competition between the United States and China. Indeed, a narrative has already developed that the superpowers are locked in an AI race, with the Trump administration proclaiming its determination to 'dismantle unnecessary regulatory barriers' to winning it. We argue that this approach presents three profound dangers. The first two are familiar from past arms races: being overtaken by a rival or triggering a war. The third is new: losing control of human beings' future to agents far more intelligent than we are, which could endanger our very survival. Striving to get to AGI first risks a race to the bottom on safety practices and regulation concerning them. China does not yet appear bent on racing to superintelligence. The United States should prioritise both unilateral and co-operative efforts to improve AI safety and avoid provoking a race that all humanity could lose.

Explore related subjects

cs.CYcs.AI

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Matthew Rendall, Max Hellrigel-Holderbaum, Leonard Dung. 2026-10-12. Superintelligence and the Triple Risk of an AI Race. https://arxiv.org/abs/2610.17085

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Stability Regimes for Framing-Sensitive Fine-Tuning in Language Models

AI systems increasingly shape how individuals access and evaluate information, intensifying concerns about misinformation. Computational simulation offers a controlled complement to direct empirical study, with fine-tuned LLMs enabling powerful agent-based simulations. However, fine-tuning often induces broad behavioral shifts including bias drift, degenerate heuristics, and changes in baseline task behavior, which undermine experimental validity. The central challenge is inducing localized decision shifts while preserving the model's aggregate behavior outside the targeted intervention. We study this through a stability analysis of supervised fine-tuning, attenuating loss on selected training slices to shift false-claim acceptance. We introduce FrameRef, a large-scale dataset of semantically equivalent claims with controlled surface framings across five dimensions (Authoritative, Consensus, Emotional, Sensationalist, Prestige), with human validation confirming systematic framing effects on claim acceptance. We present a methodology for identifying model-specific stability regimes in which targeted error shifts can be induced while preserving aggregate accuracy and calibration, and demonstrate its application to selected language models. A sequential exposure task over FrameRef shows that small framing-conditioned shifts compound into substantially different cumulative outcomes under feedback, but largely disappear when feedback is removed, confirming that interventions modify specific decision tendencies rather than global performance. We release code, LoRA adapters, and data at https://github.com/infosenselab/framing-sensitive-ft.

cs.CY↗
arXiv2026

Technology-Supported Moderation in Online Deliberation

Mini-publics are an increasingly popular family of democratic innovation to broaden citizen engagement. However, convening a representative sample in person is resource-intensive, and requires significant organizational efforts to coordinate travel, venue logistics, and facilitator training. This chapter outlines the design and development of the Stanford Online Deliberation Platform, initially tailored for Deliberative Polling, building upon insights from in-person moderation in that setting, but supporting a broader range of methods and approaches in the deliberative space. The platform supports structured conversations for small groups (ideally 8-15 people) with automated moderation functionality, enabling the groups to assume ownership of the deliberative conversation rather than relying on a moderator persona. We describe the platform's architecture and key design decisions, including the deliberation flow, room assignment, speaker management, speaking nudges, agenda management, outcome development, and real-time monitoring. Between its inception in 2018 and 2025, the platform has facilitated over 30,000 unique participants engaging in deliberations; we catalog 54 deliberations with at least 100 participants up to December 2025, spanning a diverse range of languages, countries, and topics. Finally, we establish a standardized vocabulary for future analyses by defining the terminology employed in the platform's data and documenting significant software revisions over time.

cs.CY↗
arXiv2026

Institutionalizing Trust in Data Exchange: Trust-Anchor Model of the Data Credit Guarantee Organization and Its Simulation-Based Comparison

Data trading markets that span industries and regions are expanding, but the implicit trust that supports data use within an organization does not carry over to cross-domain exchange. This paper examines the Data Credit Guarantee Organization (DCGO), a proposal to institutionalize trust through third-party verification and certification, and asks what it means to trust data, what such certification can support, and under what conditions DCGO outperforms existing trading models. We decompose trust in data into four layers: authenticity of entity, authenticity and integrity of data, rights and conditions of use, and history and auditability. A third party can certify authenticity but not the correctness of content, and DCGO is positioned as a trust anchor spanning existing marketplaces and data spaces. We then extend the Law Merchant model with three data-specific properties, namely imperfect ex-post detection, cheap pseudonyms, and non-rivalry of harm, and compare bilateral trading with DCGO by agent-based simulation. DCGO keeps the buyer's payoff near its theoretical upper bound regardless of the market environment, whereas bilateral trading loses even when fraud is always detected. Identity verification proves to be a prerequisite for record sharing, and pre-verification is the only function that limits the spread of harm. On the seller side, honest sellers join voluntarily whenever the price premium exceeds the fee. Lock-in and a critical mass for diffusion, however, call for fee governance and support for entry.

cs.CY↗