Learning to cooperate in a changing world: How caring about the future promotes cooperation across scales

Yuxin Geng; Xingru Chen; Xin Wang; Hongwei Zheng; Longzhao Liu; Shaoting Tang; Feng Fu

Home/Archive/arXiv

arXiv · 2609.34005

Learning to cooperate in a changing world: How caring about the future promotes cooperation across scales

Yuxin Geng·Xingru Chen·Xin Wang·Hongwei Zheng·Longzhao Liu·Shaoting Tang·Feng Fu

View original source ↗Read source document ↗Export metadata ↓

Abstract

In social dilemmas, individuals need to forgo short-term temptations to achieve synergistic collective outcomes through cooperation. Previous work has examined mechanisms through which cooperation can evolve, including direct reciprocity, indirect reciprocity, environmental stochasticity, network reciprocity, and demographic stochasticity. These mechanisms have largely been studied under natural selection or social learning. As the other side of the same coin, it is equally important to study cooperation under self-learning, where individuals adapt based on their own experiences. Here, we focus on the dynamics of multi-agent reinforcement learning and derive analytical conditions under which these mechanisms can stabilize cooperation under learning dynamics across scales. We find that reinforcement learning can steer self-interested individuals toward cooperation when agents value the future over short-term temptation. Our work provides a unified approach to identifying the determinants of learning to cooperate in a changing world, thereby paving the way for the advancement of cooperative artificial intelligence.

Explore related subjects

physics.soc-ph

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Yuxin Geng, Xingru Chen, Xin Wang, Hongwei Zheng, Longzhao Liu, Shaoting Tang, Feng Fu. 2026-09-27. Learning to cooperate in a changing world: How caring about the future promotes cooperation across scales. https://arxiv.org/abs/2609.34005

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Emergence of cooperation in nonlinear higher-order public goods games

Evolutionary game theory has provided substantial contributions to explain the emergence of cooperation under unfavorable conditions in ecology, economics, and the social sciences. Recently, inspired by newly available empirical evidence on group interactions, higher-order networks have emerged as a natural framework to encode multiplayer games in structured populations. Here, we study the emergence of cooperation in nonlinear public goods games on hypergraphs, where collective reinforcement captures the synergistic or discounting effect associated with each additional cooperator. In well-mixed populations, when all games have the same number of players, the system displays a transition whose nature changes from continuous to discontinuous depending on the form of nonlinearity. By contrast, when games involving different numbers of players coexist, an additional bistability region between an active coexistence state and full cooperation may emerge. We further find that scale-free hypergraphs promote cooperation, highlighting the crucial role played by both the initial placement of cooperators and the presence of hyperdegree correlations. Overall, our results provide a comprehensive characterization of nonlinear public goods games on hypergraphs and open avenues for richer models of evolutionary dynamics of multiplayer games on structured populations.

physics.soc-ph↗

arXiv2026

Clustering in co-evolving opinion dynamics: reduced SPDE models

Clustering is a fundamental collective phenomenon in agent-based models (ABMs) of opinion dynamics. To study clustering in systems with co-evolving social and opinion variables, we derive stochastic partial differential equation (SPDE) models that describe the evolution of clusters. Specifically, these SPDE models are reduced in the sense that their domain accounts only for social variables, while opinion variables are instead incorporated in a multiplicative (Eulerian velocity-type) fashion. The model reduction is primarily guided by computational efficiency, as well as model interpretability. We consider two settings: one in which opinions do not affect social interactions, and another one in which a feedback mechanism couples the two. Our approach extends reduced PDE modelling to a stochastic framework, which is essential for capturing long-term cluster behaviour. Numerical experiments indeed demonstrate that the proposed reduced SPDEs substantially decrease computational cost compared to full-state SPDE models, such as the Dean--Kawasaki equation, while still accurately reproducing the clustering behaviour of the underlying ABM. As a result, these reduced models provide an efficient tool for studying systems with large populations, including those arising in the analysis of real-world data: in particular, we provide an application related to the large-scale General Social Survey (GSS), which comprises opinion and social data of the US population since 1972.

physics.soc-ph↗

arXiv2026

Measuring the impact of hits

Many real systems can be represented as growing networks where new nodes and links gradually emerge. The Barabási-Albert model for growing networks, and many models inspired by it, are based on the idea that nodes compete for links. However, the strength and the very presence of this competition have not been tested. We propose a robust statistical approach to quantify how strongly nodes compete for links, and apply it to data from various real systems---commenting on online news and cinema attendance data. We find a range of possible behaviors, from the perfectly elastic case, where new entrants shape network growth in a way that leaves the rest of the system unaffected, to an intermediate case where new entrants measurably affect the rest. Perfect competition is never observed. These findings have direct implications for complex systems modeling and e-commerce applications.

physics.soc-ph↗