arXiv subjects

Angel Y. He

Publications and source records attributed to Angel Y. He.

3 recordsLinked to original sources

arXiv2026

Robust PAC Learning of Concurrent Stochastic Games

We introduce the first Probably Approximately Correct (PAC) learning framework for general-sum concurrent stochastic games (CSGs) with transition uncertainty, while addressing the challenge of Nash equilibrium (NE) existence. Our algorithm maintains data-driven $L^1$ confidence sets over transition kernels and solves a robust CSG to compute a social-welfare optimal $\varepsilon$-NE, using a robust MDP-based exploration mechanism to drive joint state-action coverage. Crucially, we introduce a Nash margin characterisation that enables principled reasoning about equilibrium existence: the framework either returns an $\varepsilon$-approximate NE whose social-welfare value is $\varepsilon$-close to optimal, or provides a sound certificate that no exact NE exists. Under a minimum reachability condition $p_{\mathrm{reach}}>0$ over relevant state-action pairs, the algorithm terminates after a polynomial number of trajectory samples, with sample complexity $\widetilde{O}\left( {R_{\max}^2 H^4 |S|^2 |A| / (p_{\mathrm{reach}} \varepsilon^2)} \right)$. Empirical results on benchmark CSGs demonstrate near-optimal performance, correct handling of equilibrium (non-)existence, and sample complexity consistent with theory.

cs.LG↗

arXiv2026

Robust Verification of Concurrent Stochastic Games

Autonomous systems often operate in multi-agent settings and need to make concurrent, strategic decisions, typically in uncertain environments. Verification and control problems for these systems can be tackled with concurrent stochastic games (CSGs), but this model requires transition probabilities to be precisely specified - an unrealistic requirement in many real-world settings. We introduce *robust CSGs* and their subclass *interval CSGs* (ICSGs), which capture epistemic uncertainty about transition probabilities in CSGs. We propose a novel framework for *robust* verification of these models under worst-case assumptions about transition uncertainty. Specifically, we develop the underlying theoretical foundations and efficient algorithms, for finite- and infinite-horizon objectives in both zero-sum and nonzero-sum settings, the latter based on (social-welfare optimal) Nash equilibria. We build an implementation in the PRISM-games model checker and demonstrate the feasibility of robust verification of ICSGs across a selection of large benchmarks.

cs.LO↗

arXiv2024

All In: Give me your money!

We present a computer assisted proof for a result concerning a three player betting game, introduced by Angel and Holmes. The three players start with initial capital $x, y, z > 0$ respectively. At each step of this game two players are selected at random to bet on the outcome of a fair coin toss, with the size of the bet being the largest possible, namely the total capital held by the poorer of the two players at that time. The main quantity of interest is the probability of player 1 being eliminated (reaching 0 capital) first. Angel and Holmes have shown that this probability is not monotone decreasing as a function of the initial capital $x$ of player 1. They conjecture that if $x < y < z$ then player 1 would be better off (less likely to be eliminated first) by swapping their capital with another player. In this paper we present a computer-assisted proof of this conjecture. To achieve this, we introduce the theoretical framework MeshItUp, and then perform a two-stage reduction to make MeshItUp computationally feasible, through the use of mixed-integer programming.

math.PR↗