arXiv ScienceSearch

arXiv subjects

Jonathan P. Shock

Publications and source records attributed to Jonathan P. Shock.

At least 19 recordsLinked to original sources

Interoceptive Attention as Dynamic Homeostatic Prioritization in a Foraging Agent

Biological systems must regulate competing needs under limited perceptual bandwidth, where sharpening one estimate costs the capacity to sharpen the others. Any fixed-budget system therefore has to decide where to allocate its perceptual precision. We study this in a foraging agent that must keep several bodily needs satisfied to survive, modelled with active inference. At each step it reads its own body-state beliefs, identifies the most-needed channel, and reallocates a fixed budget of interoceptive precision toward it, so that the same precision-shaped likelihood feeds both belief update and planning. In AffectWorld, a four-channel foraging gridworld, this selective allocation more than doubles learning-phase survival at matched budget against a uniform-precision agent ($0.414$ vs $0.199$ across 11 layouts, $n{=}32$ seeds each, paired cluster-bootstrap $p \leq 10^{-4}$). Two further results sharpen the mechanism. The benefit runs through planning as well as perception, since denying the shaped likelihood to the planner alone removes about half of it. It is also need-aligned, since aiming precision at the least-needed channel does worse than spreading it evenly. The attended channel additionally learns its own dynamics about twice as fast, and stays ahead even at matched observation count, a behavioural trace of the same precision routing, visible in learning speed, not survival.

cs.AI

Predictable Confabulations: Factual Recall by LLMs Scales with Model Size and Topic Frequency

While scaling laws govern aggregate large language model performance, no scaling law has linked factual recall to both model size and training-data composition. We evaluated 38 models on over 8,900 scholarly references evaluated by an automated reference verification system. Recall quality follows a sigmoid in the log-linear combination of model parameter count and topic representation in training data. These two variables alone explain 60% of the variance across 16 dense models from four families, rising to 74-94% within individual families. The form matches a superposition-inspired account in which recall is gated by a signal-to-noise ratio: signal strength scales with concept frequency and the noise floor with model capacity.

cs.CL

Spinning Billiards and Chaos

We investigate the impact of internal spin on chaos in billiard systems. Extending the standard point-particle billiard by coupling translational and rotational degrees of freedom through a dimensionless spin parameter $\alpha = I/(mr^2) \in [0,1]$, we find that spin reduces chaos monotonically but does not eliminate it. In the Bunimovich stadium and Sinai billiard, the Lyapunov exponent decreases with $\alpha$ but remains positive throughout the physical range, while the circle and rectangle remain integrable. Finite-time Lyapunov exponent distributions reveal a mixed phase space in which spin creates islands of regularity while the majority of trajectories remain chaotic. The mechanism is a conserved quantity $Q = v_\parallel - \alpha u$ preserved through each collision, which constrains the dynamics on sequences of same-orientation wall collisions and explains why spin suppresses chaos more effectively in geometries with longer flat sections. We further show that the Datseris--Hupe--Fleischmann scaling $\lambda \propto 1/f_{\rm chaotic}$ fails for spinning billiards: spin reduces the intensity of chaos, not merely the fraction of chaotic trajectories.

nlin.CD

Thermodynamics and DC conductivity of 2D anisotropic fluids from axion holography

We investigate a strongly coupled finite-density anisotropic fluid in $2+1$ dimensions dual to an asymptotically AdS black brane that is a solution of Einstein-Maxwell-Axion theory in $3+1$ dimensions. Despite the anisotropy, the fluid thermodynamic properties align with those of a conformal fluid. Moreover, we show that the fluid is stable under the increase of the anisotropy parameter. Additionally, we analyse the DC conductivity of the anisotropic fluid, showing its compatibility with momentum dissipation due to translational symmetry breaking. In the limit of very large anisotropy we find that the DC conductivity vanishes as a consequence of dimensionality reduction. We also find that a metal-insulator transition arises driven by the anisotropy.

hep-th

Opportunities of Reinforcement Learning in South Africa's Just Transition

South Africa stands at a crucial juncture, grappling with interwoven socio-economic challenges such as poverty, inequality, unemployment, and the looming climate crisis. The government's Just Transition framework aims to enhance climate resilience, achieve net-zero greenhouse gas emissions by 2050, and promote social inclusion and poverty eradication. According to the Presidential Commission on the Fourth Industrial Revolution, artificial intelligence technologies offer significant promise in addressing these challenges. This paper explores the overlooked potential of Reinforcement Learning (RL) in supporting South Africa's Just Transition. It examines how RL can enhance agriculture and land-use practices, manage complex, decentralised energy networks, and optimise transportation and logistics, thereby playing a critical role in achieving a just and equitable transition to a low-carbon future for all South Africans. We provide a roadmap as to how other researchers in the field may be able to contribute to these pressing problems.

cs.CY

Putting Data at the Centre of Offline Multi-Agent Reinforcement Learning

Offline multi-agent reinforcement learning (MARL) is an exciting direction of research that uses static datasets to find optimal control policies for multi-agent systems. Though the field is by definition data-driven, efforts have thus far neglected data in their drive to achieve state-of-the-art results. We first substantiate this claim by surveying the literature, showing how the majority of works generate their own datasets without consistent methodology and provide sparse information about the characteristics of these datasets. We then show why neglecting the nature of the data is problematic, through salient examples of how tightly algorithmic performance is coupled to the dataset used, necessitating a common foundation for experiments in the field. In response, we take a big step towards improving data usage and data awareness in offline MARL, with three key contributions: (1) a clear guideline for generating novel datasets; (2) a standardisation of over 80 existing datasets, hosted in a publicly available repository, using a consistent storage format and easy-to-use API; and (3) a suite of analysis tools that allow us to understand these datasets better, aiding further development.

cs.LG

Coordination Failure in Cooperative Offline MARL

Offline multi-agent reinforcement learning (MARL) leverages static datasets of experience to learn optimal multi-agent control. However, learning from static data presents several unique challenges to overcome. In this paper, we focus on coordination failure and investigate the role of joint actions in multi-agent policy gradients with offline data, focusing on a common setting we refer to as the 'Best Response Under Data' (BRUD) approach. By using two-player polynomial games as an analytical tool, we demonstrate a simple yet overlooked failure mode of BRUD-based algorithms, which can lead to catastrophic coordination failure in the offline setting. Building on these insights, we propose an approach to mitigate such failure, by prioritising samples from the dataset based on joint-action similarity during policy learning and demonstrate its effectiveness in detailed experiments. More generally, however, we argue that prioritised dataset sampling is a promising area for innovation in offline MARL that can be combined with other effective approaches such as critic and policy regularisation. Importantly, our work shows how insights drawn from simplified, tractable games can lead to useful, theoretically grounded insights that transfer to more complex contexts. A core dimension of offering is an interactive notebook, from which almost all of our results can be reproduced, in a browser.

cs.LG

Sophisticated Learning: A novel algorithm for active learning during model-based planning

We introduce Sophisticated Learning (SL), a planning-to-learn algorithm that embeds active parameter learning inside the Sophisticated Inference (SI) tree-search framework of Active Inference. Unlike SI -- which optimizes beliefs about hidden states -- SL also updates beliefs about model parameters within each simulated branch, enabling counterfactual reasoning about how future observations would improve subsequent planning. We compared SL with Bayes-adaptive Reinforcement Learning (BARL) agents as well as with its parent algorithm, SI. Using a biologically inspired seasonal foraging task in which resources shift probabilistically over a 10x10 grid, we designed experiments that forced agents to balance probabilistic reward harvesting against information gathering. In early trials, where rapid learning is vital, SL agents survive, on average, 8.2% longer than SI and 35% longer than Bayes-adaptive Reinforcement Learning. While both SL and SI showed equal convergence performance, SL reached this convergence 40% faster than SI. Additionally, SL showed robust out-performance of other algorithms in altered environment configurations. Our results show that incorporating active learning into multi-step planning materially improves decision making under radical uncertainty, and reinforces the broader utility of Active Inference for modeling biologically relevant behavior.

cs.AI

Magnetising the ${\cal N}=4$ Super Yang-Mills plasma

We investigate the thermodynamics of the anisotropic magnetic $\rm AdS_5$ black brane solution found by D'Hoker and Kraus arXiv:0908.3875. This solution is the gravity dual of a strongly coupled ${\cal N}=4$ Super Yang-Mills plasma in ${\mathbb R}^{3,1}$, with temperature $T$, in the presence of a magnetic field ${\cal B}$. Following the procedure of holographic renormalisation we calculate the Gibbs free energy and the holographic stress tensor of the conformal plasma. We evaluate several thermodynamic quantities including the magnetisation, the anisotropic pressures and the speeds of sound. Our results are consistent with an RG flow from a perturbed $\rm AdS_5$ black brane at small ${\cal B}/T^2$ to a $\rm \bf BTZ \times {\mathbb R}^2$ black brane at large ${\cal B}/T^2$. We also perform a phenomenological analysis where we compare the thermodynamics of a magnetised conformal plasma against the lattice QCD results for the thermodynamics of the magnetised quark-gluon plasma.

hep-th

Remarks on Fermions in a Dipole Magnetic Field

This work is a continuation of our recent study of non-relativistic charged particles, confined to a sphere enclosing a magnetic dipole at its center. In this sequel, we extend our computations in two significant ways. The first is to a relativistic spin-$\frac{1}{2}$ fermion and the second concerns the interpretation of the physics. Whereas in a previous paper, we speculated on the possibility of observing such condensed matter systems in the astrophysics of extreme magnetic sources such as neutron stars, the physical systems in this study are more down-to-earth objects such as a $\mathsf{C}_{60}$ fullerine enclosing a current loop. We unpack some of the details of our previous analysis for the spinless fermion on the dipole sphere and adapt it to solve the eigenvalue problem for the single-particle Dirac Hamiltonian. In the strong-field/small-radius limit, the spectrum of the spin-$\tfrac{1}{2}$ Hamiltonian, like the spinless case, exhibits a Landau level structure in the $|m|\ll Q$ regime. It features a new, additional (approximately) zero-energy lowest Landau level which persists into the $|m|<Q$ regime. As in the spinless system, the spectrum exhibits level-crossing as the strength of the magnetic field increases, with the wavefunctions localising at the poles in the strong-field/small-radius limit.

hep-th

Magnetic catalysis and the chiral condensate in holographic QCD

We investigate the effect of a non-zero magnetic field on the chiral condensate using a holographic QCD approach. We extend the model proposed by Iatrakis, Kiritsis and Paredes in arXiv:1010.1364 that realises chiral symmetry breaking dynamically from 5d tachyon condensation. We calculate the chiral condensate, magnetisation and susceptibilities for the confined and deconfined phases. The model leads, in the probe approximation, to magnetic catalysis of chiral symmetry breaking in both confined and deconfined phases. In the chiral limit, $m_q=0$, we find that in the deconfined phase a sufficiently strong magnetic field leads to a second order phase transition from the chirally restored phase to a chirally broken phase. The transition becomes a crossover as the quark mass increases. Due to a scaling in the temperature, the chiral transition will also be interpreted as a transition in the temperature for fixed magnetic field. We elaborate on the relationship between the chiral condensate, magnetisation and the (magnetic) free energy density. We compare our results at low and moderate temperatures temperatures with lattice QCD results.

hep-th

Notes on the Squashed Sphere Lowest Landau Level

In a recent article, we were motivated by the question of whether any of the remarkable condensed matter phenomena, such as the quantum Hall effect (QHE), the Integer quantum Hall effect (IQHE) etc., could potentially be observed in the extreme astrophysical environments of neutron stars. As a prequel to that work, and with the aim of understanding better the role of the geometry of the conducting surface on the structure of Landau levels, in this article we study the quantum dynamics of a quantum particle on a squashed sphere. More specifically, we study the dynamics of a single particle on an oblate squashed Haldane sphere i.e. a 2-sphere enclosing a single magnetic monopole at its center. While several features of the conventional Haldane sphere persist, by numerically solving the Schrodinger equation in this background, we find that the particle becomes increasingly localised in a band between the equator and the poles, with a corresponding increase of the eccentricity of the spheroid.

hep-th

Chaos and Scrambling in Quantum Small Worlds

Quantum small-worlds are quantum many-body systems that interpolate between completely ordered (nearest-neighbour, next-to-nearest-neighbour etc.) and completely random interactions. As such, they furnish a novel new laboratory to study quantum systems transitioning between regular and chaotic behaviour. In this article, we introduce the idea of a quantum small-world network by starting from a well understood integrable system, a spin-1 Heisenberg chain. We then inject a small number of long-range interactions into the spin chain and study its ability to scramble quantum information using two primary devices: the out-of-time-order correlator (OTOC) and the spectral form factor (SFF). We find that the system shows increasingly rapid scrambling as its interactions become progressively more random, with no evidence of quantum chaos.

hep-th

Astrophysical Quantum Matter: Spinless charged particles on a magnetic dipole sphere

We consider the quantum mechanics of a spinless charged particle on a 2-dimensional sphere. When threaded with a magnetic monopole field, this is the well-known Haldane sphere that furnishes a translationally-invariant, incompressible quantum fluid state of a gas of electrons confined to the sphere. This letter presents the results of a novel variant of the Haldane solution where the monopole field is replaced by that of a dipole. We argue that this system is relevant to the physics on the surface of compact astrophysical objects like neutron stars.

hep-th

A universal order parameter for Inverse Magnetic Catalysis

We revisit the chiral transition in the finite density Sakai-Sugimoto model and find that, at fixed temperature $T$, the magnetisation near the critical line $\mu_c(B)$ acts as an order parameter to distinguish Inverse Magnetic Catalysis from Magnetic Catalysis. Moreover, we propose a universal relation between $\mu_c (B)$ and the magnetisation that allows us to predict the behaviour of the former from the behaviour of the latter. We find that a similar relation holds, at fixed chemical potential $\mu$, for the critical line $T_c(B)$. Our results are obtained by investigating a fully numerical solution to the relevant equations. At low temperatures our results reduce to those obtained by Preis, Rebhan and Schmitt [JHEP 1103 (2011) 033], based on a semi-analytic approximation.

hep-th

Quantum discord in de Sitter space

We study quantum discord between two free modes of a massive scalar field in a maximally entangled state in de Sitter space. We introduce two observers, one in a global chart and the other in an open chart of de Sitter space, and the observers determine the quantum discord created by each detecting one of the modes. This situation is analogous to the relationship between an observer in a Minkowski chart and another in one of the two Rindler charts in flat space. We find that the state becomes less entangled as the curvature of the open chart gets larger. In particular, for the cases of a massless, and a conformally coupled scalar field, the entanglement vanishes in the limit of infinite curvature. However, we find that the quantum discord never disappears even in the limit that entanglement disappears.

hep-th

Probability Density Functions from the Fisher Information Metric

We show a general relation between the spatially disjoint product of probability density functions and the sum of their Fisher information metric tensors. We then utilise this result to give a method for constructing the probability density functions for an arbitrary Riemannian Fisher information metric tensor. We note further that this construction is extremely unconstrained, depending only on certain continuity properties of the probability density functions and a select symmetry of their domains.

cs.IT

Entanglement negativity in the multiverse

We explore quantum entanglement between two causally disconnected regions in the multiverse. We first consider a free massive scalar field, and compute the entanglement negativity between two causally separated open charts in de Sitter space. The qualitative feature of it turns out to be in agreement with that of the entanglement entropy. We then introduce two observers who determine the entanglement between two causally disconnected de Sitter spaces. When one of the observers remains constrained to a region of the open chart in a de Sitter space, we find that the scale dependence enters into the entanglement. We show that a state which is initially maximally entangled becomes more entangled or less entangled on large scales depending on the mass of the scalar field and recovers the initial entanglement in the small scale limit. We argue that quantum entanglement may provide some evidence for the existence of the multiverse.

hep-th