arXiv subjects

Thomas Read

Publications and source records attributed to Thomas Read.

4 recordsLinked to original sources

arXiv2026

Interactions Between Crosscoder Features: A Compact Proofs Perspective

Dictionary learning methods like Sparse Autoencoders (SAEs) and crosscoders attempt to explain a model by decomposing its activations into independent features. Interactions between features hence induce errors in the reconstruction. We formalize this intuition via compact proofs and make five contributions. First, we show how, \textit{in principle}, a compact proof of model performance can be constructed using a crosscoder. Second, we show that an error term arising in this proof can naturally be interpreted as a measure of interaction between crosscoder features and provide an explicit expression for the interaction term in the Multi-Layer Perceptron (MLP) layers. We then provide three applications of this new interaction measure. In our third contribution we show that the interaction term itself can be used as a differentiable loss penalty. Applying this penalty, we can achieve ``computationally sparse'' crosscoders that retain $60\%$ of MLP performance when only keeping a single feature at each datapoint and neuron, compared to $10\%$ in standard crosscoders. We then show that clustering according to our interaction measure provides semantically meaningful feature clusters, and finally that sleeper agents have significant interactions. Code is available at https://github.com/chainik1125/crosscoders-feature-interactions/tree/arxiv.

cs.LG↗

arXiv2025

Auditing Games for Sandbagging

Future AI systems could conceal their capabilities ('sandbagging') during evaluations, potentially misleading developers and auditors. We stress-tested sandbagging detection techniques using an auditing game. First, a red team fine-tuned five models, some of which conditionally underperformed, as a proxy for sandbagging. Second, a blue team used black-box, model-internals, or training-based approaches to identify sandbagging models. We found that the blue team could not reliably discriminate sandbaggers from benign models. Black-box approaches were defeated by effective imitation of a weaker model. Linear probes, a model-internals approach, showed more promise but their naive application was vulnerable to behaviours instilled by the red team. We also explored capability elicitation as a strategy for detecting sandbagging. Although Prompt-based elicitation was not reliable, training-based elicitation consistently elicited full performance from the sandbagging models, using only a single correct demonstration of the evaluation task. However the performance of benign models was sometimes also raised, so relying on elicitation as a detection strategy was prone to false-positives. In the short-term, we recommend developers remove potential sandbagging using on-distribution training for elicitation. In the longer-term, further research is needed to ensure the efficacy of training-based elicitation, and develop robust methods for sandbagging detection. We open source our model organisms at https://github.com/AI-Safety-Institute/sandbagging_auditing_games and select transcripts and results at https://huggingface.co/datasets/sandbagging-games/evaluation_logs . A demo illustrating the game can be played at https://sandbagging-demo.far.ai/ .

cs.AI↗

arXiv2024

On the geometric fixed points of the real topological cyclic homology of $\mathbb{Z}/4$

We study the homotopy groups of the geometric fixed points of the real topological cyclic homology of $\mathbb{Z}/4$. We relate these groups to the values of the non-abelian derived functors of the functor $M \mapsto (M \otimes_{\mathbb{Z}/4} M)^{C_2}$ at the $\mathbb{Z}/4$-module $\mathbb{Z}/2$, which we precisely calculate with computer assistance up to degree $6$, and calculate in general up to slight remaining ambiguity. Using these results we compute $\pi_i(\mathrm{TCR}(\mathbb{Z}/4)^{\phi \mathbb{Z}/2})$ exactly for $i \le 1$, up to an extension problem for $2 \le i \le 5$, and describe the asymptotic growth of this group for large $i$. A consequence of these computations is that there exists some $0 \le i \le 5$ such that the canonical map comparing the genuine symmetric and symmetric $L$-theory spectra of $\mathbb{Z}/4$ is not an isomorphism on degree $i$ homotopy, and moreover this comparison map is never an isomorphism on homotopy in sufficiently large degrees.

math.AT↗

arXiv2023

G-typical Witt vectors with coefficients and the norm

For a profinite group $G$ we describe an abelian group $W_G(R; M)$ of $G$-typical Witt vectors with coefficients in an $R$-module $M$ (where $R$ is a commutative ring). This simultaneously generalises the ring $W_G(R)$ of Dress and Siebeneicher and the Witt vectors with coefficients $W(R; M)$ of Dotto, Krause, Nikolaus and Patchkoria, both of which extend the usual Witt vectors of a ring. We use this new variant of Witt vectors to give a purely algebraic description of the zeroth equivariant stable homotopy groups of the Hill-Hopkins-Ravenel norm $N_{\{e\}}^G(X)$ of a connective spectrum $X$, for any finite group $G$. Our construction is reasonably analogous to the constructions of previous variants of Witt vectors, and as such is amenable to fairly explicit concrete computations.

math.AT↗