arXiv ScienceSearch

arXiv subjects

David Berman

Publications and source records attributed to David Berman.

7 recordsLinked to original sources

Towards Worst-Case Guarantees with Scale-Aware Interpretability

Neural networks organize information according to the hierarchical, multi-scale structure of natural data. Methods to interpret model internals should be similarly scale-aware, explicitly tracking how features compose across resolutions and guaranteeing bounds on the influence of fine-grained structure that is discarded as irrelevant noise. We posit that the renormalisation framework from physics can meet this need by offering technical tools that can overcome limitations of current methods. Moreover, relevant work from adjacent fields has now matured to a point where scattered research threads can be synthesized into practical, theory-informed tools. To combine these threads in an AI safety context, we propose a unifying research agenda -- \emph{scale-aware interpretability} -- to develop formal machinery and interpretability tools that have robustness and faithfulness properties supported by statistical physics.

hep-th

Teaming LLMs to Detect and Mitigate Hallucinations

Recent work has demonstrated state-of-the-art results in large language model (LLM) hallucination detection and mitigation through consistency-based approaches which involve aggregating multiple responses sampled from a single LLM for a given prompt. These approaches help offset limitations stemming from the imperfect data on which LLMs are trained, which includes biases and under-representation of information required at deployment time among other limitations which can lead to hallucinations. We show that extending these single-model consistency methods to combine responses from multiple LLMs with different training data, training schemes and model architectures can result in substantial further improvements in hallucination detection and mitigation capabilities beyond their single-model consistency counterparts. We evaluate this "consortium consistency" approach across many model teams from a pool of 15 LLMs and explore under what conditions it is beneficial to team together different LLMs in this manner. Further, we show that these performance improvements often come with reduced inference costs, offsetting a significant drawback with single-model consistency methods.

cs.LG

Vacua of $\omega$-deformed SO(8) supergravity

We perform a detailed analysis of the vacua of $\omega$-deformed SO(8) supergravity in four dimensions. In particular, using Tensorflow-based numerical methods, we track how the equilibria of the theory change when varying the electric-magnetic deformation parameter $\omega$. Apart from describing various properties of different equilibria (390 in total), we show that as $\omega$ is deformed, the SO(3), N=1 vacuum of the de Wit-Nicolai theory becomes equivalent to a critical point in $U(4)\ltimes\mathbb{R}^{12}$ gauged supergravity with a known uplift in IIB supergravity. The procedure employed here to obtain a new gauging with a guaranteed equilibrium is generic and allows one to obtain further admissible noncompact gaugings via $\omega$-deformation, all of which have guaranteed critical points, and some of which may be novel upliftable solutions.

hep-th

New N=1 AdS$_4$ solutions of type IIB supergravity

We construct analytically a new family of supersymmetric AdS$_4$ solutions of IIB supergravity, with the internal space provided by a deformed $S^5\times S^1$. The solutions preserve N=1 supersymmetry and an SO(3) subgroup of isometries of $S^5$, which is broken to U(1) along a flat direction. They are further parametrised by a winding number and a choice of SL(2) duality twist along the circle in an elliptic conjugacy class, thus including both globally geometric and S-fold configurations. We identify these solutions by first constructing a new family of vacua of D=4, $U(4)\ltimes\mathbb{R}^{12}$ gauged maximal supergravity and use exceptional field theory to perform the uplift to ten dimensions. We discuss the relevance of D=5 Wilson loops associated to preserved and broken gauge symmetries in the construction of these classes of solutions.

hep-th

Exotic branes in Exceptional Field Theory: the SL(5) duality group

We study how exotic branes, i.e. branes whose tensions are proportional to $g_s^{-\alpha}$, with $\alpha>2$, are realised in Exceptional Field Theory (EFT). The generalised torsion of the Weitzenb\"ock connection of the $\operatorname{SL}(5)$ EFT which, in the language of gauged supergravity describes the embedding tensor, is shown to classify the exotic branes whose magnetic fluxes can fit into four internal dimensions. By analysing the weight diagrams of the corresponding representations of $\operatorname{SL}(5)$ we determine the U-duality orbits relating geometric and non-geometric fluxes. As a further application of the formalism we consider the Kaluza-Klein monopole of 11D supergravity and rotate it into the exotic $6^{(3,1)}$-brane.

hep-th

Bit Patterned Magnetic Recording: Theory, Media Fabrication, and Recording Performance

Bit Patterned Media (BPM) for magnetic recording provide a route to densities $>1 Tb/in^2$ and circumvents many of the challenges associated with conventional granular media technology. Instead of recording a bit on an ensemble of random grains, BPM uses an array of lithographically defined isolated magnetic islands, each of which stores one bit. Fabrication of BPM is viewed as the greatest challenge for its commercialization. In this article we describe a BPM fabrication method which combines e-beam lithography, directed self-assembly of block copolymers, self-aligned double patterning, nanoimprint lithography, and ion milling to generate BPM based on CoCrPt alloys. This combination of fabrication technologies achieves feature sizes of $<10 nm$, significantly smaller than what conventional semiconductor nanofabrication methods can achieve. In contrast to earlier work which used hexagonal close-packed arrays of round islands, our latest approach creates BPM with rectangular bitcells, which are advantageous for integration with existing hard disk drive technology. The advantages of rectangular bits are analyzed from a theoretical and modeling point of view, and system integration requirements such as servo patterns, implementation of write synchronization, and providing for a stable head-disk interface are addressed in the context of experimental results. Optimization of magnetic alloy materials for thermal stability, writeability, and switching field distribution is discussed, and a new method for growing BPM islands on a patterned template is presented. New recording results at $1.6 Td/in^2$ (teradot/inch${}^2$, roughly equivalent to $1.3 Tb/in^2$) demonstrate a raw error rate $<10^{-2}$, which is consistent with the recording system requirements of modern hard drives. Extendibility of BPM to higher densities, and its eventual combination with energy assisted recording are explored.

cond-mat.other

A note on Quantum Aspects of Multiple Membranes

In this note we investigate quantum aspects of the newly proposed theory of multiple membranes put forward by Bagger and Lambert. In particular we analyse the possibility of a finite renormalisation of the coupling at one loop.

hep-th