arXiv subjects

Christopher Frye

Publications and source records attributed to Christopher Frye.

At least 19 recordsLinked to original sources

arXiv2024

Language hooks: a modular framework for augmenting LLM reasoning that decouples tool usage from the model and its prompt

Prompting and fine-tuning have emerged as two competing paradigms for augmenting language models with new capabilities, such as the use of tools. Prompting approaches are quick to set up but rely on providing explicit demonstrations of each tool's usage in the model's prompt, thus coupling tool use to the task at hand and limiting generalisation. Fine-tuning removes the need for task-specific demonstrations of tool usage at runtime; however, this ties new capabilities to a single model, thus making already-heavier setup costs a recurring expense. In this paper, we introduce language hooks, a novel framework for augmenting language models with new capabilities that is decoupled both from the model's task-specific prompt and from the model itself. The language hook algorithm interleaves text generation by the base model with the execution of modular programs that trigger conditionally based on the existing text and the available capabilities. Upon triggering, programs may call external tools, auxiliary language models (e.g. using tool specific prompts), and modify the existing context. We benchmark our method against state-of-the-art baselines, find that it outperforms task-aware approaches, and demonstrate its ability to generalise to novel tasks.

cs.CL↗

arXiv2023

Task-specific experimental design for treatment effect estimation

Understanding causality should be a core requirement of any attempt to build real impact through AI. Due to the inherent unobservability of counterfactuals, large randomised trials (RCTs) are the standard for causal inference. But large experiments are generically expensive, and randomisation carries its own costs, e.g. when suboptimal decisions are trialed. Recent work has proposed more sample-efficient alternatives to RCTs, but these are not adaptable to the downstream application for which the causal effect is sought. In this work, we develop a task-specific approach to experimental design and derive sampling strategies customised to particular downstream applications. Across a range of important tasks, real-world datasets, and sample sizes, our method outperforms other benchmarks, e.g. requiring an order-of-magnitude less data to match RCT performance on targeted marketing tasks.

stat.ME↗

arXiv2020

Representation Learning for High-Dimensional Data Collection under Local Differential Privacy

The collection of individuals' data has become commonplace in many industries. Local differential privacy (LDP) offers a rigorous approach to preserving privacy whereby the individual privatises their data locally, allowing only their perturbed datum to leave their possession. LDP thus provides a provable privacy guarantee to the individual against both adversaries and database administrators. Existing LDP mechanisms have successfully been applied to low-dimensional data, but in high dimensions the privacy-inducing noise largely destroys the utility of the data. In this work, our contributions are two-fold: first, by adapting state-of-the-art techniques from representation learning, we introduce a novel approach to learning LDP mechanisms. These mechanisms add noise to powerful representations on the low-dimensional manifold underlying the data, thereby overcoming the prohibitive noise requirements of LDP in high dimensions. Second, we introduce a novel denoising approach for downstream model learning. The training of performant machine learning models using collected LDP data is a common goal for data collectors, and downstream model performance forms a proxy for the LDP data utility. Our approach significantly outperforms current state-of-the-art LDP mechanisms.

cs.LG↗

arXiv2020

Human-interpretable model explainability on high-dimensional data

The importance of explainability in machine learning continues to grow, as both neural-network architectures and the data they model become increasingly complex. Unique challenges arise when a model's input features become high dimensional: on one hand, principled model-agnostic approaches to explainability become too computationally expensive; on the other, more efficient explainability algorithms lack natural interpretations for general users. In this work, we introduce a framework for human-interpretable explainability on high-dimensional data, consisting of two modules. First, we apply a semantically meaningful latent representation, both to reduce the raw dimensionality of the data, and to ensure its human interpretability. These latent features can be learnt, e.g. explicitly as disentangled representations or implicitly through image-to-image translation, or they can be based on any computable quantities the user chooses. Second, we adapt the Shapley paradigm for model-agnostic explainability to operate on these latent features. This leads to interpretable model explanations that are both theoretically controlled and computationally tractable. We benchmark our approach on synthetic data and demonstrate its effectiveness on several image-classification tasks.

cs.LG↗

arXiv2020

Explainability for fair machine learning

As the decisions made or influenced by machine learning models increasingly impact our lives, it is crucial to detect, understand, and mitigate unfairness. But even simply determining what "unfairness" should mean in a given context is non-trivial: there are many competing definitions, and choosing between them often requires a deep understanding of the underlying task. It is thus tempting to use model explainability to gain insights into model fairness, however existing explainability tools do not reliably indicate whether a model is indeed fair. In this work we present a new approach to explaining fairness in machine learning, based on the Shapley value paradigm. Our fairness explanations attribute a model's overall unfairness to individual input features, even in cases where the model does not operate on sensitive attributes directly. Moreover, motivated by the linearity of Shapley explainability, we propose a meta algorithm for applying existing training-time fairness interventions, wherein one trains a perturbation to the original model, rather than a new model entirely. By explaining the original model, the perturbation, and the fair-corrected model, we gain insight into the accuracy-fairness trade-off that is being made by the intervention. We further show that this meta algorithm enjoys both flexibility and stability benefits with no loss in performance.

cs.LG↗

arXiv2020

Shapley explainability on the data manifold

Explainability in AI is crucial for model development, compliance with regulation, and providing operational nuance to predictions. The Shapley framework for explainability attributes a model's predictions to its input features in a mathematically principled and model-agnostic way. However, general implementations of Shapley explainability make an untenable assumption: that the model's features are uncorrelated. In this work, we demonstrate unambiguous drawbacks of this assumption and develop two solutions to Shapley explainability that respect the data manifold. One solution, based on generative modelling, provides flexible access to data imputations; the other directly learns the Shapley value-function, providing performance and stability at the cost of flexibility. While "off-manifold" Shapley values can (i) give rise to incorrect explanations, (ii) hide implicit model dependence on sensitive attributes, and (iii) lead to unintelligible explanations in higher-dimensional data, on-manifold explainability overcomes these problems.

cs.LG↗

arXiv2019

Asymmetric Shapley values: incorporating causal knowledge into model-agnostic explainability

Explaining AI systems is fundamental both to the development of high performing models and to the trust placed in them by their users. The Shapley framework for explainability has strength in its general applicability combined with its precise, rigorous foundation: it provides a common, model-agnostic language for AI explainability and uniquely satisfies a set of intuitive mathematical axioms. However, Shapley values are too restrictive in one significant regard: they ignore all causal structure in the data. We introduce a less restrictive framework, Asymmetric Shapley values (ASVs), which are rigorously founded on a set of axioms, applicable to any AI system, and flexible enough to incorporate any causal structure known to be respected by the data. We demonstrate that ASVs can (i) improve model explanations by incorporating causal information, (ii) provide an unambiguous test for unfair discrimination in model predictions, (iii) enable sequentially incremental explanations in time-series models, and (iv) support feature-selection studies without the need for model retraining.

stat.ML↗

arXiv2019

Binary JUNIPR: an interpretable probabilistic model for discrimination

JUNIPR is an approach to unsupervised learning in particle physics that scaffolds a probabilistic model for jets around their representation as binary trees. Separate JUNIPR models can be learned for different event or jet types, then compared and explored for physical insight. The relative probabilities can also be used for discrimination. In this paper, we show how the training of the separate models can be refined in the context of classification to optimize discrimination power. We refer to this refined approach as Binary JUNIPR. Binary JUNIPR achieves state-of-the-art performance for quark/gluon discrimination and top-tagging. The trained models can then be analyzed to provide physical insight into how the classification is achieved. As examples, we explore differences between quark and gluon jets and between gluon jets generated with two different simulations.

hep-ph↗

arXiv2019

Parenting: Safe Reinforcement Learning from Human Input

Autonomous agents trained via reinforcement learning present numerous safety concerns: reward hacking, negative side effects, and unsafe exploration, among others. In the context of near-future autonomous agents, operating in environments where humans understand the existing dangers, human involvement in the learning process has proved a promising approach to AI Safety. Here we demonstrate that a precise framework for learning from human input, loosely inspired by the way humans parent children, solves a broad class of safety problems in this context. We show that our Parenting algorithm solves these problems in the relevant AI Safety gridworlds of Leike et al. (2017), that an agent can learn to outperform its parent as it "matures", and that policies learnt through Parenting are generalisable to new environments.

cs.AI↗

arXiv2018

Infrared Finiteness and Forward Scattering

Infrared divergences have long been heralded to cancel in sufficiently inclusive cross-sections, according to the famous Kinoshita-Lee-Nauenberg theorem which mandates an initial and final state sum. While well-motivated, this theorem is much weaker than necessary: for finiteness, one need only sum over initial $\textit{or}$ final states. Moreover, the cancellation generically requires the inclusion of the forward scattering process. We provide a number of examples showing the importance of this revised understanding: in $e^+e^- \to Z$ at next-to-leading order, one can sum over certain initial and final states with an arbitrary number of extra photons, or only over final states with a finite number of photons, if forward scattering is included. For Compton scattering, infrared finiteness requires the indistinguishability of hard forward-scattered electrons and photons. This implies that in addition to experimental limits on the energy and angular resolution, there must also be an experimental limit on the momentum at which electric charge can be observed. Similar considerations are required to explain why the rate for $\gamma \gamma$ to scatter into photons alone is infrared divergent but the rate for $\gamma \gamma$ to scatter into photons or charged particles is finite. This new understanding sheds light on the importance of including degenerate initial states in physical predictions, the relevance of disconnected Feynman diagrams, the importance of dressing initial or final-state charged particles, and the quest to properly define the $S$ matrix.

hep-ph↗

arXiv2018

JUNIPR: a Framework for Unsupervised Machine Learning in Particle Physics

In applications of machine learning to particle physics, a persistent challenge is how to go beyond discrimination to learn about the underlying physics. To this end, a powerful tool would be a framework for unsupervised learning, where the machine learns the intricate high-dimensional contours of the data upon which it is trained, without reference to pre-established labels. In order to approach such a complex task, an unsupervised network must be structured intelligently, based on a qualitative understanding of the data. In this paper, we scaffold the neural network's architecture around a leading-order model of the physics underlying the data. In addition to making unsupervised learning tractable, this design actually alleviates existing tensions between performance and interpretability. We call the framework JUNIPR: "Jets from UNsupervised Interpretable PRobabilistic models". In this approach, the set of particle momenta composing a jet are clustered into a binary tree that the neural network examines sequentially. Training is unsupervised and unrestricted: the network could decide that the data bears little correspondence to the chosen tree structure. However, when there is a correspondence, the network's output along the tree has a direct physical interpretation. JUNIPR models can perform discrimination tasks, through the statistically optimal likelihood-ratio test, and they permit visualizations of discrimination power at each branching in a jet's tree. Additionally, JUNIPR models provide a probability distribution from which events can be drawn, providing a data-driven Monte Carlo generator. As a third application, JUNIPR models can reweight events from one (e.g. simulated) data set to agree with distributions from another (e.g. experimental) data set.

hep-ph↗

arXiv2017

Casimir Meets Poisson: Improved Quark/Gluon Discrimination with Counting Observables

Charged track multiplicity is among the most powerful observables for discriminating quark- from gluon-initiated jets. Despite its utility, it is not infrared and collinear (IRC) safe, so perturbative calculations are limited to studying the energy evolution of multiplicity moments. While IRC-safe observables, like jet mass, are perturbatively calculable, their distributions often exhibit Casimir scaling, such that their quark/gluon discrimination power is limited by the ratio of quark to gluon color factors. In this paper, we introduce new IRC-safe counting observables whose discrimination performance exceeds that of jet mass and approaches that of track multiplicity. The key observation is that track multiplicity is approximately Poisson distributed, with more suppressed tails than the Sudakov peak structure from jet mass. By using an iterated version of the soft drop jet grooming algorithm, we can define a "soft drop multiplicity" which is Poisson distributed at leading-logarithmic accuracy. In addition, we calculate the next-to-leading-logarithmic corrections to this Poisson structure. If we allow the soft drop groomer to proceed to the end of the jet branching history, we can define a collinear-unsafe (but still infrared-safe) counting observable. Exploiting the universality of the collinear limit, we define generalized fragmentation functions to study the perturbative energy evolution of collinear-unsafe multiplicity.

hep-ph↗

arXiv2016

Factorization for groomed jet substructure beyond the next-to-leading logarithm

Jet grooming algorithms are widely used in experimental analyses at hadron colliders to remove contaminating radiation from within jets. While the algorithms perform a great service to the experiments, their intricate algorithmic structure and multiple parameters has frustrated precision theoretic understanding. In this paper, we demonstrate that one particular groomer called soft drop actually makes precision jet substructure easier. In particular, we derive a factorization formula for a large class of soft drop jet substructure observables, including jet mass. The essential observation that allows for this factorization is that, without the soft wide-angle radiation groomed by soft drop, all singular contributions are collinear. The simplicity and universality of the collinear limit in QCD allows us to show that to all orders, the normalized differential cross section has no contributions from non-global logarithms. It is also independent of process, up to the relative fraction of quark and gluon jets. In fact, soft drop allows us to define this fraction precisely. The factorization theorem also explains why soft drop observables are less sensitive to hadronization than their ungroomed counterparts. Using the factorization theorem, we resum the soft drop jet mass to next-to-next-to-leading logarithmic accuracy. This requires calculating some clustering effects that are closely related to corresponding effects found in jet veto calculations. We match our resummed calculation to fixed order results for both $e^+e^-\to$ dijets and $pp\to Z+j$ events, producing the first jet substructure predictions (groomed or ungroomed) to this accuracy for the LHC.

hep-ph↗

arXiv2016

Precision physics with pile-up insensitive observables

To deepen the search for beyond the Standard Model physics, the Large Hadron Collider is pushing to higher and higher luminosity. At high luminosity, precision physics becomes increasingly difficult due to contamination from additional proton collisions per bunch crossing called pile-up. In recent years, many methods have been developed to cull this excess mostly low-energy radiation away from important signal regions, but it has been unclear if these methods were amenable to systematically-improvable theoretical understanding. In this paper, it is shown that one such method, soft drop jet grooming, has excellent theoretical properties: it is ultra-local, depending on only radiation within a jet, and it is free of non-global logarithms. Calculations of the soft drop jet mass and related observables are presented at next-to-next-to-leading logarithmic accuracy matched to next-to-next-to-leading fixed-order in perturbative Quantum Chromodynamics. Once measured at the Large Hadron Collider, precision comparisons between theory and data can be made, essentially independent of the amount of pile-up contamination.

hep-ph↗

arXiv2015

Precision Diboson Observables for the LHC

Motivated by the restoration of $SU(2)\times U(1)$ at high energy, we suggest that certain ratios of diboson differential cross sections can be used as high-precision observables at the LHC. We rewrite leading-order diboson partonic cross sections in a form that makes their $SU(2)\times U(1)$ and custodial $SU(2)$ structure more explicit than in previous literature, and identify important aspects of this structure that survive even in hadronic cross sections. We then focus on higher-order corrections to ratios of $\gamma\gamma$, $Z\gamma$ and $ZZ$ processes, including full next-to-leading-order corrections and $gg$ initial-state contributions, and argue that these ratios can likely be predicted to better than $5\%$, which should make them useful in searches for new phenomena. The ratio of $Z\gamma$ to $\gamma\gamma$ is especially promising in the near term, due to large rates and to exceptional cancellations of QCD-related uncertainties. We argue that electroweak corrections are moderate in size, have small uncertainties, and can potentially be observed in these ratios in the long run.

hep-ph↗

arXiv2013

Stringy Corrections to the Classical Tests of General Relativity

String theory imposes modifications to Einstein's equations of classical general relativity. Consequently, we calculate the additional corrections to the classical tests: the perihelion precession of Mercury, the deflection of light rays by the sun, and the gravitational redshift which should be present if these modified equations hold. In each case, we determine --- quite consistently with expectations --- that the stringy effects are much too small to be measured.

hep-th↗

arXiv2013

String Theory has no Isotropic Solution for the Modified Einstein's Equations without the Dilaton

We investigate the modification to Einstein's vacuum field equations which is imposed by string theory when the dilaton field is ignored. Including the cosmological constant in all calculations, we prove that such a theory of gravity admits no static isotropic solution. We then show that any isotropic solution of the equations in question must necessarily be static, therefore proving that no isotropic solution exists for this stringy modification to gravity.

hep-th↗

arXiv2012

Spherical Harmonics in p Dimensions

The authors prepared this booklet in order to make several useful topics from the theory of special functions, in particular the spherical harmonics and Legendre polynomials for any dimension, available to undergraduates studying physics or mathematics. With this audience in mind, nearly all details of the calculations and proofs are written out, and extensive background material is covered before beginning the main subject matter. The reader is assumed to have knowledge of multivariable calculus and linear algebra as well as some level of comfort with reading proofs.

math.CA↗