arXiv subjects

Benjamin Hoffman

Publications and source records attributed to Benjamin Hoffman.

At least 19 recordsLinked to original sources

arXiv2026

Evaluating Agentic Configuration Repair for Computer Networks

Misconfigurations in computer networks remain a major source of critical Internet outages. Research is turning to Large Language Models (LLMs) to automate the complex, error-prone task of network configuration. However, even state-of-the-art models fail to resolve misconfigurations in large-scale, complex scenarios and often introduce new errors. In this work, we benchmark open- and closed-source LLMs augmented with formal network verification and context retrieval tools. We demonstrate that agentic architectures outperform base LLMs in repair efficacy (by 12% on average) and safety (by 17% on average), enabled by the ability to dynamically manage context and iteratively validate configuration repairs.

cs.AI↗

arXiv2026

Multi-layer attentive probing improves transfer of audio representations for bioacoustics

Probing heads map the representations learned from audio by a machine learning model to downstream task labels and are a key component in evaluating representation learning. Most bioacoustic benchmarks use a fixed, low-capacity probe, such as a linear layer on the final encoder layer. While this standardization enables model comparisons, it may bias results by overlooking the interaction between encoder features and probe design. In this work, we systematically study different probing strategies across two bioacoustic benchmarks, BEANs and BirdSet. We evaluate last- and multi-layer probing, across linear and attention probes. We show that larger probe heads that leverage time information have superior performance. Our results suggest that current benchmarks may misrepresent encoder quality when relying on a last-layer probing setup. Multi-layer probing improves downstream task performance across all tested models, while attention probing has superior performance to linear probing for transformer models.

cs.SD↗

arXiv2026

Benchmarking LLM-Driven Network Configuration Repair

There is a rapidly growing interest in using Large Language Models (LLMs) to automate complex network operations, but their reliable adoption requires rigorous assessment of their effectiveness and safety. Existing benchmarks do not address whether LLMs can successfully resolve errors in large-scale, interdependent network configurations without introducing new disruptions. Developing such a benchmark is challenging: scenarios must be diverse and increasingly complex, yet their evaluation must be straightforward and meaningful. In this paper, we present Cornetto, the first benchmark to evaluate LLM-driven network configuration repair functionally and at scale. Cornetto features a generation pipeline that synthesizes representative and plausible misconfiguration scenarios, coupled with an evaluation framework that uses formal verification to assess functional correctness of proposed fixes against ground-truth specifications. Using this pipeline, we synthesize a dataset of 231 problems for fixing configurations across varying network topologies (20--754 nodes) and diverse protocols. We evaluate 9 state-of-the-art LLMs and find that while they show promise, they often introduce regressions and their performance degrades at scale. Our results indicate that reliable LLM-powered network automation requires integrating LLMs into iterative workflows guided by formal verification.

cs.NI↗

arXiv2025

AVEX: What Matters for Animal Vocalization Encoding

Bioacoustics, the study of sounds produced by living organisms, plays a vital role in conservation, biodiversity monitoring, and behavioral studies. Many tasks in this field, such as species, individual, and behavior classification and detection, are well-suited to machine learning. However, they often suffer from limited annotated data, highlighting the need for a general-purpose bioacoustic encoder capable of extracting useful representations for diverse downstream tasks. Such encoders have been proposed before, but are often limited in scope due to a focus on a narrow range of species (typically birds), and a reliance on a single model architecture or training paradigm. Moreover, they are usually evaluated on a small set of tasks and datasets. In this work, we present a large-scale empirical study that covers aspects of bioacoustics that are relevant to research but have previously been scarcely considered: training data diversity and scale, model architectures and training recipes, and the breadth of evaluation tasks and datasets. We obtain encoders that are state-of-the-art on the existing and proposed benchmarks. We also identify what matters for training these encoders, such that this work can be extended when more data are available or better architectures are proposed. Specifically, across 26 datasets with tasks including species classification, detection, individual ID, and vocal repertoire discovery, we find self-supervised pre-training followed by supervised post-training on a mixed bioacoustics + general-audio corpus yields the strongest in- and out-of-distribution performance. We show the importance of data diversity in both stages. To support ongoing research and application, we will release the model checkpoints.

cs.SD↗

arXiv2025

Robust detection of overlapping bioacoustic sound events

We propose a method for accurately detecting bioacoustic sound events that is robust to overlapping events, a common issue in domains such as ethology, ecology and conservation. While standard methods employ a frame-based, multi-label approach, we introduce an onset-based detection method which we name Voxaboxen. It takes inspiration from object detection methods in computer vision, but simultaneously takes advantage of recent advances in self-supervised audio encoders. For each time window, Voxaboxen predicts whether it contains the start of a vocalization and how long the vocalization is. It also does the same in reverse, predicting whether each window contains the end of a vocalization, and how long ago it started. The two resulting sets of bounding boxes are then fused using a graph-matching algorithm. We also release a new dataset designed to measure performance on detecting overlapping vocalizations. This consists of recordings of zebra finches annotated with temporally-strong labels and showing frequent overlaps. We test Voxaboxen on seven existing data sets and on our new data set. We compare Voxaboxen to natural baselines and existing sound event detection methods and demonstrate SotA results. Further experiments show that improvements are robust to frequent vocalization overlap.

cs.SD↗

arXiv2025

Synthetic data enables context-aware bioacoustic sound event detection

We propose a methodology for training foundation models that enhances their in-context learning capabilities within the domain of bioacoustic signal processing. We use synthetically generated training data, introducing a domain-randomization-based pipeline that constructs diverse acoustic scenes with temporally strong labels. We generate over 8.8 thousand hours of strongly-labeled audio and train a query-by-example, transformer-based model to perform few-shot bioacoustic sound event detection. Our second contribution is a public benchmark of 13 diverse few-shot bioacoustics tasks. Our model outperforms previously published methods, and improves relative to other training-free methods by $64\%$. We demonstrate that this is due to increase in model size and data scale, as well as algorithmic improvements. We make our trained model available via an API, to provide ecologists and ethologists with a training-free tool for bioacoustic sound event detection.

cs.SD↗

arXiv2025

Learning More With Less: Sample Efficient Model-Based RL for Loco-Manipulation

By combining the agility of legged locomotion with the capabilities of manipulation, loco-manipulation platforms have the potential to perform complex tasks in real-world applications. To this end, state-of-the-art quadrupeds with manipulators, such as the Boston Dynamics Spot, have emerged to provide a capable and robust platform. However, the complexity of loco-manipulation control, as well as the black-box nature of commercial platforms, pose challenges for deriving accurate dynamics models and robust control policies. To address these challenges, we turn to model-based reinforcement learning (RL). We develop a hand-crafted kinematic model of a quadruped-with-arm platform which - employing recent advances in Bayesian Neural Network (BNN)-based learning - we use as a physical prior to efficiently learn an accurate dynamics model from limited data. We then leverage our learned model to derive control policies for loco-manipulation via RL. We demonstrate the effectiveness of our approach on state-of-the-art hardware using the Boston Dynamics Spot, accurately performing dynamic end-effector trajectory tracking even in low data regimes. Project website and videos: https://sites.google.com/view/learning-more-with-less.

cs.RO↗

arXiv2024

Biodenoising: Animal Vocalization Denoising without Access to Clean Data

Animal vocalization denoising is a task similar to human speech enhancement, which is relatively well-studied. In contrast to the latter, it comprises a higher diversity of sound production mechanisms and recording environments, and this higher diversity is a challenge for existing models. Adding to the challenge and in contrast to speech, we lack large and diverse datasets comprising clean vocalizations. As a solution we use as training data pseudo-clean targets, i.e. pre-denoised vocalizations, and segments of background noise without a vocalization. We propose a train set derived from bioacoustics datasets and repositories representing diverse species, acoustic environments, geographic regions. Additionally, we introduce a non-overlapping benchmark set comprising clean vocalizations from different taxa and noise samples. We show that that denoising models (demucs, CleanUNet) trained on pseudo-clean targets obtained with speech enhancement models achieve competitive results on the benchmarking set. We publish data, code, libraries, and demos at https://earthspecies.github.io/biodenoising/.

cs.SD↗

arXiv2023

A benchmark for computational analysis of animal behavior, using animal-borne tags

Animal-borne sensors (`bio-loggers') can record a suite of kinematic and environmental data, which are used to elucidate animal ecophysiology and improve conservation efforts. Machine learning techniques are used for interpreting the large amounts of data recorded by bio-loggers, but there exists no common framework for comparing the different machine learning techniques in this domain. This makes it difficult to, for example, identify patterns in what works well for machine learning-based analysis of bio-logger data. It also makes it difficult to evaluate the effectiveness of novel methods developed by the machine learning community. To address this, we present the Bio-logger Ethogram Benchmark (BEBE), a collection of datasets with behavioral annotations, as well as a modeling task and evaluation metrics. BEBE is to date the largest, most taxonomically diverse, publicly available benchmark of this type. Using BEBE, we compare the performance of deep and classical machine learning methods for identifying animal behaviors based on bio-logger data. As an example usage of BEBE, we test an approach based on self-supervised learning. To apply this approach to animal behavior classification, we adapt a deep neural network pre-trained with 700,000 hours of data collected from human wrist-worn accelerometers. We find that deep neural networks out-perform the classical machine learning methods we tested across all nine datasets in BEBE. We additionally find that the approach based on self-supervised learning out-performs the alternatives we tested, especially in settings when there is a low amount of training data available. In light of this, we are able to make concrete suggestions for designing studies that rely on machine learning to infer behavior from bio-logger data. Datasets and code are available at https://github.com/earthspecies/BEBE.

cs.LG↗

arXiv2022

BEANS: The Benchmark of Animal Sounds

The use of machine learning (ML) based techniques has become increasingly popular in the field of bioacoustics over the last years. Fundamental requirements for the successful application of ML based techniques are curated, agreed upon, high-quality datasets and benchmark tasks to be learned on a given dataset. However, the field of bioacoustics so far lacks such public benchmarks which cover multiple tasks and species to measure the performance of ML techniques in a controlled and standardized way and that allows for benchmarking newly proposed techniques to existing ones. Here, we propose BEANS (the BEnchmark of ANimal Sounds), a collection of bioacoustics tasks and public datasets, specifically designed to measure the performance of machine learning algorithms in the field of bioacoustics. The benchmark proposed here consists of two common tasks in bioacoustics: classification and detection. It includes 12 datasets covering various species, including birds, land and marine mammals, anurans, and insects. In addition to the datasets, we also present the performance of a set of standard ML methods as the baseline for task performance. The benchmark and baseline code is made publicly available at \url{https://github.com/earthspecies/beans} in the hope of establishing a new standard dataset for ML-based bioacoustic research.

cs.SD↗

arXiv2020

Stratified Gradient Hamiltonian Vector Fields and Collective Integrable Systems

We construct completely integrable systems on the dual of the Lie algebra of any compact Lie group $K$ with respect to the standard Lie-Poisson structure. These systems generalize key properties of Gelfand-Zeitlin systems: A) the pullback to any Hamiltonian $K$-manifold defines a Hamiltonian torus action on an open dense subset, B) if the $K$-manifold is multiplicity-free, then the resulting torus action is \textit{completely} integrable, and C) the collective moment map has convexity and fiber connectedness properties. These systems generalize the relationship between Gelfand-Zeitlin systems and Gelfand-Zeitlin canonical bases via geometric quantization by a real polarization. To construct these systems, we generalize Harada and Kaveh's construction of integrable systems by toric degeneration on smooth projective varieties to singular quasi-projective varieties. Under certain conditions, we show that the stratified-gradient Hamiltonian vector field of such a degeneration, which is defined piece-wise, has a flow whose limit exists and defines continuous degeneration map.

math.SG↗

arXiv2020

Action-angle coordinates on coadjoint orbits and multiplicity free spaces from partial tropicalization

Coadjoint orbits and multiplicity free spaces of compact Lie groups are important examples of symplectic manifolds with Hamiltonian groups actions. Constructing action-angle variables on these spaces is a challenging task. A fundamental result in the field is the Guillemin-Sternberg construction of Gelfand-Zeitlin integrable systems for the groups $K=U(n), SO(n)$. Extending these results to groups of other types is one of the goals of this paper. Partial tropicalizations are Poisson spaces with constant Poisson bracket built using techniques of Poisson-Lie theory and the geometric crystals of Berenstein-Kazhdan. They provide a bridge between dual spaces of Lie algebras ${\rm Lie}(K)^*$ with linear Poisson brackets and polyhedral cones which parametrize the canonical bases of irreducible modules of $G=K^\mathbb{C}$. We generalize the construction of partial tropicalizations to allow for arbitrary cluster charts, and apply it to questions in symplectic geometry. For each regular coadjoint orbit of a compact group $K$, we construct an exhaustion by symplectic embeddings of toric domains. As a by product we arrive at a conjectured formula for Gromov width of regular coadjoint orbits. We prove similar results for multiplicity free $K$-spaces.

math.SG↗

arXiv2020

Toric Symplectic Stacks

We give an intrinsic definition of toric symplectic stacks, and show that they are classified by simple convex polytopes equipped with some additional combinatorial data. This generalizes Delzant's classification of toric symplectic manifolds. As an application, we show that any toric symplectic stack can be deformed to an ineffective toric orbifold.

math.SG↗

arXiv2019

Concentration of symplectic volumes on Poisson homogeneous spaces

For a compact Poisson-Lie group $K$, the homogeneous space $K/T$ carries a family of symplectic forms $ω_ξ^s$, where $ξ\in \mathfrak{t}^*_+$ is in the positive Weyl chamber and $s \in \mathbb{R}$. The symplectic form $ω_ξ^0$ is identified with the natural $K$-invariant symplectic form on the $K$ coadjoint orbit corresponding to $ξ$. The cohomology class of $ω_ξ^s$ is independent of $s$ for a fixed value of $ξ$. In this paper, we show that as $s\to -\infty$, the symplectic volume of $ω_ξ^s$ concentrates in arbitrarily small neighbourhoods of the smallest Schubert cell in $K/T \cong G/B$. This strengthens earlier results [9,10] and is a step towards a conjectured construction of global action-angle coordinates on $Lie(K)^*$ [4, Conjecture 1.1].

math.SG↗

arXiv2019

Langlands Duality and Poisson-Lie Duality via Cluster Theory and Tropicalization

Let $G$ be a connected semisimple Lie group. There are two natural duality constructions that assign to it the Langlands dual group $G^\vee$ and the Poisson-Lie dual group $G^*$. The main result of this paper is the following relation between these two objects: the integral cone defined by the cluster structure and the Berenstein-Kazhdan potential on the double Bruhat cell $G^{\vee; w_0, e} \subset G^\vee$ is isomorphic to the integral Bohr-Sommerfeld cone defined by the Poisson structure on the partial tropicalization of $K^* \subset G^*$ (the Poisson-Lie dual of the compact form $K \subset G$). By [5], the first cone parametrizes the canonical bases of irreducible $G$-modules. The corresponding points in the second cone belong to integral symplectic leaves of the partial tropicalization labeled by the highest weight of the representation. As a by-product of our construction, we show that symplectic volumes of generic symplectic leaves in the partial tropicalization of $K^*$ are equal to symplectic volumes of the corresponding coadjoint orbits in $\operatorname{Lie}(K)^*$. To achieve these goals, we make use of (Langlands dual) double cluster varieties defined by Fock and Goncharov [9]. These are pairs of cluster varieties whose seed matrices are transpose to each other. There is a naturally defined isomorphism between their tropicalizations. The isomorphism between the cones described above is a particular instance of such an isomorphism associated to the double Bruhat cells $G^{w_0, e} \subset G$ and $G^{\vee; w_0, e} \subset G^\vee$.

math.RT↗

arXiv2018

Stacky Hamiltonian actions and symplectic reduction

We introduce the notion of a Hamiltonian action of an \'etale Lie group stack on an \'etale symplectic stack and establish versions of the Kirwan convexity theorem, the Meyer-Marsden-Weinstein symplectic reduction theorem, and the Duistermaat-Heckman theorem in this context.

math.SG↗

arXiv2018

Poisson Structures and Potentials

We introduce a notion of weakly log-canonical Poisson structures on positive varieties with potentials. Such a Poisson structure is log-canonical up to terms dominated by the potential. To a compatible real form of a weakly log-canonical Poisson variety we assign an integrable system on the product of a certain real convex polyhedral cone (the tropicalization of the variety) and a compact torus. We apply this theory to the dual Poisson-Lie group $G^*$ of a simply-connected semisimple complex Lie group $G$. We define a positive structure and potential on $G^*$ and show that the natural Poisson-Lie structure on $G^*$ is weakly log-canonical with respect to this positive structure and potential. For $K \subset G$ the compact real form, we show that the real form $K^* \subset G^*$ is compatible and prove that the corresponding integrable system is defined on the product of the decorated string cone and the compact torus of dimension $\frac{1}{2}({\rm dim} \, G - {\rm rank} \, G)$.

math.RT↗

arXiv2013

A note on triangulations of sum sets

For finite sets A and B in the plane, we write A+B to denote the set of sums of the elements of A and B. In addition, we write tr(A) to denote the common number of triangles in any triangulation of the convex hull of A using the points of A as vertices. We consider the conjecture that tr(A+B)^{1/2}\geq tr(A)^{1/2}+tr(B)^{1/2}. If true, this conjecture would be a discrete, two-dimensional analogue to the Brunn-Minkowski inequality. We prove the conjecture in three special cases.

math.NT↗