arXiv ScienceSearch

arXiv subjects

Benjamin Barrett

Publications and source records attributed to Benjamin Barrett.

5 recordsLinked to original sources

How Small Can You Go? LoRA Fine-Tuning 270M-8B Models for Merchant Information Extraction in Financial Transactions

Merchant information extraction turns noisy financial transaction descriptors into structured fields at production scale. Our deployed LoRA-fine-tuned LLaMA~3.1-8B reaches 96.95\% F1, but its memory and throughput motivate smaller replacements. We evaluate 23 retained fine-tuning runs plus a separately trained production reference, spanning Gemma~3 (270M--4B), Qwen~3.5 (0.8B--4B), Aya~3.35B, and LLaMA~3.1-8B across LoRA ranks, prompts, training templates, and serving environments. A rank-8 LLaMA fine-tune reaches 96.75\% F1, only 0.20 points below the rank-32 production reference. Qwen~3.5~4B with JSON-Only prompting reaches 96.60\% F1 and strict record-level exact match of 91.67\%, with a $3.8\times$ lower inverse-throughput time estimate than the rank-8 8B model. Qwen~3.5~0.8B reaches 94.75\% F1, and Qwen Think and Nothink templates differ by less than 0.004 F1. Across 14 Databricks endpoints, mean F1 change from local evaluation is $-0.0081$; Aya is the only family with a 2.7--5.1 point decline. These results show that compact fine-tuned models can preserve most extraction accuracy, but model selection must account for prompt choice, throughput, and serving-stack behavior.

cs.AI

Thick embeddings of graphs into symmetric spaces via coarse geometry

We prove estimates for the optimal volume of thick embeddings of finite graphs into symmetric spaces, generalising results of Kolmogorov-Barzdin and Gromov-Guth for embeddings into Euclidean spaces. We distinguish two very different behaviours depending on the rank of the non-compact factor. For rank at least 2, we construct thick embeddings of $N$-vertex graphs with volume $CN\ln(1+N)$ and prove that this is optimal. For rank at most $1$ we prove lower bounds of the form $cN^a$ for some (explicit) $a>1$ which depends on the dimension of the Euclidean factor and the conformal dimension of the boundary of the non-compact factor. The main tool is a coarse geometric analogue of a thick embedding called a coarse wiring, with the key property that the minimal volume of a thick embedding is comparable to the ``minimal volume'' of a coarse wiring for symmetric spaces of dimension at least $3$. In the appendix it is proved that for each $k\geq 3$ every bounded degree graph admits a coarse wiring into $\mathbb{R}^k$ with volume at most $CN^{1+\frac{1}{k-1}}$. As a corollary, the same upper bound holds for real hyperbolic space of dimension $k+1$ and in both cases this result is optimal.

math.GT

Local simple connectedness of boundaries of hyperbolic groups

In this paper we prove a theorem describing the local topology of the boundary of a hyperbolic group in terms of its global topology: the boundary is locally simply connected if and only if the complement of any point in the boundary is simply connected. This generalises a theorem of Bestvina and Mess.

math.GT

Computing the Cech cohomology of decomposition spaces

A line pattern in a free group $F$ is defined by a malnormal collection of cyclic subgroups. Otal defined a decomposition space $\mathcal{D}$ associated to a line pattern. We provide an algorithm that computes a presentation for the \v{C}ech cohomology of $\mathcal{D}$, thought of as a $F$-module. This answers a relative version of a question of Epstein about boundaries of hyperbolic groups.

math.GT

Computing JSJ decompositions of hyperbolic groups

We present an algorithm that computes Bowditch's canonical JSJ decomposition of a given one-ended hyperbolic group over its virtually cyclic subgroups. The algorithm works by identifying topological features in the boundary of the group. As a corollary we also show how to compute the JSJ decomposition of such a group over its virtually cyclic subgroups with infinite centre. We also give a new algorithm that determines whether or not a given one-ended hyperbolic group is virtually fuchsian. Our approach uses only the geometry of large balls in the Cayley graph and avoids Makanin's algorithm.

math.GT