arXiv subjects

Christopher Davis

Publications and source records attributed to Christopher Davis.

At least 19 recordsLinked to original sources

arXiv2026

AutoOR: Scalably Post-training LLMs to Autoformulate Operations Research Problems

Optimization problems are central to decision-making in manufacturing, logistics, scheduling, and other industrial settings. Translating complicated descriptions of these problems into solver-ready formulations requires specialized operations research (OR) expertise, making it hard to scale. We present AutoOR, a scalable synthetic data generation and reinforcement learning pipeline that trains LLMs to autoformulate optimization problems specified in natural language across linear, mixed-integer, and non-linear categories. AutoOR generates verified training data from standard optimization forms and uses solver execution feedback as the reward signal for RL post-training. AutoOR applied to an 8B model achieves state-of-the-art or competitive results across six established OR benchmarks, matching significantly larger frontier models. For a non-linear problem class involving physical dynamics, where frontier models score near 0%, we introduce a curriculum RL strategy that bootstraps from limited initial training data to make this class tractable for post-training. We believe that methods such as AutoOR can significantly accelerate industrial decision-making with AI.

cs.LG↗

arXiv2026

Benchmarking Deflection and Hallucination in Large Vision-Language Models

Large Vision-Language Models (LVLMs) increasingly rely on retrieval to answer knowledge-intensive multimodal questions. Existing benchmarks overlook conflicts between visual and textual evidence and the importance of generating deflections (e.g., Sorry, I cannot answer...) when retrieved knowledge is incomplete. These benchmarks also suffer from rapid obsolescence, as growing LVLM training sets allow models to answer many questions without retrieval. We address these gaps with three contributions. First, we propose a dynamic data curation pipeline that preserves benchmark difficulty over time by filtering for genuinely retrieval-dependent samples. Second, we introduce VLM-DeflectionBench, a benchmark of 2,775 samples spanning diverse multimodal retrieval settings, designed to probe model behaviour under conflicting or insufficient evidence. Third, we define a fine-grained evaluation protocol with four scenarios that disentangle parametric memorization from retrieval robustness. Experiments across 20 state-of-the-art LVLMs indicate that models usually fail to deflect in the presence of noisy or misleading evidence. Our results highlight the need to evaluate not only what models know, but how they behave when they do not, and serve as a reusable and extensible benchmark for reliable KB-VQA evaluation. All resources will be publicly available upon publication.

cs.CL↗

arXiv2025

GaRAGe: A Benchmark with Grounding Annotations for RAG Evaluation

We present GaRAGe, a large RAG benchmark with human-curated long-form answers and annotations of each grounding passage, allowing a fine-grained evaluation of whether LLMs can identify relevant grounding when generating RAG answers. Our benchmark contains 2366 questions of diverse complexity, dynamism, and topics, and includes over 35K annotated passages retrieved from both private document sets and the Web, to reflect real-world RAG use cases. This makes it an ideal test bed to evaluate an LLM's ability to identify only the relevant information necessary to compose a response, or provide a deflective response when there is insufficient information. Evaluations of multiple state-of-the-art LLMs on GaRAGe show that the models tend to over-summarise rather than (a) ground their answers strictly on the annotated relevant passages (reaching at most a Relevance-Aware Factuality Score of 60%), or (b) deflect when no relevant grounding is available (reaching at most 31% true positive rate in deflections). The F1 in attribution to relevant sources is at most 58.9%, and we show that performance is particularly reduced when answering time-sensitive questions and when having to draw knowledge from sparser private grounding sources.

cs.CL↗

arXiv2024

SceneDiffuser: Efficient and Controllable Driving Simulation Initialization and Rollout

Realistic and interactive scene simulation is a key prerequisite for autonomous vehicle (AV) development. In this work, we present SceneDiffuser, a scene-level diffusion prior designed for traffic simulation. It offers a unified framework that addresses two key stages of simulation: scene initialization, which involves generating initial traffic layouts, and scene rollout, which encompasses the closed-loop simulation of agent behaviors. While diffusion models have been proven effective in learning realistic and multimodal agent distributions, several challenges remain, including controllability, maintaining realism in closed-loop simulations, and ensuring inference efficiency. To address these issues, we introduce amortized diffusion for simulation. This novel diffusion denoising paradigm amortizes the computational cost of denoising over future simulation steps, significantly reducing the cost per rollout step (16x less inference steps) while also mitigating closed-loop errors. We further enhance controllability through the introduction of generalized hard constraints, a simple yet effective inference-time constraint mechanism, as well as language-based constrained scene generation via few-shot prompting of a large language model (LLM). Our investigations into model scaling reveal that increased computational resources significantly improve overall simulation realism. We demonstrate the effectiveness of our approach on the Waymo Open Sim Agents Challenge, achieving top open-loop performance and the best closed-loop performance among diffusion models.

cs.LG↗

arXiv2024

Prompting open-source and commercial language models for grammatical error correction of English learner text

Thanks to recent advances in generative AI, we are able to prompt large language models (LLMs) to produce texts which are fluent and grammatical. In addition, it has been shown that we can elicit attempts at grammatical error correction (GEC) from LLMs when prompted with ungrammatical input sentences. We evaluate how well LLMs can perform at GEC by measuring their performance on established benchmark datasets. We go beyond previous studies, which only examined GPT* models on a selection of English GEC datasets, by evaluating seven open-source and three commercial LLMs on four established GEC benchmarks. We investigate model performance and report results against individual error types. Our results indicate that LLMs do not always outperform supervised English GEC models except in specific contexts -- namely commercial LLMs on benchmarks annotated with fluency corrections as opposed to minimal edits. We find that several open-source models outperform commercial ones on minimal edit benchmarks, and that in some settings zero-shot prompting is just as competitive as few-shot prompting.

cs.CL↗

arXiv2023

Reflective Groupwork for Introductory Proof-Writing Courses

We discuss two proof evaluation activities meant to promote the acquisition of learning behaviors of professional mathematics within an introductory undergraduate proof-writing course. These learning behaviors include the ability to read and discuss mathematics critically, reach a consensus on correctness and clarity as a group, and verbalize what qualities ``good`` proofs possess. The first of these two activities involves peer review and the second focuses on evaluating the quality of internet resources. All of the activities involve groupwork and reflective discussion questions to develop students' experience with these practices of professional mathematics.

math.HO↗

arXiv2023

CLIMB: Curriculum Learning for Infant-inspired Model Building

We describe our team's contribution to the STRICT-SMALL track of the BabyLM Challenge. The challenge requires training a language model from scratch using only a relatively small training dataset of ten million words. We experiment with three variants of cognitively-motivated curriculum learning and analyze their effect on the performance of the model on linguistic evaluation tasks. In the vocabulary curriculum, we analyze methods for constraining the vocabulary in the early stages of training to simulate cognitively more plausible learning curves. In the data curriculum experiments, we vary the order of the training instances based on i) infant-inspired expectations and ii) the learning behavior of the model. In the objective curriculum, we explore different variations of combining the conventional masked language modeling task with a more coarse-grained word class prediction task to reinforce linguistic generalization capabilities. Our results did not yield consistent improvements over our own non-curriculum learning baseline across a range of linguistic benchmarks; however, we do find marginal gains on select tasks. Our analysis highlights key takeaways for specific combinations of tasks and settings which benefit from our proposed curricula. We moreover determine that careful selection of model architecture, and training hyper-parameters yield substantial improvements over the default baselines provided by the BabyLM challenge.

cs.CL↗

arXiv2023

On the cyclic homology of certain universal differential graded algebras

Let $p$ be an odd prime and $R$ a $p$-torsion-free commutative $\mathbb{Z}_{(p)}$-algebra. We compute the periodic cyclic homology over $R$ of the universal differential graded algebra $R//p$ which is obtained from $R$ by universally killing $p$. We furthermore compute the cyclic and negative cyclic homologies of $R//p$ over $R$ in infinitely many degrees.

math.AT↗

arXiv2023

On the application of Large Language Models for language teaching and assessment technology

The recent release of very large language models such as PaLM and GPT-4 has made an unprecedented impact in the popular media and public consciousness, giving rise to a mixture of excitement and fear as to their capabilities and potential uses, and shining a light on natural language processing research which had not previously received so much attention. The developments offer great promise for education technology, and in this paper we look specifically at the potential for incorporating large language models in AI-driven language teaching and assessment systems. We consider several research areas and also discuss the risks and ethical considerations surrounding generative AI in education technology for language learners. Overall we find that larger language models offer improvements over previous models in text generation, opening up routes toward content generation which had not previously been plausible. For text generation they must be prompted carefully and their outputs may need to be reshaped before they are ready for use. For automated grading and grammatical error correction, tasks whose progress is checked on well-known benchmarks, early investigations indicate that large language models on their own do not improve on state-of-the-art results according to standard evaluation metrics. For grading it appears that linguistic features established in the literature should still be used for best performance, and for error correction it may be that the models can offer alternative feedback styles which are not measured sensitively with existing methods. In all cases, there is work to be done to experiment with the inclusion of large language models in education technology for language learners, in order to properly understand and report on their capacities and limitations, and to ensure that foreseeable risks such as misinformation and harmful bias are mitigated.

cs.CL↗

arXiv2022

Probing for targeted syntactic knowledge through grammatical error detection

Targeted studies testing knowledge of subject-verb agreement (SVA) indicate that pre-trained language models encode syntactic information. We assert that if models robustly encode subject-verb agreement, they should be able to identify when agreement is correct and when it is incorrect. To that end, we propose grammatical error detection as a diagnostic probe to evaluate token-level contextual representations for their knowledge of SVA. We evaluate contextual representations at each layer from five pre-trained English language models: BERT, XLNet, GPT-2, RoBERTa, and ELECTRA. We leverage public annotated training data from both English second language learners and Wikipedia edits, and report results on manually crafted stimuli for subject-verb agreement. We find that masked language models linearly encode information relevant to the detection of SVA errors, while the autoregressive models perform on par with our baseline. However, we also observe a divergence in performance when probes are trained on different training sets, and when they are evaluated on different syntactic constructions, suggesting the information pertaining to SVA error detection is not robustly encoded.

cs.CL↗

arXiv2020

Discovery of a Candidate Binary Supermassive Black Hole in a Periodic Quasar from Circumbinary Accretion Variability

Binary supermassive black holes (BSBHs) are expected to be a generic byproduct from hierarchical galaxy formation. The final coalescence of BSBHs is thought to be the loudest gravitational wave (GW) siren, yet no confirmed BSBH is known in the GW-dominated regime. While periodic quasars have been proposed as BSBH candidates, the physical origin of the periodicity has been largely uncertain. Here we report discovery of a periodicity (P=1607$\pm$7 days) at 99.95% significance (with a global p-value of ~$10^{-3}$ accounting for the look elsewhere effect) in the optical light curves of a redshift 1.53 quasar, SDSS J025214.67-002813.7. Combining archival Sloan Digital Sky Survey data with new, sensitive imaging from the Dark Energy Survey, the total ~20-yr time baseline spans ~4.6 cycles of the observed 4.4-yr (restframe 1.7-yr) periodicity. The light curves are best fit by a bursty model predicted by hydrodynamic simulations of circumbinary accretion disks. The periodicity is likely caused by accretion rate modulation by a milli-parsec BSBH emitting GWs, dynamically coupled to the circumbinary accretion disk. A bursty hydrodynamic variability model is statistically preferred over a smooth, sinusoidal model expected from relativistic Doppler boost, a kinematic effect proposed for PG1302-102. Furthermore, the frequency dependence of the variability amplitudes disfavors Doppler boost, lending independent support to the circumbinary accretion variability hypothesis. Given our detection rate of one BSBH candidate from circumbinary accretion variability out of 625 quasars, it suggests that future large, sensitive synoptic surveys such as the Vera C. Rubin Observatory Legacy Survey of Space and Time may be able to detect hundreds to thousands of candidate BSBHs from circumbinary accretion with direct implications for Laser Interferometer Space Antenna.

astro-ph.GA↗

arXiv2020

Survey of Gravitationally-lensed Objects in HSC Imaging (SuGOHI). VI. Crowdsourced lens finding with Space Warps

Strong lenses are extremely useful probes of the distribution of matter on galaxy and cluster scales at cosmological distances, but are rare and difficult to find. The number of currently known lenses is on the order of 1,000. We wish to use crowdsourcing to carry out a lens search targeting massive galaxies selected from over 442 square degrees of photometric data from the Hyper Suprime-Cam (HSC) survey. We selected a sample of $\sim300,000$ galaxies with photometric redshifts in the range $0.2 < z_{phot} < 1.2$ and photometrically inferred stellar masses $\log{M_*} > 11.2$. We crowdsourced lens finding on this sample of galaxies on the Zooniverse platform, as part of the Space Warps project. The sample was complemented by a large set of simulated lenses and visually selected non-lenses, for training purposes. Nearly 6,000 citizen volunteers participated in the experiment. In parallel, we used YattaLens, an automated lens finding algorithm, to look for lenses in the same sample of galaxies. Based on a statistical analysis of classification data from the volunteers, we selected a sample of the most promising $\sim1,500$ candidates which we then visually inspected: half of them turned out to be possible (grade C) lenses or better. Including lenses found by YattaLens or serendipitously noticed in the discussion section of the Space Warps website, we were able to find 14 definite lenses, 129 probable lenses and 581 possible lenses. YattaLens found half the number of lenses discovered via crowdsourcing. Crowdsourcing is able to produce samples of lens candidates with high completeness and purity, compared to currently available automated algorithms. A hybrid approach, in which the visual inspection of samples of lens candidates pre-selected by discovery algorithms and/or coupled to machine learning is crowdsourced, will be a viable option for lens finding in the 2020s.

astro-ph.IM↗

arXiv2020

On the de Rham-Witt complex over perfectoid rings

Fix an odd prime $p$. The results in this paper are modeled after work of Hesselholt and Hesselholt-Madsen on the $p$-typical absolute de Rham-Witt complex in mixed characteristic. We have two primary results. The first is an exact sequence which describes the kernel of the restriction map on the de Rham-Witt complex over $A$, where $A$ is the ring of integers in an algebraic extension of $\mathbb{Q}_p$, or where $A$ is a $p$-torsion-free perfectoid ring. The second result is a description of the $p$-power torsion (and related objects) in the de Rham-Witt complex over $A$, where $A$ is a $p$-torsion-free perfectoid ring containing a compatible system of $p$-power roots of unity. Both of these results are analogous to results of Hesselholt and Madsen. Our main contribution is the extension of their results to certain perfectoid rings. We also provide algebraic proofs of these results, whereas the proofs of Hesselholt and Madsen used techniques from topology.

math.NT↗

arXiv2019

The Buzzard Flock: Dark Energy Survey Synthetic Sky Catalogs

We present a suite of 18 synthetic sky catalogs designed to support science analysis of galaxies in the Dark Energy Survey Year 1 (DES Y1) data. For each catalog, we use a computationally efficient empirical approach, ADDGALS, to embed galaxies within light-cone outputs of three dark matter simulations that resolve halos with masses above ~5x10^12 h^-1 m_sun at z <= 0.32 and 10^13 h^-1 m_sun at z~2. The embedding method is tuned to match the observed evolution of galaxy counts at different luminosities as well as the spatial clustering of the galaxy population. Galaxies are lensed by matter along the line of sight --- including magnification, shear, and multiple images --- using CALCLENS, an algorithm that calculates shear with 0.42 arcmin resolution at galaxy positions in the full catalog. The catalogs presented here, each with the same LCDM cosmology (denoted Buzzard), contain on average 820 million galaxies over an area of 1120 square degrees with positions, magnitudes, shapes, photometric errors, and photometric redshift estimates. We show that the weak-lensing shear catalog, redMaGiC galaxy catalogs and redMaPPer cluster catalogs provide plausible realizations of the same catalogs in the DES Y1 data by comparing their magnitude, color and redshift distributions, angular clustering, and mass-observable relations, making them useful for testing analyses that use these samples. We make public the galaxy samples appropriate for the DES Y1 data, as well as the data vectors used for cosmology analyses on these simulations.

astro-ph.CO↗

arXiv2018

Astrometry and Occultation predictions to Trans-Neptunian and Centaur Objects observed within the Dark Energy Survey

Transneptunian objects (TNOs) are a source of invaluable information to access the history and evolution of the outer solar system. However, observing these faint objects is a difficult task. As a consequence, important properties such as size and albedo are known for only a small fraction of them. Now, with the results from deep sky surveys and the Gaia space mission, a new exciting era is within reach as accurate predictions of stellar occultations by numerous distant small solar system bodies become available. From them, diameters with kilometer accuracies can be determined. Albedos, in turn, can be obtained from diameters and absolute magnitudes. We use observations from the Dark Energy Survey (DES) from November 2012 until February 2016, amounting to 4292847 CCD frames. We searched them for all known small solar system bodies and recovered a total of 202 TNOs and Centaurs, 63 of which have been discovered by the DES collaboration until the date of this writing. Their positions were determined using the Gaia Data Release 2 as reference and their orbits were refined. Stellar occultations were then predicted using these refined orbits plus stellar positions from Gaia. These predictions are maintained, and updated, in a dedicated web service. The techniques developed here are also part of an ambitious preparation to use the data from the Large Synoptic Survey Telescope (LSST), that expects to obtain accurate positions and multifilter photometry for tens of thousands of TNOs.

astro-ph.EP↗

arXiv2017

On the p-typical de Rham-Witt complex over W(k)

Hesselholt and Madsen in [7] define and study the (absolute, p-typical) de Rham-Witt complex in mixed characteristic, where p is an odd prime. They give as an example an elementary algebraic description of the de Rham-Witt complex over Z_(p). The main goal of this paper is to construct, for k a perfect ring of characteristic p > 2, a Witt complex over A = W(k) with an algebraic description which is completely analogous to Hesselholt and Madsen's description for Z_(p). Our Witt complex is not isomorphic to the de Rham-Witt complex; instead we prove that, in each level, the de Rham-Witt complex over W(k) surjects onto our Witt complex, and that the kernel consists of all elements which are divisible by arbitrarily high powers of p. We deduce an explicit description of the de Rham-Witt complex over W(k). We also deduce results concerning the de Rham-Witt complex over certain perfectoid rings.

math.AC↗

arXiv2014

Explicit points on $y^2 + xy - t^d y = x^3$ and related character sums

Let $\mathbb{F}_q$ denote a finite field of characteristic $p \geq 5$ and let $d = q+1$. Let $E_d$ denote the elliptic curve over the function field $\mathbb{F}_{q^2}(t)$ defined by the equation $y^2 + xy - t^d y = x^3$. Its rank is $q$ when $q \equiv 1 \bmod 3$ and its rank is $q-2$ when $q \equiv 2 \bmod 3$. We describe an explicit method for producing points on this elliptic curve. In case $q \not\equiv 11 \bmod 12$, our method produces points which generate a full-rank subgroup. Our strategy for producing rational points on $E_d$ makes use of a dominant map from the degree $d$ Fermat surface over $\mathbb{F}_{q^2}$ to the elliptic surface associated to $E_d$. We in turn study lines on the Fermat surface $\mathcal{F}_d$ using certain multiplicative character sums which are interesting in their own right. In particular, in the $q \equiv 7 \bmod 12$ case, a character sum argument shows that we can generate a full-rank subgroup using $\mu_d$-translates of a single rational point.

math.NT↗

arXiv2014

Which finite simple groups are unit groups?

We prove that if $G$ is a finite simple group which is the unit group of a ring, then $G$ is isomorphic to either (a) a cyclic group of order 2; (b) a cyclic group of prime order $2^k -1$ for some $k$; or (c) a projective special linear group $PSL_n(\mathbb{F}_2)$ for some $n \geq 3$. Moreover, these groups do (trivially) all occur as unit groups. We deduce this classification from a more general result, which holds for groups $G$ with no non-trivial normal 2-subgroup.

math.RA↗