arXiv subjects

Eric Page

Publications and source records attributed to Eric Page.

3 recordsLinked to original sources

arXiv2026

Benchmarking Distilled Language Models: Performance and Efficiency in Resource-Constrained Settings

Knowledge distillation offers a transformative pathway to developing powerful, yet efficient, small language models (SLMs) suitable for resource-constrained environments. In this paper, we benchmark the performance and computational cost of distilled models against their vanilla and proprietary counterparts, providing a quantitative analysis of their efficiency. Our results demonstrate that distillation creates a superior performance-tocompute curve. We find that creating a distilled 8B model is over 2,000 times more compute-efficient than training its vanilla counterpart, while achieving reasoning capabilities on par with, or even exceeding, standard models ten times its size. These findings validate distillation not just as a compression technique, but as a primary strategy for building state-of-the-art, accessible AI

cs.CL↗

arXiv2022

Triadic Temporal Exponential Random Graph Models (TTERGM)

Temporal exponential random graph models (TERGM) are powerful statistical models that can be used to infer the temporal pattern of edge formation and elimination in complex networks (e.g., social networks). TERGMs can also be used in a generative capacity to predict longitudinal time series data in these evolving graphs. However, parameter estimation within this framework fails to capture many real-world properties of social networks, including: triadic relationships, small world characteristics, and social learning theories which could be used to constrain the probabilistic estimation of dyadic covariates. Here, we propose triadic temporal exponential random graph models (TTERGM) to fill this void, which includes these hierarchical network relationships within the graph model. We represent social network learning theory as an additional probability distribution that optimizes Markov chains in the graph vector space. The new parameters are then approximated via Monte Carlo maximum likelihood estimation. We show that our TTERGM model achieves improved fidelity and more accurate predictions compared to several benchmark methods on GitHub network data.

cs.SI↗

arXiv2000

Experimental feasibility of measuring the gravitational redshift of light using dispersion in optical fibers

This paper describes a new class of experiments that use dispersion in optical fibers to convert the gravitational frequency shift of light into a measurable phase shift or time delay. Two conceptual models are explored. In the first model, long counter-propagating pulses are used in a vertical fiber optic Sagnac interferometer. The second model uses optical solitons in vertically separated fiber optic storage rings. We discuss the feasibility of using such an instrument to make a high precision measurement of the gravitational frequency shift of light.

gr-qc↗