arXiv subjects

Christopher Ellis

Publications and source records attributed to Christopher Ellis.

3 recordsLinked to original sources

arXiv2026

Black-Box Inference of LLM Architectural Properties with Restrictive API Access

In practice, most commercial LLM providers do not publicly release details of underlying LLM architectures. However, prior work has shown that given limited API access to an LLM (namely, top-$k$ logits and/or a logit bias function), one can recover certain architectural details of an LLM, such as the hidden dimension of the feed-forward network. Perhaps in response to these results, most commercial LLM providers have restricted their APIs to expose only the single logit for each decoded token, and they no longer give users the ability to bias logits. We show that even under current restrictive APIs, several architectural parameters are still recoverable. We present NightVision, an attack that uses restrictive black-box API access to estimate the hidden dimension, depth, and parameter count of an LLM. Algorithmically, NightVision relies on a novel common set prompting technique in which multiple prompts expose log probabilities for the same set of output tokens; a spectral analysis of these results is used to infer hidden dimension. NightVision additionally uses end-to-end time to first token (TTFT) measurements and the estimated hidden dimension to estimate depth and parameter count. We empirically evaluate NightVision on 32 open-source LLMs, recovering hidden dimension to within 23% average relative error across all models (9% on MoE models), and depth and parameter count to within 53% for models exceeding three billion parameters. We run extensive ablations to demonstrate how these accuracies scale with token budget and model properties. Overall, our results suggest that current LLM APIs are not sufficiently restricted to fully obfuscate the architectural details of their underlying models.

cs.LG↗

arXiv2026

A Multiwavelength Assessment Disfavoring the X-ray Binary Origin of He III Regions in Metal-Poor Star-Forming Dwarf Galaxies

Recent observations of metal-poor, star-forming dwarf galaxies reveal He III regions, traced by nebular He II 4686 emission that require a strong source of extreme-ultraviolet (EUV) radiation. The origin of this hard ionizing radiation remains poorly understood, as standard stellar populations fail to account for it, posing key implications for the understanding of early galaxy formation. We present a systematic Chandra X-ray study of 21 nearby star-forming galaxies with He II emission but lacking Wolf-Rayet spectral signatures. Using 7 new and 36 archival Chandra X-ray observations combined with optical stellar population synthesis modelling, we constrain the ionizing continuum required to sustain the observed He II line, the ionizing continuum available from X-ray objects, and the properties of the host H II regions. We find that the inferred EUV output from accreting X-ray sources in our sample is systematically lower than what is required to produce the observed He II emission. Our sample is consistent with established empirical scaling relations for X-ray luminosity, indicating that this discrepancy cannot be attributed to an anomalously low number or luminosity of X-ray sources. These results indicate that accreting X-ray sources alone cannot account for the observed He II-ionizing photon budget, pointing to additional or alternative sources of hard EUV radiation in metal-poor star-forming environments. Potential alternative or additional contributors are discussed.

astro-ph.HE↗

arXiv2025

BRIDGES: Bridging Graph Modality and Large Language Models within EDA Tasks

While many EDA tasks already involve graph-based data, existing LLMs in EDA primarily either represent graphs as sequential text, or simply ignore graph-structured data that might be beneficial like dataflow graphs of RTL code. Recent studies have found that LLM performance suffers when graphs are represented as sequential text, and using additional graph information significantly boosts performance. To address these challenges, we introduce BRIDGES, a framework designed to incorporate graph modality into LLMs for EDA tasks. BRIDGES integrates an automated data generation workflow, a solution that combines graph modality with LLM, and a comprehensive evaluation suite. First, we establish an LLM-driven workflow to generate RTL and netlist-level data, converting them into dataflow and netlist graphs with function descriptions. This workflow yields a large-scale dataset comprising over 500,000 graph instances and more than 1.5 billion tokens. Second, we propose a lightweight cross-modal projector that encodes graph representations into text-compatible prompts, enabling LLMs to effectively utilize graph data without architectural modifications. Experimental results demonstrate 2x to 10x improvements across multiple tasks compared to text-only baselines, including accuracy in design retrieval, type prediction and perplexity in function description, with negligible computational overhead (<1% model weights increase and <30% additional runtime overhead). Even without additional LLM finetuning, our results outperform text-only by a large margin. We plan to release BRIDGES, including the dataset, models, and training flow.

cs.LG↗