arXiv subjects

Guangxu Chen

Publications and source records attributed to Guangxu Chen.

4 recordsLinked to original sources

arXiv2026

A Hyperbolicity Atlas of Large Language Model Hidden States

LLM hidden states are ordinary vectors, but the distances among those vectors may still show hierarchical structure. To our knowledge, this paper is the first systematic study of whether prompt-token hidden states in contemporary LLMs exhibit Gromov Hyperbolicity (GH), a distance-based measure of tree-likeness. Using 818,904 sample-layer measurements from ten open-weight models across MATH500, HumanEval, WinoGrande, and TruthfulQA, we build a GH map over four axes: parameter scale, layer depth, model family, and input domain. The clearest pattern is depth, not scale: middle layers usually form a high-relative-hyperbolicity plateau, while final layers often become substantially more tree-like. Scale effects are weak and non-monotonic, matched 7/8B model families differ strongly, and domains interact with model specialization. These findings make GH useful as a practical diagnostic: it shows where hierarchical distance structure appears, how specialization changes it, and which model-layer-domain comparisons deserve closer analysis.

cs.CL↗

arXiv2026

Beyond Quantity: Trajectory Diversity Scaling for Code Agents

As code large language models (LLMs) evolve into tool-interactive agents via the Model Context Protocol (MCP), their generalization is increasingly limited by low-quality synthetic data and the diminishing returns of quantity scaling. Moreover, quantity-centric scaling exhibits an early bottleneck that underutilizes trajectory data. We propose TDScaling, a Trajectory Diversity Scaling-based data synthesis framework for code agents that scales performance through diversity rather than raw volume. Under a fixed training budget, increasing trajectory diversity yields larger gains than adding more trajectories, improving the performance-cost trade-off for agent training. TDScaling integrates four innovations: (1) a Business Cluster mechanism that captures real-service logical dependencies; (2) a blueprint-driven multi-agent paradigm that enforces trajectory coherence; (3) an adaptive evolution mechanism that steers synthesis toward long-tail scenarios using Domain Entropy, Reasoning Mode Entropy, and Cumulative Action Complexity to prevent mode collapse; and (4) a sandboxed code tool that mitigates catastrophic forgetting of intrinsic coding capabilities. Experiments on general tool-use benchmarks (BFCL, tau^2-Bench) and code agent tasks (RebenchT, CodeCI, BIRD) demonstrate a win-win outcome: TDScaling improves both tool-use generalization and inherent coding proficiency. We plan to release the full codebase and the synthesized dataset (including 30,000+ tool clusters) upon publication.

cs.AI↗

arXiv2026

Hierarchical Orthogonal Residual Spread for Precise Massive Editing in Large Language Models

Large language models (LLMs) exhibit exceptional performance across various domains, yet they face critical safety concerns. Model editing has emerged as an effective approach to mitigate these issues. Existing model editing methods often focus on optimizing an information matrix that blends new and old knowledge. While effective, these approaches can be computationally expensive and may cause conflicts. In contrast, we shift our attention to Hierarchical Orthogonal Residual SprEad of the information matrix, which reduces noisy gradients and enables more stable edits from a different perspective. We demonstrate the effectiveness of our method HORSE through a clear theoretical comparison with several popular methods and extensive experiments conducted on two datasets across multiple LLMs. The results show that HORSE maintains precise massive editing across diverse scenarios. The code is available at https://github.com/XiaojieGu/HORSE

cs.CL↗

arXiv2019

Cryo-EM structures of atomic surfaces and host-guest chemistry in metal-organic frameworks

Host-guest interactions govern the chemistry of a broad range of functional materials. However, the weak bonding between host and guest prevents atomic-resolution studies of their structure and chemistry using transmission electron microscopy (TEM). This problem is exacerbated in metal-organic frameworks (MOF), in which the host framework is easily damaged by the electron beam. Here, we use cryogenic-electron microscopy (cryo-EM) to simultaneously address these two challenges and resolve the atomic surface structure of zeolitic imidazolate framework (ZIF-8) and its interaction with guest CO2 molecules. We image atomic step-edge sites on the ZIF-8 surface that provides possible insight to its growth behavior. Furthermore, we observe two distinct binding sites for CO2 within the ZIF-8 pore, which are both predicted by density functional theory (DFT) to be energetically favorable. This CO2 insertion induces an apparent ~3% lattice expansion along the <002> and <011> directions of the ZIF-8 unit cell. The ability to stabilize MOFs and preserve their host-guest chemistry opens a rich materials space for scientific exploration and discovery using cryo-EM.

cond-mat.mtrl-sci↗