arXiv Science⌕ Search

arXiv subjects

Gang Lin

Publications and source records attributed to Gang Lin.

7 recordsLinked to original sources

TeleChat to Xing4: Advancing Frontier Agentic Models on Domestic Chips and Frameworks

We present Xing 4, a series of large language models that extends the TeleChat lineage through coordinated advances in model architecture and training infrastructure on Ascend. This report describes the design principles and systems engineering behind the series, spanning architecture selection, large-scale pretraining, and reasoning and agentic post-training. We study how sparse activation, attention design, model depth and width, and speculative decoding balance model capacity with computation, memory access, and execution overhead. Our pretraining infrastructure builds on MindSpore HyperParallel, combining topology-aware hybrid sharding, efficient distributed optimizer execution, and coordinated management of long-sequence workloads and activation memory. CPU affinity and core isolation further reduce host scheduling interference. Together, these mechanisms support the pretraining of a 285B-parameter model on 8,192 Ascend 910C cards, providing a concrete setting for the architectural and systems studies. For post-training, we introduce TeleGym, a unified agent execution platform that connects execution, evaluation, and trajectory construction to policy optimization. Disaggregated asynchronous execution, bounded oversampling, and partial rollout accommodate heterogeneous task durations while preserving trajectory continuity across policy updates. Together, these advances establish an Ascend-oriented training foundation for the continued development of Xing 4 across model scales and increasingly demanding reasoning and agent workloads.

cs.AI↗

Competition between thermal pressurization and dilatant strengthening in laboratory ruptures

In fluid-saturated faults, thermal pressurization (TP) is predicted to induce rapid weakening, whereas dilatant strengthening (DS) can counteract this process through pore-space expansion. However, experimental constraints on their competition remain limited. Here, we investigate these processes using triaxial stick-slip experiments with direct on- and off-fault pore pressure (Pp) measurements on saturated, saw-cut, thermally cracked Westerly granite under effective confining pressures of 30-60 MPa. Results reveal a systematic rupture transition from co- seismic Pp rise (TP-type) to Pp drop (DS-type) with increasing shear strain, accompanied by a fast-slow-fast slip sequence, with slip velocities differing by up to three orders of magnitude. An undrained, adiabatic TP model reproduces the measured Pp rise evolution during early-stage fast events and indicates progressive shear zone widening that reduces TP efficiency. With continued slip, increasing cumulative plastic porosity reflects enhanced dilatancy during DS-dominated sequences. Microstructural observations reveal gouge development and a near- fault damage zone, providing independent evidence for this structural evolution. This evolution modifies fault stiffness and explains the observed transition in slip behavior. Despite contrasting Pp responses, fracture energy scales similarly with slip for both TP- and DS-type events, suggesting comparable rupture energetics. Overall, this study provides direct experimental evidence of TP-DS transitions, demonstrating that TP governs early-stage weakening but diminishes as dilatancy progressively strengthens with shear zone widening and near-fault damage. These results highlight that fault structure and its evolution plays a key role in controlling rupture dynamics in natural faults.

physics.geo-ph↗

LycheeCluster: Efficient Long-Context Inference with Structure-Aware Chunking and Hierarchical KV Indexing

The quadratic complexity of the attention mechanism and the substantial memory footprint of the Key-Value (KV) cache present severe computational and memory challenges for Large Language Models (LLMs) processing long contexts. Existing retrieval-based methods often compromise semantic integrity through fixed-size chunking and suffer from inefficient linear scanning. In this paper, we propose LycheeCluster, a novel method for efficient KV cache management. LycheeCluster preserves local semantic coherence via boundary-aware chunking and constructs a recursive hierarchical index rooted in the triangle inequality. This design transforms cache retrieval from a linear scan into a theoretically bounded, logarithmic-time pruning process, while a lazy update strategy supports efficient streaming generation. Experiments demonstrate that LycheeCluster achieves up to a 3.6x end-to-end inference speedup with negligible degradation in model performance, outperforming state-of-the-art KV cache management methods (e.g., Quest, ClusterKV). We will release our code and kernels after publication.

cs.LG↗

LycheeDecode: Accelerating Long-Context LLM Inference via Hybrid-Head Sparse Decoding

The proliferation of long-context large language models (LLMs) exposes a key bottleneck: the rapidly expanding key-value cache during decoding, which imposes heavy memory and latency costs. While recent approaches attempt to alleviate this by sharing a single set of crucial tokens across layers, such coarse-grained sharing undermines model performance by neglecting the functional diversity of attention heads. To address this, we propose LycheeDecode, an efficient decoding method centered on a fine-grained hybrid-head attention mechanism that employs a hardware-efficient top-k selection strategy. Specifically, the novel HardKuma-based mechanism partitions attention heads into a small subset of retrieval heads that dynamically identify crucial tokens and a majority of sparse heads that reuse them for efficient computation. Through extensive experiments on leading models like Llama3 and Qwen3 across diverse benchmarks for long-context understanding (e.g., LongBench, RULER) and complex reasoning (e.g., AIME24, OlympiadBench), we demonstrate that LycheeDecode achieves generative quality comparable to, and at times surpassing even the full-attention baseline. Crucially, this is accomplished with up to a 2.7x speedup at a 128K context length. By preserving the functional diversity of attention heads, our fine-grained strategy overcomes the performance bottlenecks of existing methods, providing a powerful and validated pathway to both efficient and high-quality long-context LLM inference.

cs.CL↗

Leveraging Logical Rules in Knowledge Editing: A Cherry on the Top

Multi-hop Question Answering (MQA) under knowledge editing (KE) is a key challenge in Large Language Models (LLMs). While best-performing solutions in this domain use a plan and solve paradigm to split a question into sub-questions followed by response generation, we claim that this approach is sub-optimal as it fails for hard to decompose questions, and it does not explicitly cater to correlated knowledge updates resulting as a consequence of knowledge edits. This has a detrimental impact on the overall consistency of the updated knowledge. To address these issues, in this paper, we propose a novel framework named RULE-KE, i.e., RULE based Knowledge Editing, which is a cherry on the top for augmenting the performance of all existing MQA methods under KE. Specifically, RULE-KE leverages rule discovery to discover a set of logical rules. Then, it uses these discovered rules to update knowledge about facts highly correlated with the edit. Experimental evaluation using existing and newly curated datasets (i.e., RKE-EVAL) shows that RULE-KE helps augment both performances of parameter-based and memory-based solutions up to 92% and 112.9%, respectively.

cs.CL↗

Multi-hop Question Answering under Temporal Knowledge Editing

Multi-hop question answering (MQA) under knowledge editing (KE) has garnered significant attention in the era of large language models. However, existing models for MQA under KE exhibit poor performance when dealing with questions containing explicit temporal contexts. To address this limitation, we propose a novel framework, namely TEMPoral knowLEdge augmented Multi-hop Question Answering (TEMPLE-MQA). Unlike previous methods, TEMPLE-MQA first constructs a time-aware graph (TAG) to store edit knowledge in a structured manner. Then, through our proposed inference path, structural retrieval, and joint reasoning stages, TEMPLE-MQA effectively discerns temporal contexts within the question query. Experiments on benchmark datasets demonstrate that TEMPLE-MQA significantly outperforms baseline models. Additionally, we contribute a new dataset, namely TKEMQA, which serves as the inaugural benchmark tailored specifically for MQA with temporal scopes.

cs.CL↗

Observations Supporting the Role of Magnetoconvection in Energy Supply to the Quiescent Solar Atmosphere

Identifying the two physical mechanisms behind the production and sustenance of the quiescent solar corona and solar wind poses two of the outstanding problems in solar physics today. We present analysis of spectroscopic observations from the Solar and Heliospheric Observatory that are consistent with a single physical mechanism being responsible for a significant portion of the heat supplied to the lower solar corona and the initial acceleration of the solar wind; the ubiquitous action of magnetoconvection-driven reprocessing and exchange reconnection of the Sun's magnetic field on the supergranular scale. We deduce that while the net magnetic flux on the scale of a supergranule controls the injection rate of mass and energy into the transition region plasma it is the global magnetic topology of the plasma that dictates whether the released ejecta provides thermal input to the quiet solar corona or becomes a tributary that feeds the solar wind.

astro-ph↗