arXiv subjects

Jingchun Gao

Publications and source records attributed to Jingchun Gao.

7 recordsLinked to original sources

arXiv2026

FlashOffloading: Low-Latency KV Cache Offloading for Long-Context LLM Serving

In large language model (LLM) serving systems, the key-value (KV) cache grows linearly with sequence length and concurrency, so long-context inference easily hits the high-bandwidth memory (HBM) capacity wall and results in low concurrency. Offloading the KV cache to host dynamic random-access memory (DRAM) frees HBM space and raises concurrency, but the additional cache management and host-to-device (H2D) load overhead inflates inference latency, higher concurrency fails to translate into effective throughput. We present FlashOffloading, a host-DRAM-centric inference architecture that fully offloads the KV cache in both the prefill and decode phases. FlashOffloading builds rolling HBM cache for prefill, a hot cache for decode, a reverse sparse index with zero extra miss-lookup overhead, and a compute--load overlapped kernel, optimizing KV offloading latency across the entire pipeline and delivering throughput gains under a time-per-output-token (TPOT) service-level objective (SLO). In experiments deploying GLM-5.2 with multi-token prediction (MTP3) speculative decoding on an Ascend910C prefill--decode (PD)-disaggregated platform, FlashOffloading improves prefill throughput by up to 1.38\(\times\) and decode throughput by up to 1.91\(\times\) under a 30 ms TPOT constraint. FlashOffloading is integrated into an open-source serving framework: https://github.com/vllm-project/vllm-ascend/tree/releases/v0.30.0.

cs.AI↗

arXiv2026

Relaxation Dynamics of Superconducting/Normal Interfaces in the Intermediate State of a type-I superconductor

The dynamics of phase boundaries, such as superconducting/normal (S/N) interfaces in type-I superconductors, are typically obscured in conventional magnetic measurements, which are strongly influenced by surface barriers and global flux processes. Here, we employ the complex ac magnetostrictive coefficient as a sensitive probe of the bulk dynamics of S/N interfaces in the intermediate state of lead. The ac magnetostrictive coefficient exhibits an unusual complex response, with a negative real component and a positive imaginary component. Frequency-dependent measurements show that the magnitude of the real component decreases monotonically with increasing frequency, whereas the imaginary component first increases, reaches a broad maximum, and then decreases. In contrast, ac susceptibility displays a conventional Debye-type magnetic relaxation with a different phase relation between its real and imaginary components. We propose that the magnetostrictive response arises from ac-field-driven relaxation and rearrangement of metastable S/N domain configurations toward states of lower free energy. These results reveal a distinct interfacial relaxation channel in the intermediate state and establish the complex ac magnetostrictive coefficient as a sensitive probe of nonequilibrium S/N interface dynamics.

cond-mat.supr-con↗

arXiv2026

MoE-CORE: Coordinated Expert Offloading and Residency for Memory-Constrained MoE Inference

Sparse expert activation reduces MoE models' computation, yet expert weights can exceed limited device memory. Offloading makes inference feasible on a compact AI appliance but exposes host-to-device transfers to the inference path. We present MoE-CORE, a system that coordinates expert offloading and residency for memory-constrained MoE inference. It stages complete expert layers in alternating buffers during prefill. During decode, it combines nonuniform layer-wise cache capacity, domain-informed initialization, routing-history-aware replacement, and cross-layer prefetching. The main configuration executes router-selected experts exactly; an optional score-based substitution path handles eligible low-score misses. The main comparison uses 1K- and 128-token output caps for MoE-CORE and vLLM Prefetch, respectively. Across five workloads per model, MoE-CORE records a mean time per output token (TPOT) of 38.0-44.8 ms versus 1268.9-1269.1 ms for the evaluated vLLM Prefetch configuration on DeepSeek-V4-Flash-W4A8; the corresponding values on GLM-5.2-W4A8C8 are 206.6-220.5 and 5941.5-5941.8 ms. Under an 84-GB NPU-memory cap, the best measured DeepSeek GSM8K configuration achieves a TPOT of 21.5 ms with approximate expert substitution and multi-token prediction (MTP) at depth 2. These results support coordinated expert residency and transfer scheduling under a device-memory constraint. The code is here.

cs.DC↗

arXiv2026

VPP: Virtual Pipeline Parallelism for Efficient Chunked Prefill in Long-Context LLM Inference

Chunked prefill pipeline parallelism (CPP) is a key technique for LLM inference. However, equal-size chunks exhibit imbalanced latency, as later chunks attend longer prefix KV caches and incur higher attention costs, leading to pipeline bubbles. Existing approaches mitigate this imbalance through dynamic chunk resizing (Dynamic CPP, DCPP), but our measurements show that this trades scheduling overhead for load balancing, which becomes unfavorable on long sequences. In this study, we propose Virtual Pipeline Parallelism (VPP), which keeps chunk sizes fixed and optimizes the pipeline layout through virtual stages. A V-shaped virtual-stage traversal overlaps each chunk's expensive middle stages with the lighter head and tail stages of its neighbors, while asynchronous communication and pipelined packing further reduce communication stalls and cross-request drain bubbles. We implement VPP in vLLM-Ascend and evaluate it on three MoE-based LLMs with sequences up to 1M tokens on 16 Ascend 910C NPUs. VPP improves throughput by up to 13.1% over DCPP on long sequences and 6.7% on mixed workloads, while preserving performance on short sequences. On a 512K-token DeepSeek-V3.1 prefill workload, VPP reduces the pipeline bubble ratio from 6.4% to 0.1%, achieving a 98.0% reduction compared with DCPP.

cs.DC↗

arXiv2026

Giant Magnetocrystalline Anisotropy in Honeycomb Iridate NiIrO3 with Large Coercive Field Exceeding 17 T

The realization of unconventional quantum phases in frustrated and spin-orbit coupled materials remains at the forefront of quantum materials research. Here we report the synthesis and discovery of NiIrO3, the first honeycomb iridate with coupled 3d-5d magnetic sublattices, through a soft topotactic reaction. Structural analysis reveals an ilmenite-type stacking of edge-sharing NiO6 and IrO6 octahedral honeycomb sublattices in a Kitaev geometry. Comprehensive magnetic and electrical transport measurements unveil its long-range ferrimagnetic order below 213 K, which is in sharp contrast to the predominantly antiferromagnetic order in the known honeycomb iridates. Notably, the titled compound displays an exceptionally large magnetocrystalline anisotropy energy of 32.2 meV/f.u. and a giant coercivity with coercive field exceeding 17.3 T below 4.2 K, both ranking among the highest observed in iridates to date. Combined experimental and theoretical investigations indicate that the exceptional anisotropy and coercivity originate from the synergistic effect between strong lattice frustration in the coupled 3d-5d honeycomb lattice network and the robust spin-orbit coupling of the Ir4+ (Jeff = 1/2) state. This work positions NiIrO3 as a promising platform to investigate low-dimensional and frustrated quantum spin systems, and highlights its potential for spintronic applications through the targeted engineering of 3d-5d interactions.

cond-mat.str-el↗

arXiv2025

Distinct Suppression Mechanisms of Superconductivity by Magnetic Domains and Spin Fluctuations in EuFe2(As1-xPx)2 superconductors

Using ac composite magnetoelectric technique, we map the phase diagrams of EuFe(As1-xPx)2 to resolve the interplay between superconductivity and ferromagnetism. For samples with Tc TFM, strong short-range spin correlations and phase boundaries within a multiphase coexistence regime near the triple point act as potent pair-breaking centers, leading to pronounced Hc2 suppression.

cond-mat.supr-con↗

arXiv2025

IntentVCNet: Bridging Spatio-Temporal Gaps for Intention-Oriented Controllable Video Captioning

Intent-oriented controlled video captioning aims to generate targeted descriptions for specific targets in a video based on customized user intent. Current Large Visual Language Models (LVLMs) have gained strong instruction following and visual comprehension capabilities. Although the LVLMs demonstrated proficiency in spatial and temporal understanding respectively, it was not able to perform fine-grained spatial control in time sequences in direct response to instructions. This substantial spatio-temporal gap complicates efforts to achieve fine-grained intention-oriented control in video. Towards this end, we propose a novel IntentVCNet that unifies the temporal and spatial understanding knowledge inherent in LVLMs to bridge the spatio-temporal gap from both prompting and model perspectives. Specifically, we first propose a prompt combination strategy designed to enable LLM to model the implicit relationship between prompts that characterize user intent and video sequences. We then propose a parameter efficient box adapter that augments the object semantic information in the global visual context so that the visual token has a priori information about the user intent. The final experiment proves that the combination of the two strategies can further enhance the LVLM's ability to model spatial details in video sequences, and facilitate the LVLMs to accurately generate controlled intent-oriented captions. Our proposed method achieved state-of-the-art results in several open source LVLMs and was the runner-up in the IntentVC challenge. Our code is available on https://github.com/thqiu0419/IntentVCNet.

cs.CV↗