arXiv Science⌕ Search

arXiv subjects

Cheng Li

Publications and source records attributed to Cheng Li.

At least 91 records · Page 5Linked to original sources

Amorphous Nanoconfinement Enables Self-sustaining Sabatier Reaction at Ambient Conditions

The Sabatier reaction, the catalytic hydrogenation of CO2 into CH4, offers a cornerstone for carbon capture and utilization, and in-situ resource utilization during space exploration; however, it faces a fundamental thermodynamic-kinetic paradox: although highly exothermic, conventional catalysts still require continuous external heating to activate CO2 and maintain stable operation. Here we report an amorphous silica-embedded ruthenium catalyst that enables a long-term self-sustaining autothermal Sabatier reaction dispensing with external energy supply. Operating under ambient conditions, this system achieves a record-high CH4 yield of 0.50 mol gcat-1 h-1 with 100% selectivity, stable operation for over 2,000 hours, and a record-low catalyst bed temperature down to 100 oC. This exceptional self-sustaining behavior stems from the synergistic effect of the catalyst's ultralow effective thermal conductivity (0.27 W m-1 K-1), induced by amorphous nanoconfinement, and its superior intrinsic activity. This synergy generates localized hot spots at Ru sites while suppressing macroscopic heat loss. In situ measurements further reveal CH4 formation even at 54 oC and identify a *CO-mediated pathway for CO2 methanation. The reaction ignites readily with a lighter or focused sunlight and persists even under forced convection from an electric fan, demonstrating strong environmental tolerance. By removing the need for constant energy input, this "ignite-and-forget" system paves the way for decentralized Power-to-Gas systems and autonomous fuel production in resource-constrained environments like Mars.

cond-mat.mtrl-sci↗

Fast and Provably Accurate Sequential Designs using Hilbert Space Gaussian Processes

Gaussian processes are widely used for accurate emulation of unknown surfaces in sequential design of expensive simulation experiments. Integrated mean squared error (IMSE) is an effective acquisition function for sequential designs based on Gaussian processes. However, existing approaches struggle with its implementation because the required integrals often lack closed-form expressions for most kernel functions. We propose a novel and computationally efficient Hilbert space Gaussian process approximation for the IMSE acquisition function, where a truncated eigenbasis representation of the integral enables closed-form evaluation. We establish sharp global non-asymptotic bounds for both the approximation error of isotropic kernels and the resulting error in the acquisition function. In a series of numerical experiments with $γ$-stabilizing, the proposed method achieves substantially lower prediction error and reduced computation time compared to existing benchmarks. These results demonstrate that the proposed Hilbert space Gaussian process framework provides an accurate and computationally efficient approach for Gaussian process based sequential design.

math.ST↗

Search for Dark Matter in 2HDMS at LHC and future Lepton Colliders

We investigate the phenomenological prospects of the Two Higgs Doublet and Complex Singlet Scalar Extension (2HDMS) in the context of dark matter (DM) and Higgs phenomenology. The 2HDMS provides an enlarged Higgs sector along with a DM candidate. In this work, we perform an exhaustive scan to find representative benchmarks which are consistent with all theoretical and experimental constraints. We choose benchmarks with light, intermediate and massive DM masses and in some cases, also accommodate the 95 GeV excess in $b\bar{b}$ and $γγ$ channels observed at the Large Electron-Positron Collider (LEP) and Large Hadron Collider (LHC). We focus on the relevant signatures at the LHC and at proposed future lepton colliders including electron-positron and muon colliders. Using a cut and count analysis, we show that while the High Luminosity LHC (HL-LHC) may give a hint of new physics, future lepton colliders prove to be efficient discovery probes for the 2HDMS.

hep-ph↗

AdaCluster: Adaptive Query-Key Clustering for Sparse Attention in Video Generation

Video diffusion transformers (DiTs) suffer from prohibitive inference latency due to quadratic attention complexity. Existing sparse attention methods either overlook semantic similarity or fail to adapt to heterogeneous token distributions across layers, leading to model performance degradation. We propose AdaCluster, a training-free adaptive clustering framework that accelerates the generation of DiTs while preserving accuracy. AdaCluster applies an angle-similarity-preserving clustering method to query vectors for higher compression, and designs a euclidean-similarity-preserving clustering method for keys, covering cluster number assignment, threshold-wise adaptive clustering, and efficient critical cluster selection. Experiments on CogVideoX-2B, HunyuanVideo, and Wan-2.1 on one A40 GPU demonstrate up to 1.67-4.31x speedup with negligible quality degradation.

cs.CV↗

Bias-constrained multimodal intelligence for equitable and reliable clinical AI

The integration of medical imaging and clinical text has enabled the emergence of generalist artificial intelligence (AI) systems for healthcare. However, pervasive biases, such as imbalanced disease prevalence, skewed anatomical region distributions, heterogeneous imaging protocols, and demographic disparities, pose significant challenges to the fairness and reliability of vision-language systems in real-world clinical settings. Here we present BiasCareVL, a bias-aware multimodal learning framework that introduces bias control directly into model design, rather than treating it as a post hoc correction. BiasCareVL incorporates adaptive uncertainty modeling with optional human-in-the-loop refinement to regulate the influence of dominant data patterns and to promote equitable reasoning under distributional imbalance. Trained on 3.44 million samples spanning over 15 imaging modalities, the framework supports diverse clinical tasks, including visual question answering, disease classification, segmentation, and report generation within a unified representation space. Across eight public benchmarks covering dermatology, oncology, radiology, and pathology, BiasCareVL consistently outperforms 20 state-of-the-art methods, with pronounced gains in clinically challenging scenarios, including over 10% accuracy improvement in multi-class skin lesion diagnosis and more than 20% Dice improvement in small tumor segmentation. Furthermore, BiasCareVL achieves diagnostic performance exceeding human accuracy with substantially reduced time requirements when evaluated with board-certified radiologists. By open-sourcing BiasCareVL, we aim to promote a transparent, reproducible, and equitable future for AI in healthcare, paving the way for general-purpose, trustworthy, and clinically reliable AI systems.

cs.CV↗

A comparison of the spin-phonon behaviour of Fe$_2$P-based magnetocaloric materials

Magnetic refrigeration can provide an environmentally friendly technology to reduce significantly the energy consumption of cooling devices. To retain the sustainability of the device, all parts must be made from abundant materials, excluding e.g. rare earth elements. As such, materials based on Fe$_2$P have shown great potential for magnetocaloric devices. In this study, Fe$_2$P and FeMnP$_{0.55}$Si$_{0.45}$, have been studied using magnetometry, neutron scattering and theoretical modelling with the aim to understand the ferromagnetic transition, related to the magnetocaloric effect. Analysis of the diffraction data of Fe$_2$P showed that it is the Fe$_{3g}$-site that drives the magnetic transition as the Fe$_{3f}$ does not have any magnetic contribution at the magnetic transition temperature. For FeMnP$_{0.55}$Si$_{0.45}$, the magnetic transition is more gradual, on both sites, with coexistence of the para- and ferromagnetic phases close to the magnetic transition. The temperature dependent magnetic structure behaviour are well in agreement with our first principles calculations. Both Fe$_2$P and FeMnP$_{0.55}$Si$_{0.45}$ showed two distinct regions, at different length scales, in their S(\textbf{Q},$ω$) spectra. The two length scales can be modelled using a different set of magnetic spin states (S), using S$\rm _{Fe}$~=~2 and S$\rm _{Mn}$~=~2.5, consistent with the ground state of the magnetic atoms. QENS at low Q (Q~\textless{}~0.5~Å) shows similar magnetic processes in both compounds with uncorrelated magnetism below the magnetic transition temperature. The uncorrelated state highlights that the magnetic anisotropy does not play a major role in the formation of the magnetic state. Furthermore, this emphasises the existence of a two part system in FeMn(P,Si)-based compounds, that drives the magnetic transition and in turn the magnetocaloric effect.

cond-mat.mtrl-sci↗

ScoutAttention: Efficient KV Cache Offloading via Layer-Ahead CPU Pre-computation for LLM Inference

Large language models encounter critical GPU memory capacity constraints during long-context inference, where KV cache memory consumption severely limits decode batch sizes. While existing research has explored offloading KV cache to DRAM, these approaches either demand frequent GPU-CPU data transfers or impose extensive CPU computation requirements, resulting in poor GPU utilization as the system waits for I/O operations or CPU processing to complete. We propose ScoutAttention, a novel KV cache offloading framework that accelerates LLM inference through collaborative GPU-CPU attention computation. To prevent CPU computation from bottlenecking the system, ScoutAttention introduces GPU-CPU collaborative block-wise sparse attention that significantly reduces CPU load. Unlike conventional parallel computing approaches, our framework features a novel layer-ahead CPU pre-computation algorithm, enabling the CPU to initiate attention computation one layer in advance, complemented by asynchronous periodic recall mechanisms to maintain minimal CPU compute load. Experimental results demonstrate that ScoutAttention maintains accuracy within 2.4% of baseline while achieving 2.1x speedup compared to existing offloading methods.

cs.LG↗

LiteCache: A Query Similarity-Driven, GPU-Centric KVCache Subsystem for Efficient LLM Inference

During LLM inference, KVCache memory usage grows linearly with sequence length and batch size and often exceeds GPU capacity. Recent proposals offload KV states to host memory and reduce transfers using top-k attention. But their CPU-centric management of the on-GPU cache and CPU-GPU data movement incurs high overhead and fragments the bulk GPU execution that CUDA Graph relies on. To close this gap, we observe that adjacent queries within the same attention head exhibit strong directional similarity and retrieve highly overlapping top-k KV states. This insight enables a simple head granularity cache algorithm, QSAC, in which each head reuses its previously cached KV states whenever the current query is sufficiently similar to the prior one. QSAC further simplifies cache management primitives and cuts CPU involvement almost entirely. We develop LiteCache, a KVCache subsystem that incorporates QSAC. LiteCache introduces a GPU-centric synchronization controller and speculative sparse prefetching, enabling fully overlapped data movement and computation. These mechanisms produce a stable and predictable execution pattern that remains compatible with the bulk execution mode required by CUDA Graphs. Evaluation on two widely-used LLMs indicates that LiteCache achieves comparable accuracy to baselines, while sharply minimizing CPU overhead, fully utilizing PCIe bandwidth, thus improving decoding throughput by 10.7-224.2% on both H100 and A40 GPUs and easily supporting sequence lengths beyond 1M. We opensource LiteCache at https://anonymous.4open.science/r/LiteCache-888D.

cs.LG↗

Interaction-induced HI gas concentration with centrally-enhanced star formation in ALFALFA-SDSS galaxies

We present a statistical analysis for the interaction-induced central concentration of HI gas distributions and its connection with interaction-induced central star formation enhancement, using a large sample of $\sim 10^4$ galaxies from the ALFALFA and SDSS surveys. By adopting the HI profile parameter $K$, an indicator of gas concentration inferred from the integrated 21 cm emission line, we find that galaxies with more centrally concentrated HI (higher $K$ values) or enhanced specific star foramtion rate (sSFR) exhibit significantly stronger clustering and higher probability of hosting a nearby neighbor on scales below $100h^{-1}\mathrm{kpc}$, which is more pronounced in low-mass galaxies. Furthermore, by utilizing the enhancement functions for a sample of galaxy pairs, we directly trace the evolution of HI concentration and sSFR enhancement as a function of projected separation. Our findings indicate that tidal interactions drive a statistical synchrony between the central concentration of atomic gas and the enhancement of central star formation. Gas concentration appears to be a necessary condition for central star formation enhancement in interacting systems at all but the smallest separations. Compared to satellite galaxies, central galaxies exhibit stronger enhancement of gas fraction, gas concentration and sSFR, suggesting the role of environmental regulation.

astro-ph.GA↗

A Tug-of-War Between Baroclinic Eddies and Convection: Implications for Icy Moon Oceans

In many geophysical and planetary environments, such as Earth's ocean and atmosphere as well as subsurface oceans of icy satellites, convection driven by bottom geothermal heating usually coexists with baroclinic eddies driven by lateral buoyancy/temperature gradients. These processes compete against each other, with convection destabilizing the stratification and baroclinic eddies re-stabilizing it, thereby controlling whether the bottom heat flux is significantly redistributed as it is transmitted to the upper surface. Using scaling analysis and numerical simulations, we show that a stratified layer persists near the upper surface up to ${\rm Ra}_{v}\sim {\rm Ra}_h^{5/2}$, where ${\rm Ra}_h\equiv Δb_0/(L_zf^2)$ measures the imposed upper-surface buoyancy contrast $Δb_0$ and ${\rm Ra}_v\equiv B_0/(L_z^2f^3)$ measures the strength of the bottom buoyancy flux $B_0$, $L_z$ is the domain depth and $f$ is the Coriolis parameter. For ${\rm Ra}_v<{\rm Ra}_h^{5/2}$, baroclinic eddies dominate over convection, maintain the upper stratified layer, and completely deflect the bottom buoyancy/heat input into meridional transport. In contrast, when ${\rm Ra}_v>{\rm Ra}_h^{5/2}$, convective plumes penetrate the stratification and transport buoyancy/heat vertically with negligible deflection. Building on these results, we further propose a scaling law for the meridional buoyancy/heat transport in this system. Applications to icy satellites are discussed.

physics.ao-ph↗

Let It Flow: Agentic Crafting on Rock and Roll, Building the ROME Model within an Open Agentic Learning Ecosystem

Agentic crafting requires LLMs to operate in real-world environments over multiple turns by taking actions, observing outcomes, and iteratively refining artifacts. Despite its importance, the open-source community lacks a principled, end-to-end ecosystem to streamline agent development. We introduce the Agentic Learning Ecosystem (ALE), a foundational infrastructure that optimizes the production pipeline for agentic model. ALE consists of three components: ROLL, a post-training framework for weight optimization; ROCK, a sandbox environment manager for trajectory generation; and iFlow CLI, an agent framework for efficient context engineering. We release ROME, an open-source agent grounded by ALE and trained on over one million trajectories. Our approach includes data composition protocols for synthesizing complex behaviors and a novel policy optimization algorithm, Interaction-Perceptive Agentic Policy Optimization (IPA), which assigns credit over semantic interaction chunks rather than individual tokens to improve long-horizon training stability. Empirically, we evaluate ROME within a structured setting and introduce Terminal Bench Pro, a benchmark with improved scale and contamination control. ROME demonstrates strong performance across benchmarks like SWE-bench Verified and Terminal Bench, proving the effectiveness of ALE.

cs.AI↗

Wukong-Omni: Design, Modeling and Control of a Multi-mode Robot for Air, Land, and Underwater Exploration with All-in-One Propulsion Unit

In flood disaster rescue scenarios, partially submerged buildings prevent aerial robots from accessing lower levels, limiting mission effectiveness. To address this challenge, this paper presents Wukong-Omni, a novel multimode robot capable of operating across land, air, and underwater using a unified propulsion system. The system is enabled by an innovative mechanical design that allows motor reuse and improves thrust generation. Efficiency and peak thrust are enhanced through simulation and tank-based optimization. Experimental results show a 100 percent improvement in propulsion efficiency and a 150 percent increase in maximum thrust compared with direct installation methods. Dynamic models for the three operating domains are developed, and a unified cross-domain control framework is proposed. Comprehensive experiments validate stable locomotion and smooth transition across domains. Outdoor experiments further demonstrate robustness and adaptability in real-world environments.

cs.RO↗

Lagom: Unleashing the Power of Communication and Computation Overlapping for Distributed LLM Training

Overlapping communication with computation is crucial for distributed large-model training, yet optimizing it - especially when computation becomes the bottleneck-remains challenging. We present Lagom, a system that co-tunes communication parameters to balance resource usage between computation and communication. By introducing a unified cost model and a priority-based search algorithm, Lagom reduces optimization complexity from exponential to linear. Evaluations on high- and low-bandwidth GPU clusters show that Lagom achieves 1.07-1.33x and 1.03-1.27x speedup over NCCL and AutoCCL across diverse models and parallelizations.

cs.DC↗

BayeSED-GALAXIES II. Bayesian full spectrum analysis of galaxies and application in the CSST wide-field slitless spectroscopy survey

The China Space Station Telescope (CSST) will conduct wide-field multiband photometric imaging and slitless spectroscopic surveys, advancing cosmology and galaxy evolution studies. Achieving CSST's cosmological goals requires precise redshifts ($σ_{\rm NMAD}\lesssim 0.002-0.005$) from low-resolution ($R\sim200$) and potentially blended slitless spectra. We present BayeSED3, extended for Bayesian full-spectrum analysis, including nebular emission modeling (via \textsc{Cloudy}) and a Bayesian treatment of the model scaling factor, improving reliability over optimization methods for low SNR spectra. Validated on realistic mock data generated with the CESS emulator (median SNR=1.65, including instrumental and self-blending effects), our method achieves excellent redshift precision with three-band (GU+GV+GI) spectroscopy: $σ_{\rm NMAD}=0.0008$ ($\sim$80% success) for star-forming and $σ_{\rm NMAD}=0.0015$ ($\sim$50% success) for quiescent galaxies. Stellar mass ($σ_{\rm NMAD}\approx0.015$ dex for SF, $\approx0.016$ dex for quiescent) and SFR ($σ_{\rm NMAD}\approx0.05$ dex for SF, especially at SNR>1) are reliably recovered. Self-blending increases scatter by $\gtrsim30%$, but combining spectroscopy with CSST's seven-band photometry significantly improves accuracy, especially for quiescent galaxies and data-limited cases. Single-band spectroscopy plus photometry yields reasonable redshifts: GU+photometry is limited, GI+photometry gives >60% (SF) and >40% (quiescent) success at $σ_{\rm NMAD}\lesssim0.002$, GV+photometry gives >35% (SF) and $\sim$40% (quiescent) at similar precision. The Bayesian framework offers a powerful method for accurate galaxy characterization, enhancing CSST's scientific outcomes despite the challenges of slitless spectroscopy.

astro-ph.GA↗

Kimi K2: Open Agentic Intelligence

We introduce Kimi K2, a Mixture-of-Experts (MoE) large language model with 32 billion activated parameters and 1 trillion total parameters. We propose the MuonClip optimizer, which improves upon Muon with a novel QK-clip technique to address training instability while enjoying the advanced token efficiency of Muon. Based on MuonClip, K2 was pre-trained on 15.5 trillion tokens with zero loss spike. During post-training, K2 undergoes a multi-stage post-training process, highlighted by a large-scale agentic data synthesis pipeline and a joint reinforcement learning (RL) stage, where the model improves its capabilities through interactions with real and synthetic environments. Kimi K2 achieves state-of-the-art performance among open-source non-thinking models, with strengths in agentic capabilities. Notably, K2 obtains 66.1 on Tau2-Bench, 76.5 on ACEBench (En), 65.8 on SWE-Bench Verified, and 47.3 on SWE-Bench Multilingual -- surpassing most open and closed-sourced baselines in non-thinking settings. It also exhibits strong capabilities in coding, mathematics, and reasoning tasks, with a score of 53.7 on LiveCodeBench v6, 49.5 on AIME 2025, 75.1 on GPQA-Diamond, and 27.1 on OJBench, all without extended thinking. These results position Kimi K2 as one of the most capable open-source large language models to date, particularly in software engineering and agentic tasks. We release our base and post-trained model checkpoints to facilitate future research and applications of agentic intelligence.

cs.LG↗

Neuro-Symbolic Verification on Instruction Following of LLMs

A fundamental problem of applying Large Language Models (LLMs) to important applications is that LLMs do not always follow instructions, and violations are often hard to observe or check. In LLM-based agentic workflows, such violations can propagate and amplify along reasoning chains, causing task failures and system incidents. This paper presents NSVIF, a neuro-symbolic framework for verifying whether an LLM's output follows the instructions used to prompt the LLM. NSVIF is a universal, general-purpose verifier; it makes no assumption about the instruction or the LLM. NSVIF formulates instruction-following verification as a constraint-satisfaction problem by modeling user instructions as constraints. NSVIF models both logical and semantic constraints; constraint solving is done by a unified solver that orchestrates logical reasoning and semantic analysis. To evaluate NSVIF, we develop VIFBENCH, a new benchmark for instruction-following verifiers with fine-grained data labels. Experiments show that NSVIF significantly outperforms LLM-based approaches and provides interpretable feedback. We also show that feedback from NSVIF helps improve LLMs' instruction-following capability without post-training.

cs.AI↗

Pathways of Thoughts: Multi-Directional Thinking for Long-form Personalized Question Answering

Personalization is well studied in search and recommendation, but personalized question answering remains underexplored due to challenges in inferring preferences from long, noisy, implicit contexts and generating responses that are both accurate and aligned with user expectations. To address this, we propose Pathways of Thoughts (PoT), an inference-stage method that applies to any large language model (LLM) without task-specific fine-tuning. PoT models the thinking as an iterative decision process, where the model dynamically selects among cognitive operations such as reasoning, revision, personalization, and clarification. This enables exploration of multiple reasoning trajectories, producing diverse candidate responses that capture different perspectives. PoT then aggregates and reweights these candidates according to inferred user preferences, yielding a final personalized response that benefits from the complementary strengths of diverse reasoning paths. Experiments on the LaMP-QA benchmark show that PoT consistently outperforms competitive baselines, achieving up to a 10.8\% relative improvement. Human evaluation further validates these improvements, with annotators preferring PoT in 66\% of cases compared to the best-performing baseline and reporting ties in 15\% of cases.

cs.CL↗

Exploring Lorentz Invariance Violation from Ultra-high-energy Gamma Rays Observed by LHAASO

Recently the LHAASO Collaboration published the detection of 12 ultra-high-energy gamma-ray sources above 100 TeV, with the highest energy photon reaching 1.4 PeV. The first detection of PeV gamma rays from astrophysical sources may provide a very sensitive probe of the effect of the Lorentz invariance violation (LIV), which results in decay of high-energy gamma rays in the superluminal scenario and hence a sharp cutoff of the energy spectrum. Two highest energy sources are studied in this work. No signature of the existence of LIV is found in their energy spectra, and the lower limits on the LIV energy scale are derived. Our results show that the first-order LIV energy scale should be higher than about 10^5 times the Planck scale M_{pl} and that the second-order LIV scale is >10^{-3}M_{pl}. Both limits improve by at least one order of magnitude the previous results.

astro-ph.HE↗