arXiv subjects

Guowei Li

Publications and source records attributed to Guowei Li.

At least 19 recordsLinked to original sources

arXiv2026

Measurement-Driven Diagnosis and Mitigation of Host-CPU Co-location Interference in Single-GPU LLM Serving on a Multi-GPU Server

Host CPUs in GPU servers are often under-used during LLM inference. Co-locating CPU workloads can improve resource use, but it can also seriously hurt serving quality. Existing work mainly improves LLM serving engines or studies CPU-GPU boundary delays. It gives limited guidance on how external CPU workloads affect the serving path and how operators should choose protection policies. This paper studies host-CPU co-location interference in single-GPU LLM serving. We show that the main observed problem is not slower GPU kernels. Instead, CPU workloads amplify long tails in CPU-side serving stages before GPU work is submitted. To capture this effect, we introduce the Core Path Tail Index (CPTI) and Core Tail Suppression (CTS). Based on these metrics, we build CoTail, a measurement-driven diagnostic procedure that screens workload risk, profiles serving-stage tails, selects OS-level protections, and validates decode SLO compliance. In our primary setup, unprotected nginx co-location reduces throughput by 78.8%, increases TTFT by 429.5%, and increases TPOT by 362.4%. CoTail-guided protections improve nginx throughput by up to 4.4x and reduce TPOT by 4.5x. Under a common-baseline deployment SLO, CoTail satisfies all 12 oracle-feasible held-out cases, compared with 10/12 for Always-rt and 11/12 for Macro-only. It also reduces RT usage from 28 to 22 cases and lowers mean co-tenant slowdown from 56.65% to 51.21%.

cs.DC↗

arXiv2026

DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence

We present a preview version of DeepSeek-V4 series, including two strong Mixture-of-Experts (MoE) language models -- DeepSeek-V4-Pro with 1.6T parameters (49B activated) and DeepSeek-V4-Flash with 284B parameters (13B activated) -- both supporting a context length of one million tokens. DeepSeek-V4 series incorporate several key upgrades in architecture and optimization: (1) a hybrid attention architecture that combines Compressed Sparse Attention (CSA) and Heavily Compressed Attention (HCA) to improve long-context efficiency; (2) Manifold-Constrained Hyper-Connections (mHC) that enhance conventional residual connections; (3) and the Muon optimizer for faster convergence and greater training stability. We pre-train both models on more than 32T diverse and high-quality tokens, followed by a comprehensive post-training pipeline that unlocks and further enhances their capabilities. DeepSeek-V4-Pro-Max, the maximum reasoning effort mode of DeepSeek-V4-Pro, redefines the state-of-the-art for open models, outperforming its predecessors in core tasks. Meanwhile, DeepSeek-V4 series are highly efficient in long-context scenarios. In the one-million-token context setting, DeepSeek-V4-Pro requires only 27% of single-token inference FLOPs and 10% of KV cache compared with DeepSeek-V3.2. This enables us to routinely support one-million-token contexts, thereby making long-horizon tasks and further test-time scaling more feasible. The model checkpoints are available at https://huggingface.co/collections/deepseek-ai/deepseek-v4.

cs.CL↗

arXiv2026

LifeBench: A Benchmark for Long-Horizon Multi-Source Memory

Long-term memory is fundamental for personalized agents capable of accumulating knowledge, reasoning over user experiences, and adapting across time. However, existing memory benchmarks primarily target declarative memory, specifically semantic and episodic types, where all information is explicitly presented in dialogues. In contrast, real-world actions are also governed by non-declarative memory, including habitual and procedural types, and need to be inferred from diverse digital traces. To bridge this gap, we introduce Lifebench, which features densely connected, long-horizon event simulation. It pushes AI agents beyond simple recall, requiring the integration of declarative and non-declarative memory reasoning across diverse and temporally extended contexts. Building such a benchmark presents two key challenges: ensuring data quality and scalability. We maintain data quality by employing real-world priors, including anonymized social surveys, map APIs, and holiday-integrated calendars, thus enforcing fidelity, diversity and behavioral rationality within the dataset. Towards scalability, we draw inspiration from cognitive science and structure events according to their partonomic hierarchy; enabling efficient parallel generation while maintaining global coherence. Performance results show that top-tier, state-of-the-art memory systems reach just 55.2\% accuracy, highlighting the inherent difficulty of long-horizon retrieval and multi-source integration within our proposed benchmark. The dataset and data synthesis code are available at https://github.com/1754955896/LifeBench.

cs.AI↗

arXiv2025

DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models

We introduce DeepSeek-V3.2, a model that harmonizes high computational efficiency with superior reasoning and agent performance. The key technical breakthroughs of DeepSeek-V3.2 are as follows: (1) DeepSeek Sparse Attention (DSA): We introduce DSA, an efficient attention mechanism that substantially reduces computational complexity while preserving model performance in long-context scenarios. (2) Scalable Reinforcement Learning Framework: By implementing a robust reinforcement learning protocol and scaling post-training compute, DeepSeek-V3.2 performs comparably to GPT-5. Notably, our high-compute variant, DeepSeek-V3.2-Speciale, surpasses GPT-5 and exhibits reasoning proficiency on par with Gemini-3.0-Pro, achieving gold-medal performance in both the 2025 International Mathematical Olympiad (IMO) and the International Olympiad in Informatics (IOI). (3) Large-Scale Agentic Task Synthesis Pipeline: To integrate reasoning into tool-use scenarios, we developed a novel synthesis pipeline that systematically generates training data at scale. This methodology facilitates scalable agentic post-training, yielding substantial improvements in generalization and instruction-following robustness within complex, interactive environments.

cs.CL↗

arXiv2025

Huge Stress-induced Adiabatic Temperature Change in a High-Toughness All-d-metal Heusler Alloy

The elastocaloric effect (eCE), referring to the thermal effect triggered by a uniaxial stress, provides a promising and versatile routine for green and high efficient thermal management. However, current eCE materials generally suffer from relatively low eCE and poor mechanical properties, hindering their practical applications. Here, we report a exceptionally huge eCE with a directly measured adiabatic temperature change of up to 57.2 K in a dual-phase all-d-metal Heusler Mn50Ni37.5Ti12.5 polycrystalline alloy, revealing an extra contribution to the latent heat during the stress-induced martensitic transformation from B2 to L10, and breaking the record of adiabatic temperature change for elastocaloric alloys. Moreover, thanks to the combined strengthening effect of d-d hybridization and well-dispersed secondary cubic {\gamma} phase, the alloy can endure a uniaxial stress up to 1760 MPa. Such an abnormal huge eCE is attributed to the combination of the enhanced entropy change associated with a stress-induced B2 to L10 martensitic transformation under higher stress, in contrast with the thermally induced B2 to 5-layer modulated structure one, and the high transformation fraction due to the multi-point nucleation facilitated by the {\gamma} phase dispersed in the main phase. This work provides insight into making full use of the transformation heat to enhance the caloric effect for high-efficient thermal management systems.

cond-mat.mtrl-sci↗

arXiv2025

DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

General reasoning represents a long-standing and formidable challenge in artificial intelligence. Recent breakthroughs, exemplified by large language models (LLMs) and chain-of-thought prompting, have achieved considerable success on foundational reasoning tasks. However, this success is heavily contingent upon extensive human-annotated demonstrations, and models' capabilities are still insufficient for more complex problems. Here we show that the reasoning abilities of LLMs can be incentivized through pure reinforcement learning (RL), obviating the need for human-labeled reasoning trajectories. The proposed RL framework facilitates the emergent development of advanced reasoning patterns, such as self-reflection, verification, and dynamic strategy adaptation. Consequently, the trained model achieves superior performance on verifiable tasks such as mathematics, coding competitions, and STEM fields, surpassing its counterparts trained via conventional supervised learning on human demonstrations. Moreover, the emergent reasoning patterns exhibited by these large-scale models can be systematically harnessed to guide and enhance the reasoning capabilities of smaller models.

cs.CL↗

arXiv2024

DeepSeek-V3 Technical Report

We present DeepSeek-V3, a strong Mixture-of-Experts (MoE) language model with 671B total parameters with 37B activated for each token. To achieve efficient inference and cost-effective training, DeepSeek-V3 adopts Multi-head Latent Attention (MLA) and DeepSeekMoE architectures, which were thoroughly validated in DeepSeek-V2. Furthermore, DeepSeek-V3 pioneers an auxiliary-loss-free strategy for load balancing and sets a multi-token prediction training objective for stronger performance. We pre-train DeepSeek-V3 on 14.8 trillion diverse and high-quality tokens, followed by Supervised Fine-Tuning and Reinforcement Learning stages to fully harness its capabilities. Comprehensive evaluations reveal that DeepSeek-V3 outperforms other open-source models and achieves performance comparable to leading closed-source models. Despite its excellent performance, DeepSeek-V3 requires only 2.788M H800 GPU hours for its full training. In addition, its training process is remarkably stable. Throughout the entire training process, we did not experience any irrecoverable loss spikes or perform any rollbacks. The model checkpoints are available at https://github.com/deepseek-ai/DeepSeek-V3.

cs.CL↗

arXiv2024

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

We present DeepSeek-V2, a strong Mixture-of-Experts (MoE) language model characterized by economical training and efficient inference. It comprises 236B total parameters, of which 21B are activated for each token, and supports a context length of 128K tokens. DeepSeek-V2 adopts innovative architectures including Multi-head Latent Attention (MLA) and DeepSeekMoE. MLA guarantees efficient inference through significantly compressing the Key-Value (KV) cache into a latent vector, while DeepSeekMoE enables training strong models at an economical cost through sparse computation. Compared with DeepSeek 67B, DeepSeek-V2 achieves significantly stronger performance, and meanwhile saves 42.5% of training costs, reduces the KV cache by 93.3%, and boosts the maximum generation throughput to 5.76 times. We pretrain DeepSeek-V2 on a high-quality and multi-source corpus consisting of 8.1T tokens, and further perform Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) to fully unlock its potential. Evaluation results show that, even with only 21B activated parameters, DeepSeek-V2 and its chat versions still achieve top-tier performance among open-source models.

cs.CL↗

arXiv2024

DeepSeek LLM: Scaling Open-Source Language Models with Longtermism

The rapid development of open-source large language models (LLMs) has been truly remarkable. However, the scaling law described in previous literature presents varying conclusions, which casts a dark cloud over scaling LLMs. We delve into the study of scaling laws and present our distinctive findings that facilitate scaling of large scale models in two commonly used open-source configurations, 7B and 67B. Guided by the scaling laws, we introduce DeepSeek LLM, a project dedicated to advancing open-source language models with a long-term perspective. To support the pre-training phase, we have developed a dataset that currently consists of 2 trillion tokens and is continuously expanding. We further conduct supervised fine-tuning (SFT) and Direct Preference Optimization (DPO) on DeepSeek LLM Base models, resulting in the creation of DeepSeek Chat models. Our evaluation results demonstrate that DeepSeek LLM 67B surpasses LLaMA-2 70B on various benchmarks, particularly in the domains of code, mathematics, and reasoning. Furthermore, open-ended evaluations reveal that DeepSeek LLM 67B Chat exhibits superior performance compared to GPT-3.5.

cs.CL↗

arXiv2023

Topological Quantum Materials for Energy Conversion and Storage

Topological quantum materials (TQMs) have symmetry protected band structures with useful electronic properties that have applications in information, sensing, energy, and other technologies. In the past 10 years, the applications of TQMs in the field of energy conversion and storage mainly including water splitting, ethanol electro-oxidation, battery, supercapacitor, and relative energy-efficient devices have attracted increasing attention. The novel quantum states in TQMs provide a stable electron bath with high conductivity and carrier mobility, long lifetime, and determined spin states, making TQMs an ideal platform for understanding the surface reactions and looking for highly efficient materials for energy conversion and storage. In this Perspective, we present an overview of the recent progress regarding topological quantum catalysis. We describe the open problems, and the potential applications of TQMs in water splitting, batteries, supercapacitors, and other prospects in energy conversion and storage.

cond-mat.mtrl-sci↗

arXiv2021

Fully two-dimensional incommensurate charge modulation on the Pd-terminated polar surface of PdCoO2

Here we use low-temperature scanning tunneling microscopy and spectroscopy to study the polar surfaces of PdCoO2. On the CoO2-terminated polar surface, we detect the quasiparticle interference pattern originating from the Rashba spin-split surface states. On the well-ordered Pd-terminated polar surface, we observe a regular lattice which has larger lattice constant than the atomic lattice of PdCoO2. In comparison with the shape of the hexagonal bulk Fermi surface, we identify this regular lattice as a fully two-dimensional incommensurate charge modulation that is driven by the Fermi surface nesting. More interestingly, we also find the moir\'e pattern induced by the interference between the two-dimensional incommensurate charge modulation in the Pd layer and the underlying CoO2 lattice. Our results not only show a new charge modulation on the Pd surface of PdCoO2, but also pave the way for fully understanding the novel electronic properties of this material.

cond-mat.str-el↗

arXiv2021

Three-Dimensional Real Space Invariants, Obstructed Atomic Insulators and A New Principle for Active Catalytic Sites

Topologically trivial insulators come in two kinds: atomic, where the Wannier charge centers (WCCs) are localized on the atoms, and obstructed atomic, where the WCCs are located away from the atoms. The latter, which can exhibit interesting surface states and possibly have much larger band gaps than the topological insulators, have so far not been classified in three-dimensional (3D) crystalline materials. In this paper, we developed the 3D real space invariants (RSIs) for the 1651 Shubnikov space groups with the spin-orbit coupling and provide the full classification of 3D obstructed atomic insulators (OAIs) by the RSIs. We then apply the theory to the entire database of materials on the Topological Quantum Chemistry website and Topological Magnetic Materials website, obtaining all the OAIs so far existing in nature. We find that, out of the 34013 paramagnetic and 296 magnetic topologically trivial insulators, there are 3383 paramagnetic and 30 magnetic OAIs. All of them present a filling anomaly under certain open-boundary conditions and exhibit obstructed surface states (OSSs). We further refine the atomic insulator concept to obtain the orbital-selected OAIs (OOAIs), where the WCC of the system is located at a Wyckoff position occupied by an atom but forms a symmetric representation that does not belong to the outer-shell electrons of the given atom. In such a way, we obtain a further 121 OOAIs. Furthermore, we analyze the catalytic properties of one of the OAIs in a "proof of principle" experiment. By using the single crystal of 2H-MoS2 as a hydrogen evolution catalyst, we directly prove that the catalytic activities arise from the surfaces with OSSs. Additional potential applications of the 3D RSIs and OAIs in, for example, electrochemistry, asymmetric catalysis, superconductivity, and Josephson diode will be discussed.

cond-mat.mtrl-sci↗

arXiv2021

Obstructed surface states as the origin of catalytic activity in inorganic heterogeneous catalysts

The discovery of new catalysts that are efficient, sustainable, and low-cost is a major research endeavor for many industrial chemical processes. This requires an understanding and determination of the catalytic origins for the given catalysts, which still remains a challenge. Here we describe a novel method to identify new catalysts based on searching for crystalline symmetry-protected obstructed atomic insulators (OAIs) that have metallic surface states on otherwise semiconducting or insulating compounds. The Wannier charge centers in OAIs are pinned by symmetries at some empty Wyckoff positions so that surfaces that accommodate these sites are guaranteed to have metallic obstructed surface states (OSSs). Beyond the well-studied 2H-MoS2, we further verified our theory on the catalysts, 2H-MoTe2, and 1T'-MoTe2, whose catalytic active sites are consistent with our calculations of obstructed Wannier charge centers (OWCCs) and OSSs. In addition, we have predicted the location of catalytic active sites and confirmed these predictions by exploring the hydrogen evolution reaction on NiPS3 bulk single crystals, which we find to be one of the most promising new catalysts with high activity and, moreover, of low cost. Most importantly, we successfully identified several high-efficient catalysts just by considering the number of OWCCs and the crystal symmetry of the OAIs. Using the real space invariant theory and high-throughput computational methods applied to a database of 34013 topologically trivial insulators, we have identified 1788 unique OAIs (3383 ICSDs), of which 465 are potential high-quality catalysts for heterogeneous reactions. The Miller indices of the active surfaces are also obtained. Our new methodology will facilitate and accelerate the discovery of new catalysts for a wide range of heterogeneous redox reactions, where sustainability, toxicity, and cost must be considered.

cond-mat.mtrl-sci↗

arXiv2021

Growth and helicity of non-centrosymmetric Cu$_2$OSeO$_3$ crystals

We have grown Cu$_2$OSeO$_3$ single crystals with an optimized chemical vapor transport technique by using SeCl$_4$ as a transport agent. Our optimized growth method allows to selectively produce large high quality single crystals. The method is shown to consistently produce Cu$_2$OSeO$_3$ crystals of maximum size 8 mm x 7 mm x 4 mm with a transport duration of around three weeks. We found this method, with SeCl$_4$ as transport agent, more efficient and simple compared to the commonly used growth techniques reported in literature with HCl gas as transport agent. The Cu$_2$OSeO$_3$ crystals have very high quality and the absolute structure are fully determined by simple single crystal x-ray diffraction. We observed both type of crystals with left- and right-handed chiralities. Our magnetization and ferromagnetic resonance data show the same magnetic phase diagram as reported earlier.

cond-mat.mtrl-sci↗

arXiv2020

Growth and transport properties of Mg3X2 (X = Sb, Bi) single crystals

The discovery of high thermoelectric performance in n-type polycrystalline Mg3(Sb,Bi)2 based Zintl compounds has ignited intensive research interest. However, some fundamental questions concerning the anisotropic transport properties and the origin of intrinsically low thermal conductivity are still elusive, requiring the investigation of single crystals. In this work, high-quality p-type Mg3Sb2 and Mg3Bi2 single crystals have been grown by using a self-flux method. The electrical resistivity \r{ho} of Mg3Bi2 single crystal displays an anisotropy with \r{ho} in-plane twice larger than out-of-plane. The low-temperature heat capacity and lattice thermal conductivity of Mg3Sb2 and Mg3Bi2 single crystals have been investigated by using the Debye-Callaway model, from which the existence of low-lying vibration mode could be concluded. Large Gr\"uneisen parameters and strong anharmonicity are found responsible for the intrinsically low thermal conductivity. Moreover, grain boundary scattering does not contribute significantly to suppress the lattice thermal conductivity of polycrystalline Mg3Sb2. Our results provide insights into the intrinsic transport properties of Mg3X2 and could pave a way to realize enhanced thermoelectric performance in single-crystalline Mg3X2-based Zintl compounds.

cond-mat.mtrl-sci↗

arXiv2020

Large Nernst Power Factor over a Broad Temperature Range in Polycrystalline Weyl Semimetal NbP

The discovery of topological materials has provided new opportunities to exploit advanced materials for heat-to-electricity energy conversion as they share many common characteristics with thermoelectric materials. In this work, we report the magneto-thermoelectric properties and Nernst effect of the topological Weyl semimetal NbP. We find that polycrystalline, bulk NbP shows a significantly larger Nernst thermopower than its conventional thermopower under magnetic field. As a result, a maximum Nernst power factor of ~ 35*10-4 Wm-1K-2 is achieved at 9 T and 136 K, which is 4 times higher than its conventional power factor and is also comparable to that of state-of-the-art thermoelectrics. Moreover, the Nernst power factor maintains relatively large value over a broad temperature range. These results highlight that the enhancement of thermoelectric performance can be achieved in topological semimetals based on the Nernst effect and transverse transport.

cond-mat.mtrl-sci↗

arXiv2020

Synergistically creating sulfur vacancies in semimetal-supported amorphous MoS2 for efficient hydrogen evolution

The presence of elemental vacancies in materials is inevitable according to statistical thermodynamics, which will decide the chemical and physical properties of the investigated system. However, the controlled manipulation of vacancies for specific applications is a challenge. Here we report a facile method for creating large concentrations of S vacancies in the inert basal plane of MoS2 supported on semimetal CoMoP2. With a small applied potential, S atoms can be removed in the form of H2S due to the optimized free energy of formation. The existence of vacancies favors electron injection from the electrode to the active site by decreasing the contact resistance. As a consequence, the activity is increased by 221 % with the vacancy-rich MoS2 as electrocatalyst for hydrogen evolution reaction (HER). A small overpotential of 75 mV is needed to deliver a current density of 10 mA cm-2, which is considered among the best values achieved for MoS2. It is envisaged that this work may provide a new strategy for utilizing the semimetal phase for structuring MoS2 into a multi-functional material.

cond-mat.mtrl-sci↗

arXiv2020

In situ modification of delafossite type PdCoO2 bulk single crystal for reversible hydrogen sorption and fast hydrogen evolution

The observation of extraordinarily high conductivity in delafossite-type PdCoO2 is of great current interest, and there is some evidence that electrons behave like a fluid when flowing in bulk crystals of PdCoO2. Thus, this material is an ideal platform for the study of the electron transfer processes in heterogeneous reactions. Here, we report the use of bulk single crystal PdCoO2 as a promising electrocatalyst for hydrogen evolution reactions (HERs). An overpotential of only 31 mV results in a current density of 10 mA cm^(-2), accompanied by high long-term stability. We have precisely determined that the crystal surface structure is modified after electrochemical activation with the formation of strained Pd nanoclusters in the surface layer. These nanoclusters exhibit reversible hydrogen sorption and desorption, creating more active sites for hydrogen access. The bulk PdCoO2 single crystal with ultra-high conductivity, which acts as a natural substrate for the Pd nanoclusters, provides a high-speed channel for electron transfer

cond-mat.mtrl-sci↗