arXiv Science⌕ Search

arXiv subjects

Lei Shen

Publications and source records attributed to Lei Shen.

At least 19 recordsLinked to original sources

GateSID: One Gate to Balance Semantic and Collaborative Signals across the Item Lifecycle

In recommender systems, collaborative signals work well for popular items but are nearly absent for cold-start ones. Semantic content helps new items, yet over-reliance on it blurs the behavioral distinctions of popular items. Existing Semantic ID (SID) based methods handle this trade-off only partially, because their fusion of the two signals is rigid and item-agnostic. We present GateSID, a ranking framework that takes SID from an upstream tokenizer and adapts how each SID is used to the item's maturity through a single shared gate. The gate drives three mechanisms. Gating-Fused Shared Attention (GFSA) fuses the attention distributions of the two modalities rather than their representations. Gate-Regulated Contrastive Alignment (GRCA) strengthens semantic-behavioral alignment for items with weak collaborative evidence and relaxes it when collaborative structure is reliable. Gate-Regulated Semantic Resolution (GRSR) uses coarse shared SID prefixes for items with weak behavioral evidence and opens deeper SID levels when the gate indicates more reliable collaborative evidence. On a large-scale industrial dataset, GateSID leads the strongest SID-enhanced baseline by +0.27% CTR AUC and +0.36% CTCVR GAUC, with gains balanced across item groups rather than trading cold-start for popular-item performance; on the public Taobao-MM benchmark, it also leads overall and gives the strongest new-item results under both DIN and RankMixer backbones. In a one-month online A/B test, GMV improves by 2.6%, CTR by 1.1%, and Order by 1.6%, at a cost of less than 5 ms of additional latency. We also provide a systematic analysis of SID design choices, covering embedding type, codebook configuration, and fusion strategy.

cs.IR↗

Learning to Reason with Predictive Gains for Generative Recommendation

Reasoning-enhanced generative recommendation (GR) has attracted increasing attention for leveraging the reasoning capabilities of large language models (LLMs) to improve next-item prediction. However, existing methods primarily optimize reasoning through Group Relative Policy Optimization (GRPO) with rule-based rewards determined by final recommendation performance, which faces two key limitations: (i) unmeasured predictive contributions within reasoning, where the predictive contributions of individual reasoning steps are not directly reflected in optimization signals, and (ii) weakly discriminative learning signals within groups, where different reasoning trajectories within the group often receive indistinguishable rewards, limiting effective policy optimization. In this paper, we propose GainReason, a simple yet effective training framework that optimizes reasoning through Predictive Gain (PG). Specifically, PG measures changes in target Semantic ID (SID) log-likelihood induced by individual reasoning sentences, providing contribution-aware and discriminative rewards. We further theoretically establish the alignment between expected PG and the recommendation ranking objective. Building on this signal, we develop PG-based Reasoning Optimization (PGRO) to optimize reasoning generation with sentence-level rewards, supported by a custom causal attention mechanism for efficient PG computation. Additionally, an auxiliary PG-based Reasoning Utilization (PGRU) task adaptively strengthens reasoning-conditioned prediction to complement PGRO. Extensive experiments on three public benchmarks demonstrate that GainReason consistently outperforms competitive baselines and achieves substantial performance gains from reasoning.

cs.AI↗

Local topology hallucinations in universal machine-learned interatomic potentials

Predicting metastable states with universal machine-learned interatomic potentials requires that they preserve the minima and saddles of the reference potential-energy surface. Here we identify local topology hallucination, in which distinct model minima relax into the same reference basin. This failure arises from mode-selective curvature-sign errors shared by MACE, CHGNet and M3GNet. Curvature signs predicted by two of the three models agreed with density-functional calculations in 55 of 57 positive but only 5 of 56 negative cases. In LiGe$_2$S, two MACE minima connected by a verified saddle relaxed into one density-functional basin. Reference relaxation likewise returned nine of ten selected model minima to their reference basins. A directional test with two displaced reference calculations rejected 9 of 12 prospectively tested model instabilities. Model agreement alone therefore cannot establish that predicted minima are distinct metastable states.

physics.comp-ph↗

Physical structure as an organizing principle for universal Hamiltonian learning

Density functional theory (DFT) gives the electronic structure of materials, but its cost limits large-supercell calculations and materials screening. Machine-learned Hamiltonians bypass the self-consistent cycle but are usually system-specific; universal ones could cover new compositions and disordered solids. Such models must generalize across chemistry and keep downstream properties physical, while staying inexpensive for large cells. Here we introduce UniTB, a universal E(3) equivariant Hamiltonian representation framework that integrates physical priors rooted in density-functional tight-binding theory with deep learning. UniTB's network, which corrects a prior Hamiltonian, generalizes across chemistry through a mixture of experts routed by that prior and a charge-equilibration head as in self-consistent-charge tight binding. A projection bounds band shifts from the prior, suppressing spurious states and keeping downstream properties physical. We provide the fastest SO(2) tensor-product GPU kernels for the network. The variant UniTB-Flash assembles its prior from two-center tables at $O(N)$ cost for $N$ atoms, against $O(N\log N)$ on a grid. Trained on 29,242 crystals, UniTB reaches a 0.48 meV matrix-element error on nonmagnetic test crystals spanning 68 elements. Without amorphous training data, both models agree with DFT optics and conductivity of amorphous Ge-Sb-Te. UniTB-Flash ranks candidates with no significant difference from UniTB, whose property values are more accurate; together they screen 16,195 crystals for five application domains of industrial relevance.

cond-mat.mtrl-sci↗

Foundation-Model Supervision of Distilled Potentials for Million-Atom Molecular Dynamics

Machine-learned interatomic potentials distilled from foundation models enable fast large-scale molecular dynamics (MD), but they can fail locally in chemical environments that their training data did not sample. System-averaged error metrics and small random audits often miss such sparse or isolated failures. Here we use an exact equivariant foundation model, MACE-MPA-0, to check every atom of million-atom production simulations. Reorganizing two-layer MACE inference into a receiver-chunked three-pass schedule that keeps no per-edge intermediates resident reduces the marginal memory per atom 340-fold, evaluates up to $2.86\times10^{7}$ atoms on a single H200 GPU, and supervises $10^{6}$-atom trajectories in LAMMPS at 1.3% of the run time. Distilled MACE students run four to nine times slower than NEP89 with 0.95-1.28 times the teacher's force error against density functional theory (DFT). In molten SiO$_2$, whole-system checks uncover a persistent tail of under-coordinated atoms hidden by the system-averaged error and an isolated, unphysical O-O contact that a 1% random audit misses 94% of the time. On-the-fly retraining on teacher-labelled 13-Å clusters, with the force loss restricted to their inner 6 Å, removes three quarters of the failure tail and the kilobar-level pressure biases in SiO$_2$ and compressed water; the repair converges to the teacher, not to DFT.

physics.comp-ph↗

Anomalous Hall enhancement in fully compensated non-collinear antiferromagnetic Cr-doped Mn3Sn

The non-collinear antiferromagnet (AFM), Mn3Sn, exhibits ultrafast spin dynamics and negligible stray fields, making it a promising candidate for fast and energy-efficient spintronic devices. However, its practical applications remain limited by the relatively small Hall response compared with ferromagnets. Here, we demonstrate through both first-principles calculations and experiments that Cr-doping is a promising strategy to enhance the anomalous Hall transport in Mn3Sn without breaking the antiferromagnetic order. Our first-principles calculations reveal an effective Cr-doping window that enhances the anomalous Hall conductivity while largely preserving the host coplanar inverse triangular AFM order. Berry curvature and Wannier Hamiltonian analyses further reveal that Cr substitution amplifies the pre-existing Berry curvature hotspots through coordinated changes in the energy alignment, local interband gap, and Mn-derived orbital weight of the relevant bands. Experimentally, we have found that Cr doping not only supports our computational predictions (enhancement of the anomalous Hall conductivity), but also suppresses the transition to helical or spin-glass phases at low temperatures. These findings demonstrate that Cr-doping is an effective strategy for stabilizing the AFM order while simultaneously improving the anomalous Hall transport properties over a wide temperature range in Mn3Sn.

cond-mat.mtrl-sci↗

Unbiased Reward Modeling from Implicit Feedback for LLM Alignment

Despite the success of reinforcement learning from human feedback (RLHF), existing reward modeling methods largely rely on explicit feedback, which is costly to collect and difficult to scale. This work studies implicit reward modeling, learning reward models from implicit user feedback, such as clicks, copies and skips. While scalable and cost-effective, implicit feedback poses two key challenges: It lacks definitive negative samples, which makes standard positive-negative classification methods inapplicable; It suffers from selection bias, where responses have heterogeneous propensities to elicit feedback, which further obscures definitive negative samples. To address these challenges, we propose ImplicitRM, which learns unbiased reward models from implicit feedback. It stratifies training samples into four latent groups using a stratification model and derives a likelihood-maximization objective that is theoretically unbiased, thereby addressing both challenges. Experiments across diverse LLM backbones and benchmark datasets validate that ImplicitRM learns accurate reward models from implicit feedback and improves performance on downstream RLHF tasks.

cs.CL↗

Not All Prompts Are Equal: Exploration-Guided Prompt Scaffolding for Multimodal Reinforcement Post-Training

Training prompts in online reinforcement learning (RL) differ substantially in how informative they are for the current policy: some are already saturated while others are too difficult to yield reliable learning signals, yet both receive equal rollout budget under standard training. We propose an exploration-guided prompt scaffolding framework that adapts the training prompt distribution dynamically throughout RL post-training of multimodal large language models (MLLMs). Central to our approach is the $\textit{Exploration Potential Score} (EPS)$, a lightweight rollout-based proxy for prompt utility derived from KL-regularized policy improvement theory, computable directly from on-policy rollout statistics without additional overhead. Rather than discarding low-utility prompts, we use a teacher model to generate scaffolded rewrites that preserve the original task intent while making subsequent training more informative, reframing teacher supervision as training-data refinement rather than output imitation. Integrated with GRPO on Geo3K and MMK12, our method consistently outperforms the baseline on both in-domain and out-of-distribution benchmarks, achieving up to 9.7\% relative improvement in-domain and gains of 11.5\% on MathVision and 11.1\% on MMMU-Pro.

cs.LG↗

POSPAN: Position-Constrained Span Masking for Language Model Pre-training

Span-level masked language modeling (MLM) has shown to be advantageous to pre-trained language models over the original single-token MLM, as entities/phrases and their dependencies are critical to language understanding. Previous works only consider span length with some discrete distributions, while the dependencies among spans are ignored, i.e., assuming that the positions of masked spans are uniformly distributed. In this paper, we present POSPAN, a general framework to allow diverse position-constrained span masking strategies via the combination of span length distribution and position constraint distribution, which unifies all existing span-level masking methods. To verify the effectiveness of POSPAN in pre-training, we evaluate it on the datasets from several NLU benchmarks. Experimental results indicate that the position constraint is capable of enhancing span-level masking broadly, and our best POSPAN setting consistently outperforms its span-length-only counterparts and vanilla MLM. We also conduct theoretical analysis for the position constraint in masked language models to shed light on the reason why POSPAN works well, demonstrating the rationality and necessity of POSPAN.

cs.LG↗

A Density-Matrix Framework for Electronic-Structure Analysis of Electrolytes for Lithium Batteries

Electrolyte reactivity in lithium batteries is shaped by molecular functional groups, Li$^{+}$ solvation and salt-anion participation. Conventional quantum chemistry is too computationally expensive for systematic analysis of diverse electrolyte molecules and their local solvation environments. Here we present EMolStudio, a density-matrix-centered AI platform for electronic-structure prediction and analysis. Its workflow integrates molecular functionalization, explicit Li$^{+}$ first-shell assembly, density-matrix prediction, and electronic-structure parsing. Applied to 163,655 functionalized molecules and 22,500 first-shell clusters across four lithium salts, we find that 1) functionalization separates CO$_{2}$Me, CN, F/CF$_{3}$, and sulfonyl groups by distinct shifts in frontier levels, electrostatic potential, and Li$^{+}$-donor contact; 2) anion identity reshapes frontier-orbital localization, with LiTDI anchoring the highest occupied orbital on the anion across the library. By carrying a unified density-matrix representation from molecular functionalization to salt-resolved solvation shells, EMolStudio provides a general platform for understanding and designing battery electrolytes.

cs.AI↗

Machine learning for the design and prediction of soft-magnetic electromagnetic shielding FeCo-based alloys in laser cladding

Electromagnetic shielding materials play a pivotal role in both aerospace applications and daily life. However, their design and manufacturing still face persistent challenges. Machine learning demonstrates significant potential in accelerating material development and compositions optimization. Furthermore, laser additive manufacturing provides powerful technical support for fabricating multi-component, multifunctional electromagnetic shielding materials with tailored properties. In this study, the multiple machine learning strategies have been proposed, based on experimental derivation and soft magnetic material databases, to accelerate the design of multifunctional FeCo-based alloys for electromagnetic interference (EMI) shielding within an almost infinite compositional space. This work presents a novel approach for the rapid and automated discovery of multifunctional alloys with optimized EMI shielding effectiveness, as well as enhanced magnetic and electrical properties.

cond-mat.mtrl-sci↗

High-Throughput Computational Discovery of Inverted Resistive Switching in Two-Dimensional Materials

Atomristors, non-volatile resistive switching devices based on two-dimensional (2D) monolayers, are promising building blocks for energy-efficient memory and neuromorphic computing. However, their design remains restricted to a few materials such as MoS2 and h-BN, limiting functional diversity and design flexibility. Here, a high-throughput computational framework combining density functional theory, machine-learning molecular dynamics, and quantum transport simulations screens about 2,900 exfoliable monolayers for vacancy-mediated resistive switching, identifying 17 thermally stable candidates in two mechanistically distinct classes. In Class 1 monolayers, such as GaS, Au adsorption at the native vacancy introduces conducting states, switching the insulating monolayer from a high- to a low-resistance state (HRS-to-LRS). Class 2 monolayers, comprising ionically bonded metal oxyhalides and nitrohalides such as BiOCl, exhibit previously unreported inverted switching. Vacancy-released electrons delocalize and push the Fermi level into the conduction band, placing the device natively in the LRS; Au adsorption re-localizes these carriers and returns the Fermi level to the gap, driving LRS-to-HRS switching. Quantum transport simulations confirm both mechanisms, while migration-barrier calculations identify the electrode-2D separation as a key parameter governing Au migration and the resistance window. These findings expand the atomristor landscape and establish complementary switching as a design paradigm for multifunctional memory and neuromorphic hardware.

cond-mat.mtrl-sci↗

SORT: A Systematically Optimized Ranking Transformer for Industrial-scale Recommenders

While Transformers have achieved remarkable success in LLMs through superior scalability, their application in industrial-scale ranking models remains nascent, hindered by the challenges of high feature sparsity and low label density. In this paper, we propose SORT (Systematically Optimized Ranking Transformer), a scalable model designed to bridge the gap between Transformers and industrial-scale ranking models. We address the high feature sparsity and low label density challenges through a series of optimizations, including request-centric sample organization, local attention, query pruning, and generative pre-training. Furthermore, we introduce a suite of refinements to the tokenization, multi-head attention (MHA), and feed-forward network (FFN) modules, which collectively stabilize the training process and enlarge the model capacity. To maximize hardware efficiency, we optimize our training system to elevate the model FLOPs utilization (MFU) to 45%. Extensive experiments demonstrate that SORT outperforms strong baselines and exhibits excellent scalability across data size, model size, and sequence length, while remaining flexible at integrating diverse features. Finally, online A/B testing in large-scale e-commerce scenarios confirms that SORT achieves significant gains in key business metrics, including orders (+7.47%), buyers (+6.67%), and GMV (+8.65%), while simultaneously cutting latency by 62% and boosting throughput nearly sevenfold (+589%). SORT has been fully deployed in production, serving all users on AliExpress.

cs.IR↗

Best Reaction Target To Determine Proton Distribution Radii of Atomic Nuclei

We found that a heavy target such as Pb is most suitable for determining the proton distribution radii of unstable nuclei through charge-changing cross-section ($σ_\text{cc}$) measurements. As a heavy ion probe, low-$Z$ targets are routinely used to determine nucleon distribution radii of unstable isotopes. This approach has recently been extended to study proton distribution radii from $σ_\text{cc}$ measurements. However, empirical scaling factors have to be introduced to apply the Glauber models. In the present work, we systematically investigated the scaling factor using 39 new $σ_\text{cc}$ data of 18 $p$-shell nuclei on hydrogen, carbon, silver, and lead targets at around 240 MeV/nucleon. Together with the existing data, we reveal a universal dependence of the scaling factor on both the masses of target nuclei and the separation energies of projectile nuclei. The scaling factors decrease with increasing target-nucleus mass and converge to 1 for the highest-$Z$ target, making the scaling unnecessary. We conclude that instead of a low-$Z$ target, employing a heavy target such as Pb in $σ_\text{cc}$ measurements is the best option to determine the proton distribution radii of unstable nuclei.

nucl-ex↗

PReM: Learning What to Preserve and When to Refresh for Context Compression

Efficient long-context inference is not only about reducing memory cost, but also about keeping useful contextual evidence accessible as generation proceeds. However, existing compression-oriented approaches, such as key-value (KV) cache compression and context compression, often either make an early decision about which contextual information to keep or rely on an external compressor. Such designs make it difficult to adapt the compressed context to the evidence needed by later reasoning steps. This paper introduces PReM (Preserve and Refresh Memory), a context-compression framework that maintains the long context as the model's internal layer-wise KV memory and learns what to preserve and when to refresh it. Specifically, PReM uses a dedicated memory layer to make memory-selection decisions, and a special memory token to trigger refreshes during generation. To train this behavior, PReM introduces Phase-Separated Refresh Training, aligning memory selection with memory-conditioned generation while preserving continuity across refreshes. Experiments with 32K-token contexts show that PReM outperforms strong baselines under both 16x and 32x compression, while maintaining a favorable balance between answer quality and inference efficiency.

cs.CL↗

Electrical manipulation and detection of perpendicular altermagnetic order via proximitized Dirac semimetal

Altermagnets, which combine antiferromagnetic-like magnetic compensation with ferromagnetic-like broken time-reversal symmetry, hold great promise for high-density and ultrafast spintronic applications. However, the detection and switching of perpendicular altermagnetic order are fundamentally constrained by magnetic symmetry, restricting both fundamental studies and practical implementation. We realize robust electrical reading and deterministic switching of perpendicular altermagnetic order by designing a Dirac semimetal/altermagnet heterostructure of PtTe2/CrSb. This engineered interface enables anomalous Hall readout via altermagnetic proximity effect and delivers efficient spin-orbit torque for manipulating the epitaxial perpendicular Neel vector in CrSb. These findings significantly broaden the functional scope of altermagnetic heterostructures and pave the way for highly scalable altermagnetic memory.

cond-mat.mtrl-sci↗

Uncertainty-Aware Reward Modeling for Stable RLHF

Reinforcement learning from human feedback (RLHF) aligns large language models by training reward models on preference data and optimizing policies to maximize predicted rewards. However, this pipeline faces two fundamental challenges: (1) reward models cannot signal when their predictions are unreliable, since they usually act as deterministic point estimators; and (2) modern group-based policy optimization can amplify unreliable reward signals, as exemplified by GRPO's uniform treatment of rewards during advantage computation. As policies explore increasingly diverse responses, these two limitations create a critical vulnerability: unreliable reward estimates may be granted disproportionate influence, triggering severe reward hacking. We propose Uncertainty-Aware Reward Modeling (UARM), which equips reward models with calibrated uncertainty via quantile-based conformal prediction and reweights GRPO advantages through heteroscedastic variance decomposition. Experiments across HelpSteer, UltraFeedback, and PKU-SafeRLHF demonstrate that UARM significantly improves reward model calibration, reduces reward hacking, and enhances downstream alignment quality compared to standard GRPO and uncertainty-agnostic baselines.

cs.LG↗

Coexistence and tunability of orbital and spin Hall effects in RuO$_2$

Altermagnetic materials, especially RuO$_2$, have recently attracted considerable attention for their unique magnetic properties and energy-efficient spintronic applications. However, recent experimental studies have reported highly conflicting signatures regarding altermagnetic spin splitting and charge--spin interconversion (CSI) in RuO$_2$. While some experiments link efficient CSI to non-relativistic altermagnetic spin-splitting effects, others observe large CSI signals in non-spin-splitting RuO$_2$, which are instead explained by relativistic inverse spin Hall effects. In this work, based on first-principles calculations, we reveal that these controversial experimental results originate from a phase-dependent coexistence and relative dominance of the orbital Hall effect (OHE) and spin Hall effect (SHE) in RuO$_2$. We systematically investigate the OHE and SHE in both altermagnetic and nonmagnetic phases of RuO$_2$. Our results show that the altermagnetic state hosts a giant OHE that exceeds the SHE by two orders of magnitude and carries an opposite sign. This dominant OHE can generate experimentally observed "SHE-like" voltages through orbital-to-spin conversion, explaining previously reported altermagnetic CSI signals. In contrast, OHE of nonmagnetic RuO$_2$ is suppressed and a large relativistic SHE emerges, in agreement with recent angle-resolved photoemission and spin-pumping experiments. Finally, we demonstrate that the coexistence of OHE and SHE is tunable via chemical doping, enabling on-demand modulation of CSI in in RuO$_2$. Our work provides a new physical mechanism for understanding CSI in RuO$_2$ and highlights the central role of orbital transport.

cond-mat.mtrl-sci↗