arXiv ScienceSearch

arXiv subjects

Xiaolong Chen

Publications and source records attributed to Xiaolong Chen.

At least 19 recordsLinked to original sources

Repo-To-Skill: Distilling GitHub Repositories Into AI4AI Skills

Autonomous agents are beginning to carry out machine-learning (ML) research end to end. These agents combine a model backbone with a harness for planning, execution, memory, and verification, but this architecture still leaves domain-specific know-how outside the agent. We call this missing layer operational knowledge, the know-how that separates knowing a method from making it work. That knowledge is not absent from the field. It appears in repositories and papers, but in forms written for human readers and too large to load during a task. Once distilled into compact, verified skills, this knowledge can be reused across tasks rather than rediscovered during each run. We present DisCo, a skill-powered research agent that creates skills and uses them during research. Its distillation runs in two complementary forms: task-agnostic, condensing the field's widely used repositories into reusable skills, and task-oriented, producing the skills a concrete task calls for. The former, applied across the open ecosystem, yields the AREX-Skill Library, with 5,000+ verified skills distilled from 1,000 widely used ML repositories and organized into 20 areas and 178 capability families. With the GPT-5.5 backbone, research harness, and downstream execution budget held fixed, the skill-equipped research agent scores 134.3% higher on MLE-bench, 34.4% higher on PaperBench, 9.2% higher on FrontierCS, and 14.0% higher on PassNet than the same agent without skills. These gains come from adding distilled operating context under that fixed setup.

cs.AI

VISA: Agentic Self-Evolving Data Synthesis for Multimodal Instruction Following

Multimodal instruction-following models require training data that is accurate, diverse, verifiable, and challenging. Existing synthesis pipelines typically follow a one-pass generate-and-filter paradigm, discarding feedback from failed samples, verifier outcomes, and target-model errors. We present VISA (Visual Instruction Synthesis Agent), an agentic framework that reformulates multimodal instruction synthesis as a self-evolving loop. At each round, VISA analyzes an image to filter incompatible constraints and discover new verifiable ones, samples diversity- and difficulty-aware constraint sets from persistent memory, generates candidate instructions, and verifies the resulting samples with executable tools and structured large language model judges. Failed samples trigger diagnostic-guided recovery, while accepted samples are probed against the target model to estimate difficulty. The resulting verifier signals and target-model failure profiles are written back to memory, allowing subsequent rounds to adaptively expand the constraint space, reduce template repetition, and focus on unresolved model weaknesses. The same verifier contracts further provide reward signals for reinforcement learning without a separately trained reward model. Experiments on MM-IFEval show that VISA consistently improves multimodal instruction following over strong baselines, while preserving general multimodal capability across seven public benchmarks.

cs.CL

DA-WAM: Decision-Aligned Future Latents for Driving World Models

Anticipating how scenes evolve under ego actions is fundamental to safe autonomous driving, yet the full potential of world models for decision-making remains unrealized. The critical challenge lies in ensuring that future modeling is not merely predictive, but decision-informative: the predicted future must directly shape which trajectory is selected. Existing approaches decouple future representation learning from planning optimization, or share predicted states across trajectory candidates, thereby diluting the action-specific consequences that ought to guide selection. To bridge this gap, we propose DA-WAM, a framework that unifies predictive representation learning, action-conditioned future modeling, and trajectory scoring under a single decision-making objective. DA-WAM maintains predictive supervision throughout planner optimization via an online encoder and a stable momentum target, allowing future representations to co-evolve with the driving task. An action-conditioned predictor generates a distinct future latent state per trajectory candidate, which is then evaluated by a future-latent-conditioned factorized scorer. For the expert-matched trajectory, the predicted future latent is supervised by the observed future representation, while safety-critical hard negatives provide additional supervision near planning boundaries. Extensive experiments on NAVSIM-v1 and NAVSIM-v2 demonstrate state-of-the-art performance, while ablations and diagnostic analyses validate the key components.

cs.RO

Breaking the mutual exclusivity between metallicity and ferroelectricity in a non-polar covalent semiconductor via orbital selective doping

The mutual exclusion of ferroelectricity and metallic conductivity is a long-standing tenet because itinerant electrons screen long-range Coulomb forces that stabilize the bulk polar order. Here, we break this paradigm by heavily doping a non-polar covalent semiconductor of cubic silicon carbide (3C-SiC) with nitrogen. This introduces heavy electron doping, inducing metallicity and driving a structural transition from the non-polar F-43m to the polar R3m symmetry via the pseudo-Jahn-Teller effect. Remarkably, we provide direct, atomic-scale visualization of about 180{\deg} polarization reversal under an external voltage bias in a ferroelectric metal. The strongly directional character of antibonding orbitals occupied by conduction electrons prevents them from screening the local Si-C polarization, resulting in the coexistence of metallicity and ferroelectricity. Ferroelectric tunnel junctions demonstrate nonvolatile memory properties with a well-defined high-resistance state (HRS) and low-resistance state (LRS), an ultrahigh response speed (~50 ns), an ultralow operating voltage (1 V), an endurance exceeding 85927 cycles, and a projected retention time of 100 years. Our results provide a novel strategy for pioneering ferroelectricity in a metal, a new ferroelectric metal platform for exploring exotic properties, and a ferroelectric device with high performance that meets the requirements for low consumption and high-speed non-volatile devices.

cond-mat.mtrl-sci

FlowTrain: Flow-Based Decoupled Training for Industrial-Grade Vision-Language Models

Industrial-grade distributed training of vision-language models (VLMs) remains far less efficient than that of unimodal LLMs. Existing solutions either follow a monolithic design that assigns uniform parallelism to heterogeneous modules or adopt a disaggregated deployment that separates modules while executing them as a batch-synchronized pipeline. In this paper, we highlight that the above solutions are still not sufficient, and VLM training can be further decoupled. To this end, we present FlowTrain, a flow-based decoupled training framework that reformulates VLM training as a producer-consumer dataflow coordinated through a unified memory pool. The encoder and backbone can progress independently over a global virtual address space. Since this execution decoupling fundamentally changes the optimization objective of allocation and scheduling, FlowTrain further introduces a heterogeneous parallel allocator that assigns module-specific parallelism strategies by solving a throughput matching problem. The dynamic packing scheduler is used to construct balanced microbatches at runtime according to the actual LLM-side computation cost. Extensive experiments on real-world workloads show that FlowTrain achieves over 50% MFU and up to 1.7x throughput improvement, narrowing the efficiency gap to LLM-only training.

cs.LG

Anomalous charge density wave in a two-dimensional superatomic superconductor

The spatial modulation of electron density into a wave-like pattern, known as charge density wave (CDW), represents a fundamental quantum state that often coexists with superconductivity, quantum Hall states, axion insulating phases and etc. Conventional CDWs are mediated by longitudinal acoustic phonons, exhibit picometer-scale lattice distortions ($10^{-12}$--$10^{-11}$ m), and typically vanish approaching the atomic limit. Here, we report a series of anomalous CDW behaviors in the 2D superatomic superconductor Au$_6$Te$_{12}$Se$_8$. Remarkably, its CDW is governed by transverse phonons, accompanied by an extraordinarily high real-space displacement of $\sim 4$ \AA ngstr\"om. Furthermore, we observe an exotic dimensional response persisting up to micrometer-scale thickness, a regime where other materials are already considered as bulk. Through liquid helium-temperature transmission electron microscopy, ultrafast pump-probe spectroscopy and transport measurements, we demonstrate a dramatic enhancement of the CDW transition temperature ($T_{\text{CDW}}$) from $<2$ K in the bulk to 110 K in approaching the ``superatomic limit''. Our findings not only reveal novel facets of both CDW and superatomic materials, but the competition between this anomalous CDW and superconductivity opens avenues for exploring unconventional electron-phonon interactions.

cond-mat.supr-con

Bragg-Williams order competes with superconductivity

Orderings in charge and spin have been extensively studied to unravel their correlation to emergent superconductivity over the past decades. Bragg-Williams order (BWO), a classical structural order parameter describing site occupancy in alloys, has long been speculated to influence superconducting behavior. Yet, its role still remains ambiguous, largely due to the difficulty of isolating BWO from concomitant charge doping or competing electronic instabilities. Here, we establish In2/3PSe3 as a platform wherein indium vacancies are reversibly configurable between ordered and disordered states via thermal treatment. We show that the disordered phase undergoes a pressure-induced superconducting transition with a Tc of 11 K, significantly higher than the 7 K observed in its ordered counterpart. This constitutes a rare instance in which pure BWO variation drives a substantial shift in Tc. By combining a Ginzburg-Landau phenomenological analysis with a BCS-McMillan microscopic description, we demonstrate that BWO naturally suppresses superconductivity through electron-phonon interactions, a mechanism supported by ultra-low-wavenumber Raman measurements. Our findings support BWO as an independent order parameter that competes directly with superconductivity, extending the concept of competing orders beyond conventional electronic and magnetic degrees of freedom.

cond-mat.supr-con

Similar Users-Augmented Interest Network

Click-through rate (CTR) prediction is one of the core tasks in recommender systems. User behavior sequences, as one of the most effective features, can accurately reflect user preferences and significantly improve prediction accuracy. Richer behavior sequences often enable more comprehensive user profiling, and recent studies have shown that scaling the length of user behavior sequence can yield substantial gains in CTR. However, due to the widespread sparsity in recommender systems, incomplete behavior sequences are common in real-world scenarios. Existing sequential modeling methods often rely solely on the target user's own behavior, and therefore struggle in such scenarios. This paper proposes a novel method called SUIN (Similar Users-augmented Interest Network), which enhances the target user's behavior sequence with behaviors from similar users to enhance the user profile for CTR prediction. Specifically, we use behavior embeddings encoded by a sequence encoder to retrieve users with similar behaviors from a user retrieval pool. The behavior sequences of these similar users are then concatenated with that of the target user in descending order of similarity to construct an augmented sequence. Given that the augmented sequence contains behaviors from multiple users, we propose a user-specific target-aware position encoding, which identifies the source user of each behavior and captures its relative position to the target item. Furthermore, to mitigate the empirically observed noise in similar users' behaviors, we design a user-aware target attention that jointly considers item-item and user-user correlations, fully exploiting the potential of the augmented behavior sequence. Comprehensive experiments on widely-used short-term and long-term sequence benchmark datasets demonstrate that our method significantly outperforms state-of-the-art sequential CTR models.

cs.IR

Intrinsically ultralow thermal conductivity in all-inorganic superatomic bulk crystals

Superatomic compounds, composed of atomic clusters interwoven by weak chemical bonds exhibit large anharmonicity vibrations, are excellent candidates for ultralow thermal conductivity (\k{appa}) materials. However, growing bulk superatomic single crystals is challenging due to complex chemical composition and chemical bonds, and studies on their intrinsic thermal property are scarce. Here, we grew high-quality superatomic single crystals of Re6Se8Te7 and Re6Te15, both of which are narrow band gap semiconductors that change into metals under external physical pressure. At room-temperature, the \k{appa} are 0.32 W m-1 K-1 and 0.53 W m-1 K-1 in Re6Se8Te7 and Re6Te15, respectively, ranking among the lowest value reported in all-inorganic bulk crystals. It is mainly attributed to the large Gr\"uneisen parameter (1.93) and low average sound speed (< 1482 m/s), which are due to soft Te7 nets weakly embedded among the rigid Re6Se8 (Re6Te8) quasi-cubic clusters. The appearance of boson peak, i. e., hump of C(T)/T3, verifies the existence of disordered phonon transports. Besides, the temperature dependence of \k{appa} can be described by classic Debye-Callaway model. Notably, above 350 K, the \k{appa} values of Re6Se8Te7 and Re6Te15 are remarkably close to the upper limit derived from glassy-like diffusion model. This finding sets the superatomic compounds as a promising family for searching ultralow-\k{appa} and energy management materials.

cond-mat.mtrl-sci

Superconductivity of 30.4 K and its Reemergence under Pressure in Fe1.11Se Synthesized via Ion-exchange and De-intercalation Reaction

Binary stoichiometry FeSe (s-FeSe) is a well-known parent of high-temperature unconventional superconductors owing to its charge-neutral layer, highly tunable structure and electronic properties, and rich interplays among multiple electronic phases. Yet the s-FeSe synthesized via high-temperature equilibrium reactions bears the notorious interstitial Fe,where merely 3% of them is sufficient to kill the superconductivity. Here, we successfully synthesized a new non-stoichiometric Fe1.11Se single crystal with a superconducting onset temperature (Tconset) of 30.4 K through a hydrothermal ion-exchange and de-intercalation route. 11% interstitial Fe ions exceed the equilibrium phase diagram limit. Intriguingly, under physical pressure, the Tconset of exhibits a "V"-shaped evolution with a minimum at 2-2.6 GPa, and then upturning into a second superconducting region, reminiscent of the behaviors in FeSe intercalates. Furthermore, a pressure-induced possible magnetic order, previously only observed in pressurized s-FeSe, shows up. These results offer fresh insights into the role of interstitial Fe in governing superconducting and transport properties under non-equilibrium synthesis and tuning strategies.

cond-mat.supr-con

CoPlanner: An Interactive Motion Planner with Contingency-Aware Diffusion for Autonomous Driving

Accurate trajectory prediction and motion planning are crucial for autonomous driving systems to navigate safely in complex, interactive environments characterized by multimodal uncertainties. However, current generation-then-evaluation frameworks typically construct multiple plausible trajectory hypotheses but ultimately adopt a single most likely outcome, leading to overconfident decisions and a lack of fallback strategies that are vital for safety in rare but critical scenarios. Moreover, the usual decoupling of prediction and planning modules could result in socially inconsistent or unrealistic joint trajectories, especially in highly interactive traffic. To address these challenges, we propose a contingency-aware diffusion planner (CoPlanner), a unified framework that jointly models multi-agent interactive trajectory generation and contingency-aware motion planning. Specifically, the pivot-conditioned diffusion mechanism anchors trajectory sampling on a validated, shared short-term segment to preserve temporal consistency, while stochastically generating diverse long-horizon branches that capture multimodal motion evolutions. In parallel, we design a contingency-aware multi-scenario scoring strategy that evaluates candidate ego trajectories across multiple plausible long-horizon evolution scenarios, balancing safety, progress, and comfort. This integrated design preserves feasible fallback options and enhances robustness under uncertainty, leading to more realistic interaction-aware planning. Extensive closed-loop experiments on the nuPlan benchmark demonstrate that CoPlanner consistently surpasses state-of-the-art methods on both Val14 and Test14 datasets, achieving significant improvements in safety and comfort under both reactive and non-reactive settings. Code and model will be made publicly available upon acceptance.

cs.RO

DECAMP: Towards Scene-Consistent Multi-Agent Motion Prediction with Disentangled Context-Aware Pre-Training

Trajectory prediction is a critical component of autonomous driving, essential for ensuring both safety and efficiency on the road. However, traditional approaches often struggle with the scarcity of labeled data and exhibit suboptimal performance in multi-agent prediction scenarios. To address these challenges, we introduce a disentangled context-aware pre-training framework for multi-agent motion prediction, named DECAMP. Unlike existing methods that entangle representation learning with pretext tasks, our framework decouples behavior pattern learning from latent feature reconstruction, prioritizing interpretable dynamics and thereby enhancing scene representation for downstream prediction. Additionally, our framework incorporates context-aware representation learning alongside collaborative spatial-motion pretext tasks, which enables joint optimization of structural and intentional reasoning while capturing the underlying dynamic intentions. Our experiments on the Argoverse 2 benchmark showcase the superior performance of our method, and the results attained underscore its effectiveness in multi-agent motion forecasting. To the best of our knowledge, this is the first context autoencoder framework for multi-agent motion forecasting in autonomous driving. The code and models will be made publicly available.

cs.RO

NDCG-Consistent Softmax Approximation with Accelerated Convergence

Ranking tasks constitute fundamental components of extreme similarity learning frameworks, where extremely large corpora of objects are modeled through relative similarity relationships adhering to predefined ordinal structures. Among various ranking surrogates, Softmax (SM) Loss has been widely adopted due to its natural capability to handle listwise ranking via global negative comparisons, along with its flexibility across diverse application scenarios. However, despite its effectiveness, SM Loss often suffers from significant computational overhead and scalability limitations when applied to large-scale object spaces. To address this challenge, we propose novel loss formulations that align directly with ranking metrics: the Ranking-Generalizable \textbf{squared} (RG$^2$) Loss and the Ranking-Generalizable interactive (RG$^\times$) Loss, both derived through Taylor expansions of the SM Loss. Notably, RG$^2$ reveals the intrinsic mechanisms underlying weighted squared losses (WSL) in ranking methods and uncovers fundamental connections between sampling-based and non-sampling-based loss paradigms. Furthermore, we integrate the proposed RG losses with the highly efficient Alternating Least Squares (ALS) optimization method, providing both generalization guarantees and convergence rate analyses. Empirical evaluations on real-world datasets demonstrate that our approach achieves comparable or superior ranking performance relative to SM Loss, while significantly accelerating convergence. This framework offers the similarity learning community both theoretical insights and practically efficient tools, with methodologies applicable to a broad range of tasks where balancing ranking quality and computational efficiency is essential.

cs.LG

Optimizing Case-Based Reasoning System for Functional Test Script Generation with Large Language Models

In this work, we explore the potential of large language models (LLMs) for generating functional test scripts, which necessitates understanding the dynamically evolving code structure of the target software. To achieve this, we propose a case-based reasoning (CBR) system utilizing a 4R cycle (i.e., retrieve, reuse, revise, and retain), which maintains and leverages a case bank of test intent descriptions and corresponding test scripts to facilitate LLMs for test script generation. To improve user experience further, we introduce Re4, an optimization method for the CBR system, comprising reranking-based retrieval finetuning and reinforced reuse finetuning. Specifically, we first identify positive examples with high semantic and script similarity, providing reliable pseudo-labels for finetuning the retriever model without costly labeling. Then, we apply supervised finetuning, followed by a reinforcement learning finetuning stage, to align LLMs with our production scenarios, ensuring the faithful reuse of retrieved cases. Extensive experimental results on two product development units from Huawei Datacom demonstrate the superiority of the proposed CBR+Re4. Notably, we also show that the proposed Re4 method can help alleviate the repetitive generation issues with LLMs.

cs.SE

Human-aligned Safe Reinforcement Learning for Highway On-Ramp Merging in Dense Traffic

Most reinforcement learning (RL) approaches for the decision-making of autonomous driving consider safety as a reward instead of a cost, which makes it hard to balance the tradeoff between safety and other objectives. Human risk preference has also rarely been incorporated, and the trained policy might be either conservative or aggressive for users. To this end, this study proposes a human-aligned safe RL approach for autonomous merging, in which the high-level decision problem is formulated as a constrained Markov decision process (CMDP) that incorporates users' risk preference into the safety constraints, followed by a model predictive control (MPC)-based low-level control. The safety level of RL policy can be adjusted by computing cost limits of CMDP's constraints based on risk preferences and traffic density using a fuzzy control method. To filter out unsafe or invalid actions, we design an action shielding mechanism that pre-executes RL actions using an MPC method and performs collision checks with surrounding agents. We also provide theoretical proof to validate the effectiveness of the shielding mechanism in enhancing RL's safety and sample efficiency. Simulation experiments in multiple levels of traffic densities show that our method can significantly reduce safety violations without sacrificing traffic efficiency. Furthermore, due to the use of risk preference-aware constraints in CMDP and action shielding, we can not only adjust the safety level of the final policy but also reduce safety violations during the training stage, proving a promising solution for online learning in real-world environments.

cs.RO

Ferroelectricity in undoped HfO2 down to one-unit-cell on Si substrate

Hafnium oxide (HfO2), particularly at low-dimensional scales, exhibits extensive promising applications in ultrahigh density devices like low-power logic and non-volatile memory devices due to its compatibility with current semiconductor technology1-5. However, achieving ferroelectricity (FE) at ultimate scale especially in undoped HfO2 remains challenging as the non-centrosymmetric FE phase, so-called O-III (space group: Pca21) is metastable and FE has a strong tendency of depolarization with the decrease in thickness6. Up to now, this phase has usually stabilized via doping with other elements7-9. But the minimum film thickness is still limited to 1 nm, about 2-unit-cell, to keep FE8. Thinner and undoped films, conducive to further miniature device size and avoid contamination during deposition process, have been a challenge to fabricate on Si substrates. Herein, we report the robust FE observed in undoped HfO2 ultrathin films directly grown on Si substrate via atomic layer deposition (ALD) and post-heat treat in vacuum. The so-fabricated ferroelectric O-III phase contains about 4.48 at% oxygen vacancy, is robust even monoclinic phase (space group: P21/c) coexists. The spontaneous and switchable polarization is remarkably stable, still surviving even in films down to 0.5 nm (one-unit-cell). Our results show the robust FE O-III phase can be obtained in films down to one-unit-cell in thickness on Si, providing a practical way to fabricating this important material in thickness limit.

cond-mat.mtrl-sci

Quantum-Confined Tunable Ferromagnetism on the Surface of a van der Waals Antiferromagnet NaCrTe2

The surface of three-dimensional materials provides an ideal and versatile platform to explore quantum-confined physics. Here, we systematically investigate the electronic structure of Na-intercalated CrTe2, a van der Waals antiferromagnet, using angle-resolved photoemission spectroscopy and ab-initio calculations. The measured band structure deviates from the calculation of bulk NaCrTe2 but agrees with that of ferromagnetic monolayer CrTe2. Consistently, we observe an unexpected exchange splitting of the band dispersions, persisting well above the N\'eel temperature of bulk NaCrTe2. We argue that NaCrTe2 features a quantum-confined 2D ferromagnetic state in the topmost surface layer due to strong ferromagnetic correlation in the CrTe2 layer. Moreover, the exchange splitting and the critical temperature can be controlled by surface doping of alkali-metal atoms, suggesting a feasible tunability of the surface ferromagnetism. Our work not only presents a simple platform to explore tunable 2D ferromagnetism but also provides important insights into the quantum-confined low-dimensional magnetic states.

cond-mat.mtrl-sci

Powder Diffraction Crystal Structure Determination Using Generative Models

Accurate crystal structure determination is critical across all scientific disciplines involving crystalline materials. However, solving and refining inorganic crystal structures from powder X-ray diffraction (PXRD) data is traditionally a labor-intensive and time-consuming process that demands substantial expertise. In this work, we introduce PXRDGen, an end-to-end neural network that determines crystal structures by learning joint structural distributions from experimentally stable crystals and their PXRD, producing atomically accurate structures refined through PXRD data. PXRDGen integrates a pretrained XRD encoder, a diffusion/flow-based structure generator, and a Rietveld refinement module, enabling the solution of structures with unparalleled accuracy in a matter of seconds. Evaluation on MP-20 inorganic dataset reveals a remarkable matching rate of 82% (1 sample) and 96% (20 samples) for valid compounds, with Root Mean Square Error (RMSE) approaching the precision limits of Rietveld refinement. PXRDGen effectively tackles key challenges in XRD, such as the precise localization of light atoms, differentiation of neighboring elements, and resolution of overlapping peaks. Overall, PXRDGen marks a significant advancement in the automated determination of crystal structures from powder diffraction data.

cond-mat.mtrl-sci