arXiv subjects

Yang Xu

Publications and source records attributed to Yang Xu.

At least 109 records · Page 6Linked to original sources

arXiv2026

Quantifying and extending the coverage of spatial categorization data sets

Variation in spatial categorization across languages is often studied by eliciting human labels for the relations depicted in a set of scenes known as the Topological Relations Picture Series (TRPS). We demonstrate that labels generated by large language models (LLMs) align relatively well with human labels, and show how LLM-generated labels can help to decide which scenes and languages to add to existing spatial data sets. To illustrate our approach we extend the TRPS by adding 42 new scenes, and show that this extension achieves better coverage of the space of possible scenes than two previous extensions of the TRPS. Our results provide a foundation for scaling towards spatial data sets with dozens of languages and hundreds of scenes.

cs.CL↗

arXiv2026

Field-theoretical approach to estimate mean gap and gap distribution in randomly rough surface contact mechanics

We extend the statistical field-theoretical framework of rough surface contact mechanics to characterize the interfacial gap between an elastic half-space and a randomly rough surface incorporating exponential repulsion. Building upon a cumulant expansion to second-order, we derive an explicit analytical relation between the mean gap and the applied normal pressure. This result provides a closed-form expression for the drift and diffusion coefficients in a convection-diffusion equation governing the scale-dependent evolution of the gap distribution. Solving this equation with appropriate initial and boundary conditions yields the gap distribution under varying external pressures. Both the mean gap and the gap distribution are found to be in good agreement with Green's function molecular dynamics (GFMD) simulations. Our results demonstrate that the field-theoretical approach enables quantitative predictions not only for contact stresses but also for interfacial gap in rough surface contacts.

cond-mat.soft↗

arXiv2026

Don't Freeze, Don't Crash: Extending the Safe Operating Range of Neural Navigation in Dense Crowds

Navigating safely through dense crowds requires collision avoidance that generalizes beyond the densities seen during training. Learning-based crowd navigation can break under out-of-distribution crowd sizes due to density-sensitive observation normalization and social-cost scaling, while analytical solvers often remain safe but freeze in tight interactions. We propose a reinforcement learning approach for dense, variable-density navigation that attains zero-shot density generalization using a density-invariant observation encoding with density-randomized training and physics-informed proxemic reward shaping with density-adaptive scaling. The encoding represents the distance-sorted $K$ nearest pedestrians plus bounded crowd summaries, keeping input statistics stable as crowd size grows. Trained with $N\!\in\![11,16]$ pedestrians in a $3\mathrm{m}\times3\mathrm{m}$ arena and evaluated up to $N\!=\!21$ pedestrians ($1.3\times$ denser), our policy reaches the goal in $>99\%$ of episodes and achieves $86\%$ collision-free success in random crowds, with markedly less freezing than analytical methods and a $>\!60$-point collision-free margin over learning-based benchmark methods. Codes are available at \href{https://github.com/jznmsl/PSS-Social}{https://github.com/jznmsl/PSS-Social}.

cs.LG↗

arXiv2026

Memory-Efficient 2D/3D Shape Assembly of Robot Swarms

Mean-shift-based approaches have recently emerged as a representative class of methods for robot swarm shape assembly. They rely on image-based target-shape representations to compute local density gradients and perform mean-shift exploration, which constitute their core mechanism. However, such representations incur substantial memory overhead, especially for high-resolution or 3D shapes. To address this limitation, we propose a memory-efficient tree representation that hierarchically encodes user-specified shapes in both 2D and 3D. Based on this representation, we design a behavior-based distributed controller for assignment-free shape assembly. Comparative 2D and 3D simulations against a state-of-the-art mean-shift algorithm show one to two orders of magnitude lower memory usage and two to four times faster shape entry. Physical experiments with 6 to 7 UAVs further validate real-world practicality.

cs.RO↗

arXiv2026

Emergence of a symmetry-broken Chern insulator near a moiré Kondo breakdown

Moiré semiconductors built on angle-aligned transition metal dichalcogenide (TMD) heterobilayers provide a physical realization of the Kondo lattice model, in which one TMD layer is prepared in a Mott insulating state supporting a lattice of local magnetic moments and the other layer in a metallic state supporting itinerant carriers. The artificial Kondo lattice enables the exploration of exotic states of matter near a continuously tunable Kondo breakdown. Here we report the emergence of a symmetry-broken Chern insulator at a moiré hole filling factor 4/3 in angle-aligned MoTe2/WSe2 moiré bilayers, which realize a chiral Kondo lattice. The symmetry-broken Chern insulator, which exhibits integer quantized Hall conductance at a fractional moiré filling, breaks the translational symmetry of the lattice spontaneously; it also appears only near a magnetic field-induced Kondo breakdown in the mixed-valence regime of the material. We further demonstrate that the magnetic field required to induce the Kondo breakdown and to stabilize the symmetry-broken Chern insulator is twist angle dependent. The results present new opportunities for exploring the subtle interplay between topology and Kondo interactions in moiré semiconductors.

cond-mat.mes-hall↗

arXiv2026

Paraphrase Types Elicit Prompt Engineering Capabilities

Much of the success of modern language models depends on finding a suitable prompt to instruct the model. Until now, it has been largely unknown how variations in the linguistic expression of prompts affect these models. This study systematically and empirically evaluates which linguistic features influence models through paraphrase types, i.e., different linguistic changes at particular positions. We measure behavioral changes for five models across 120 tasks and six families of paraphrases (i.e., morphology, syntax, lexicon, lexico-syntax, discourse, and others). We also control for other prompt engineering factors (e.g., prompt length, lexical diversity, and proximity to training data). Our results show a potential for language models to improve tasks when their prompts are adapted in specific paraphrase types (e.g., 6.7% median gain in Mixtral 8x7B; 5.5% in LLaMA 3 8B). In particular, changes in morphology and lexicon, i.e., the vocabulary used, showed promise in improving prompts. These findings contribute to developing more robust language models capable of handling variability in linguistic expression.

cs.CL↗

arXiv2026

LH-Deception: Simulating and Understanding LLM Deceptive Behaviors in Long-Horizon Interactions

Deception is a pervasive feature of human communication and an emerging concern in large language models (LLMs). While recent studies document instances of LLM deception, most evaluations remain confined to single-turn prompts and fail to capture the long-horizon interactions in which deceptive strategies typically unfold. We introduce a new simulation framework, LH-Deception, for a systematic, empirical quantification of deception in LLMs under extended sequences of interdependent tasks and dynamic contextual pressures. LH-Deception is designed as a multi-agent system: a performer agent tasked with completing tasks and a supervisor agent that evaluates progress, provides feedback, and maintains evolving states of trust. An independent deception auditor then reviews full trajectories to identify when and how deception occurs. We conduct extensive experiments across 11 frontier models, spanning both closed-source and open-source systems, and find that deception is model-dependent, increases with event pressure, and consistently erodes supervisor trust. Qualitative analyses further reveal emergent, long-horizon phenomena, such as ``chains of deception", which are invisible to static, single-turn evaluations. Our findings provide a foundation for evaluating future LLMs in real-world, trust-sensitive contexts.

cs.CL↗

arXiv2026

A Unified View of Attention and Residual Sinks: Outlier-Driven Rescaling is Essential for Transformer Training

We investigate the functional role of emergent outliers in large language models, specifically attention sinks (a few tokens that consistently receive large attention logits) and residual sinks (a few fixed dimensions with persistently large activations across most tokens). We hypothesize that these outliers, in conjunction with the corresponding normalizations (\textit{e.g.}, softmax attention and RMSNorm), effectively rescale other non-outlier components. We term this phenomenon \textit{outlier-driven rescaling} and validate this hypothesis across different model architectures and training token counts. This view unifies the origin and mitigation of both sink types. Our main conclusions and observations include: (1) Outliers function jointly with normalization: removing normalization eliminates the corresponding outliers but degrades training stability and performance; directly clipping outliers while retaining normalization leads to degradation, indicating that outlier-driven rescaling contributes to training stability. (2) Outliers serve more as rescale factors rather than contributors, as the final contributions of attention and residual sinks are significantly smaller than those of non-outliers. (3) Outliers can be absorbed into learnable parameters or mitigated via explicit gated rescaling, leading to improved training performance (average gain of 2 points) and enhanced quantization robustness (1.2 points degradation under W4A4 quantization).

cs.CL↗

arXiv2026

TaQ-DiT: Time-aware Quantization for Diffusion Transformers

Transformer-based diffusion models, dubbed Diffusion Transformers (DiTs), have achieved state-of-the-art performance in image and video generation tasks. However, their large model size and slow inference speed limit their practical applications, calling for model compression methods such as quantization. Unfortunately, existing DiT quantization methods overlook (1) the impact of reconstruction and (2) the varying quantization sensitivities across different layers, which hinder their achievable performance. To tackle these issues, we propose innovative time-aware quantization for DiTs (TaQ-DiT). Specifically, (1) we observe a non-convergence issue when reconstructing weights and activations separately during quantization and introduce a joint reconstruction method to resolve this problem. (2) We discover that Post-GELU activations are particularly sensitive to quantization due to their significant variability across different denoising steps as well as extreme asymmetries and variations within each step. To address this, we propose time-variance-aware transformations to facilitate more effective quantization. Experimental results show that when quantizing DiTs' weights to 4-bit and activations to 8-bit (W4A8), our method significantly surpasses previous quantization methods.

eess.IV↗

arXiv2026

Systematicity between Forms and Meanings across Languages Supports Efficient Communication

Languages vary widely in how meanings map to word forms. These mappings have been found to support efficient communication; however, this theory does not account for systematic relations within word forms. We examine how a restricted set of grammatical meanings (e.g. person, number) are expressed on verbs and pronouns across typologically diverse languages. Consistent with prior work, we find that verb and pronoun forms are shaped by competing communicative pressures for simplicity (minimizing the inventory of grammatical distinctions) and accuracy (enabling recovery of intended meanings). Crucially, our proposed model uses a novel measure of complexity (inverse of simplicity) based on the learnability of meaning-to-form mappings. This innovation captures fine-grained regularities in linguistic form, allowing better discrimination between attested and unattested systems, and establishes a new connection from efficient communication theory to systematicity in natural language.

cs.CL↗

arXiv2026

Engineering of Orbital Hybridization: An Exotic Strategy to Manipulate Orbital Current

Current-induced spin-orbit torque (SOT) plays a crucial role in the next-generation spin-orbitronics. Enhancing its efficiency is both fundamentally and practically interesting and remains a challenge to date. Recently, orbital counterparts of spin effects that do not rely on the spin-orbit coupling (SOC) have been found as an alternative mechanism to realize it. This work highlights the engineering of copper oxidation states for manipulating the orbital current and its torque in the CuO$_x$-based heterostructures. The orbital hybridization and thus the orbital-Rashba-Edelstein effect at the CuO$_x$/Cu interfaces are significantly enhanced by increasing the copper oxidation state, yielding a torque efficiency that is almost ten times larger than the conventional heavy metals. The Cu$_4$O$_3$/Cu interface, rather than the widely accepted CuO/Cu interface, is revealed to account for the enhanced SOT performance in the CuO$_x$-based heterostructures. In addition, the torque efficiency can be alternatively switched between high and low thresholds through the redox reaction. The current results establish an exotic and robust strategy for engineering the orbital current and SOT for spin-orbitronics, which applies to other weak-SOC materials.

cond-mat.mtrl-sci↗

arXiv2026

VoCodec: An Efficient Lightweight Low-Bitrate Speech Codec

Recent advancements in end-to-end neural speech codecs enable compressing audio at extremely low bitrates while maintaining high-fidelity reconstruction. Meanwhile, low computational complexity and low latency are crucial for real-time communication. In this paper, we propose VoCodec, a speech codec model featuring a computational complexity of only 349.29M multiply-accumulate operations per second (MACs/s) and a latency of 30 ms. With the competitive vocoder Vocos as its backbone, the proposed model ranked fourth on Track 1 in the 2025 LRAC Challenge and achieved the highest subjective evaluation score (MUSHRA) on the clean speech test set. Additionally, we cascade a lightweight neural network at the front end to extend its capability of speech enhancement. Experimental results demonstrate that the two systems achieve competitive performance across multiple evaluation metrics. Speech samples can be found at https://acceleration123.github.io/.

eess.AS↗

arXiv2026

A non-equilibrium strategy for the general synthesis of single-atom catalysts

Single-atom catalysts (SACs) maximize atom efficiency and exhibit unique electronic structures, yet realizing precise and scalable atomic dispersion remains a key challenge. Here, we report a non-equilibrium strategy for the scalable synthesis of SACs via ion implantation, enabling precise stabilization of metal atoms on diverse supports. Using an industrial-grade ion source, wafer-scale ion implantation with milliampere-level beam currents enables high-throughput fabrication of SACs, while the synergistic energy-mass effects stabilize isolated metal atoms in situ. A library of 36 SACs was constructed, and the resulting Pt/MoS2 exhibits outstanding hydrogen evolution performance with an overpotential of only 26 mV at 10 mA cm-2 and exceptional long-term stability, surpassing commercial Pt/C. This work demonstrates ion implantation as a versatile platform bridging fundamental SACs design and scalable manufacturing, providing new opportunities for high-performance catalysts in energy conversion applications.

cond-mat.mtrl-sci↗

arXiv2026

Judge Q: Trainable Queries for Optimized Information Retention in KV Cache Eviction

Large language models (LLMs) utilize key-value (KV) cache to store historical information during sequence processing. The size of KV cache grows linearly as the length of the sequence extends, which seriously affects memory usage and decoding efficiency. Current methods for KV cache eviction typically utilize the last window from the pre-filling phase as queries to compute the KV importance scores for eviction. Although this scheme is simple to implement, it tends to overly focus on local information, potentially leading to the neglect or omission of crucial global information. To mitigate this issue, we propose Judge Q, a novel training method which incorporates a soft token list. This method only tunes the model's embedding layer at a low training cost. By concatenating the soft token list at the end of the input sequence, we train these tokens' attention map to the original input sequence to align with that of the actual decoded tokens. In this way, the queries corresponding to the soft tokens can effectively capture global information and better evaluate the importance of the keys and values within the KV cache, thus maintaining decoding quality when KV cache is evicted. Under the same eviction budget, our method exhibits less performance degradation compared to existing eviction approaches. We validate our approach through experiments conducted on models such as Llama-3.1-8B-Instruct and Mistral-7B-Instruct-v0.3, using benchmarks including LongBench, RULER, and Needle-in-a-Haystack. Results indicate an improvement of approximately 1 point on the LongBench and over 3 points on RULER. This proposed methodology can be seamlessly integrated into existing open-source models with minimal training overhead, thereby enhancing performance in KV cache eviction scenarios.

cs.CL↗

arXiv2026

HAPNet: Toward Superior RGB-Thermal Scene Parsing via Hybrid, Asymmetric, and Progressive Heterogeneous Feature Fusion

Data-fusion networks have shown significant promise for RGB-thermal scene parsing. However, the majority of existing studies have relied on symmetric duplex encoders for heterogeneous feature extraction and fusion, paying inadequate attention to the inherent differences between RGB and thermal modalities. Recent progress in vision foundation models (VFMs) trained through self-supervision on vast amounts of unlabeled data has proven their ability to extract informative, general-purpose features. However, this potential has yet to be fully leveraged in the domain. In this study, we take one step toward this new research area by exploring a feasible strategy to fully exploit VFM features for RGB-thermal scene parsing. Specifically, we delve deeper into the unique characteristics of RGB and thermal modalities, thereby designing a hybrid, asymmetric encoder that incorporates both a VFM and a convolutional neural network. This design allows for more effective extraction of complementary heterogeneous features, which are subsequently fused in a dual-path, progressive manner. Moreover, we introduce an auxiliary task to further enrich the local semantics of the fused features, thereby improving the overall performance of RGB-thermal scene parsing. Our proposed HAPNet, equipped with all these components, demonstrates superior performance compared to all other state-of-the-art RGB-thermal scene parsing networks, achieving top ranks across three widely used public RGB-thermal scene parsing datasets. We believe this new paradigm has opened up new opportunities for future developments in data-fusion scene parsing approaches.

cs.CV↗

arXiv2025

PTalker: Personalized Speech-Driven 3D Talking Head Animation via Style Disentanglement and Modality Alignment

Speech-driven 3D talking head generation aims to produce lifelike facial animations precisely synchronized with speech. While considerable progress has been made in achieving high lip-synchronization accuracy, existing methods largely overlook the intricate nuances of individual speaking styles, which limits personalization and realism. In this work, we present a novel framework for personalized 3D talking head animation, namely "PTalker". This framework preserves speaking style through style disentanglement from audio and facial motion sequences and enhances lip-synchronization accuracy through a three-level alignment mechanism between audio and mesh modalities. Specifically, to effectively disentangle style and content, we design disentanglement constraints that encode driven audio and motion sequences into distinct style and content spaces to enhance speaking style representation. To improve lip-synchronization accuracy, we adopt a modality alignment mechanism incorporating three aspects: spatial alignment using Graph Attention Networks to capture vertex connectivity in the 3D mesh structure, temporal alignment using cross-attention to capture and synchronize temporal dependencies, and feature alignment by top-k bidirectional contrastive losses and KL divergence constraints to ensure consistency between speech and mesh modalities. Extensive qualitative and quantitative experiments on public datasets demonstrate that PTalker effectively generates realistic, stylized 3D talking heads that accurately match identity-specific speaking styles, outperforming state-of-the-art methods. The source code and supplementary videos are available at: PTalker.

cs.CV↗

arXiv2025

Embedding Samples Dispatching for Recommendation Model Training in Edge Environments

Training deep learning recommendation models (DLRMs) on edge workers brings several benefits, particularly in terms of data privacy protection, low latency and personalization. However, due to the huge size of embedding tables, typical DLRM training frameworks adopt one or more parameter servers to maintain global embedding tables, while leveraging the edge workers cache part of them. This incurs significant transmission cost for embedding transmissions between workers and parameter servers, which can dominate the training cycle. In this paper, we investigate how to dispatch input embedding samples to appropriate edge workers to minimize the total embedding transmission cost when facing edge-specific challenges such as heterogeneous networks and limited resources. We develop ESD, a novel mechanism that optimizes the dispatch of input embedding samples to edge workers based on expected embedding transmission cost. We propose HybridDis as the dispatch decision method within ESD, which combines a resource-intensive optimal algorithm and a heuristic algorithm to balance decision quality and resource consumption. We implement a prototype of ESD and compare it with state-of-the-art mechanisms on real-world workloads. Extensive experimental results show that ESD reduces the embedding transmission cost by up to 36.76% and achieves up to 1.74 times speedup in end-to-end DLRM training.

cs.DC↗

arXiv2025

Scalable low-latency entanglement distribution for distributed quantum computing

Practical distributed quantum computing and error correction require quantum networks with high-qubit-rate, high-fidelity, and low-reconfiguration-latency. Unfortunately, current approaches are limited by fundamental constraints: single-channel entanglement rates remain at the MHz level with millisecond-level reconfiguration, which is insufficient for fault-tolerant distributed quantum computing. Here, we propose a quantum network architecture that leverages reconfigurable quantum interfaces and wavelength-selective switches to overcome bandwidth and latency constraints. By tuning the frequency and temporal modes of photonic qubits across dense wavelength division multiplexing (DWDM) channels, our protocol achieves an entanglement generation rate of up to 183.4 MHz based on our comprehensive modeling of the networked cold atom computing systems. Our architecture enables nanosecond-scale network reconfiguration with low loss, low infidelity, and high dimensionality. Our modeling and simulation are designed for deployable distributed quantum computing and error correction, integrating the quantum interface, network switching, circuit compilation, and execution into a unified framework. The proposed architecture is fully compatible with industry-standard DWDM infrastructure, providing a scalable and cost-effective foundation for distributed quantum computing.

quant-ph↗