arXiv subjects

Wei Wu

Publications and source records attributed to Wei Wu.

At least 181 records · Page 10Linked to original sources

arXiv2025

DoctorRAG: Medical RAG Fusing Knowledge with Patient Analogy through Textual Gradients

Existing medical RAG systems mainly leverage knowledge from medical knowledge bases, neglecting the crucial role of experiential knowledge derived from similar patient cases -- a key component of human clinical reasoning. To bridge this gap, we propose DoctorRAG, a RAG framework that emulates doctor-like reasoning by integrating both explicit clinical knowledge and implicit case-based experience. DoctorRAG enhances retrieval precision by first allocating conceptual tags for queries and knowledge sources, together with a hybrid retrieval mechanism from both relevant knowledge and patient. In addition, a Med-TextGrad module using multi-agent textual gradients is integrated to ensure that the final output adheres to the retrieved knowledge and patient query. Comprehensive experiments on multilingual, multitask datasets demonstrate that DoctorRAG significantly outperforms strong baseline RAG models and gains improvements from iterative refinements. Our approach generates more accurate, relevant, and comprehensive responses, taking a step towards more doctor-like medical reasoning systems.

cs.CL↗

arXiv2025

From 1,000,000 Users to Every User: Scaling Up Personalized Preference for User-level Alignment

Large language models (LLMs) have traditionally been aligned through one-size-fits-all approaches that assume uniform human preferences, fundamentally overlooking the diversity in user values and needs. This paper introduces a comprehensive framework for scalable personalized alignment of LLMs. We establish a systematic preference space characterizing psychological and behavioral dimensions, alongside diverse persona representations for robust preference inference in real-world scenarios. Building upon this foundation, we introduce \textsc{AlignX}, a large-scale dataset of over 1.3 million personalized preference examples, and develop two complementary alignment approaches: \textit{in-context alignment} directly conditioning on persona representations and \textit{preference-bridged alignment} modeling intermediate preference distributions. Extensive experiments demonstrate substantial improvements over existing methods, with an average 17.06\% accuracy gain across four benchmarks while exhibiting a strong adaptation capability to novel preferences, robustness to limited user data, and precise preference controllability. These results validate our approach toward user-adaptive AI systems.

cs.CL↗

arXiv2025

Empowering Vision Transformers with Multi-Scale Causal Intervention for Long-Tailed Image Classification

Causal inference has emerged as a promising approach to mitigate long-tail classification by handling the biases introduced by class imbalance. However, along with the change of advanced backbone models from Convolutional Neural Networks (CNNs) to Visual Transformers (ViT), existing causal models may not achieve an expected performance gain. This paper investigates the influence of existing causal models on CNNs and ViT variants, highlighting that ViT's global feature representation makes it hard for causal methods to model associations between fine-grained features and predictions, which leads to difficulties in classifying tail classes with similar visual appearance. To address these issues, this paper proposes TSCNet, a two-stage causal modeling method to discover fine-grained causal associations through multi-scale causal interventions. Specifically, in the hierarchical causal representation learning stage (HCRL), it decouples the background and objects, applying backdoor interventions at both the patch and feature level to prevent model from using class-irrelevant areas to infer labels which enhances fine-grained causal representation. In the counterfactual logits bias calibration stage (CLBC), it refines the optimization of model's decision boundary by adaptive constructing counterfactual balanced data distribution to remove the spurious associations in the logits caused by data distribution. Extensive experiments conducted on various long-tail benchmarks demonstrate that the proposed TSCNet can eliminate multiple biases introduced by data imbalance, which outperforms existing methods.

cs.CV↗

arXiv2025

Latent Preference Coding: Aligning Large Language Models via Discrete Latent Codes

Large language models (LLMs) have achieved remarkable success, yet aligning their generations with human preferences remains a critical challenge. Existing approaches to preference modeling often rely on an explicit or implicit reward function, overlooking the intricate and multifaceted nature of human preferences that may encompass conflicting factors across diverse tasks and populations. To address this limitation, we introduce Latent Preference Coding (LPC), a novel framework that models the implicit factors as well as their combinations behind holistic preferences using discrete latent codes. LPC seamlessly integrates with various offline alignment algorithms, automatically inferring the underlying factors and their importance from data without relying on pre-defined reward functions and hand-crafted combination weights. Extensive experiments on multiple benchmarks demonstrate that LPC consistently improves upon three alignment algorithms (DPO, SimPO, and IPO) using three base models (Mistral-7B, Llama3-8B, and Llama3-8B-Instruct). Furthermore, deeper analysis reveals that the learned latent codes effectively capture the differences in the distribution of human preferences and significantly enhance the robustness of alignment against noise in data. By providing a unified representation for the multifarious preference factors, LPC paves the way towards developing more robust and versatile alignment techniques for the responsible deployment of powerful LLMs.

cs.CL↗

arXiv2025

A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applications

Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their transition to real-world applications reveals a critical limitation: the inability to adapt to individual preferences while maintaining alignment with universal human values. Current alignment techniques adopt a one-size-fits-all approach that fails to accommodate users' diverse backgrounds and needs. This paper presents the first comprehensive survey of personalized alignment-a paradigm that enables LLMs to adapt their behavior within ethical boundaries based on individual preferences. We propose a unified framework comprising preference memory management, personalized generation, and feedback-based alignment, systematically analyzing implementation approaches and evaluating their effectiveness across various scenarios. By examining current techniques, potential risks, and future challenges, this survey provides a structured foundation for developing more adaptable and ethically-aligned LLMs.

cs.CL↗

arXiv2025

NANO-SLAM : Natural Gradient Gaussian Approximation for Vehicle SLAM

Accurate localization is a challenging task for autonomous vehicles, particularly in GPS-denied environments such as urban canyons and tunnels. In these scenarios, simultaneous localization and mapping (SLAM) offers a more robust alternative to GPS-based positioning, enabling vehicles to determine their position using onboard sensors and surrounding environment's landmarks. Among various vehicle SLAM approaches, Rao-Blackwellized particle filter (RBPF) stands out as one of the most widely adopted methods due to its efficient solution with logarithmic complexity relative to the map size. RBPF approximates the posterior distribution of the vehicle pose using a set of Monte Carlo particles through two main steps: sampling and importance weighting. The key to effective sampling lies in solving a distribution that closely approximates the posterior, known as the sampling distribution, to accelerate convergence. Existing methods typically derive this distribution via linearization, which introduces significant approximation errors due to the inherent nonlinearity of the system. To address this limitation, we propose a novel vehicle SLAM method called \textit{N}atural Gr\textit{a}dient Gaussia\textit{n} Appr\textit{o}ximation (NANO)-SLAM, which avoids linearization errors by modeling the sampling distribution as the solution to an optimization problem over Gaussian parameters and solving it using natural gradient descent. This approach improves the accuracy of the sampling distribution and consequently enhances localization performance. Experimental results on the long-distance Sydney Victoria Park vehicle SLAM dataset show that NANO-SLAM achieves over 50\% improvement in localization accuracy compared to the most widely used vehicle SLAM algorithms, with minimal additional computational cost.

cs.RO↗

arXiv2025

Stark-induced tunable phase transition in the two-photon Dicke-Stark model

We theoretically investigate the superradiant phase transition (SPT) in the two-photon Dicke-Stark model, which incorporates both Rabi and Stark coupling. By introducing a Stark coupling term, we significantly reduce the critical Rabi coupling strength required to achieve the SPT, enabling it to occur even in strong coupling regimes. Using mean-field theory, we derive the conditions for the SPT and show that it exhibits a second-order phase transition. Surprisingly, we demonstrate that the transition point can be widely tuned by the Stark coupling strength. The signatures of these Stark-tunable SPT points are manifested through atomic averages. When quantum fluctuations are included, the spin-squeezing distributions also reveal the effects of Stark-tunable SPT points. In addition, we propose an experimentally feasible realization using an ion trap system driven by three lasers. Our scheme enables optical switching between normal and superradiant phases through pump field intensity modulation, where the Stark coupling coefficient serves as the optically tunable parameter. Our results offer a new approach to engineer the SPT, extending superradiance-based quantum technologies beyond the ultrastrong coupling regime.

quant-ph↗

arXiv2025

Global Intervention and Distillation for Federated Out-of-Distribution Generalization

Attribute skew in federated learning leads local models to focus on learning non-causal associations, guiding them towards inconsistent optimization directions, which inevitably results in performance degradation and unstable convergence. Existing methods typically leverage data augmentation to enhance sample diversity or employ knowledge distillation to learn invariant representations. However, the instability in the quality of generated data and the lack of domain information limit their performance on unseen samples. To address these issues, this paper presents a global intervention and distillation method, termed FedGID, which utilizes diverse attribute features for backdoor adjustment to break the spurious association between background and label. It includes two main modules, where the global intervention module adaptively decouples objects and backgrounds in images, injects background information into random samples to intervene in the sample distribution, which links backgrounds to all categories to prevent the model from treating background-label associations as causal. The global distillation module leverages a unified knowledge base to guide the representation learning of client models, preventing local models from overfitting to client-specific attributes. Experimental results on three datasets demonstrate that FedGID enhances the model's ability to focus on the main subjects in unseen data and outperforms existing methods in collaborative modeling.

cs.CV↗

arXiv2025

Benchmarking Large Vision-Language Models via Directed Scene Graph for Comprehensive Image Captioning

Generating detailed captions comprehending text-rich visual content in images has received growing attention for Large Vision-Language Models (LVLMs). However, few studies have developed benchmarks specifically tailored for detailed captions to measure their accuracy and comprehensiveness. In this paper, we introduce a detailed caption benchmark, termed as CompreCap, to evaluate the visual context from a directed scene graph view. Concretely, we first manually segment the image into semantically meaningful regions (i.e., semantic segmentation mask) according to common-object vocabulary, while also distinguishing attributes of objects within all those regions. Then directional relation labels of these objects are annotated to compose a directed scene graph that can well encode rich compositional information of the image. Based on our directed scene graph, we develop a pipeline to assess the generated detailed captions from LVLMs on multiple levels, including the object-level coverage, the accuracy of attribute descriptions, the score of key relationships, etc. Experimental results on the CompreCap dataset confirm that our evaluation method aligns closely with human evaluation scores across LVLMs.

cs.CV↗

arXiv2025

Learning Visual Generative Priors without Text

Although text-to-image (T2I) models have recently thrived as visual generative priors, their reliance on high-quality text-image pairs makes scaling up expensive. We argue that grasping the cross-modality alignment is not a necessity for a sound visual generative prior, whose focus should be on texture modeling. Such a philosophy inspires us to study image-to-image (I2I) generation, where models can learn from in-the-wild images in a self-supervised manner. We first develop a pure vision-based training framework, Lumos, and confirm the feasibility and the scalability of learning I2I models. We then find that, as an upstream task of T2I, our I2I model serves as a more foundational visual prior and achieves on-par or better performance than existing T2I models using only 1/10 text-image pairs for fine-tuning. We further demonstrate the superiority of I2I priors over T2I priors on some text-irrelevant visual generative tasks, like image-to-3D and image-to-video. Our project page is available at https://ant-research.github.io/lumos.

cs.CV↗

arXiv2025

Non-equilibrium Capacitance Loss in EDLC Based on Ion Flux

Understanding the loss of non-equilibrium capacitance in the electric double layer capacitor (EDLC) during continuous charging compared to equilibrium capacitance is crucial for the design of high-rate energy storage devices. Due to three major challenges, including strong ion correlations induced by high concentrations at the interface, the difficulty in representing far from equilibrium, and numerical stability issues, current numerical simulations of ion distribution based on statistical mechanics struggle to achieve long-term accurate modeling under realistic parameters. Since non-equilibrium capacitance loss is a universal macroscopic phenomenon in EDLC, which exists independently of the microscopic model of the electrolyte, this study starts from macroscopic non-equilibrium phenomena, introduces a novel perspective centered on ion flux (IF) for the first time. By deriving the relationship among the charging current, IF, and displacement current, a novel capacitance model based on IF is first established. It is further demonstrated that the current relationship and voltage relationship of EDLC, when represented by conventional circuit models, exhibit inherent contradictions. Therefore, a new interpretative framework is proposed, wherein IF and displacement current are analogized to acceleration and deformation in an elastic medium, respectively. Inspired by this insight, this study reveals that the decrease in non-equilibrium capacitance with increasing charging current originates from the inherent resistance of IF to external charging. This tendency to restore equilibrium is the fundamental cause of non-equilibrium capacitance loss.

cond-mat.mtrl-sci↗

arXiv2025

Cross-Layer Security for Semantic Communications: Metrics and Optimization

Different from traditional secure communication that focuses on symbolic protection at the physical layer, semantic secure communication requires further attention to semantic-level task performance at the application layer. There is a research gap on how to comprehensively evaluate and optimize the security performance of semantic communication. In order to fill this gap, a unified semantic security metric, the cross-layer semantic secure rate (CLSSR), is defined to estimate cross-layer security requirements at both the physical layer and the application layer. Then, we formulate the maximization problem of the CLSSR with the mixed integer nonlinear programming (MINLP). We propose a hierarchical AI-native semantic secure communication network with a reinforcement learning (RL)-based semantic resource allocation scheme, aiming to ensure the cross-layer semantic security (CL-SS). Finally, we prove the convergence of our proposed intelligent resource allocation, and the simulation results demonstrate that our proposed CLSS method outperforms the traditional physical layer semantic security (PL-SS) method in terms of both task reliability and CLSSR.

cs.IT↗

arXiv2025

Theoretical Investigation of High-Tc Superconductivity in Sr-Doped La$_3$Ni$_2$O$_7$ at Ambient Pressure

The recent discovery of pressure-induced superconductivity in La$_3$Ni$_2$O$_7$ has established a novel platform for studying unconventional superconductors. However, achieving superconductivity in this system currently requires relatively high pressures. In this study, we propose a chemical pressure strategy via Sr substitution to stabilize high-Tc superconductivity in La$_3$Ni$_2$O$_7$ under ambient conditions.Using density functional theory (DFT) calculations, we systematically investigate the structural and electronic properties of Sr-doped La$_{3-x}$Sr$_x$Ni$_2$O$_7$ (x = 0.25, 0.5, 1) at ambient pressure and identify two dynamically stable phases:La$_{2.5}$Sr$_{0.5}$Ni$_2$O$_7$ and La$_2$SrNi$_2$O$_7$.Our calculations reveal that both phases exhibit metallization of the $σ$-bonding bands dominated by Ni-d$_{z^{2}}$ orbitals-a key feature associated with high-Tc superconductivity, as reported in the high-pressure phase of La$_3$Ni$_2$O$_7$. Further analysis using tight-binding models shows that the key hopping parameters in La$_{2.5}$Sr$_{0.5}$Ni$_2$O$_7$ and La$_2$SrNi$_2$O$_7$ closely resemble those of La$_3$Ni$_2$O$_7$ under high pressure, indicating that strong super-exchange interactions between interlayer Ni-d$_{z^{2}}$ orbitals are preserved. These findings suggest that Sr-doped La$_3$Ni$_2$O$_7$ is a promising candidate for realizing high-Tcsuperconductivity at ambient pressure.

cond-mat.supr-con↗

arXiv2025

Hierarchical Locality Sensitive Hashing for Structured Data: A Survey

Data similarity (or distance) computation is a fundamental research topic which fosters a variety of similarity-based machine learning and data mining applications. In big data analytics, it is impractical to compute the exact similarity of data instances due to high computational cost. To this end, the Locality Sensitive Hashing (LSH) technique has been proposed to provide accurate estimators for various similarity measures between sets or vectors in an efficient manner without the learning process. Structured data (e.g., sequences, trees and graphs), which are composed of elements and relations between the elements, are commonly seen in the real world, but the traditional LSH algorithms cannot preserve the structure information represented as relations between elements. In order to conquer the issue, researchers have been devoted to the family of the hierarchical LSH algorithms. In this paper, we explore the present progress of the research into hierarchical LSH from the following perspectives: 1) Data structures, where we review various hierarchical LSH algorithms for three typical data structures and uncover their inherent connections; 2) Applications, where we review the hierarchical LSH algorithms in multiple application scenarios; 3) Challenges, where we discuss some potential challenges as future directions.

cs.DS↗

arXiv2025

Every FLOP Counts: Scaling a 300B Mixture-of-Experts LING LLM without Premium GPUs

In this technical report, we tackle the challenges of training large-scale Mixture of Experts (MoE) models, focusing on overcoming cost inefficiency and resource limitations prevalent in such systems. To address these issues, we present two differently sized MoE large language models (LLMs), namely Ling-Lite and Ling-Plus (referred to as "Bailing" in Chinese, spelled Bǎilíng in Pinyin). Ling-Lite contains 16.8 billion parameters with 2.75 billion activated parameters, while Ling-Plus boasts 290 billion parameters with 28.8 billion activated parameters. Both models exhibit comparable performance to leading industry benchmarks. This report offers actionable insights to improve the efficiency and accessibility of AI development in resource-constrained settings, promoting more scalable and sustainable technologies. Specifically, to reduce training costs for large-scale MoE models, we propose innovative methods for (1) optimization of model architecture and training processes, (2) refinement of training anomaly handling, and (3) enhancement of model evaluation efficiency. Additionally, leveraging high-quality data generated from knowledge graphs, our models demonstrate superior capabilities in tool use compared to other models. Ultimately, our experimental findings demonstrate that a 300B MoE LLM can be effectively trained on lower-performance devices while achieving comparable performance to models of a similar scale, including dense and MoE models. Compared to high-performance devices, utilizing a lower-specification hardware system during the pre-training phase demonstrates significant cost savings, reducing computing costs by approximately 20%. The models can be accessed at https://huggingface.co/inclusionAI.

cs.LG↗

arXiv2025

Exploring atom-ion Feshbach resonances below the s-wave limit

Revealing the quantum properties of matter requires a high degree of experimental control accompanied by a profound theoretical understanding. At ultracold temperatures, quantities that appear continuous in everyday life, such as the motional angular momentum of two colliding particles, become quantized, leaving a measurable imprint on experimental results. Embedding a single particle within a larger quantum bath at lowest temperatures can result in resonant partial-wave dependent interaction, whose strength near zero energy is dictated by universal threshold scaling laws. Hybrid atom-ion systems have emerged as a novel platform in which a single charged atom in an ultracold bath serves as a well-controlled impurity of variable energy. However, entering the low-energy s-wave regime and exploring the role of higher-partial-wave scattering within has remained an open challenge. Here, we immerse a Barium ion in a cloud of ultracold spin-polarized Lithium atoms, realize tunable collision energies below the s-wave limit and explore resonant higher-partial-wave scattering by studying the energy dependence of Feshbach resonances. Utilizing precise electric field control, we tune the collision energy over four orders of magnitude, reaching from the many-parital-wave to the s-wave regime. At the lowest energies, we probe the energy dependence of an isolated s-wave Feshbach resonance and introduce a theoretical model that allows to distinguish it from higher-partial-wave resonances. Additionally, at energies around the p-wave barrier, we find and identify an open-channel f-wave resonance, consistent with threshold laws. Our findings highlight and benchmark the importance of higher-partial-wave scattering well within the s-wave regime and offer control over chemical reactions and complex many-body dynamics in atom-ion ensembles - on the level of individual angular momentum quanta.

physics.atom-ph↗

arXiv2025

Exploring the Performance Improvement of Tensor Processing Engines through Transformation in the Bit-weight Dimension of MACs

General matrix-matrix multiplication (GEMM) is a cornerstone of AI computations, making tensor processing engines (TPEs) increasingly critical in GPUs and domain-specific architectures. Existing architectures primarily optimize dataflow or operand reuse strategies. However, considering the interaction between matrix multiplication and multiply-accumulators (MACs) offers greater optimization potential. This work introduces a novel hardware perspective on matrix multiplication, focusing on the bit-weight dimension of MACs. We propose a finer-grained TPE notation using matrix triple loops as an example, introducing new methods for designing and optimizing PE microarchitectures. Based on this notation and its transformations, we propose four optimization techniques that improve timing, area, and power consumption. Implementing our design in RTL using the SMIC-28nm process, we evaluate its effectiveness across four classic TPE architectures: systolic array, 3D-Cube, multiplier-adder tree, and 2D-Matrix. Our techniques achieve area efficiency improvements of 1.27x, 1.28x, 1.56x, and 1.44x, and energy efficiency gains of 1.04x, 1.56x, 1.49x, and 1.20x, respectively. Applied to a bit-slice architecture, our approach achieves a 12.10x improvement in energy efficiency and 2.85x in area efficiency compared to Laconic. Our Verilog HDL code, along with timing, area, and power reports, is available at https://github.com/wqzustc/High-Performance-Tensor-Processing-Engines

cs.AR↗

arXiv2025

RoboSense: Large-scale Dataset and Benchmark for Egocentric Robot Perception and Navigation in Crowded and Unstructured Environments

Reliable embodied perception from an egocentric perspective is challenging yet essential for autonomous navigation technology of intelligent mobile agents. With the growing demand of social robotics, near-field scene understanding becomes an important research topic in the areas of egocentric perceptual tasks related to navigation in both crowded and unstructured environments. Due to the complexity of environmental conditions and difficulty of surrounding obstacles owing to truncation and occlusion, the perception capability under this circumstance is still inferior. To further enhance the intelligence of mobile robots, in this paper, we setup an egocentric multi-sensor data collection platform based on 3 main types of sensors (Camera, LiDAR and Fisheye), which supports flexible sensor configurations to enable dynamic sight of view from ego-perspective, capturing either near or farther areas. Meanwhile, a large-scale multimodal dataset is constructed, named RoboSense, to facilitate egocentric robot perception. Specifically, RoboSense contains more than 133K synchronized data with 1.4M 3D bounding box and IDs annotated in the full $360^{\circ}$ view, forming 216K trajectories across 7.6K temporal sequences. It has $270\times$ and $18\times$ as many annotations of surrounding obstacles within near ranges as the previous datasets collected for autonomous driving scenarios such as KITTI and nuScenes. Moreover, we define a novel matching criterion for near-field 3D perception and prediction metrics. Based on RoboSense, we formulate 6 popular tasks to facilitate the future research development, where the detailed analysis as well as benchmarks are also provided accordingly. Data desensitization measures have been conducted for privacy protection.

cs.CV↗