arXiv subjects

Shuai Zhang

Publications and source records attributed to Shuai Zhang.

At least 163 records · Page 9Linked to original sources

arXiv2025

RadialRouter: Structured Representation for Efficient and Robust Large Language Models Routing

The rapid advancements in large language models (LLMs) have led to the emergence of routing techniques, which aim to efficiently select the optimal LLM from diverse candidates to tackle specific tasks, optimizing performance while reducing costs. Current LLM routing methods are limited in effectiveness due to insufficient exploration of the intrinsic connection between user queries and the characteristics of LLMs. To address this issue, in this paper, we present RadialRouter, a novel framework for LLM routing which employs a lightweight Transformer-based backbone with a radial structure named RadialFormer to articulate the query-LLMs relationship. The optimal LLM selection is performed based on the final states of RadialFormer. The pipeline is further refined by an objective function that combines Kullback-Leibler divergence with the query-query contrastive loss to enhance robustness. Experimental results on RouterBench show that RadialRouter significantly outperforms existing routing methods by 9.2\% and 5.8\% in the Balance and Cost First scenarios, respectively. Additionally, its adaptability toward different performance-cost trade-offs and the dynamic LLM pool demonstrates practical application potential.

cs.CL↗

arXiv2025

Extending the short gamma-ray burst population from sub-threshold triggers in Fermi/GBM and GECAM data and its implications

Detection of short gamma-ray bursts (SGRBs) is critically important for the research of compact object mergers and multi-messenger astrophysics, but a significant part of SGRBs fall below the trigger threshold of GRB detectors, and thus are often missed. Here we present a systematic search for and verification of missed SGRBs using Fermi/GBM subthreshold triggers, jointly analyzing data from GBM, GECAM-B, and GECAM-C. Among 466 Fermi/GBM sub-threshold events (with reliability >= 5) from 2021 to 2024, 181 are within GECAM's field of view. We find that 49 out of 181 are confirmed astrophysical transients, and 41 can be classified as SGRBs. Thus, the SGRB detection rate of Fermi/GBM is increased to about 50 per year. Additionally, a complete multi-instrument monitoring and systematic verification of GBM sub-threshold events is expected to further increase the SGRB rate to about 80 per year, which is about 100% improvement relative to the GBM-triggered SGRBs. These results may have important implications on the local formation rate of SGRBs and the binary neutron star merger rate. We also searched for potential temporal coincidences between these SGRBs and gravitational waves from the LIGO-Virgo-KAGRA O4 run resulting in no detection.

astro-ph.HE↗

arXiv2025

Strong Correlation Driven Quadrupolar to Dipolar Exciton Transitions in a Trilayer Moiré Superlattice

The additional layer degree of freedom in trilayer moiré superlattices of transition metal dichalcogenides enables the emergence of novel excitonic species, such as quadrupolar excitons, which exhibit unique excitonic interactions and hold promise for realizing intriguing excitonic phases and their quantum phase transitions. Concurrently, the presence of strong electronic correlations in moiré superlattices, as exemplified by the observations of Mott insulators and generalized Wigner crystals, offers a direct route to manipulate these new excitonic states and resulting collective excitonic phases. Here, we demonstrate that strong exciton-exciton and electron-exciton interactions, both stemming from robust electron correlations, can be harnessed to controllably drive transitions between quadrupolar and dipolar excitons. This is achieved by tuning either the exciton density or electrostatic doping in a trilayer semiconducting moiré superlattice. Our findings not only advance the fundamental understanding of quadrupolar excitons but also usher in new avenues for exploring and engineering many-body quantum phenomena through novel correlated excitons in semiconducting moiré systems.

cond-mat.mes-hall↗

arXiv2025

Comprehensive Study of Phonon Chirality under Symmetry Constraints

Phonons are quanta of lattice vibrations, and their modes (linear, circular, or stationary) are symmetry-determined. Circularly polarized phonons, possessing nonzero angular momentum (AM), have drawn widespread attention recently. Despite widespread use of pseudo-angular momentum (PAM) and circularly polarized light polarization flips to identify chiral phonons in Raman scattering, their reliability is debated due to symmetry dependence, and experimental verification standards remain lacking. Here, we systematically study phonon chirality and associated phenomena across magnetic point groups. We establish that the AM-PAM correlation is governed by both crystalline symmetry and Wyckoff positions, dictating conditions where nonzero AM manifests in PAM signatures. Crucially, phonons belonging to distinct irreducible representations exhibit distinct experimental benchmarks, enabling direct determination of crystalline chirality and symmetry classification. Furthermore, we report the discovery of a signature for symmetry-induced phenomena, notably a half-wave plate-analogous effect induced by mirror-odd phonons. Meanwhile, we conducted five experiments to validate our theory.

cond-mat.mtrl-sci↗

arXiv2025

Turbo-VAED: Fast and Stable Transfer of Video-VAEs to Mobile Devices

There is a growing demand for deploying large generative AI models on mobile devices. For recent popular video generative models, however, the Variational AutoEncoder (VAE) represents one of the major computational bottlenecks. Both large parameter sizes and mismatched kernels cause out-of-memory errors or extremely slow inference on mobile devices. To address this, we propose a low-cost solution that efficiently transfers widely used video VAEs to mobile devices. (1) We analyze redundancy in existing VAE architectures and get empirical design insights. By integrating 3D depthwise separable convolutions into our model, we significantly reduce the number of parameters. (2) We observe that the upsampling techniques in mainstream video VAEs are poorly suited to mobile hardware and form the main bottleneck. In response, we propose a decoupled 3D pixel shuffle scheme that slashes end-to-end delay. Building upon these, we develop a universal mobile-oriented VAE decoder, Turbo-VAED. (3) We propose an efficient VAE decoder training method. Since only the decoder is used during deployment, we distill it to Turbo-VAED instead of retraining the full VAE, enabling fast mobile adaptation with minimal performance loss. To our knowledge, our method enables real-time 720p video VAE decoding on mobile devices for the first time. This approach is widely applicable to most video VAEs. When integrated into four representative models, with training cost as low as $95, it accelerates original VAEs by up to 84.5x at 720p resolution on GPUs, uses as low as 17.5% of original parameter count, and retains 96.9% of the original reconstruction quality. Compared to mobile-optimized VAEs, Turbo-VAED achieves a 2.9x speedup in FPS and better reconstruction quality on the iPhone 16 Pro. The code and models will soon be available at https://github.com/hustvl/Turbo-VAED.

cs.CV↗

arXiv2025

Dynamic 2D Gaussians: Geometrically Accurate Radiance Fields for Dynamic Objects

Reconstructing objects and extracting high-quality surfaces play a vital role in the real world. Current 4D representations show the ability to render high-quality novel views for dynamic objects, but cannot reconstruct high-quality meshes due to their implicit or geometrically inaccurate representations. In this paper, we propose a novel representation that can reconstruct accurate meshes from sparse image input, named Dynamic 2D Gaussians (D-2DGS). We adopt 2D Gaussians for basic geometry representation and use sparse-controlled points to capture the 2D Gaussian's deformation. By extracting the object mask from the rendered high-quality image and masking the rendered depth map, we remove floaters that are prone to occur during reconstruction and can extract high-quality dynamic mesh sequences of dynamic objects. Experiments demonstrate that our D-2DGS is outstanding in reconstructing detailed and smooth high-quality meshes from sparse inputs. The code is available at https://github.com/hustvl/Dynamic-2DGS.

cs.CV↗

arXiv2025

The Expressions of Depression and Anxiety in Chinese Psycho-counseling: Usage of First-person Singular Pronoun and Negative Emotional Words

This study explores the relationship between linguistic expressions and psychological states of depression and anxiety within Chinese psycho-counseling interactions, focusing specifically on the usage of first-person singular pronouns and negative emotional words. Utilizing a corpus derived from 735 online counseling sessions, the analysis employed a general linear mixed-effect model to assess linguistic patterns quantified by the Linguistic Inquiry and Word Count (LIWC) software. Results indicate a significant positive correlation between the frequency of negative emotional words and the severity of both depressive and anxious states among clients. However, contrary to prior findings predominantly derived from English-language contexts, the usage frequency of first-person singular pronouns did not vary significantly with the clients' psychological conditions. These outcomes are discussed within the framework of cultural distinctions between collectivist Chinese contexts and individualistic Western settings, as well as the interactive dynamics unique to psycho-counseling conversations. The findings highlight the nuanced influence of cultural and conversational contexts on language use in mental health communications, providing insights into psycholinguistic markers relevant to therapeutic practices in Chinese-speaking populations.

cs.CL↗

arXiv2025

Toward Holistic Evaluation of Recommender Systems Powered by Generative Models

Recommender systems powered by generative models (Gen-RecSys) extend beyond classical item ranking by producing open-ended content, which simultaneously unlocks richer user experiences and introduces new risks. On one hand, these systems can enhance personalization and appeal through dynamic explanations and multi-turn dialogues. On the other hand, they might venture into unknown territory-hallucinating nonexistent items, amplifying bias, or leaking private information. Traditional accuracy metrics cannot fully capture these challenges, as they fail to measure factual correctness, content safety, or alignment with user intent. This paper makes two main contributions. First, we categorize the evaluation challenges of Gen-RecSys into two groups: (i) existing concerns that are exacerbated by generative outputs (e.g., bias, privacy) and (ii) entirely new risks (e.g., item hallucinations, contradictory explanations). Second, we propose a holistic evaluation approach that includes scenario-based assessments and multi-metric checks-incorporating relevance, factual grounding, bias detection, and policy compliance. Our goal is to provide a guiding framework so researchers and practitioners can thoroughly assess Gen-RecSys, ensuring effective personalization and responsible deployment.

cs.IR↗

arXiv2025

Efficient Training of Large-Scale AI Models Through Federated Mixture-of-Experts: A System-Level Approach

The integration of Federated Learning (FL) and Mixture-of-Experts (MoE) presents a compelling pathway for training more powerful, large-scale artificial intelligence models (LAMs) on decentralized data while preserving privacy. However, efficient federated training of these complex MoE-structured LAMs is hindered by significant system-level challenges, particularly in managing the interplay between heterogeneous client resources and the sophisticated coordination required for numerous specialized experts. This article highlights a critical, yet underexplored concept: the absence of robust quantitative strategies for dynamic client-expert alignment that holistically considers varying client capacities and the imperative for system-wise load balancing. Specifically, we propose a conceptual system design for intelligent client-expert alignment that incorporates dynamic fitness scoring, global expert load monitoring, and client capacity profiling. By tackling these systemic issues, we can unlock more scalable, efficient, and robust training mechanisms {with fewer communication rounds for convergence}, paving the way for the widespread deployment of large-scale federated MoE-structured LAMs in edge computing with ultra-high communication efficiency.

cs.LG↗

arXiv2025

Benchmarking Generalizable Bimanual Manipulation: RoboTwin Dual-Arm Collaboration Challenge at CVPR 2025 MEIS Workshop

Embodied Artificial Intelligence (Embodied AI) is an emerging frontier in robotics, driven by the need for autonomous systems that can perceive, reason, and act in complex physical environments. While single-arm systems have shown strong task performance, collaborative dual-arm systems are essential for handling more intricate tasks involving rigid, deformable, and tactile-sensitive objects. To advance this goal, we launched the RoboTwin Dual-Arm Collaboration Challenge at the 2nd MEIS Workshop, CVPR 2025. Built on the RoboTwin Simulation platform (1.0 and 2.0) and the AgileX COBOT-Magic Robot platform, the competition consisted of three stages: Simulation Round 1, Simulation Round 2, and a final Real-World Round. Participants totally tackled 17 dual-arm manipulation tasks, covering rigid, deformable, and tactile-based scenarios. The challenge attracted 64 global teams and over 400 participants, producing top-performing solutions like SEM and AnchorDP3 and generating valuable insights into generalizable bimanual policy learning. This report outlines the competition setup, task design, evaluation methodology, key findings and future direction, aiming to support future research on robust and generalizable bimanual manipulation policies. The Challenge Webpage is available at https://robotwin-benchmark.github.io/cvpr-2025-challenge/.

cs.RO↗

arXiv2025

Towards Generalized and Training-Free Text-Guided Semantic Manipulation

Text-guided semantic manipulation refers to semantically editing an image generated from a source prompt to match a target prompt, enabling the desired semantic changes (e.g., addition, removal, and style transfer) while preserving irrelevant contents. With the powerful generative capabilities of the diffusion model, the task has shown the potential to generate high-fidelity visual content. Nevertheless, existing methods either typically require time-consuming fine-tuning (inefficient), fail to accomplish multiple semantic manipulations (poorly extensible), and/or lack support for different modality tasks (limited generalizability). Upon further investigation, we find that the geometric properties of noises in the diffusion model are strongly correlated with the semantic changes. Motivated by this, we propose a novel $\textit{GTF}$ for text-guided semantic manipulation, which has the following attractive capabilities: 1) $\textbf{Generalized}$: our $\textit{GTF}$ supports multiple semantic manipulations (e.g., addition, removal, and style transfer) and can be seamlessly integrated into all diffusion-based methods (i.e., Plug-and-play) across different modalities (i.e., modality-agnostic); and 2) $\textbf{Training-free}$: $\textit{GTF}$ produces high-fidelity results via simply controlling the geometric relationship between noises without tuning or optimization. Our extensive experiments demonstrate the efficacy of our approach, highlighting its potential to advance the state-of-the-art in semantics manipulation.

cs.CV↗

arXiv2025

DReSS: Data-driven Regularized Structured Streamlining for Large Language Models

Large language models (LLMs) have achieved significant progress across various domains, but their increasing scale results in high computational and memory costs. Recent studies have revealed that LLMs exhibit sparsity, providing the potential to reduce model size through pruning techniques. However, existing pruning methods typically follow a prune-then-finetune paradigm. Since the pruned components still contain valuable information, their direct removal often leads to irreversible performance degradation, imposing a substantial computational burden to recover performance during finetuning. In this paper, we propose a novel paradigm that first applies regularization, then prunes, and finally finetunes. Based on this paradigm, we introduce DReSS, a simple and effective Data-driven Regularized Structured Streamlining method for LLMs. By leveraging a small amount of data to regularize the components to be pruned, DReSS explicitly transfers the important information to the remaining parts of the model in advance. Compared to direct pruning, this can reduce the information loss caused by parameter removal, thereby enhancing its language modeling capabilities. Experimental results demonstrate that DReSS significantly outperforms existing pruning methods even under extreme pruning ratios, significantly reducing latency and increasing throughput.

cs.LG↗

arXiv2025

CrEst: Credibility Estimation for Contexts in LLMs via Weak Supervision

The integration of contextual information has significantly enhanced the performance of large language models (LLMs) on knowledge-intensive tasks. However, existing methods often overlook a critical challenge: the credibility of context documents can vary widely, potentially leading to the propagation of unreliable information. In this paper, we introduce CrEst, a novel weakly supervised framework for assessing the credibility of context documents during LLM inference--without requiring manual annotations. Our approach is grounded in the insight that credible documents tend to exhibit higher semantic coherence with other credible documents, enabling automated credibility estimation through inter-document agreement. To incorporate credibility into LLM inference, we propose two integration strategies: a black-box approach for models without access to internal weights or activations, and a white-box method that directly modifies attention mechanisms. Extensive experiments across three model architectures and five datasets demonstrate that CrEst consistently outperforms strong baselines, achieving up to a 26.86% improvement in accuracy and a 3.49% increase in F1 score. Further analysis shows that CrEst maintains robust performance even under high-noise conditions.

cs.CL↗

arXiv2025

Absorbance marker: Detection of quantum geometry and spread of Wannier function in disordered 2D semiconductors

The optical absorbance of 2D semiconductors is generalized to individual lattice sites through the topological marker formalism, yielding an absorbance marker. This marker allows to investigate the atomic scale variation of absorbance caused by impurities, thereby quantifies the influence of disorder on the quantum geometry and the spread of Wannier functions of valence band states. Applying this marker to transition metal dichalcogenides reveals a very localized suppression of absorbance caused by potential impurities, rendering a reduction of absorbance in the macroscopic scale proportional to the impurity density, in good agreement with the experimental results of plasma-treated WS$_{2}$.

cond-mat.str-el↗

arXiv2025

Entanglement and entropy uncertainty in black hole quantum atmosphere

In this work, we investigate the properties of Hawking radiation induced by the quantum atmosphere beyond the event horizon, by considering two detectors in Schwarzschild spacetime with the parameterized Hartle-Hawking temperature. \textcolor{black}{We explicitly study the dynamics of quantum entanglement and found that its characteristics are closely correlated with Hawking quantum radiation beyond the event horizon. Namely, its minimal value corresponds to the peak of Hawking radiation.} By virtue of the mutual information, we demonstrate the complementary relationship of the information distribution in the black hole. In addition, we detailedly discuss the influence of distance from the center of black hole to particle, radius of event horizon and Hartle-Hawking constant on the entropy uncertainty in the current scenario, and the results interestingly show that there exists an opposite correlation between the entanglement and the entropy uncertainty. It is believed that our observation could provide a new perspective for understanding the black hole information paradox and black hole thermodynamics.

gr-qc↗

arXiv2025

Hyper-active repeating fast radio bursts from rotation modulated starquakes on magnetars

The non-detection of periodicity related to rotation challenges magnetar models for fast radio bursts (FRBs) with FRB emission from close to the magnetar surface. Moreover, a bimodal distribution of the burst waiting times is widely observed in hyper-active FRBs, a significant deviation from the exponential distribution expected from stationary Poisson processes. By combining the epidemic-type aftershock sequence (ETAS) earthquake model and the rotating vector model (RVM) involving the rotation of the magnetar and orientations of the spin and magnetic axes, we find that starquake events modulated by the rotation of FRB-emitting magnetar can explain the bimodal distribution of FRB waiting times, as well as the non-detection of periodicity in hyper-active repeating FRBs. We analyze data from multiple FRB sources, demonstrating that differences in waiting time distributions and, to some extent, observed energies can be explained by varying parameters related to geometric properties of the magnetar FRB emission and starquake dynamics. Our results show that the assumption that all FRBs are repeaters is compatible with our model. Notably, we find that hyper-active repeaters tend to have small magnetic inclination angles in order to hide their periodicity. We also show that our model can reproduce the waiting time distribution of a pulsar phase of the galactic magnetar SGR J1935+2154 with a larger inclination angle than the hyper-active repeaters, which could explain the detection of spin period and the relatively low observed energy for FRBs from the magnetar. The spin periods of hyper-active repeaters are not well constrained, but most likely fall in the valley region between the two peaks of the waiting time distributions.

astro-ph.HE↗

arXiv2025

Beyond Examples: High-level Automated Reasoning Paradigm in In-Context Learning via MCTS

In-context learning (ICL) enables large language models (LLMs) to perform downstream tasks through advanced prompting and high-quality demonstrations. However, traditional ICL paradigms encounter significant limitations in complex reasoning tasks, stemming primarily from their dependence on example quality and absence of explicit reasoning guidance. To address these challenges, we introduce HiAR-ICL, a **Hi**gh-level **A**utomated **R**easoning paradigm in **ICL** that shifts focus from specific examples to abstract reasoning patterns, thereby extending the conventional concept of "context" in ICL. Our approach begins by defining five atomic reasoning actions, upon which we employ Monte Carlo Tree Search to systematically construct high-level reasoning patterns. During inference, HiAR-ICL dynamically selects appropriate reasoning patterns based on problem attributes, providing explicit guidance for the model's reasoning process. Experiments demonstrate HiAR-ICL's effectiveness and efficiency: utilizing only 200 prior samples with Qwen2.5-7B-Instruct, our method achieves 80.6% accuracy on MATH and 62.5% on AMC, exceeding GPT-4o's 77.2% and 57.5%. Our approach enhances performance across models of varying sizes while generalizing effectively across domains. Further analysis reveals that HiAR-ICL can also serve as a plug-and-play inference method compatible with post-training techniques like GRPO. Code and data are available at https://github.com/jinyangwu/HiARICL.

cs.CL↗

arXiv2025

Pandora's Box or Aladdin's Lamp: A Comprehensive Analysis Revealing the Role of RAG Noise in Large Language Models

Retrieval-Augmented Generation (RAG) has emerged as a crucial method for addressing hallucinations in large language models (LLMs). While recent research has extended RAG models to complex noisy scenarios, these explorations often confine themselves to limited noise types and presuppose that noise is inherently detrimental to LLMs, potentially deviating from real-world retrieval environments and restricting practical applicability. In this paper, we define seven distinct noise types from a linguistic perspective and establish a Noise RAG Benchmark (NoiserBench), a comprehensive evaluation framework encompassing multiple datasets and reasoning tasks. Through empirical evaluation of eight representative LLMs with diverse architectures and scales, we reveal that these noises can be further categorized into two practical groups: noise that is beneficial to LLMs (aka beneficial noise) and noise that is harmful to LLMs (aka harmful noise). While harmful noise generally impairs performance, beneficial noise may enhance several aspects of model capabilities and overall performance. Our analysis offers insights for developing more robust, adaptable RAG solutions and mitigating hallucinations across diverse retrieval scenarios. Code is available at https://github.com/jinyangwu/NoiserBench.

cs.CL↗