arXiv subjects

Yue Zhang

Publications and source records attributed to Yue Zhang.

At least 325 records · Page 18Linked to original sources

arXiv2025

If LLMs Would Just Look: Simple Line-by-line Checking Improves Vulnerability Localization

The rapid expansion of software systems and the growing number of reported vulnerabilities have emphasized the importance of accurately identifying vulnerable code segments. Traditional methods for vulnerability localization, such as manual code audits or rule-based tools, are often time-consuming and limited in scope, typically focusing on specific programming languages or types of vulnerabilities. In recent years, the introduction of large language models (LLMs) such as GPT and LLaMA has opened new possibilities for automating vulnerability detection. However, while LLMs show promise in this area, they face challenges, particularly in maintaining accuracy over longer code contexts. This paper introduces LOVA, a novel framework leveraging the self-attention mechanisms inherent in LLMs to enhance vulnerability localization. Our key insight is that self-attention mechanisms assign varying importance to different parts of the input, making it possible to track how much attention the model focuses on specific lines of code. In the context of vulnerability localization, the hypothesis is that vulnerable lines of code will naturally attract higher attention weights because they have a greater influence on the model's output. By systematically tracking changes in attention weights and focusing on specific lines of code, LOVA improves the precision of identifying vulnerable lines across various programming languages. Through rigorous experimentation and evaluation, we demonstrate that LOVA significantly outperforms existing LLM-based approaches, achieving up to a 5.3x improvement in F1-scores. LOVA also demonstrated strong scalability, with up to a 14.6x improvement in smart contract vulnerability localization across languages like C, Python, Java, and Solidity. Its robustness was proven through consistent performance across different LLM architectures.

cs.CR↗

arXiv2025

Everything You Wanted to Know About LLM-based Vulnerability Detection But Were Afraid to Ask

Large Language Models are a promising tool for automated vulnerability detection, thanks to their success in code generation and repair. However, despite widespread adoption, a critical question remains: Are LLMs truly effective at detecting real-world vulnerabilities? Current evaluations, which often assess models on isolated functions or files, ignore the broader execution and data-flow context essential for understanding vulnerabilities. This oversight leads to two types of misleading outcomes: incorrect conclusions and flawed rationales, collectively undermining the reliability of prior assessments. Therefore, in this paper, we challenge three widely held community beliefs: that LLMs are (i) unreliable, (ii) insensitive to code patches, and (iii) performance-plateaued across model scales. We argue that these beliefs are artifacts of context-deprived evaluations. To address this, we propose CORRECT (Context-Rich Reasoning Evaluation of Code with Trust), a new evaluation framework that systematically incorporates contextual information into LLM-based vulnerability detection. We construct a context-rich dataset of 2,000 vulnerable-patched program pairs spanning 99 CWEs and evaluate 13 LLMs across four model families. Our framework elicits both binary predictions and natural-language rationales, which are further validated using LLM-as-a-judge techniques. Our findings overturn existing misconceptions. When provided with sufficient context, SOTA LLMs achieve significantly improved performance (e.g., 0.7 F1-score on key CWEs), with 0.8 precision. We show that most false positives stem from reasoning errors rather than misclassification, and that while model and test-time scaling improve performance, they introduce diminishing returns and trade-offs in recall. Finally, we uncover new flaws in current LLM-based detection systems, such as limited generalization and overthinking biases.

cs.CR↗

arXiv2025

High-Velocity Magnetic Domain Wall Motion Driven by Acoustic Spin Transfer Torque

We predict high-velocity magnetic domain wall (DW) motion driven by out-of-plane acoustic spin in surface acoustic waves (SAWs). We demonstrate that the SAW propagating at a 30-degree angle relative to the x-axis of a 128-degree Y-LiNbO3 substrate exhibits uniform out-of-plane spin angular momentum. This acoustic spin triggers the DW motion at a velocity exceeding 50 m/s in a way that is similar to the spin-transfer-torque (STT) effect. This phenomenon highlights the potential of acoustic spin in enabling rapid DW displacement, offering an innovative approach to developing energy-efficient spintronic devices.

cond-mat.other↗

arXiv2025

Unveiling the Deficiencies of Pre-trained Text-and-Layout Models in Real-world Visually-rich Document Information Extraction

Recently developed pre-trained text-and-layout models (PTLMs) have shown remarkable success in multiple information extraction tasks on visually-rich documents (VrDs). However, despite achieving extremely high performance on benchmarks, their real-world performance falls short of expectations. Owing to this issue, we investigate the prevailing evaluation pipeline to reveal that: (1) The inadequate annotations within benchmark datasets introduce spurious correlations between task inputs and labels, which would lead to overly-optimistic estimation of model performance. (2) The evaluation solely relies on the performance on benchmarks and is insufficient to comprehensively explore the capabilities of methods in real-world scenarios. These problems impede the prevailing evaluation pipeline from reflecting the real-world performance of methods, misleading the design choices of method optimization. In this work, we introduce EC-FUNSD, an entity-centric dataset crafted for benchmarking information extraction from visually-rich documents. This dataset contains diverse layouts and high-quality annotations. Additionally, this dataset disentangles the falsely-coupled segment and entity annotations that arises from the block-level annotation of FUNSD. Using the proposed dataset, we evaluate the real-world information extraction capabilities of PTLMs from multiple aspects, including their absolute performance, as well as generalization, robustness and fairness. The results indicate that prevalent PTLMs do not perform as well as anticipated in real-world information extraction scenarios. We hope that our study can inspire reflection on the directions of PTLM development.

cs.CL↗

arXiv2025

Harnessing Machine Learning for Quantum-Accurate Predictions of Non-Equilibrium Behavior in 2D Materials

Accurately predicting the non-equilibrium mechanical properties of two-dimensional (2D) materials is essential for understanding their deformation, thermo-mechanical properties, and failure mechanisms. In this study, we parameterize and evaluate two machine learning (ML) interatomic potentials, SNAP and Allegro, for modeling the non-equilibrium behavior of monolayer MoSe2. Using a density functional theory (DFT) derived dataset, we systematically compare their accuracy and transferability against the physics-based Tersoff force field. Our results show that SNAP and Allegro significantly outperform Tersoff, achieving near-DFT accuracy while maintaining computational efficiency. Allegro surpasses SNAP in both accuracy and efficiency due to its advanced neural network architecture. Both ML potentials demonstrate strong transferability, accurately predicting out-of-sample properties such as surface stability, inversion domain formation, and fracture toughness. Unlike Tersoff, SNAP and Allegro reliably model temperature-dependent edge stabilities and phase transformation pathways, aligning closely with DFT benchmarks. Notably, their fracture toughness predictions closely match experimental measurements, reinforcing their suitability for large-scale simulations of mechanical failure in 2D materials. This study establishes ML-based force fields as a powerful alternative to traditional potentials for modeling non-equilibrium mechanical properties in 2D materials.

cond-mat.mtrl-sci↗

arXiv2025

An Efficient Quantum Classifier Based on Hamiltonian Representations

Quantum machine learning (QML) is a discipline that seeks to transfer the advantages of quantum computing to data-driven tasks. However, many studies rely on toy datasets or heavy feature reduction, raising concerns about their scalability. Progress is further hindered by hardware limitations and the significant costs of encoding dense vector representations on quantum devices. To address these challenges, we propose an efficient approach called Hamiltonian classifier that circumvents the costs associated with data encoding by mapping inputs to a finite set of Pauli strings and computing predictions as their expectation values. In addition, we introduce two classifier variants with different scaling in terms of parameters and sample complexity. We evaluate our approach on text and image classification tasks, against well-established classical and quantum models. The Hamiltonian classifier delivers performance comparable to or better than these methods. Notably, our method achieves logarithmic complexity in both qubits and quantum gates, making it well-suited for large-scale, real-world applications. We make our implementation available on GitHub.

quant-ph↗

arXiv2025

Observation of non-Hermitian bulk-boundary correspondence in non-chiral non-unitary quantum dynamics of single photons

The breakdown of conventional bulk-boundary correspondence, a cornerstone of topological physics, is one of counter-intuitive phenomena in non-Hermitian systems, that is deeply rooted in symmetry. In particular, preserved chiral symmetry is one of the key ingredients, which plays a pivotal role in determining non-Hermitian topology. Nevertheless, chiral symmetry breaking in non-Hermitian systems disrupts topological protection, modifies topological invariants, and substantially reshapes spectral and edge-state behavior. The corresponding fundamentally important bulk-boundary correspondence thus needs to be drastically reconstructed. However, it has so far eluded experimental efforts. Here, we theoretically predict and experimentally demonstrate the bulk-boundary correspondence of a one-dimensional (1D) non-Hermitian system with chiral symmetry breaking in discrete-time non-chiral non-unitary quantum walks of single photons. Through constructing a domain-wall configuration, we experimentally observe the photon localization at the interface of domain-wall structure, clearly indicating the presence of the topological edge mode. The appearance of that matches excellently with the prediction of our introduced non-chiral non-Bloch topological invariants pair. Our work thus unequivocally builds the non-Hermitian bulk-boundary correspondence as a general principle for studying topological physics in non-Hermitian systems with chiral symmetry breaking.

cond-mat.mes-hall↗

arXiv2025

BBN Constraint on Heavy Neutrino Production and Decay

We explore the big-bang nucleosynthesis (BBN) constraint on heavy neutrino that is a mixture of gauge singlet fermion and active neutrinos in the Standard Model. We work in the minimal model with only two parameters, the heavy neutrino mass $m_4$ and the mixing parameter $|U_{a4}|^2$, where $a=e$, $μ$, or $τ$ stands for the active neutrino flavor. We show that both the early universe production mechanism and decay products of the heavy neutrino are determined by $m_4$ and $|U_{a4}|^2$, with little room for further assumptions. This predictivity allows us to present a portrait of the entire BBN excluded parameter space. Our analysis includes various effects including temporary matter domination, energy injections in the form of charged mesons, photons and light neutrinos. The BBN constraint is complementary to terrestrial search for heavy neutrinos (heavy neutral leptons) behind the origin of neutrino masses and portal to the dark sector.

hep-ph↗

arXiv2025

Nonreciprocally Boosting Magnetoacoustic Coupling with Surface-Acoustic-Wave-induced Spin Transfer Torque

Strengthening magnetoacoustic coupling is crucial to the improvement of the surface acoustic wave (SAW)-driven spintronics devices. A key challenge in enhancing magnetoacoustic coupling is minimizing the phonon and magnon dissipation of the device, which usually requires complicated techniques for generating shear-horizontal (SH) or standing waves to suppress the phonon dissipation. In this work, we significantly strengthened the magnetoacoustic coupling by suppressing the magnon dissipation via the SAW-induced spin-transfer-torque (STT) in Co/Cu/NiFe multilayer, which is facilitated by the non-parallel magnetization alignment between the two ferromagnetic layers. Also, this STT exhibits the form of Zhang-Li torque due to the SAW-induced spin wave, which gives rise to the unique nonreciprocal SAW transportation under external magnetic field. This finding opens new avenues for non-reciprocally boosting magnetoacoustic coupling, which pays the way for developing on-chip SAW-driven multifunctional devices.

physics.app-ph↗

arXiv2025

SuperGPQA: Scaling LLM Evaluation across 285 Graduate Disciplines

Large language models (LLMs) have demonstrated remarkable proficiency in mainstream academic disciplines such as mathematics, physics, and computer science. However, human knowledge encompasses over 200 specialized disciplines, far exceeding the scope of existing benchmarks. The capabilities of LLMs in many of these specialized fields-particularly in light industry, agriculture, and service-oriented disciplines-remain inadequately evaluated. To address this gap, we present SuperGPQA, a comprehensive benchmark that evaluates graduate-level knowledge and reasoning capabilities across 285 disciplines. Our benchmark employs a novel Human-LLM collaborative filtering mechanism to eliminate trivial or ambiguous questions through iterative refinement based on both LLM responses and expert feedback. Our experimental results reveal significant room for improvement in the performance of current state-of-the-art LLMs across diverse knowledge domains (e.g., the reasoning-focused model DeepSeek-R1 achieved the highest accuracy of 61.82% on SuperGPQA), highlighting the considerable gap between current model capabilities and artificial general intelligence. Additionally, we present comprehensive insights from our management of a large-scale annotation process, involving over 80 expert annotators and an interactive Human-LLM collaborative system, offering valuable methodological guidance for future research initiatives of comparable scope.

cs.CL↗

arXiv2025

Enhancing Mobile Crowdsensing Efficiency: A Coverage-aware Resource Allocation Approach

In this study, we investigate the resource management challenges in next-generation mobile crowdsensing networks with the goal of minimizing task completion latency while ensuring coverage performance, i.e., an essential metric to ensure comprehensive data collection across the monitored area, yet it has been commonly overlooked in existing studies. To this end, we formulate a weighted latency and coverage gap minimization problem via jointly optimizing user selection, subchannel allocation, and sensing task allocation. The formulated minimization problem is a non-convex mixed-integer programming issue. To facilitate the analysis, we decompose the original optimization problem into two subproblems. One focuses on optimizing sensing task and subband allocation under fixed sensing user selection, which is optimally solved by the Hungarian algorithm via problem reformulation. Building upon these findings, we introduce a time-efficient two-sided swapping method to refine the scheduled user set and enhance system performance. Extensive numerical results demonstrate the effectiveness of our proposed approach compared to various benchmark strategies.

cs.NI↗

arXiv2025

MuseTalk: Real-Time High-Fidelity Video Dubbing via Spatio-Temporal Sampling

Real-time video dubbing that preserves identity consistency while achieving accurate lip synchronization remains a critical challenge. Existing approaches face a trilemma: diffusion-based methods achieve high visual fidelity but suffer from prohibitive computational costs, while GAN-based solutions sacrifice lip-sync accuracy or dental details for real-time performance. We present MuseTalk, a novel two-stage training framework that resolves this trade-off through latent space optimization and spatio-temporal data sampling strategy. Our key innovations include: (1) During the Facial Abstract Pretraining stage, we propose Informative Frame Sampling to temporally align reference-source pose pairs, eliminating redundant feature interference while preserving identity cues. (2) In the Lip-Sync Adversarial Finetuning stage, we employ Dynamic Margin Sampling to spatially select the most suitable lip-movement-promoting regions, balancing audio-visual synchronization and dental clarity. (3) MuseTalk establishes an effective audio-visual feature fusion framework in the latent space, delivering 30 FPS output at 256*256 resolution on an NVIDIA V100 GPU. Extensive experiments demonstrate that MuseTalk outperforms state-of-the-art methods in visual fidelity while achieving comparable lip-sync accuracy. %The codes and models will be made publicly available upon acceptance. The code is made available at \href{https://github.com/TMElyralab/MuseTalk}{https://github.com/TMElyralab/MuseTalk}

cs.CV↗

arXiv2025

Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detector

Deepfake detection is a long-established research topic vital for mitigating the spread of malicious misinformation. Unlike prior methods that provide either binary classification results or textual explanations separately, we introduce a novel method capable of generating both simultaneously. Our method harnesses the multi-modal learning capability of the pre-trained CLIP and the unprecedented interpretability of large language models (LLMs) to enhance both the generalization and explainability of deepfake detection. Specifically, we introduce a multi-modal face forgery detector (M2F2-Det) that employs tailored face forgery prompt learning, incorporating the pre-trained CLIP to improve generalization to unseen forgeries. Also, M2F2-Det incorporates an LLM to provide detailed textual explanations of its detection decisions, enhancing interpretability by bridging the gap between natural language and subtle cues of facial forgeries. Empirically, we evaluate M2F2-Det on both detection and explanation generation tasks, where it achieves state-of-the-art performance, demonstrating its effectiveness in identifying and explaining diverse forgeries.

cs.CV↗

arXiv2025

MCRanker: Generating Diverse Criteria On-the-Fly to Improve Point-wise LLM Rankers

The most recent pointwise Large Language Model (LLM) rankers have achieved remarkable ranking results. However, these rankers are hindered by two major drawbacks: (1) they fail to follow a standardized comparison guidance during the ranking process, and (2) they struggle with comprehensive considerations when dealing with complicated passages. To address these shortcomings, we propose to build a ranker that generates ranking scores based on a set of criteria from various perspectives. These criteria are intended to direct each perspective in providing a distinct yet synergistic evaluation. Our research, which examines eight datasets from the BEIR benchmark demonstrates that incorporating this multi-perspective criteria ensemble approach markedly enhanced the performance of pointwise LLM rankers.

cs.IR↗

arXiv2025

Exploring Model Editing for LLM-based Aspect-Based Sentiment Classification

Model editing aims at selectively updating a small subset of a neural model's parameters with an interpretable strategy to achieve desired modifications. It can significantly reduce computational costs to adapt to large language models (LLMs). Given its ability to precisely target critical components within LLMs, model editing shows great potential for efficient fine-tuning applications. In this work, we investigate model editing to serve an efficient method for adapting LLMs to solve aspect-based sentiment classification. Through causal interventions, we trace and determine which neuron hidden states are essential for the prediction of the model. By performing interventions and restorations on each component of an LLM, we identify the importance of these components for aspect-based sentiment classification. Our findings reveal that a distinct set of mid-layer representations is essential for detecting the sentiment polarity of given aspect words. Leveraging these insights, we develop a model editing approach that focuses exclusively on these critical parts of the LLM, leading to a more efficient method for adapting LLMs. Our in-domain and out-of-domain experiments demonstrate that this approach achieves competitive results compared to the currently strongest methods with significantly fewer trainable parameters, highlighting a more efficient and interpretable fine-tuning strategy.

cs.CL↗

arXiv2025

DeepReview: Improving LLM-based Paper Review with Human-like Deep Thinking Process

Large Language Models (LLMs) are increasingly utilized in scientific research assessment, particularly in automated paper review. However, existing LLM-based review systems face significant challenges, including limited domain expertise, hallucinated reasoning, and a lack of structured evaluation. To address these limitations, we introduce DeepReview, a multi-stage framework designed to emulate expert reviewers by incorporating structured analysis, literature retrieval, and evidence-based argumentation. Using DeepReview-13K, a curated dataset with structured annotations, we train DeepReviewer-14B, which outperforms CycleReviewer-70B with fewer tokens. In its best mode, DeepReviewer-14B achieves win rates of 88.21\% and 80.20\% against GPT-o1 and DeepSeek-R1 in evaluations. Our work sets a new benchmark for LLM-based paper review, with all resources publicly available. The code, model, dataset and demo have be released in http://ai-researcher.net.

cs.CL↗

arXiv2025

LEMMo-Plan: LLM-Enhanced Learning from Multi-Modal Demonstration for Planning Sequential Contact-Rich Manipulation Tasks

Large Language Models (LLMs) have gained popularity in task planning for long-horizon manipulation tasks. To enhance the validity of LLM-generated plans, visual demonstrations and online videos have been widely employed to guide the planning process. However, for manipulation tasks involving subtle movements but rich contact interactions, visual perception alone may be insufficient for the LLM to fully interpret the demonstration. Additionally, visual data provides limited information on force-related parameters and conditions, which are crucial for effective execution on real robots. In this paper, we introduce an in-context learning framework that incorporates tactile and force-torque information from human demonstrations to enhance LLMs' ability to generate plans for new task scenarios. We propose a bootstrapped reasoning pipeline that sequentially integrates each modality into a comprehensive task plan. This task plan is then used as a reference for planning in new task configurations. Real-world experiments on two different sequential manipulation tasks demonstrate the effectiveness of our framework in improving LLMs' understanding of multi-modal demonstrations and enhancing the overall planning performance.

cs.RO↗

arXiv2025

Joint Beamforming and Compressed Sensing for Uplink Grant-Free Access

Compressed sensing (CS)-based techniques have been widely applied in the grant-free non-orthogonal multiple access (NOMA) to a single-antenna base station (BS). In this paper, we consider the multi-antenna reception at the BS for uplink grant-free access for the massive machine type communication (mMTC) with limited channel resources. To enhance the overloading performance of the BS, we develop a general framework for the synergistic amalgamation of the spatial division multiple access (SDMA) technique with the CS-based grant-free NOMA. We derive a closed-form statistical beamforming and a dynamic beamforming scheme for the inter-cluster interference suppression when applying SDMA. Based on this, we further develop a joint adaptive beamforming and subspace pursuit (JABF-SP) algorithm for the multiuser detection and data recovery, with a novel sparsity level decision method without the accurate knowledge of the noise level. To further improve the data recovery performance, we propose an interference cancellation based J-ABF-SP scheme (J-ABF-SP-IC) by using the initial signal estimates generated from the J-ABF-SP algorithm. Illustrative simulations verify the superior user detection and signal recovery performance of our proposed algorithms in comparison with existing CS-based grant-free NOMA techniques.

eess.SP↗