arXiv subjects

Lin Zhang

Publications and source records attributed to Lin Zhang.

At least 109 records · Page 6Linked to original sources

arXiv2025

BUT Systems for WildSpoof Challenge: SASV in the Wild

This paper presents the BUT submission to the WildSpoof Challenge, focusing on the Spoofing-robust Automatic Speaker Verification (SASV) track. We propose a SASV framework designed to bridge the gap between general audio understanding and specialized speech analysis. Our subsystem integrates diverse Self-Supervised Learning front-ends ranging from general audio models (e.g., Dasheng) to speech-specific encoders (e.g., WavLM). These representations are aggregated via a lightweight Multi-Head Factorized Attention back-end for corresponding subtasks. Furthermore, we introduce a feature domain augmentation strategy based on Distribution Uncertainty to explicitly model and mitigate the domain shift caused by unseen neural vocoders and recording environments. By fusing these robust CM scores with state-of-the-art ASV systems, our approach achieves superior minimization of the a-DCFs and EERs.

eess.AS↗

arXiv2025

BUT Systems for Environmental Sound Deepfake Detection in the ESDD 2026 Challenge

This paper describes the BUT submission to the ESDD 2026 Challenge, specifically focusing on Track 1: Environmental Sound Deepfake Detection with Unseen Generators. To address the critical challenge of generalizing to audio generated by unseen synthesis algorithms, we propose a robust ensemble framework leveraging diverse Self-Supervised Learning (SSL) models. We conduct a comprehensive analysis of general audio SSL models (including BEATs, EAT, and Dasheng) and speech-specific SSLs. These front-ends are coupled with a lightweight Multi-Head Factorized Attention (MHFA) back-end to capture discriminative representations. Furthermore, we introduce a feature domain augmentation strategy based on distribution uncertainty modeling to enhance model robustness against unseen spectral distortions. All models are trained exclusively on the official EnvSDD data, without using any external resources. Experimental results demonstrate the effectiveness of our approach: our best single system achieved Equal Error Rates (EER) of 0.00\%, 4.60\%, and 4.80\% on the Development, Progress (Track 1), and Final Evaluation sets, respectively. The fusion system further improved generalization, yielding EERs of 0.00\%, 3.52\%, and 4.38\% across the same partitions.

eess.AS↗

arXiv2025

Probing Anharmonic Lattice Dynamics and Thermal Transport in Layered Perovskite LiYTiO4 Anode

Layered perovskite lithium yttrium titanate ($\rm LiYTiO_4$) has recently emerged as a promising low-potential, ultrahigh-rate intercalation-type anode material for lithium-ion batteries; however, its lattice dynamics and thermal transport properties remain poorly understood, limiting a complete evaluation of its practical potential. Here, we combine experimental measurements with theoretical modeling to systematically investigate the anharmonic lattice dynamics and heat transport in $\rm LiYTiO_4$. We employ a neural evolution potential (NEP)-based framework that integrates the temperature-dependent effective potential method with the Wigner thermal transport (WTT) formalism, explicitly including both diagonal and off-diagonal terms of the heat-flux operator. Zero-temperature phonon calculations reveal dynamical instabilities associated with $\rm TiO_6$ octahedral rotation, which are stabilized at finite temperatures through anharmonic renormalization. Using the WTT approach with contributions from phonon propagation and coherence contributions, we predict a room-temperature lattice thermal conductivity ($κ_{\rm L}$) of 3.8 $\rm Wm^{-1}K^{-1}$ averaged over all crystal orientations, in close agreement with the measured value of 3.2 \pm 0.08 $\rm Wm^{-1}K^{-1}$ for polycrystalline samples. To further examine the possible influence of ionic motion on high-temperature thermal transport, we compute $κ_{\rm L}$ using a Green-Kubo equilibrium molecular dynamics approach based on the same NEP, which yields consistent results with both experiment and WTT predictions, confirming the negligible role of Li-ion mobility in heat conduction. Our study not only identifies the ultralow thermal conductivity of $\rm LiYTiO_4$ as a key limitation for its practical application but also establishes a reliable computational framework for studying thermal properties in battery materials.

cond-mat.mtrl-sci↗

arXiv2025

Tracing and Mitigating Hallucinations in Multimodal LLMs via Dynamic Attention Localization

Multimodal Large Language Models (MLLMs) achieve strong performance on tasks like image captioning and visual question answering, but remain prone to hallucinations, where generated text conflicts with the visual input. Prior work links this partly to insufficient visual attention, but existing attention-based detectors and mitigation typically apply uniform adjustments across layers and heads, obscuring where errors originate. In this paper, we first show these methods fail to accurately localize problematic layers. Then, we introduce two diagnostics: Layer Image Attention Entropy (LIAE) which flags anomalous layers, and Image Attention Focus (IAF) which scores attention heads within those layers. Analysis shows that LIAE pinpoints faulty layers and IAF reliably ranks heads that warrant correction. Guided by these signals, we propose Dynamic Layer-wise Entropy and Attention Fusion (D-LEAF), a task-agnostic, attention-guided method that dynamically localizes and corrects errors during inference with negligible overhead. Furthermore, by establishing a connection between D-LEAF and DPO, we provide theoretical justification for the effectiveness of D-LEAF. Results show our D-LEAF delivers a 53\% relative improvement on standard captioning benchmarks, and on VQA both accuracy and F1-score improve by approximately 4\%, substantially suppressing hallucinations while preserving efficiency.

cs.CV↗

arXiv2025

Lane Departure Accident Prevention in Foggy Conditions: A Prior-Guided Dynamic Feature Fusion Transformer Framework for Real-Time Lane Detection

Lane departure accident prevention plays a critical role in enhancing road safety, and lane detection is a core technology to achieve this goal, especially under complex weather conditions. While existing lane detection algorithms perform well under favorable weather conditions, their effectiveness significantly degrades in foggy environments, which increases the risk of traffic accidents. In response to this challenge, we propose PDT-Net, a robust Prior-Guided Dynamic Feature Fusion Transformer framework designed for real-time lane detection in foggy conditions. This framework integrates three key modules: a Global Feature Fusion Module (GFFM) to capture the relationship between local and global features in foggy images, a Dynamic Feature Fusion Module (DFFM) to model the structural and positional relationships of lane instances, and a Prior-Guided Edge Enhancement Module (PEM) to recover lost edge details in foggy environments. Furthermore, we introduce the FoggyLane dataset, a real-world dataset that specifically targets lane detection in foggy conditions, along with two synthesized datasets, FoggyCULane and FoggyTusimple, to address the lack of fog-specific data for lane detection. Extensive experiments show that PDT-Net achieves state-of-the-art performance with F1-scores of 95.04% on FoggyLane, 79.85% on FoggyCULane, and 96.95% on FoggyTusimple. Moreover, with TensorRT acceleration, our method achieves a processing speed of 38.4 FPS on the NVIDIA Jetson AGX Orin, confirming its real-time capability and robustness in challenging foggy environments. By improving the precision of lane detection, our framework can contribute to active safety warning systems, helping to prevent accidents in foggy conditions.

cs.CV↗

arXiv2025

Bargmann-invariant framework for local unitary equivalence and entanglement

Research on quantum states often focuses on the correlation between nonlocal effects and local unitary invariants, among which local unitary equivalence plays a significant role in quantum state classification and resource theories. This paper focuses on the local unitary equivalence of multipartite quantum states in quantum information theory, aiming to determine a complete set of invariants that identify their local unitary orbits; these invariants are crucial for deriving polynomial invariants and describing the physical properties preserved under local unitary transformations.The study deeply explores the characterization of local unitary equivalence and the method of detecting entanglement using local unitary Bargmann invariants. Taking two-qubit systems as an example, it verifies the measurability of invariants that determine equivalence and establishes a connection between Makhlin fundamental invariants (a complete set of 18 local unitary invariants for two-qubit states) and local unitary Bargmann invariants. These Bargmann invariants, related to the traces of products of density operators and marginal states, can be measured through cycle tests (an extended form of SWAP tests).

quant-ph↗

arXiv2025

Hybrid Pruning: In-Situ Compression of Self-Supervised Speech Models for Speaker Verification and Anti-Spoofing

Although large-scale self-supervised learning (SSL) models like WavLM have achieved state-of-the-art performance in speech processing, their significant size impedes deployment on resource-constrained devices. While structured pruning is a key technique for model compression, existing methods typically separate it from task-specific fine-tuning. This multi-stage approach struggles to create optimal architectures tailored for diverse downstream tasks. In this work, we introduce a unified framework that integrates structured pruning into the downstream fine-tuning process. Our framework unifies these steps, jointly optimizing for task performance and model sparsity in a single stage. This allows the model to learn a compressed architecture specifically for the end task, eliminating the need for complex multi-stage pipelines and knowledge distillation. Our pruned models achieve up to a 70\% parameter reduction with negligible performance degradation on large-scale datasets, achieving equal error rates of 0.7\%, 0.8\%, and 1.6\% on Vox1-O, -E, and -H, respectively. Furthermore, our approach demonstrates improved generalization in low-resource scenarios, reducing overfitting and achieving a state-of-the-art 3.7\% EER on ASVspoof5.

eess.AS↗

arXiv2025

A Dual Large Language Models Architecture with Herald Guided Prompts for Parallel Fine Grained Traffic Signal Control

Leveraging large language models (LLMs) in traffic signal control (TSC) improves optimization efficiency and interpretability compared to traditional reinforcement learning (RL) methods. However, existing LLM-based approaches are limited by fixed time signal durations and are prone to hallucination errors, while RL methods lack robustness in signal timing decisions and suffer from poor generalization. To address these challenges, this paper proposes HeraldLight, a dual LLMs architecture enhanced by Herald guided prompts. The Herald Module extracts contextual information and forecasts queue lengths for each traffic phase based on real-time conditions. The first LLM, LLM-Agent, uses these forecasts to make fine grained traffic signal control, while the second LLM, LLM-Critic, refines LLM-Agent's outputs, correcting errors and hallucinations. These refined outputs are used for score-based fine-tuning to improve accuracy and robustness. Simulation experiments using CityFlow on real world datasets covering 224 intersections in Jinan (12), Hangzhou (16), and New York (196) demonstrate that HeraldLight outperforms state of the art baselines, achieving a 20.03% reduction in average travel time across all scenarios and a 10.74% reduction in average queue length on the Jinan and Hangzhou scenarios. The source code is available on GitHub: https://github.com/BUPT-ANTlab/HeraldLight.

cs.LG↗

arXiv2025

Retrieval Augmented Generation-Enhanced Distributed LLM Agents for Generalizable Traffic Signal Control with Emergency Vehicles

With increasing urban traffic complexity, Traffic Signal Control (TSC) is essential for optimizing traffic flow and improving road safety. Large Language Models (LLMs) emerge as promising approaches for TSC. However, they are prone to hallucinations in emergencies, leading to unreliable decisions that may cause substantial delays for emergency vehicles. Moreover, diverse intersection types present substantial challenges for traffic state encoding and cross-intersection training, limiting generalization across heterogeneous intersections. Therefore, this paper proposes Retrieval Augmented Generation (RAG)-enhanced distributed LLM agents with Emergency response for Generalizable TSC (REG-TSC). Firstly, this paper presents an emergency-aware reasoning framework, which dynamically adjusts reasoning depth based on the emergency scenario and is equipped with a novel Reviewer-based Emergency RAG (RERAG) to distill specific knowledge and guidance from historical cases, enhancing the reliability and rationality of agents' emergency decisions. Secondly, this paper designs a type-agnostic traffic representation and proposes a Reward-guided Reinforced Refinement (R3) for heterogeneous intersections. R3 adaptively samples training experience from diverse intersections with environment feedback-based priority and fine-tunes LLM agents with a designed reward-weighted likelihood loss, guiding REG-TSC toward high-reward policies across heterogeneous intersections. On three real-world road networks with 17 to 177 heterogeneous intersections, extensive experiments show that REG-TSC reduces travel time by 42.00%, queue length by 62.31%, and emergency vehicle waiting time by 83.16%, outperforming other state-of-the-art methods.

cs.AI↗

arXiv2025

Beyond One-Size-Fits-All: Personalized Harmful Content Detection with In-Context Learning

The proliferation of harmful online content--e.g., toxicity, spam, and negative sentiment--demands robust and adaptable moderation systems. However, prevailing moderation systems are centralized and task-specific, offering limited transparency and neglecting diverse user preferences--an approach ill-suited for privacy-sensitive or decentralized environments. We propose a novel framework that leverages in-context learning (ICL) with foundation models to unify the detection of toxicity, spam, and negative sentiment across binary, multi-class, and multi-label settings. Crucially, our approach enables lightweight personalization, allowing users to easily block new categories, unblock existing ones, or extend detection to semantic variations through simple prompt-based interventions--all without model retraining. Extensive experiments on public benchmarks (TextDetox, UCI SMS, SST2) and a new, annotated Mastodon dataset reveal that: (i) foundation models achieve strong cross-task generalization, often matching or surpassing task-specific fine-tuned models; (ii) effective personalization is achievable with as few as one user-provided example or definition; and (iii) augmenting prompts with label definitions or rationales significantly enhances robustness to noisy, real-world data. Our work demonstrates a definitive shift beyond one-size-fits-all moderation, establishing ICL as a practical, privacy-preserving, and highly adaptable pathway for the next generation of user-centric content safety systems. To foster reproducibility and facilitate future research, we publicly release our code on GitHub and the annotated Mastodon dataset on Hugging Face.

cs.CL↗

arXiv2025

PAHQ: Accelerating Automated Circuit Discovery through Mixed-Precision Inference Optimization

Circuit discovery, which involves identifying sparse and task-relevant subnetworks in pre-trained language models, is a cornerstone of mechanistic interpretability. Automated Circuit Discovery (ACDC) has emerged as a pivotal methodology in circuit discovery, but its application to large language models is severely limited by computational inefficiency and prohibitively high memory requirements. Although several accelerated approaches have been proposed, they primarily rely on linear approximations to ACDC, which significantly compromises analytical faithfulness. Our proposed method for accelerating automated circuit discovery, Per Attention Head Quantization (PAHQ), takes a fundamentally different approach by optimizing the efficiency of each individual patching operation. PAHQ leverages a fundamental alignment between activation patching and mixed-precision quantization (MPQ): interpretability analysis through patching essentially performs targeted ablation studies. Therefore, we can maintain high precision exclusively for investigated components while safely reducing precision elsewhere in the network. PAHQ-accelerated ACDC reduces runtime by up to 80\% and memory consumption by up to 30\% compared to unaccelerated ACDC while maintaining faithfulness. Importantly, our method readily integrates with existing edge-based circuit discovery techniques by modifying the attention computation mechanism. This training-free approach provides a practical and novel pathway for accelerating mechanistic interpretability methods. Our code is available at https://github.com/626619403/PAHQ.

cs.LG↗

arXiv2025

Detection of quantum information masking via machine learning

Recently, machine learning has been widely applied in the field of quantum information, notably in tasks such as entanglement detection, steering characterization, and nonlocality verification. However, few studies have focused on utilizing machine learning to detect quantum information masking. In this work, we investigate supervised machine learning for detecting quantum information masking in both pure and mixed qubit states. For pure qubit states, we randomly generate the corresponding density matrices and train an XGBoost model to detect quantum information masking. For mixed qubit states, we improve the XGBoost method by optimizing the selection of training samples. The experimental results demonstrate that our approach achieves higher classification accuracy. Furthermore, we analyze the area under the curve (AUC) of the receiver operating characteristic curve for this method, which further confirms its classification performance.

quant-ph↗

arXiv2025

INR-Bench: A Unified Benchmark for Implicit Neural Representations in Multi-Domain Regression and Reconstruction

Implicit Neural Representations (INRs) have gained success in various signal processing tasks due to their advantages of continuity and infinite resolution. However, the factors influencing their effectiveness and limitations remain underexplored. To better understand these factors, we leverage insights from Neural Tangent Kernel (NTK) theory to analyze how model architectures (classic MLP and emerging KAN), positional encoding, and nonlinear primitives affect the response to signals of varying frequencies. Building on this analysis, we introduce INR-Bench, the first comprehensive benchmark specifically designed for multimodal INR tasks. It includes 56 variants of Coordinate-MLP models (featuring 4 types of positional encoding and 14 activation functions) and 22 Coordinate-KAN models with distinct basis functions, evaluated across 9 implicit multimodal tasks. These tasks cover both forward and inverse problems, offering a robust platform to highlight the strengths and limitations of different neural models, thereby establishing a solid foundation for future research. The code and dataset are available at https://github.com/lif314/INR-Bench.

cs.LG↗

arXiv2025

Operator entanglement in $\mathrm{SU}(2)$-symmetric dissipative quantum many-body dynamics

The presence of symmetries can lead to nontrivial dynamics of operator entanglement in open quantum many-body systems, which characterizes the cost of an matrix product density operator (MPDO) representation of the density matrix in the tensor-network methods and provides a measure for the corresponding classical simulability. One example is the $\mathrm{U}(1)$-symmetric open quantum systems with dephasing, in which the operator entanglement increases logarithmically at late times instead of being suppressed by the dephasing. Here we numerically study the far-from-equilibrium dynamics of operator entanglement in a dissipative quantum many-body system with the more complicated $\mathrm{SU}(2)$ symmetry and dissipations beyond dephasing. We show that after the initial rise and fall, the operator entanglement also increases again in a logarithmic manner at late times in the $\mathrm{SU}(2)$-symmetric case. We find that this behavior can be fully understood from the corresponding $\mathrm{U}(1)$ subsymmetry by considering the symmetry-resolved operator entanglement. But unlike the $\mathrm{U}(1)$-symmetric case with dephasing, both the classical Shannon entropy associated with the probabilities for the half system being in different symmetry sectors and the corresponding symmetry-resolved operator entanglement have nontrivial contributions to the late time logarithmic growth of operator entanglement. Our results show evidence that the logarithmic growth of operator entanglement at long times is a generic behavior of dissipative quantum many-body dynamics with $\mathrm{U}(1)$ as the symmetry or subsymmetry and for more broad dissipations beyond dephasing. By breaking the $\mathrm{SU}(2)$ symmetry of our quantum many-body dynamics to $\mathrm{U}(1)$, we also show that the latter property is valid even for open quantum systems with only $\mathrm{U}(1)$ symmetry.

quant-ph↗

arXiv2025

Informative Text-Image Alignment for Visual Affordance Learning with Foundation Models

Visual affordance learning is crucial for robots to understand and interact effectively with the physical world. Recent advances in this field attempt to leverage pre-trained knowledge of vision-language foundation models to learn affordance properties with limited training data, providing a novel paradigm for visual affordance learning. However, these methods overlook the significance of maintaining feature alignment between visual images and language descriptions for identifying affordance areas with textual guidance, and thus may lead to suboptimal results. In this paper, we present an informative framework for text-guided affordance learning, which involves information-based constraints to achieve text-image alignment at feature level. Specifically, we design an affordance mutual information constraint that helps learn appropriate textual prompts and task-oriented visual features simultaneously by maximizing the mutual information between the features of the affordance areas in the input images and the corresponding textual prompts. In addition, we propose an object-level information constraint that maximizes the mutual information between the visual features of a given object and the text features of the category it belongs to. This enables the model to capture high-quality representations for the object, providing more reliable semantic priors for identifying affordance regions. Experimental results on the AGD20K dataset show that the proposed method outperforms existing approaches and achieves the new state-of-the-art in one-shot affordance learning.

cs.CV↗

arXiv2025

Sequential Token Merging: Revisiting Hidden States

Vision Mambas (ViMs) achieve remarkable success with sub-quadratic complexity, but their efficiency remains constrained by quadratic token scaling with image resolution. While existing methods address token redundancy, they overlook ViMs' intrinsic Limited Directional Sequential Dependence (LDSD) - a critical information flow mechanism revealed in our analysis. We further identify Mamba's selective scan enables gradual information aggregation in hidden states. Based on these insights, we propose Sequential Token Merging (STM), featuring: 1) Bidirectional nearest neighbor merging to preserve sequential dependencies through symmetric spatial aggregation, and 2) Hidden states protection to stabilize the hidden states around the class token. STM strategically leverages Mamba's layer-wise loss convergence to convert temporal forgetfulness into stability. Experiments demonstrate STM's superiority: 1.0% accuracy drop for ViM-Ti at 20% token reduction, and only 1.4% degradation for ViM-S at 40% reduction. Our method achieves state-of-the-art efficiency with minimal complexity, while providing new insights into state-space model dynamics. Codes will be released soon.

cs.CV↗

arXiv2025

Harnessing Uncertainty: Entropy-Modulated Policy Gradients for Long-Horizon LLM Agents

In long-horizon tasks, recent agents based on Large Language Models (LLMs) face a significant challenge that sparse, outcome-based rewards make it difficult to assign credit to intermediate steps. Previous methods mainly focus on creating dense reward signals to guide learning, either through traditional reinforcement learning techniques like inverse reinforcement learning or by using Process Reward Models for step-by-step feedback. In this paper, we identify a fundamental problem in the learning dynamics of LLMs: the magnitude of policy gradients is inherently coupled with the entropy, which leads to inefficient small updates for confident correct actions and potentially destabilizes large updates for uncertain ones. To resolve this, we propose Entropy-Modulated Policy Gradients (EMPG), a framework that re-calibrates the learning signal based on step-wise uncertainty and the final task outcome. EMPG amplifies updates for confident correct actions, penalizes confident errors, and attenuates updates from uncertain steps to stabilize exploration. We further introduce a bonus term for future clarity that encourages agents to find more predictable solution paths. Through comprehensive experiments on three challenging agent tasks, WebShop, ALFWorld, and Deep Search, we demonstrate that EMPG achieves substantial performance gains and significantly outperforms strong policy gradient baselines. Project page is at https://empgseed-seed.github.io/

cs.LG↗

arXiv2025

Multiple solutions to a class of $p$-Laplacian Schrödinger equations

In this paper, we will prove the existence of infinitely many solutions to the following equation by utilizing the variational perturbation method \begin{equation*} -div(A(x,u)|\nabla u|^{p-2}\nabla u)+\frac{1}{p}A_{t}(x,u)|\nabla u|^{p}+V(x)|u|^{p-2}u=g(x, u), ~~ x\in\mathbb{R}^{N}, \end{equation*} where $2<p<N$, $V(x)$ represents a coercive potential. It should be emphasized that the multiplicity of solutions is unsuitable to be discussed under the framework of $W^{1,p}(\mathbb{R}^{N})\cap L^{\infty}(\mathbb{R}^{N})$, as the functional corresponding to the above equation does not satisfy the Palais-Smale condition in this space. To this end, we will use the variational perturbation method to construct novel perturbation space and perturbation functional. By relying on the established conclusions regarding the multiplicity of solutions for classical $p$-Laplacian equations, we shall analyze the equation in question. Our result addresses positively the open question from Candela et. al in CVPDE.

math.AP↗