arXiv subjects

Lin Zhang

Publications and source records attributed to Lin Zhang.

At least 145 records · Page 8Linked to original sources

arXiv2025

Analysis of ABC Frontend Audio Systems for the NIST-SRE24

We present a comprehensive analysis of the embedding extractors (frontends) developed by the ABC team for the audio track of NIST SRE 2024. We follow the two scenarios imposed by NIST: using only a provided set of telephone recordings for training (fixed) or adding publicly available data (open condition). Under these constraints, we develop the best possible speaker embedding extractors for the pre-dominant conversational telephone speech (CTS) domain. We explored architectures based on ResNet with different pooling mechanisms, recently introduced ReDimNet architecture, as well as a system based on the XLS-R model, which represents the family of large pre-trained self-supervised models. In open condition, we train on VoxBlink2 dataset, containing 110 thousand speakers across multiple languages. We observed a good performance and robustness of VoxBlink-trained models, and our experiments show practical recipes for developing state-of-the-art frontends for speaker recognition.

eess.AS↗

arXiv2025

Diversity of Superradiant Phase Transitions in the Bose-Fermi System under Tight-Binding Model in the Weak-Coupling Regime

We present a comprehensive analysis of the dynamic diversity associated with superradiant phase transitions within a one-dimensional tight-binding electronic chain that is intrinsically coupled to a single-mode optical cavity. By employing the quantized electromagnetic vector potential through the Peierls substitution, the gauge-invariant coupled Bose-Fermi system facilitates momentum-dependent superradiant transitions and effectively avoids the second-order spurious phase transitions typically observed in Dicke-like models. The quantum phase transitions in this system are characterized by stable dynamics, including the displacement and squeezing of the cavity mode and the redistribution of electronic momentum in the solid chain. Distinct from multimode cavity QED systems with atomic gases, this single-mode optical configuration unveils a range of nonlinear phenomena, including multistability and diversity of spontaneous symmetry breaking. The setup allows for precise manipulation of superradiant phases in the weak coupling regime, effectively mitigating the adverse effects of quantum fluctuation divergences. The diverse attributes of these quantum phase transitions enhance our understanding of tunable quantum solid devices and underscore their potential applications in quantum information processing and metrology.

quant-ph↗

arXiv2025

Order within disorder: spectral key generation and distribution in random lasers

In secure communication, highly random entropy sources are essential for information security. Random lasers (RLs), which arise from multiple scattering in disordered structures, are potentially ideal entropy sources. Traditionally, RLs are viewed as disordered and unpredictable. However, in this work, we present novel evidence that orderly patterns exist beneath the seemingly disordered outputs of RLs. Utilizing deep learning techniques, a variety of advanced neural network models are used to analyze the spectral data in multiple dimensions. The results show that the time series of RLs spectra are unpredictable, but spectral wavelength component intensities can be recovered due to inter-modal correlations. This finding not only breaks through the traditional perception that RLs are unpredictable, but also reveals for the first time that RLs have the dual characteristics of both randomness and determinism. Based on this new characteristic, we further expand the application field of RLs and innovatively design a new type of key generation and distribution scheme. In this scheme, the disordered property of RLs is used for key generation to ensure high randomness, while their ordered property is used for key distribution to guarantee accuracy and reliability. The scheme provides a new strategy for secure communication.

physics.optics↗

arXiv2025

LipidBERT: A Lipid Language Model Pre-trained on METiS de novo Lipid Library

In this study, we generate and maintain a database of 10 million virtual lipids through METiS's in-house de novo lipid generation algorithms and lipid virtual screening techniques. These virtual lipids serve as a corpus for pre-training, lipid representation learning, and downstream task knowledge transfer, culminating in state-of-the-art LNP property prediction performance. We propose LipidBERT, a BERT-like model pre-trained with the Masked Language Model (MLM) and various secondary tasks. Additionally, we compare the performance of embeddings generated by LipidBERT and PhatGPT, our GPT-like lipid generation model, on downstream tasks. The proposed bilingual LipidBERT model operates in two languages: the language of ionizable lipid pre-training, using in-house dry-lab lipid structures, and the language of LNP fine-tuning, utilizing in-house LNP wet-lab data. This dual capability positions LipidBERT as a key AI-based filter for future screening tasks, including new versions of METiS de novo lipid libraries and, more importantly, candidates for in vivo testing for orgran-targeting LNPs. To the best of our knowledge, this is the first successful demonstration of the capability of a pre-trained language model on virtual lipids and its effectiveness in downstream tasks using web-lab data. This work showcases the clever utilization of METiS's in-house de novo lipid library as well as the power of dry-wet lab integration.

cs.CL↗

arXiv2025

GAN-based Generator of Adversarial Attack on Intelligent End-to-End Autoencoder-based Communication System

Deep neural networks have been applied in wireless communications system to intelligently adapt to dynamically changing channel conditions, while the users are still under the threat of the malicious attacks due to the broadcasting property of wireless channels. However, most attack models require the knowledge of the target details, which is difficult to be implemented in real systems. Our objective is to develop an attack model with no requirement for the target information, while enhancing the block error rate. In our design, we propose a novel Generative Adversarial Networks(GANs) based attack architecture, which exploits the property of deep learning models being vulnerable to perturbations induced by dynamically changing channel conditions. In the proposed generator, the attack network is composed of convolution layer, convolution transpose layer and linear layer. Then we present the training strategy and the details of the training algorithm. Subsequently, we propose the validation strategy to evaluate the performance of the generator. Simulations are conducted and the results show that our proposed adversarial attack generator achieve better block error rate attack performance than that of benchmark schemes over Additive White Gaussian Noise (AWGN) channel, Rayleigh channel and High-Speed Railway channel.

cs.IT↗

arXiv2025

OSDFace: One-Step Diffusion Model for Face Restoration

Diffusion models have demonstrated impressive performance in face restoration. Yet, their multi-step inference process remains computationally intensive, limiting their applicability in real-world scenarios. Moreover, existing methods often struggle to generate face images that are harmonious, realistic, and consistent with the subject's identity. In this work, we propose OSDFace, a novel one-step diffusion model for face restoration. Specifically, we propose a visual representation embedder (VRE) to better capture prior information and understand the input face. In VRE, low-quality faces are processed by a visual tokenizer and subsequently embedded with a vector-quantized dictionary to generate visual prompts. Additionally, we incorporate a facial identity loss derived from face recognition to further ensure identity consistency. We further employ a generative adversarial network (GAN) as a guidance model to encourage distribution alignment between the restored face and the ground truth. Experimental results demonstrate that OSDFace surpasses current state-of-the-art (SOTA) methods in both visual quality and quantitative metrics, generating high-fidelity, natural face images with high identity consistency. The code and model will be released at https://github.com/jkwang28/OSDFace.

cs.CV↗

arXiv2025

Uncertainty Estimation for Trust Attribution to Speed-of-Sound Reconstruction with Variational Networks

Speed-of-sound (SoS) is a biomechanical characteristic of tissue, and its imaging can provide a promising biomarker for diagnosis. Reconstructing SoS images from ultrasound acquisitions can be cast as a limited-angle computed-tomography problem, with Variational Networks being a promising model-based deep learning solution. Some acquired data frames may, however, get corrupted by noise due to, e.g., motion, lack of contact, and acoustic shadows, which in turn negatively affects the resulting SoS reconstructions. We propose to use the uncertainty in SoS reconstructions to attribute trust to each individual acquired frame. Given multiple acquisitions, we then use an uncertainty based automatic selection among these retrospectively, to improve diagnostic decisions. We investigate uncertainty estimation based on Monte Carlo Dropout and Bayesian Variational Inference. We assess our automatic frame selection method for differential diagnosis of breast cancer, distinguishing between benign fibroadenoma and malignant carcinoma. We evaluate 21 lesions classified as BI-RADS~4, which represents suspicious cases for probable malignancy. The most trustworthy frame among four acquisitions of each lesion was identified using uncertainty based criteria. Selecting a frame informed by uncertainty achieved an area under curve of 76% and 80% for Monte Carlo Dropout and Bayesian Variational Inference, respectively, superior to any uncertainty-uninformed baselines with the best one achieving 64%. A novel use of uncertainty estimation is proposed for selecting one of multiple data acquisitions for further processing and decision making.

cs.CV↗

arXiv2025

Discovery of a Robust Non-Janus Hybrid MoSH Monolayer as a Two-Gap Superconductor via High-Throughput Computational Screening

The atomic-scale determination of hydrogen positions in MoSH monolayers remains experimentally challenging, and existing studies are confined to Janus-type configurations. Here, we combine high-throughput structural screening with first-principles calculations to predict a novel non-Janus Hybrid 1T$^{'}$-MoSH monolayer, which energetically surpasses all previously reported MoSH phases with a binding energy of -3.02 eV. This structure emerges as a hybrid of MoS$_2$ and MoH$_2$, featuring alternating S and H atoms on both sides of the Mo layer. Comprehensive stability analyses confirm its robustness in energy, mechanics, dynamics, and thermodynamics (stable up to 1600 K). Remarkably, anisotropic Migdal-Eliashberg theory predicts Hybrid 1T$^{'}$-MoSH as a two-gap superconductor with a critical temperature T$_c$ of 16.34 K, driven by strong electron-phonon coupling ($λ$$=$1.39). Substituting Mo with Hf, Ta, or Ti drastically suppresses T$_c$ $\sim$ (0.53-2.42 K), highlighting Mo$^{'}$s unique role in enhancing superconductivity. Our work not only expands the family of 2D transition metal chalcogenides but also proposes a promising candidate for quantum technologies, bridging theoretical design to functional material discovery.

cond-mat.mtrl-sci↗

arXiv2025

Geometry of sets of Bargmann invariants

Certain unitary-invariants, known as Bargmann invariants or multivariate traces of quantum states, have recently gained attention due to their applications in quantum information theory. However, determining the boundaries of sets of Bargmann invariants remains a theoretical challenge. In this study, we address the problem by developing a unified, dimension-independent formulation that characterizes the sets of the 3rd and 4th Bargmann invariants.In particular, our result for the set of 4th Bargmann invariants confirms the conjecture given by Fernandes \emph{et al.} [Phys.Rev.Lett.\href{https://doi.org/10.1103/PhysRevLett.133.190201}{\textbf{133}, 190201 (2024)}]. Based on the obtained results, we conjecture that the unified, dimension-independent formulation of the boundaries for sets of 3rd-order and 4th-order Bargmann invariants may extend to the general case of the $n$th-order Bargmann invariants. These results deepen our understanding of the fundamental physical limits within quantum mechanics and pave the way for novel applications of Bargmann invariants in quantum information processing and related fields.

quant-ph↗

arXiv2025

Stellar parameters, extinction, and distances for stars in SMSS DR2 by SPar method

The availability of large datasets containing stellar parameters, distances, and extinctions for stars in the Milky Way, particularly within the Galactic disk, is essential for advancing our understanding of the Galaxy's stellar populations, structure, kinematics, and chemical evolution. In this study, we present a catalog of stellar parameters, including effective temperature (\teff), metallicity (\feh), absolute magnitudes ($M_{G}$), distances ($d$), and reddening values (\ebr), for a sample of 141 million stars from the SkyMapper Southern Survey (SMSS). These parameters are derived using the SPar algorithm, which employs a fitting procedure to match multi-band photometric observations and estimate the stellar properties (\teff, \feh, $M_G$, $d$, and \ebr) on an individual star basis, following the methodology outlined in our previous work. This study successfully determines stellar parameters and extinction values simultaneously for stars located in high and low Galactic latitudes. The resulting stellar parameters and extinction values are in good agreement with results from other studies, demonstrating the robustness of our method. We derive a temperature dispersion of 195\,K and a metallicity dispersion of 0.31\,dex when comparing our results with spectroscopic data. The catalog produced in this work provides a valuable resource for future research on the Galactic metallicity distribution function, the structure of the Galaxy, three-dimensional extinction mapping, and other related astrophysical topics.

astro-ph.GA↗

arXiv2025

LITE: LLM-Impelled efficient Taxonomy Evaluation

This paper presents LITE, an LLM-based evaluation method designed for efficient and flexible assessment of taxonomy quality. To address challenges in large-scale taxonomy evaluation, such as efficiency, fairness, and consistency, LITE adopts a top-down hierarchical evaluation strategy, breaking down the taxonomy into manageable substructures and ensuring result reliability through cross-validation and standardized input formats. LITE also introduces a penalty mechanism to handle extreme cases and provides both quantitative performance analysis and qualitative insights by integrating evaluation metrics closely aligned with task objectives. Experimental results show that LITE demonstrates high reliability in complex evaluation tasks, effectively identifying semantic errors, logical contradictions, and structural flaws in taxonomies, while offering directions for improvement. Code is available at https://github.com/Zhang-l-i-n/TAXONOMY_DETECT .

cs.CL↗

arXiv2025

RECKON: Large-scale Reference-based Efficient Knowledge Evaluation for Large Language Model

As large language models (LLMs) advance, efficient knowledge evaluation becomes crucial to verifying their capabilities. Traditional methods, relying on benchmarks, face limitations such as high resource costs and information loss. We propose the Large-scale Reference-based Efficient Knowledge Evaluation for Large Language Model (RECKON), which directly uses reference data to evaluate models. RECKON organizes unstructured data into manageable units and generates targeted questions for each cluster, improving evaluation accuracy and efficiency. Experimental results show that RECKON reduces resource consumption by 56.5% compared to traditional methods while achieving over 97% accuracy across various domains, including world knowledge, code, legal, and biomedical datasets. Code is available at https://github.com/MikeGu721/reckon

cs.CL↗

arXiv2025

FAVOR-Bench: A Comprehensive Benchmark for Fine-Grained Video Motion Understanding

Multimodal Large Language Models (MLLMs) have shown remarkable capabilities in video content understanding but still struggle with fine-grained motion comprehension. To comprehensively assess the motion understanding ability of existing MLLMs, we introduce FAVOR-Bench, comprising 1,776 videos with structured manual annotations of various motions. Our benchmark includes both close-ended and open-ended tasks. For close-ended evaluation, we carefully design 8,184 multiple-choice question-answer pairs spanning six distinct sub-tasks. For open-ended evaluation, we develop both a novel cost-efficient LLM-free and a GPT-assisted caption assessment method, where the former can enhance benchmarking interpretability and reproducibility. Comprehensive experiments with 21 state-of-the-art MLLMs reveal significant limitations in their ability to comprehend and describe detailed temporal dynamics in video motions. To alleviate this limitation, we further build FAVOR-Train, a dataset consisting of 17,152 videos with fine-grained motion annotations. The results of finetuning Qwen2.5-VL on FAVOR-Train yield consistent improvements on motion-related tasks of TVBench, MotionBench and our FAVOR-Bench. Comprehensive assessment results demonstrate that the proposed FAVOR-Bench and FAVOR-Train provide valuable tools to the community for developing more powerful video understanding models. Project page: \href{https://favor-bench.github.io/}{https://favor-bench.github.io/}.

cs.CV↗

arXiv2025

TokenCarve: Information-Preserving Visual Token Compression in Multimodal Large Language Models

Multimodal Large Language Models (MLLMs) are becoming increasingly popular, while the high computational cost associated with multimodal data input, particularly from visual tokens, poses a significant challenge. Existing training-based token compression methods improve inference efficiency but require costly retraining, while training-free methods struggle to maintain performance when aggressively reducing token counts. In this study, we reveal that the performance degradation of MLLM closely correlates with the accelerated loss of information in the attention output matrix. This insight introduces a novel information-preserving perspective, making it possible to maintain performance even under extreme token compression. Based on this finding, we propose TokenCarve, a training-free, plug-and-play, two-stage token compression framework. The first stage employs an Information-Preservation-Guided Selection (IPGS) strategy to prune low-information tokens, while the second stage further leverages IPGS to guide token merging, minimizing information loss. Extensive experiments on 11 datasets and 2 model variants demonstrate the effectiveness of TokenCarve. It can even reduce the number of visual tokens to 22.2% of the original count, achieving a 1.23x speedup in inference, a 64% reduction in KV cache storage, and only a 1.54% drop in accuracy. Our code is available at https://github.com/ShawnTan86/TokenCarve.

cs.CV↗

arXiv2025

GenAI for Simulation Model in Model-Based Systems Engineering

Generative AI (GenAI) has demonstrated remarkable capabilities in code generation, and its integration into complex product modeling and simulation code generation can significantly enhance the efficiency of the system design phase in Model-Based Systems Engineering (MBSE). In this study, we introduce a generative system design methodology framework for MBSE, offering a practical approach for the intelligent generation of simulation models for system physical properties. First, we employ inference techniques, generative models, and integrated modeling and simulation languages to construct simulation models for system physical properties based on product design documents. Subsequently, we fine-tune the language model used for simulation model generation on an existing library of simulation models and additional datasets generated through generative modeling. Finally, we introduce evaluation metrics for the generated simulation models for system physical properties. Our proposed approach to simulation model generation presents the innovative concept of scalable templates for simulation models. Using these templates, GenAI generates simulation models for system physical properties through code completion. The experimental results demonstrate that, for mainstream open-source Transformer-based models, the quality of the simulation model is significantly improved using the simulation model generation method proposed in this paper.

cs.SE↗

arXiv2025

Gradient-Driven Graph Neural Networks for Learning Digital and Hybrid Precoder

The optimization of multi-user multi-input multi-output (MU-MIMO) precoders is a widely recognized challenging problem. Existing work has demonstrated the potential of graph neural networks (GNNs) in learning precoding policies. However, existing GNNs often exhibit poor generalizability for the numbers of users or antennas. In this paper, we develop a gradient-driven GNN design method for the learning of fully digital and hybrid precoding policies. The proposed GNNs leverage two kinds of knowledge, namely the gradient of signal-to-interference-plus-noise ratio (SINR) to the precoders and the permutation equivariant property of the precoding policy. To demonstrate the flexibility of the proposed method for accommodating different optimization objectives and different precoding policies, we first apply the proposed method to learn the fully digital precoding policies. We study two precoder optimization problems for spectral efficiency (SE) maximization and log-SE maximization to achieve proportional fairness. We then apply the proposed method to learn the hybrid precoding policy, where the gradients to analog and digital precoders are exploited for the design of the GNN. Simulation results show the effectiveness of the proposed methods for learning different precoding policies and better generalization performance to the numbers of both users and antennas compared to baseline GNNs.

eess.SP↗

arXiv2025

BigMac: A Communication-Efficient Mixture-of-Experts Model Structure for Fast Training and Inference

The Mixture-of-Experts (MoE) structure scales the Transformer-based large language models (LLMs) and improves their performance with only the sub-linear increase in computation resources. Recently, a fine-grained DeepSeekMoE structure is proposed, which can further improve the computing efficiency of MoE without performance degradation. However, the All-to-All communication introduced by MoE has become a bottleneck, especially for the fine-grained structure, which typically involves and activates more experts, hence contributing to heavier communication overhead. In this paper, we propose a novel MoE structure named BigMac, which is also fine-grained but with high communication efficiency. The innovation of BigMac is mainly due to that we abandon the \textbf{c}ommunicate-\textbf{d}escend-\textbf{a}scend-\textbf{c}ommunicate (CDAC) manner used by fine-grained MoE, which leads to the All-to-All communication always taking place at the highest dimension. Instead, BigMac designs an efficient \textbf{d}escend-\textbf{c}ommunicate-\textbf{c}ommunicate-\textbf{a}scend (DCCA) manner. Specifically, we add a descending and ascending projection at the entrance and exit of the expert, respectively, which enables the communication to perform at a very low dimension. Furthermore, to adapt to DCCA, we re-design the structure of small experts, ensuring that the expert in BigMac has enough complexity to address tokens. Experimental results show that BigMac achieves comparable or even better model quality than fine-grained MoEs with the same number of experts and a similar number of total parameters. Equally importantly, BigMac reduces the end-to-end latency by up to 3.09$\times$ for training and increases the throughput by up to 3.11$\times$ for inference on state-of-the-art AI computing frameworks including Megatron, Tutel, and DeepSpeed-Inference.

cs.LG↗

arXiv2025

DeRS: Towards Extremely Efficient Upcycled Mixture-of-Experts Models

Upcycled Mixture-of-Experts (MoE) models have shown great potential in various tasks by converting the original Feed-Forward Network (FFN) layers in pre-trained dense models into MoE layers. However, these models still suffer from significant parameter inefficiency due to the introduction of multiple experts. In this work, we propose a novel DeRS (Decompose, Replace, and Synthesis) paradigm to overcome this shortcoming, which is motivated by our observations about the unique redundancy mechanisms of upcycled MoE experts. Specifically, DeRS decomposes the experts into one expert-shared base weight and multiple expert-specific delta weights, and subsequently represents these delta weights in lightweight forms. Our proposed DeRS paradigm can be applied to enhance parameter efficiency in two different scenarios, including: 1) DeRS Compression for inference stage, using sparsification or quantization to compress vanilla upcycled MoE models; and 2) DeRS Upcycling for training stage, employing lightweight sparse or low-rank matrixes to efficiently upcycle dense models into MoE models. Extensive experiments across three different tasks show that the proposed methods can achieve extreme parameter efficiency while maintaining the performance for both training and compression of upcycled MoE models.

cs.LG↗