arXiv subjects

Lei Li

Publications and source records attributed to Lei Li.

At least 199 records · Page 11Linked to original sources

arXiv2025

ProReason: Multi-Modal Proactive Reasoning with Decoupled Eyesight and Wisdom

Large vision-language models (LVLMs) have witnessed significant progress on visual understanding tasks. However, they often prioritize language knowledge over image information on visual reasoning tasks, incurring performance degradation. To tackle this issue, we first identify the drawbacks of existing solutions (i.e., limited multi-modal reasoning capacities, and insufficient and irrelevant visual descriptions). We then decompose visual reasoning process into two stages: proactive visual perception (i.e., eyesight) and textual reasoning (i.e., wisdom), and introduce a novel visual reasoning framework named ProReason. This framework features decoupled vision-reasoning capabilities and multi-run proactive perception. Briefly, given a multi-modal question, ProReason iterates proactive information collection and reasoning until the answer can be concluded with necessary and sufficient visual descriptions. Notably, the disassociation of capabilities allows seamless integration of existing large language models (LLMs) to compensate for the reasoning deficits of LVLMs. Our extensive experiments demonstrate that ProReason outperforms existing multi-step reasoning frameworks on various benchmarks for both open-source and closed-source models, with the average performance gain reaching 13.2%. Besides, the integration of LLMs allows ProReason to produce high-quality visual reasoning data, which empowers ProReason-distilled models (i.e., ProReason-VL and ProReason-Q3) to achieve superior performance in downstream tasks. Our insights into existing solutions and the decoupled perspective for feasible integration of LLMs illuminate future research on visual reasoning techniques, especially LLM-assisted ones.

cs.CV↗

arXiv2025

When "Correct" Is Not Safe: Can We Trust Functionally Correct Patches Generated by Code Agents?

Code agents are increasingly trusted to autonomously fix bugs on platforms such as GitHub, yet their security evaluation focuses almost exclusively on functional correctness. In this paper, we reveal a novel type of threat to real-world code agents: Functionally Correct yet Vulnerable (FCV) patches, which pass all test cases but contain vulnerable code. With our proposed FCV-Attack, which can be deliberately crafted by malicious attackers or implicitly introduced by benign developers, we show that SOTA LLMs (e.g., ChatGPT and Claude) and agent scaffolds (e.g., SWE-agent and OpenHands) are all vulnerable to this FCV threat; across 12 agent-model combinations on SWE-Bench, the attack only requires black-box access and a single query to the code agent to perform the attack. For example, for CWE-538 (information exposure vulnerability), the FCV-Attack attains an attack success rate of $40.7\%$ on GPT-5 Mini + OpenHands. Our results reveal an important security threat overlooked by current evaluation paradigms and urge the development of security-aware defenses for code agents.

cs.CR↗

arXiv2025

Breaking the Sabatier Principle by Dynamic Adsorption-Desorption Decoupling in Electrocatalytic Hydrogen Evolution

The Sabatier principle establishes a fundamental trade-off in heterogeneous electrocatalysis.In the hydrogen evolution reaction (HER), this trade-off is manifested by the coupling of Volmer step, which requires strong hydrogen adsorption, with the Heyrovsky/Tafel step, which favors facile desorption, thus giving rise to the classical volcano relationship and limiting activity even at $ΔG=0$. Here, we demonstrate a ferroelectric platform with dynamic tunability -- monolayer GeS$_2$ decorated with transition metal atoms as a proof-of-concept -- where polarization-driven surface electronic reconstruction enables real-time modulation of intermediate binding strength, thereby breaking the Sabatier constraint. Reversible control of hydrogen adsorption allows strong H binding to accelerate the Volmer step, followed by weakened adsorption to promote the Heyrovsky/Tafel step.This dynamic adsorption-desorption decoupling not only surpasses the volcano limit to achieve unprecedented HER activity, but also establishes a general paradigm for designing adaptive electrocatalysts capable of reconfiguring under operating conditions.

cond-mat.mtrl-sci↗

arXiv2025

LLaMAX2: Your Translation-Enhanced Model also Performs Well in Reasoning

General Large Language Models (LLMs) excel in reasoning, but those enhanced for translation struggle with reasoning tasks. To address this, we propose a novel translationenhanced recipe that begins with instruct models and applies layer-selective tuning only on parallel data. Following this pipeline, we introduce the Qwen3-XPlus models, which demonstrate significant improvements in translation performance across both high- and lowresource languages, achieving 15+ spBLEU and 40+ xComet in low-resource languages, like Swahili. Interestingly, training only with small parallel datasets, Qwen3-XPlus achieves an average improvement of 1+ points on 7 multilingual tasks while maintaining proficiency comparable to the Qwen3 instruct model in 15 popular reasoning datasets. This work offers a promising approach to multilingual enhancement, significantly reducing complexity and enhancing accessibility for a wider range of languages. The code and model are publicly available.

cs.CL↗

arXiv2025

Ergodicity and error estimate of laws for a random splitting Langevin Monte Carlo

The random splitting Langevin Monte Carlo could mitigate the first order bias in Langevin Monte Carlo with little extra work compared other high order schemes. We develop in this work an analysis framework for the sampling error under Wasserstein distance regarding the random splitting Langevin Monte Carlo. First, the sharp local truncation error is obtained by the relative entropy approach together with the explicit formulas for the commutator of related semi-groups. The necessary pointwise estimates of the gradient and Hessian of the logarithmic density are established by the Bernstein type approach in PDE theory. Second, the geometric ergodicity is established by accommodation of the reflection coupling. Combining the ergodicity with the local error estimate, we establish a uniform-in-time sampling error bound, showing that the invariant measure of the method approximates the true Gibbs distribution with $O(τ^2)$ accuracy where $τ$ is the time step. Lastly, we perform numerical experiments to validate the theoretical results.

math.NA↗

arXiv2025

Explanation of the Mass Distribution of Binary Black Hole Mergers

Gravitational wave detectors are observing an increasing number of binary black hole (BBH) mergers, revealing a bimodal mass distribution of BBHs, which hints at diverse formation histories for these systems. Using the rapid binary population synthesis code MOBSE, we simulate a series of population synthesis models that include chemically homogeneous evolution (CHE). By considering metallicity-specific star formation and selection effects, we compare the intrinsic merger rates and detection rates of each model with observations. We find that the observed peaks in the mass distribution of merging BBHs at the low-mass end (10\msun) and the high-mass end (35\msun) are contributed by the common envelope channel or stable mass transfer channel (depending on the stability criteria for mass transfer) and the CHE channel, respectively, in our model. The merger rates and detection rates predicted by our model exhibit significant sensitivity to the choice of physical parameters. Different models predict merger rates ranging from 15.4 to $96.7\,\rm{Gpc^{-3}yr^{-1}}$ at redshift $z$ = 0.2, and detection rates ranging from 22.2 to 148.3$\mathrm{yr^{-1}}$ under the assumption of a detectable redshift range of $z \le$ 1.0.

astro-ph.HE↗

arXiv2025

The influence of rotation and metallicity on the explodability of massive stars

During the late stages of massive stellar evolution, failed supernovae (FSN) may form through core-collapse processes. The traditional evaluation criterion $ξ_{2.5}$ $=$ 0.45, primarily established using non-rotating progenitor models, suffers from significant inaccuracies when applied to rotating pre-supernova systems. The effects of metallicity and rotation on the explodability landscapes of massive stars lack robust quantification. We aim to investigate how rotation and metallicity influence the explodability of massive stars. We investigate how rotation and metallicity affect stellar explodability using MESA simulations with initial rotational velocities of $0$, $300$, and $600~\mathrm{km,s^{-1}}$ at three metallicities ($Z_{\odot}$, $1/10,Z_{\odot}$, $1/50,Z_{\odot}$). Core-collapse phases are simulated with GR1D to determine critical heating efficiencies. Our results yield revised $ξ_{2.5}$ criteria: 0.45 for non-rotating models; 0.48 for $300~\mathrm{km,s^{-1}}$; 0.47 for $600~\mathrm{km,s^{-1}}$ at solar metallicity; and 0.59 for low-metallicity models. Chemically homogeneous evolution in rapidly rotating low-metallicity stars significantly raises the compactness limit for successful explosions and narrows the zero-age main sequence mass range for failed supernovae. Rotation substantially affects the explodability of low-metallicity massive stars, underscoring the importance of incorporating rotational effects in models of core-collapse supernova progenitors.

astro-ph.SR↗

arXiv2025

Random ordinate method for mitigating the ray effect in radiative transport equation simulations

The Discrete Ordinates Method (DOM) is the most widely used velocity discretization method for simulating the radiative transport equation. However, the ray effect is a long-standing drawback of DOM. In benchmark tests that exhibit the ray effect, we observe low regularity in the velocity variable of the solution. To address this issue, we propose a Random Ordinate Method (ROM) to mitigate the ray effect. Compared to other strategies proposed in the literature for mitigating the ray effect, ROM offers several advantages: 1) For benchmark tests that exhibit ray effect, the computational cost is lower than that of the DOM; 2) it is simple and requires minimal changes to existing DOM-based code; 3) it is easily parallelizable and independent of the problem setup. A formal analysis is presented for the convergence orders of the error and bias. Numerical tests demonstrate the reduction in computational cost compared to DOM, as well as its effectiveness in mitigating the ray effect.

math.DS↗

arXiv2025

Convergence Analysis of the Random Ordinate Method for Mitigating the Ray Effect

The Discrete Ordinates Method (DOM) is widely used for velocity discretization in radiative transport simulations. However, DOM tends to exhibit the ray effect when the velocity discretization is not sufficiently refined, a limitation that is well documented. To counter this, we have developed the Random Ordinates Method (ROM) by integrating randomness into the velocity discretization, which mitigates the ray effect without incurring additional computational costs. ROM partitions the velocity space into n cells, selects a random ordinate from each cell, and solves a DOM system with these ordinates. It leverages the average of multiple samples to achieve a higher convergence order, especially for solutions with low regularity in the velocity variable. In this work, we provide a detailed convergence analysis for ROM, focusing on bias and single-run errors. This analysis is crucial for determining the necessary mesh size and the optimal number of samples required to attain a specified level of accuracy.

math.NA↗

arXiv2025

Coarse-to-Fine Personalized LLM Impressions for Streamlined Radiology Reports

The manual creation of the "Impression" section in radiology reports is a primary driver of radiologist burnout. To address this challenge, we propose a coarse-to-fine framework that leverages open-source large language models (LLMs) to automatically generate and personalize impressions from clinical findings. The system first produces a draft impression and then refines it using machine learning and reinforcement learning from human feedback (RLHF) to align with individual radiologists' styles while ensuring factual accuracy. We fine-tune LLaMA and Mistral models on a large dataset of reports from the University of Chicago Medicine. Our approach is designed to significantly reduce administrative workload and improve reporting efficiency while maintaining high standards of clinical precision.

cs.CL↗

arXiv2025

Electronic Reporting Using SM2-Based Ring Signcryption

Electronic whistleblowing systems are widely used due to their efficiency and convenience. The key to designing such systems lies in protecting the identity privacy of whistleblowers, preventing malicious whistleblowing, and ensuring the confidentiality of whistleblowing information. To address these issues, a SM2 traceable ring signcryption scheme for electronic voting is proposed. This scheme combines the SM2 elliptic curve public key cryptography algorithm with the ring signature algorithm, enhancing the overall efficiency of the scheme while ensuring the autonomy and controllability of the core cryptographic algorithms. Security analysis demonstrates that the proposed scheme satisfies confidentiality, unforgeability, traceability, linkability, and deniability. Efficiency analysis shows that, compared to existing ring signature schemes, the proposed scheme exhibits significant efficiency advantages during the signature phase. The electronic whistleblowing system designed using the proposed scheme can track malicious whistleblowers while protecting user identity privacy, and ensures that the content of whistleblowing remains unknown to third parties.

cs.CR↗

arXiv2025

Attention Consistency for LLMs Explanation

Understanding the decision-making processes of large language models (LLMs) is essential for their trustworthy development and deployment. However, current interpretability methods often face challenges such as low resolution and high computational cost. To address these limitations, we propose the \textbf{Multi-Layer Attention Consistency Score (MACS)}, a novel, lightweight, and easily deployable heuristic for estimating the importance of input tokens in decoder-based models. MACS measures contributions of input tokens based on the consistency of maximal attention. Empirical evaluations demonstrate that MACS achieves a favorable trade-off between interpretability quality and computational efficiency, showing faithfulness comparable to complex techniques with a 22\% decrease in VRAM usage and 30\% reduction in latency.

cs.CL↗

arXiv2025

Causal Reasoning Elicits Controllable 3D Scene Generation

Existing 3D scene generation methods often struggle to model the complex logical dependencies and physical constraints between objects, limiting their ability to adapt to dynamic and realistic environments. We propose CausalStruct, a novel framework that embeds causal reasoning into 3D scene generation. Utilizing large language models (LLMs), We construct causal graphs where nodes represent objects and attributes, while edges encode causal dependencies and physical constraints. CausalStruct iteratively refines the scene layout by enforcing causal order to determine the placement order of objects and applies causal intervention to adjust the spatial configuration according to physics-driven constraints, ensuring consistency with textual descriptions and real-world dynamics. The refined scene causal graph informs subsequent optimization steps, employing a Proportional-Integral-Derivative(PID) controller to iteratively tune object scales and positions. Our method uses text or images to guide object placement and layout in 3D scenes, with 3D Gaussian Splatting and Score Distillation Sampling improving shape accuracy and rendering stability. Extensive experiments show that CausalStruct generates 3D scenes with enhanced logical coherence, realistic spatial interactions, and robust adaptability.

cs.GR↗

arXiv2025

DyGLNet: Hybrid Global-Local Feature Fusion with Dynamic Upsampling for Medical Image Segmentation

Medical image segmentation grapples with challenges including multi-scale lesion variability, ill-defined tissue boundaries, and computationally intensive processing demands. This paper proposes the DyGLNet, which achieves efficient and accurate segmentation by fusing global and local features with a dynamic upsampling mechanism. The model innovatively designs a hybrid feature extraction module (SHDCBlock), combining single-head self-attention and multi-scale dilated convolutions to model local details and global context collaboratively. We further introduce a dynamic adaptive upsampling module (DyFusionUp) to realize high-fidelity reconstruction of feature maps based on learnable offsets. Then, a lightweight design is adopted to reduce computational overhead. Experiments on seven public datasets demonstrate that DyGLNet outperforms existing methods, particularly excelling in boundary accuracy and small-object segmentation. Meanwhile, it exhibits lower computation complexity, enabling an efficient and reliable solution for clinical medical image analysis. The code will be made available soon.

cs.CV↗

arXiv2025

Is Meta-Learning Out? Rethinking Unsupervised Few-Shot Classification with Limited Entropy

Meta-learning is a powerful paradigm for tackling few-shot tasks. However, recent studies indicate that models trained with the whole-class training strategy can achieve comparable performance to those trained with meta-learning in few-shot classification tasks. To demonstrate the value of meta-learning, we establish an entropy-limited supervised setting for fair comparisons. Through both theoretical analysis and experimental validation, we establish that meta-learning has a tighter generalization bound compared to whole-class training. We unravel that meta-learning is more efficient with limited entropy and is more robust to label noise and heterogeneous tasks, making it well-suited for unsupervised tasks. Based on these insights, We propose MINO, a meta-learning framework designed to enhance unsupervised performance. MINO utilizes the adaptive clustering algorithm DBSCAN with a dynamic head for unsupervised task construction and a stability-based meta-scaler for robustness against label noise. Extensive experiments confirm its effectiveness in multiple unsupervised few-shot and zero-shot tasks.

cs.LG↗

arXiv2025

Uniqueness of Hahn--Banach extensions and inner ideals in real C$^$-algebras and real JB$^$-triples

We show that every closed (resp., weak$^*$-closed) inner ideal $I$ of a real JB$^*$-triple (resp. a real JBW$^*$-triple) $E$ is Hahn--Banach smooth (resp., weak$^*$-Hahn--Banach smooth). Contrary to what is known for complex JB$^*$-triples, being (weak$^*$-)Hahn--Banach smooth does not characterise (weak$^*$-)closed inner ideals in real JB(W)$^*$-triples. We prove here that a closed (resp., weak$^*$-closed) subtriple of a real JB$^*$-triple (resp., a real JBW$^*$-triple) is Hahn-Banach smooth (resp., weak$^*$-Hahn-Banach smooth) if, and only if, it is a hereditary subtriple. If we assume that $E$ is a reduced and atomic JBW$^*$-triple, every weak$^*$-closed subtriple of $E$ which is also weak$^*$-Hahn-Banach smooth is an inner ideal.\smallskip In case that $C$ is the realification of a complex Cartan factor or a non-reduced real Cartan factor, we show that every weak$^*$-closed subtriple of $C$ which is weak$^*$-Hahn-Banach smooth and has rank $\geq 2$ is an inner ideal. The previous conclusions are finally combined to prove the following: Let $I$ be a closed subtriple of a real JB$^*$-triple $E$ satisfying the following hypotheses: $(a)$ $I^*$ is separable. $(b)$ $I$ is weak$^*$-Hahn-Banach smooth. $(c)$ The projection of $I^{**}$ onto each real or complex Cartan factor summand in the atomic part of $E^{**}$ is zero or has rank $\geq 2$. Then $I$ is an inner ideal of $E$.

math.OA↗

arXiv2025

Beyond Frequency: The Role of Redundancy in Large Language Model Memorization

Memorization in large language models poses critical risks for privacy and fairness as these systems scale to billions of parameters. While previous studies established correlations between memorization and factors like token frequency and repetition patterns, we revealed distinct response patterns: frequency increases minimally impact memorized samples (e.g. 0.09) while substantially affecting non-memorized samples (e.g., 0.25), with consistency observed across model scales. Through counterfactual analysis by perturbing sample prefixes and quantifying perturbation strength through token positional changes, we demonstrate that redundancy correlates with memorization patterns. Our findings establish that: about 79% of memorized samples are low-redundancy, these low-redundancy samples exhibit 2-fold higher vulnerability than high-redundancy ones, and consequently memorized samples drop by 0.6 under perturbation while non-memorized samples drop by only 0.01, indicating that more redundant content becomes both more memorable and more fragile. These findings suggest potential redundancy-guided approaches for data preprocessing, thereby reducing privacy risks and mitigating bias to ensure fairness in model deployments.

cs.LG↗

arXiv2025

TF-TransUNet1D: Time-Frequency Guided Transformer U-Net for Robust ECG Denoising in Digital Twin

Electrocardiogram (ECG) signals serve as a foundational data source for cardiac digital twins, yet their diagnostic utility is frequently compromised by noise and artifacts. To address this issue, we propose TF-TransUNet1D, a novel one-dimensional deep neural network that integrates a U-Net-based encoder-decoder architecture with a Transformer encoder, guided by a hybrid time-frequency domain loss. The model is designed to simultaneously capture local morphological features and long-range temporal dependencies, which are critical for preserving the diagnostic integrity of ECG signals. To enhance denoising robustness, we introduce a dual-domain loss function that jointly optimizes waveform reconstruction in the time domain and spectral fidelity in the frequency domain. In particular, the frequency-domain component effectively suppresses high-frequency noise while maintaining the spectral structure of the signal, enabling recovery of subtle but clinically significant waveform components. We evaluate TF-TransUNet1D using synthetically corrupted signals from the MIT-BIH Arrhythmia Database and the Noise Stress Test Database (NSTDB). Comparative experiments against state-of-the-art baselines demonstrate consistent superiority of our model in terms of SNR improvement and error metrics, achieving a mean absolute error of 0.1285 and Pearson correlation coefficient of 0.9540. By delivering high-precision denoising, this work bridges a critical gap in pre-processing pipelines for cardiac digital twins, enabling more reliable real-time monitoring and personalized modeling.

cs.LG↗