arXiv subjects

Zheng Li

Publications and source records attributed to Zheng Li.

At least 217 records · Page 12Linked to original sources

arXiv2025

How Far are LLMs from Real Search? A Comprehensive Study on Efficiency, Completeness, and Inherent Capabilities

Search plays a fundamental role in problem-solving across various domains, with most real-world decision-making problems being solvable through systematic search. Drawing inspiration from recent discussions on search and learning, we systematically explore the complementary relationship between search and Large Language Models (LLMs) from three perspectives. First, we analyze how learning can enhance search efficiency and propose Search via Learning (SeaL), a framework that leverages LLMs for effective and efficient search. Second, we further extend SeaL to SeaL-C to ensure rigorous completeness during search. Our evaluation across three real-world planning tasks demonstrates that SeaL achieves near-perfect accuracy while reducing search spaces by up to 99.1% compared to traditional approaches. Finally, we explore how far LLMs are from real search by investigating whether they can develop search capabilities independently. Our analysis reveals that while current LLMs struggle with efficient search in complex problems, incorporating systematic search strategies significantly enhances their problem-solving capabilities. These findings not only validate the effectiveness of our approach but also highlight the need for improving LLMs' search abilities for real-world applications.

cs.AI↗

arXiv2025

Wavelength-Dependent Photodissociation of Iodomethylbutane

Ultrashort XUV pulses of the Free-Electron-LASer in Hamburg (FLASH) were used to investigate laser-induced fragmentation patterns of the prototypical chiral molecule 1-iodo-2-methyl-butane (C$_5$H$_{11}$I) in a pump-probe scheme. Ion velocity-map images and mass spectra of optical-laser-induced fragmentation were obtained for subsequent FEL exposure with photon energies of 63 eV and 75 eV. These energies specifically address the iodine 4d edge of neutral and singly charged iodine, respectively. The presented ion spectra for two optical pump-laser wavelengths, i.e., 800 nm and 267 nm, reveal substantially different cationic fragment yields in dependence on the wavelength and intensity. For the case of 800-nm-initiated fragmentation, the molecule dissociates notably slower than for the 267-nm pump. The results underscore the importance of considering optical-laser wavelength and intensity in the dissociation dynamics of this prototypical chiral molecule that is a promising candidate for future studies of its asymmetric nature.

physics.chem-ph↗

arXiv2025

No-reference geometry quality assessment for colorless point clouds via list-wise rank learning

Geometry quality assessment (GQA) of colorless point clouds is crucial for evaluating the performance of emerging point cloud-based solutions (e.g., watermarking, compression, and 3-Dimensional (3D) reconstruction). Unfortunately, existing objective GQA approaches are traditional full-reference metrics, whereas state-of-the-art learning-based point cloud quality assessment (PCQA) methods target both color and geometry distortions, neither of which are qualified for the no-reference GQA task. In addition, the lack of large-scale GQA datasets with subjective scores, which are always imprecise, biased, and inconsistent, also hinders the development of learning-based GQA metrics. Driven by these limitations, this paper proposes a no-reference geometry-only quality assessment approach based on list-wise rank learning, termed LRL-GQA, which comprises of a geometry quality assessment network (GQANet) and a list-wise rank learning network (LRLNet). The proposed LRL-GQA formulates the no-reference GQA as a list-wise rank problem, with the objective of directly optimizing the entire quality ordering. Specifically, a large dataset containing a variety of geometry-only distortions is constructed first, named LRL dataset, in which each sample is label-free but coupled with quality ranking information. Then, the GQANet is designed to capture intrinsic multi-scale patch-wise geometric features in order to predict a quality index for each point cloud. After that, the LRLNet leverages the LRL dataset and a likelihood loss to train the GQANet and ranks the input list of degraded point clouds according to their distortion levels. In addition, the pre-trained GQANet can be fine-tuned further to obtain absolute quality scores. Experimental results demonstrate the superior performance of the proposed no-reference LRL-GQA method compared with existing full-reference GQA metrics.

cs.CV↗

arXiv2025

The Worse The Better: Content-Aware Viewpoint Generation Network for Projection-related Point Cloud Quality Assessment

Through experimental studies, however, we observed the instability of final predicted quality scores, which change significantly over different viewpoint settings. Inspired by the "wooden barrel theory", given the default content-independent viewpoints of existing projection-related PCQA approaches, this paper presents a novel content-aware viewpoint generation network (CAVGN) to learn better viewpoints by taking the distribution of geometric and attribute features of degraded point clouds into consideration. Firstly, the proposed CAVGN extracts multi-scale geometric and texture features of the entire input point cloud, respectively. Then, for each default content-independent viewpoint, the extracted geometric and texture features are refined to focus on its corresponding visible part of the input point cloud. Finally, the refined geometric and texture features are concatenated to generate an optimized viewpoint. To train the proposed CAVGN, we present a self-supervised viewpoint ranking network (SSVRN) to select the viewpoint with the worst quality projected image to construct a default-optimized viewpoint dataset, which consists of thousands of paired default viewpoints and corresponding optimized viewpoints. Experimental results show that the projection-related PCQA methods can achieve higher performance using the viewpoints generated by the proposed CAVGN.

cs.CV↗

arXiv2025

FaceSwapGuard: Safeguarding Facial Privacy from DeepFake Threats through Identity Obfuscation

DeepFakes pose a significant threat to our society. One representative DeepFake application is face-swapping, which replaces the identity in a facial image with that of a victim. Although existing methods partially mitigate these risks by degrading the quality of swapped images, they often fail to disrupt the identity transformation effectively. To fill this gap, we propose FaceSwapGuard (FSG), a novel black-box defense mechanism against deepfake face-swapping threats. Specifically, FSG introduces imperceptible perturbations to a user's facial image, disrupting the features extracted by identity encoders. When shared online, these perturbed images mislead face-swapping techniques, causing them to generate facial images with identities significantly different from the original user. Extensive experiments demonstrate the effectiveness of FSG against multiple face-swapping techniques, reducing the face match rate from 90\% (without defense) to below 10\%. Both qualitative and quantitative studies further confirm its ability to confuse human perception, highlighting its practical utility. Additionally, we investigate key factors that may influence FSG and evaluate its robustness against various adaptive adversaries.

cs.CR↗

arXiv2025

Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training

Due to the scarcity of agent-oriented pre-training data, LLM-based autonomous agents typically rely on complex prompting or extensive fine-tuning, which often fails to introduce new capabilities while preserving strong generalizability. We introduce Hephaestus-Forge, the first large-scale pre-training corpus designed to enhance the fundamental capabilities of LLM agents in API function calling, intrinsic reasoning and planning, and adapting to environmental feedback. Hephaestus-Forge comprises 103B agent-specific data encompassing 76,537 APIs, including both tool documentation to introduce knowledge of API functions and function calling trajectories to strengthen intrinsic reasoning. To explore effective training protocols, we investigate scaling laws to identify the optimal recipe in data mixing ratios. By continual pre-training on Hephaestus-Forge, Hephaestus outperforms small- to medium-scale open-source LLMs and rivals commercial LLMs on three agent benchmarks, demonstrating the effectiveness of our pre-training corpus in enhancing fundamental agentic capabilities and generalization of LLMs to new tasks or environments.

cs.CL↗

arXiv2025

Membership Inference Attacks Against Vision-Language Models

Vision-Language Models (VLMs), built on pre-trained vision encoders and large language models (LLMs), have shown exceptional multi-modal understanding and dialog capabilities, positioning them as catalysts for the next technological revolution. However, while most VLM research focuses on enhancing multi-modal interaction, the risks of data misuse and leakage have been largely unexplored. This prompts the need for a comprehensive investigation of such risks in VLMs. In this paper, we conduct the first analysis of misuse and leakage detection in VLMs through the lens of membership inference attack (MIA). In specific, we focus on the instruction tuning data of VLMs, which is more likely to contain sensitive or unauthorized information. To address the limitation of existing MIA methods, we introduce a novel approach that infers membership based on a set of samples and their sensitivity to temperature, a unique parameter in VLMs. Based on this, we propose four membership inference methods, each tailored to different levels of background knowledge, ultimately arriving at the most challenging scenario. Our comprehensive evaluations show that these methods can accurately determine membership status, e.g., achieving an AUC greater than 0.8 targeting a small set consisting of only 5 samples on LLaVA.

cs.CR↗

arXiv2025

Static Batching of Irregular Workloads on GPUs: Framework and Application to Efficient MoE Model Inference

It has long been a problem to arrange and execute irregular workloads on massively parallel devices. We propose a general framework for statically batching irregular workloads into a single kernel with a runtime task mapping mechanism on GPUs. We further apply this framework to Mixture-of-Experts (MoE) model inference and implement an optimized and efficient CUDA kernel. Our MoE kernel achieves up to 91% of the peak Tensor Core throughput on NVIDIA H800 GPU and 95% on NVIDIA H20 GPU.

cs.DC↗

arXiv2025

Giant Anomalous Hall Effect in Kagome Nodal Surface Semimetal Fe$_3$Ge

It is well known that the intrinsic anomalous Hall effect (AHE) arises from the integration of the non-zero Berry curvature (BC), conventionally observed in the Dirac/Weyl and nodal-line semimetals. Moreover, nodal surface semimetals are expected to exhibit more significant BC under the prevalence of degenerate points near the Fermi level. In this work, we report the detection of a giant AHE in the Kagome magnet Fe$_3$Ge with a two-dimensional (2D) nodal surface (NS) at $k_{z}=π$ plane, exhibiting an anomalous Hall conductivity (AHC) of 1500 $Ω^{-1}$cm$^{-1}$ at 160 K, the highest among all reported Kagome topological materials. This finding suggests a new platform for searching large AHC materials and facilitates potential room-temperature applications in spintronic devices and quantum computing.

cond-mat.mes-hall↗

arXiv2025

Assessing Markov Property in Driving Behaviors: Insights from Statistical Tests

The Markov property serves as a foundational assumption in most existing work on vehicle driving behavior, positing that future states depend solely on the current state, not the series of preceding states. This study validates the Markov properties of vehicle trajectories for both Autonomous Vehicles (AVs) and Human-driven Vehicles (HVs). A statistical method used to test whether time series data exhibits Markov properties is applied to examine whether the trajectory data possesses Markov characteristics. t test and F test are additionally introduced to characterize the differences in Markov properties between AVs and HVs. Based on two public trajectory datasets, we investigate the presence and order of the Markov property of different types of vehicles through rigorous statistical tests. Our findings reveal that AV trajectories generally exhibit stronger Markov properties compared to HV trajectories, with a higher percentage conforming to the Markov property and lower Markov orders. In contrast, HV trajectories display greater variability and heterogeneity in decision-making processes, reflecting the complex perception and information processing involved in human driving. These results have significant implications for the development of driving behavior models, AV controllers, and traffic simulation systems. Our study also demonstrates the feasibility of using statistical methods to test the presence of Markov properties in driving trajectory data.

cs.LG↗

arXiv2025

The coherence peak of unconventional superconductors in the charge channel

In this work, we carry out a systematic investigation of the coherence peak in unconventional superconductors as they transition into the superconducting phase at $T_c$. Using $d$-wave cuprates as an example, we reveal the presence of a coherence peak below $T_c$ in the charge channel. The nuclear quadrupole relaxation rate is shown to be an effective method for detecting this unconventional coherence peak, with the superconducting coherence factor playing a pivotal role in its emergence. Additionally, we explore the influence of correlation effects, which further enhance this phenomenon. Extending our analysis, we demonstrate the existence of a similar coherence peak in ultrasonic attenuation and iron-based superconductors. Our findings offer a fresh perspective on probing superconducting gap symmetry in unconventional superconductors.

cond-mat.supr-con↗

arXiv2025

Unconventional Coherence Peak in Cuprate Superconductors

The Hebel-Slichter coherence peak, observed in the spin-lattice relaxation rate $1/T_1$ just below the critical temperature $T_{\rm c}$, serves as a crucial experimental validation of the Bardeen-Cooper-Schrieffer pairing symmetry in conventional superconductors. However, no coherence peak in $1/T_1$ has been observed in unconventional superconductors like cuprates. In this study, an unconventional coherence peak is identified for the first time using nuclear quadrupole resonance on YBa$_2$Cu$_4$O$_8$, pointing to a distinctive pairing symmetry. The spin-lattice relaxation rate in nuclear quadrupole resonance and nuclear magnetic resonance with nuclear spin $I>1/2$ comprises the magnetic relaxation rate $1/T_{1}^{\rm mag}$, which probes magnetic fluctuations, and the quadrupole relaxation rate $1/T_{1}^{\rm quad}$, which probes charge fluctuations. By utilizing $^{63}$Cu and $^{65}$Cu isotopes, we successfully distinguish $1/T_{1}^{\rm mag}$ and $1/T_{1 }^{\rm quad}$ of YBa$_2$Cu$_4$O$_8$ and reveal the presence of the coherence peak in $1/T_{1 }^{\rm quad}$ but not in $1/T_{1}^{\rm mag}$, in contrast to conventional superconductors. Our finding demonstrates that unconventional superconductors do not exhibit a coherence peak in $1/T_{1}$ when the relaxation is due to fluctuations of the hyperfine field. Conversely, a coherence peak is expected when the relaxation is caused by electric field gradient fluctuations, due to the different coherence factors between charge and magnetic fluctuations. Our successful measurements of $1/T_{1}$ for the chains of YBa$_2$Cu$_4$O$_8$ suggest that, should the conditions for predominant quadrupole relaxation be satisfied, this phenomenon could provide a novel approach to exploring the unconventional nature of the pairing mechanism in other superconductors.

cond-mat.supr-con↗

arXiv2024

Plug-and-Play Training Framework for Preference Optimization

Recently, preference optimization methods such as DPO have significantly enhanced large language models (LLMs) in wide tasks including dialogue and question-answering. However, current methods fail to account for the varying difficulty levels of training samples during preference optimization, leading to mediocre performance in tasks with high accuracy requirements, particularly in mathematical reasoning. To address this limitation, we propose a novel training framework, which employs multiple sampling to analyze output distributions, assign different weights to samples, and incorporate these weights into the preference optimization process. This plug-and-play approach enables LLMs to prioritize challenging examples during training, improving learning efficiency. Experimental results demonstrate that our framework integrates seamlessly with various preference optimization methods and achieves consistent improvements in mathematical reasoning tasks.

cs.CL↗

arXiv2024

Evaluating the Influence of Satellite Systems on Terrestrial Networks: Analyzing S-Band Interference

The co-existence of terrestrial and non-terrestrial networks (NTNs) is essential for achieving comprehensive global coverage in sixth-generation cellular networks. Given the escalating demand for spectrum, there is an ongoing global discourse on the feasibility of sharing certain frequencies currently utilized by terrestrial networks (TNs) with NTNs. However, this sharing leads to co-channel interference and subsequent performance degradation. This paper specifically investigates the interference caused by NTNs on TNs in the S-band and its relationship with the relative position between satellite and TN user equipment. We analyzed the transmission mechanisms of satellite signals and employed the ITU two-state model for our interference analysis. Through simulations, we evaluated the interference intensity at different separation distances and slant ranges. Our findings reveal that the angle between the user equipment direction and the sub-satellite point direction from the beam center significantly influences the interference level. Furthermore, we determine the minimum separation distance needed to keep the interference-to-noise ratio of NTN interference below 0 dB.

eess.SP↗

arXiv2024

MiMoTable: A Multi-scale Spreadsheet Benchmark with Meta Operations for Table Reasoning

Extensive research has been conducted to explore the capability of Large Language Models (LLMs) for table reasoning and has significantly improved the performance on existing benchmarks. However, tables and user questions in real-world applications are more complex and diverse, presenting an unignorable gap compared to the existing benchmarks. To fill the gap, we propose a \textbf{M}ult\textbf{i}-scale spreadsheet benchmark with \textbf{M}eta \textbf{o}perations for \textbf{Table} reasoning, named as MiMoTable. Specifically, MiMoTable incorporates two key features. First, the tables in MiMoTable are all spreadsheets used in real-world scenarios, which cover seven domains and contain different types. Second, we define a new criterion with six categories of meta operations for measuring the difficulty of each question in MiMoTable, simultaneously as a new perspective for measuring the difficulty of the existing benchmarks. Experimental results show that Claude-3.5-Sonnet achieves the best performance with 77.4\% accuracy, indicating that there is still significant room to improve for LLMs on MiMoTable. Furthermore, we grade the difficulty of existing benchmarks according to our new criteria. Experiments have shown that the performance of LLMs decreases as the difficulty of benchmarks increases, thereby proving the effectiveness of our proposed new criterion.

cs.CL↗

arXiv2024

Diffraction patterns in attosecond photoionization time delay

Upon absorbing a photon, the ionized electron sails through the target force field in attoseconds to reach free space. This navigation probes details of the potential landscape that get imprinted into the phase of the ionization amplitude. The Eisenbud-Wigner-Smith (EWS) time delay, the energy derivative of this phase, provides the navigation time relative to the time of the electron's ``free'' exit. This time is influenced by the diffraction of the electron from the potential landscape, offering structural and dynamical information about interactions. If the potential has an intrinsic symmetry, a regular pattern in the time delay, including subpatterns of delays and advances, may occur from the diffraction process. The recent synthesis of a polyhedral fluorocarbon instigates the current study of photoionization from a cubic molecule. Our simulation of the EWS delay unravels rich diffraction motifs within $\pm$100 attoseconds in both energy and angular distributions. Averaging over the Euler angles from the laboratory to the molecular frame and over the photoelectron azimuthal direction indicates that the pattern should be discernible in ultrafast chronoscopy. The study benchmarks diffraction in molecular photoionization as a fundamental process which can be experimentally accessed through ultrafast time delay.

physics.atom-ph↗

arXiv2024

Contrasting Adversarial Perturbations: The Space of Harmless Perturbations

Existing works have extensively studied adversarial examples, which are minimal perturbations that can mislead the output of deep neural networks (DNNs) while remaining imperceptible to humans. However, in this work, we reveal the existence of a harmless perturbation space, in which perturbations drawn from this space, regardless of their magnitudes, leave the network output unchanged when applied to inputs. Essentially, the harmless perturbation space emerges from the usage of non-injective functions (linear or non-linear layers) within DNNs, enabling multiple distinct inputs to be mapped to the same output. For linear layers with input dimensions exceeding output dimensions, any linear combination of the orthogonal bases of the nullspace of the parameter consistently yields no change in their output. For non-linear layers, the harmless perturbation space may expand, depending on the properties of the layers and input samples. Inspired by this property of DNNs, we solve for a family of general perturbation spaces that are redundant for the DNN's decision, and can be used to hide sensitive data and serve as a means of model identification. Our work highlights the distinctive robustness of DNNs (i.e., consistency under large magnitude perturbations) in contrast to adversarial examples (vulnerability for small imperceptible noises).

cs.LG↗

arXiv2024

Steering Non-Equilibrium Molecular Dynamics in Optical Cavities

Optical resonators have shown outstanding abilities to tailor chemical landscapes through enhanced light-matter interaction between confined optical modes and molecule vibrations. We propose a theoretical model to study cooperative vibrational strong coupling in an open quantum system. The non-equilibrium stochastic molecular dynamics in an optical cavity with an auxiliary ensemble is investigated. It shows that coupling with a cavity mode introduces an additional colored noise and a negative feedback, both of which enable control over thermalization rates (i.e. the lifetime of excitation) of reactive molecules. Our work offers a pathway to steer stability of chemical bonds for chemical reactivity under cooperative vibrational strong coupling.

physics.optics↗