arXiv subjects

Tong Li

Publications and source records attributed to Tong Li.

At least 109 records · Page 6Linked to original sources

arXiv2025

Adapting Pretrained Language Models for Citation Classification via Self-Supervised Contrastive Learning

Citation classification, which identifies the intention behind academic citations, is pivotal for scholarly analysis. Previous works suggest fine-tuning pretrained language models (PLMs) on citation classification datasets, reaping the reward of the linguistic knowledge they gained during pretraining. However, directly fine-tuning for citation classification is challenging due to labeled data scarcity, contextual noise, and spurious keyphrase correlations. In this paper, we present a novel framework, Citss, that adapts the PLMs to overcome these challenges. Citss introduces self-supervised contrastive learning to alleviate data scarcity, and is equipped with two specialized strategies to obtain the contrastive pairs: sentence-level cropping, which enhances focus on target citations within long contexts, and keyphrase perturbation, which mitigates reliance on specific keyphrases. Compared with previous works that are only designed for encoder-based PLMs, Citss is carefully developed to be compatible with both encoder-based PLMs and decoder-based LLMs, to embrace the benefits of enlarged pretraining. Experiments with three benchmark datasets with both encoder-based PLMs and decoder-based LLMs demonstrate our superiority compared to the previous state of the art. Our code is available at: github.com/LITONG99/Citss

cs.CL↗

arXiv2025

Prompt-Guided Internal States for Hallucination Detection of Large Language Models

Large Language Models (LLMs) have demonstrated remarkable capabilities across a variety of tasks in different domains. However, they sometimes generate responses that are logically coherent but factually incorrect or misleading, which is known as LLM hallucinations. Data-driven supervised methods train hallucination detectors by leveraging the internal states of LLMs, but detectors trained on specific domains often struggle to generalize well to other domains. In this paper, we aim to enhance the cross-domain performance of supervised detectors with only in-domain data. We propose a novel framework, prompt-guided internal states for hallucination detection of LLMs, namely PRISM. By utilizing appropriate prompts to guide changes to the structure related to text truthfulness in LLMs' internal states, we make this structure more salient and consistent across texts from different domains. We integrated our framework with existing hallucination detection methods and conducted experiments on datasets from different domains. The experimental results indicate that our framework significantly enhances the cross-domain generalization of existing hallucination detection methods.

cs.CL↗

arXiv2025

CTRAP: Embedding Collapse Trap to Safeguard Large Language Models from Harmful Fine-Tuning

Fine-tuning-as-a-service, while commercially successful for Large Language Model (LLM) providers, exposes models to harmful fine-tuning attacks. As a widely explored defense paradigm against such attacks, unlearning attempts to remove malicious knowledge from LLMs, thereby essentially preventing them from being used to perform malicious tasks. However, we highlight a critical flaw: the powerful general adaptability of LLMs allows them to easily bypass selective unlearning by rapidly relearning or repurposing their capabilities for harmful tasks. To address this fundamental limitation, we propose a paradigm shift: instead of selective removal, we advocate for inducing model collapse--effectively forcing the model to "unlearn everything"--specifically in response to updates characteristic of malicious adaptation. This collapse directly neutralizes the very general capabilities that attackers exploit, tackling the core issue unaddressed by selective unlearning. We introduce the Collapse Trap (CTRAP) as a practical mechanism to implement this concept conditionally. Embedded during alignment, CTRAP pre-configures the model's reaction to subsequent fine-tuning dynamics. If updates during fine-tuning constitute a persistent attempt to reverse safety alignment, the pre-configured trap triggers a progressive degradation of the model's core language modeling abilities, ultimately rendering it inert and useless for the attacker. Crucially, this collapse mechanism remains dormant during benign fine-tuning, ensuring the model's utility and general capabilities are preserved for legitimate users. Extensive empirical results demonstrate that CTRAP effectively counters harmful fine-tuning risks across various LLMs and attack settings, while maintaining high performance in benign scenarios. Our code is available at https://anonymous.4open.science/r/CTRAP.

cs.CR↗

arXiv2025

TAIJI: MCP-based Multi-Modal Data Analytics on Data Lakes

The variety of data in data lakes presents significant challenges for data analytics, as data scientists must simultaneously analyze multi-modal data, including structured, semi-structured, and unstructured data. While Large Language Models (LLMs) have demonstrated promising capabilities, they still remain inadequate for multi-modal data analytics in terms of accuracy, efficiency, and freshness. First, current natural language (NL) or SQL-like query languages may struggle to precisely and comprehensively capture users' analytical intent. Second, relying on a single unified LLM to process diverse data modalities often leads to substantial inference overhead. Third, data stored in data lakes may be incomplete or outdated, making it essential to integrate external open-domain knowledge to generate timely and relevant analytics results. In this paper, we envision a new multi-modal data analytics system. Specifically, we propose a novel architecture built upon the Model Context Protocol (MCP), an emerging paradigm that enables LLMs to collaborate with knowledgeable agents. First, we define a semantic operator hierarchy tailored for querying multi-modal data in data lakes and develop an AI-agent-powered NL2Operator translator to bridge user intent and analytical execution. Next, we introduce an MCP-based execution framework, in which each MCP server hosts specialized foundation models optimized for specific data modalities. This design enhances both accuracy and efficiency, while supporting high scalability through modular deployment. Finally, we propose a updating mechanism by harnessing the deep research and machine unlearning techniques to refresh the data lakes and LLM knowledges, with the goal of balancing the data freshness and inference efficiency.

cs.DB↗

arXiv2025

Machine learning bridging battery field data and laboratory data

Aiming at the dilemma that most laboratory data-driven diagnostic and prognostic methods cannot be applied to field batteries in passenger cars and energy storage systems, this paper proposes a method to bridge field data and laboratory data using machine learning. Only two field real impedances corresponding to a medium frequency and a high frequency are needed to predict laboratory real impedance curve, laboratory charge/discharge curve, and laboratory relaxation curve. Based on the predicted laboratory data, laboratory data-driven methods can be used for field battery diagnosis and prognosis. Compared with the field data-driven methods based on massive historical field data, the proposed method has the advantages of higher accuracy, lower cost, faster speed, readily available, and no use of private data. The proposed method is tested using two open-source datasets containing 249 NMC cells. For a test set containing 76 cells, the mean absolute percentage errors of laboratory real impedance curve, charge curve, and discharge curve prediction results are 0.85%, 4.72%, and 2.69%, respectively. This work fills the gap between laboratory data-driven diagnostic and prognostic methods and field battery applications, making all laboratory data-driven methods applicable to field battery diagnosis and prognosis. Furthermore, this work overturns the fixed path of developing field battery diagnostic and prognostic methods based on massive field historical data, opening up new research and breakthrough directions for field battery diagnosis and prognosis.

stat.AP↗

arXiv2025

PDE: Gene Effect Inspired Parameter Dynamic Evolution for Low-light Image Enhancement

Low-light image enhancement (LLIE) is a fundamental task in computational photography, aiming to improve illumination, reduce noise, and enhance image quality. While recent advancements focus on designing increasingly complex neural network models, we observe a peculiar phenomenon: resetting certain parameters to random values unexpectedly improves enhancement performance for some images. Drawing inspiration from biological genes, we term this phenomenon the gene effect. The gene effect limits enhancement performance, as even random parameters can sometimes outperform learned ones, preventing models from fully utilizing their capacity. In this paper, we investigate the reason and propose a solution. Based on our observations, we attribute the gene effect to static parameters, analogous to how fixed genetic configurations become maladaptive when environments change. Inspired by biological evolution, where adaptation to new environments relies on gene mutation and recombination, we propose parameter dynamic evolution (PDE) to adapt to different images and mitigate the gene effect. PDE employs a parameter orthogonal generation technique and the corresponding generated parameters to simulate gene recombination and gene mutation, separately. Experiments validate the effectiveness of our techniques. The code will be released to the public.

cs.CV↗

arXiv2025

Machine learning accelerates fuel cell life testing

Accelerated life testing (ALT) can significantly reduce the economic, time, and labor costs of life testing in the process of equipment, device, and material research and development (R&D), and improve R&D efficiency. This paper proposes a performance characterization data prediction (PCDP) method and a life prediction-driven ALT (LP-ALT) method to accelerate the life test of polymer electrolyte membrane fuel cells (PEMFCs). The PCDP method can accurately predict different PCD using only four impedances (real and imaginary) corresponding to a high frequency and a medium frequency, greatly shortening the measurement time of offline PCD and reducing the difficulty of life testing. The test results on an open source life test dataset containing 42 PEMFCs show that compared with the determination coefficient (R^2) results of predicted aging indicators, including limiting current, total mass transport resistance, electrochemically active surface area, and crossover current, obtained based on the measured PCD, the R^2 results of predicted aging indicators based on the predicted PCD is only reduced by 0.04, 0.01, 0.05, and 0.06, respectively. The LP-ALT method can shorten the life test time through early life prediction. Test results on the same open-source life test dataset of PEMFCs show that the acceleration ratio of the LP-ALT method can reach 30 times under the premise of ensuring that the minimum R^2 of the prediction results of different aging indicators, including limiting current, total mass transport resistance, and electrochemically active surface area, is not less than 0.89. Combining the different performance characterization data predicted by the PCDP method and the life prediction of the LP-ALT method, the diagnosis and prognosis of PEMFCs and their components can be achieved.

stat.AP↗

arXiv2025

Baryon-number-violating nucleon decays in sterile neutrino effective field theories

The search for baryon-number-violating (BNV) nucleon decay provides an intriguing probe of new physics beyond the Standard Model (SM). Future neutrino experiments will improve the sensitivity to BNV nucleon decays and can serve to search for dark particles. In this work, we study the sterile neutrino effective field theories (EFTs) with baryon number violation and the impact of light sterile neutrino on BNV nucleon decays. We revisit the dimension-6 and dimension-7 EFT operator bases with $|Δ(B-L)|=2$ or $|Δ(B-L)|=0$. They are then matched to the baryon chiral perturbation theory. We obtain the effective chiral Lagrangian at low energies and the BNV interactions between the sterile neutrino and baryons and mesons. The rates of nucleon decay to SM neutrinos or a sterile neutrino are calculated. We then show the constraints on the ultraviolet scale from nucleon decay search at Super-K. The correlation of two EFT operators and the dependence on the sterile neutrino mass are also investigated.

hep-ph↗

arXiv2025

A Survey of Large Language Model-Powered Spatial Intelligence Across Scales: Advances in Embodied Agents, Smart Cities, and Earth Science

Over the past year, the development of large language models (LLMs) has brought spatial intelligence into focus, with much attention on vision-based embodied intelligence. However, spatial intelligence spans a broader range of disciplines and scales, from navigation and urban planning to remote sensing and earth science. What are the differences and connections between spatial intelligence across these fields? In this paper, we first review human spatial cognition and its implications for spatial intelligence in LLMs. We then examine spatial memory, knowledge representations, and abstract reasoning in LLMs, highlighting their roles and connections. Finally, we analyze spatial intelligence across scales -- from embodied to urban and global levels -- following a framework that progresses from spatial memory and understanding to spatial reasoning and intelligence. Through this survey, we aim to provide insights into interdisciplinary spatial intelligence research and inspire future studies.

cs.AI↗

arXiv2025

Enabling Continuous THz Band Coverage via Precise Electron Beam Tailoring in Free-electron Lasers

High-power, continuously tunable narrowband terahertz (THz) sources are essential for advancing nonlinear optics, THz-driven material dynamics, and ultrafast spectroscopy. Conventional techniques typically impose a trade-off between pulse energy and frequency tunability. Here, we introduce a novel free-electron laser approach that overcomes these limitations by pre-modulating a relativistic electron beam with a frequency-beating laser pulse and leveraging bunch compression along with collective effects to enhance microbunching. Experimental results demonstrate that this technique generates narrowband THz emission with continuous frequency tunability from 7.8 to 30.8THz, achieving pulse energies up to 385μJ while maintaining spectral bandwidths between 7.7% and 14.7%. Moreover, the method exhibits exceptional robustness and scalability, highlighting its unique ability to bridge the long-standing THz gap and offering a promising solution for diverse cutting-edge scientific applications.

physics.acc-ph↗

arXiv2025

Positive2Negative: Breaking the Information-Lossy Barrier in Self-Supervised Single Image Denoising

Image denoising enhances image quality, serving as a foundational technique across various computational photography applications. The obstacle to clean image acquisition in real scenarios necessitates the development of self-supervised image denoising methods only depending on noisy images, especially a single noisy image. Existing self-supervised image denoising paradigms (Noise2Noise and Noise2Void) rely heavily on information-lossy operations, such as downsampling and masking, culminating in low quality denoising performance. In this paper, we propose a novel self-supervised single image denoising paradigm, Positive2Negative, to break the information-lossy barrier. Our paradigm involves two key steps: Renoised Data Construction (RDC) and Denoised Consistency Supervision (DCS). RDC renoises the predicted denoised image by the predicted noise to construct multiple noisy images, preserving all the information of the original image. DCS ensures consistency across the multiple denoised images, supervising the network to learn robust denoising. Our Positive2Negative paradigm achieves state-of-the-art performance in self-supervised single image denoising with significant speed improvements. The code is released to the public at https://github.com/Li-Tong-621/P2N.

cs.CV↗

arXiv2025

The pseudo-analytical density solution to parameterized Fokker-Planck equations via deep learning

Efficiently solving the Fokker-Planck equation (FPE) is crucial for understanding the probabilistic evolution of stochastic particles in dynamical systems, however, analytical solutions or density functions are only attainable in specific cases. To speed up the solving process of parameterized FPEs with several system parameters, we introduce a deep learning-based method to obtain the pseudo-analytical density (PAD). Unlike previous numerical methodologies that necessitate solving the FPE separately for each set of system parameters, the PAD simultaneously addresses all the FPEs within a predefined continuous range of system parameters during a single training phase. The approach utilizes a Gaussian mixture distribution (GMD) to represent the stationary probability density, the solution to the FPE. By leveraging a deep residual network, each system parameter configuration is mapped to the parameters of the GMD, ensuring that the weights, means, and variances of the Gaussian components adaptively align with the corresponding true density functions. A grid-free algorithm is further developed to effectively train the residual network, resulting in a feasible PAD obeying necessary normalization and boundary conditions. Extensive numerical studies validate the accuracy and efficiency of our method, promising significant acceleration in the response analysis of multi-parameter, multi-dimensional stochastic nonlinear systems.

physics.comp-ph↗

arXiv2025

Dark Photon Dark Matter in Quantum Electromagnetodynamics and Detection at Haloscope Experiments

The ultralight dark photon is one of intriguing dark matter candidates. The interaction between the visible photon and dark photon is introduced by the gauge kinetic mixing between the field strength tensors of the Abelian gauge groups in the Standard Model and dark sector. The relativistic electrodynamics was generalized to quantum electromagnetodynamics (QEMD) in the presence of both electric and magnetic charges. The photon is described by two four-potentials corresponding to two $U(1)$ gauge groups and satisfying non-trivial commutation relations. In this work, we construct the low-energy dark photon-photon interactions in the framework of QEMD and obtain new dark photon-photon kinetic mixings. The consequent field equations and the new Maxwell's equations are derived in this framework. We also investigate the detection strategies of dark photon as light dark matter as well as the generic kinetic mixings at haloscope experiments.

hep-ph↗

arXiv2025

Laser induced Compton Scattering to Dark Photon or Axion-like Particle

The laser of an intense electromagnetic field provides an important tool to study the strong-field particle physics. The nonlinear Compton scattering was observed in the collision of an ultra-relativistic electron beam with a laser pulse in 1990s. The precision measurement of the nonlinear Compton scattering shines the light on the studies of strong-field QED and nonlinear effects in QED. In this work, we propose to produce new massive particles through the nonlinear Compton scattering in the presence of a high intense laser field. We take dark photon or axion-like particle as illustrative new particle. Compared with other collider and beam dump experiments, the laser induced process provides a complementary and competitive search of new invisible particles lighter than 1 MeV.

hep-ph↗

arXiv2025

An Aspect Performance-aware Hypergraph Neural Network for Review-based Recommendation

Online reviews allow consumers to provide detailed feedback on various aspects of items. Existing methods utilize these aspects to model users' fine-grained preferences for specific item features through graph neural networks. We argue that the performance of items on different aspects is important for making precise recommendations, which has not been taken into account by existing approaches, due to lack of data. In this paper, we propose an aspect performance-aware hypergraph neural network (APH) for the review-based recommendation, which learns the performance of items from the conflicting sentiment polarity of user reviews. Specifically, APH comprehensively models the relationships among users, items, aspects, and sentiment polarity by systematically constructing an aspect hypergraph based on user reviews. In addition, APH aggregates aspects representing users and items by employing an aspect performance-aware hypergraph aggregation method. It aggregates the sentiment polarities from multiple users by jointly considering user preferences and the semantics of their sentiments, determining the weights of sentiment polarities to infer the performance of items on various aspects. Such performances are then used as weights to aggregate neighboring aspects. Experiments on six real-world datasets demonstrate that APH improves MSE, Precision@5, and Recall@5 by an average of 2.30%, 4.89%, and 1.60% over the best baseline. The source code and data are available at https://github.com/dianziliu/APH.

cs.IR↗

arXiv2025

VulnBot: Autonomous Penetration Testing for A Multi-Agent Collaborative Framework

Penetration testing is a vital practice for identifying and mitigating vulnerabilities in cybersecurity systems, but its manual execution is labor-intensive and time-consuming. Existing large language model (LLM)-assisted or automated penetration testing approaches often suffer from inefficiencies, such as a lack of contextual understanding and excessive, unstructured data generation. This paper presents VulnBot, an automated penetration testing framework that leverages LLMs to simulate the collaborative workflow of human penetration testing teams through a multi-agent system. To address the inefficiencies and reliance on manual intervention in traditional penetration testing methods, VulnBot decomposes complex tasks into three specialized phases: reconnaissance, scanning, and exploitation. These phases are guided by a penetration task graph (PTG) to ensure logical task execution. Key design features include role specialization, penetration path planning, inter-agent communication, and generative penetration behavior. Experimental results demonstrate that VulnBot outperforms baseline models such as GPT-4 and Llama3 in automated penetration testing tasks, particularly showcasing its potential in fully autonomous testing on real-world machines.

cs.SE↗

arXiv2025

SOP-Agent: Empower General Purpose AI Agent with Domain-Specific SOPs

Despite significant advancements in general-purpose AI agents, several challenges still hinder their practical application in real-world scenarios. First, the limited planning capabilities of Large Language Models (LLM) restrict AI agents from effectively solving complex tasks that require long-horizon planning. Second, general-purpose AI agents struggle to efficiently utilize domain-specific knowledge and human expertise. In this paper, we introduce the Standard Operational Procedure-guided Agent (SOP-agent), a novel framework for constructing domain-specific agents through pseudocode-style Standard Operational Procedures (SOPs) written in natural language. Formally, we represent a SOP as a decision graph, which is traversed to guide the agent in completing tasks specified by the SOP. We conduct extensive experiments across tasks in multiple domains, including decision-making, search and reasoning, code generation, data cleaning, and grounded customer service. The SOP-agent demonstrates excellent versatility, achieving performance superior to general-purpose agent frameworks and comparable to domain-specific agent systems. Additionally, we introduce the Grounded Customer Service Benchmark, the first benchmark designed to evaluate the grounded decision-making capabilities of AI agents in customer service scenarios based on SOPs.

cs.AI↗

arXiv2024

Sensitivity of two-mode SRF cavity to generic electromagnetism of sub-$μ$eV dark matter

The low-mass dark matter (DM) such as axion or wavelike scalar is a plausible DM candidate. Recently, the possible non-standard couplings of low-mass DM has drawn much attention. In this work we investigate the detection of electromagnetic couplings in a few benchmark models of low-mass DM. For illustration, we consider the generic axion electrodynamics including CP violating coupling as well as the newly proposed axion electromagnetodynamics. The superconducting radio frequency (SRF) cavity with two modes has more advantages than the traditional cavity approach with static background field. We utilize the two-mode SRF cavity to probe the generic couplings of low-mass DM with frequency lower than GHz. We show the sensitivity of the SRF cavity to the axion couplings in the above frameworks.

hep-ph↗