arXiv subjects

Xin Lu

Publications and source records attributed to Xin Lu.

At least 109 records · Page 6Linked to original sources

arXiv2025

Elucidating and Endowing the Diffusion Training Paradigm for General Image Restoration

While diffusion models demonstrate strong generative capabilities in image restoration (IR) tasks, their complex architectures and iterative processes limit their practical application compared to mainstream reconstruction-based general ordinary IR networks. Existing approaches primarily focus on optimizing network architecture and diffusion paths but overlook the integration of the diffusion training paradigm within general ordinary IR frameworks. To address these challenges, this paper elucidates key principles for adapting the diffusion training paradigm to general IR training through systematic analysis of time-step dependencies, network hierarchies, noise-level relationships, and multi-restoration task correlations, proposing a new IR framework supported by diffusion-based training. To enable IR networks to simultaneously restore images and model generative representations, we introduce a series of regularization strategies that align diffusion objectives with IR tasks, improving generalization in single-task scenarios. Furthermore, recognizing that diffusion-based generation exerts varying influences across different IR tasks, we develop an incremental training paradigm and task-specific adaptors, further enhancing performance in multi-task unified IR. Experiments demonstrate that our method significantly improves the generalization of IR networks in single-task IR and achieves superior performance in multi-task unified IR. Notably, the proposed framework can be seamlessly integrated into existing general IR architectures.

cs.CV↗

arXiv2025

NTIRE 2025 Image Shadow Removal Challenge Report

This work examines the findings of the NTIRE 2025 Shadow Removal Challenge. A total of 306 participants have registered, with 17 teams successfully submitting their solutions during the final evaluation phase. Following the last two editions, this challenge had two evaluation tracks: one focusing on reconstruction fidelity and the other on visual perception through a user study. Both tracks were evaluated with images from the WSRD+ dataset, simulating interactions between self- and cast-shadows with a large number of diverse objects, textures, and materials.

cs.CV↗

arXiv2025

Debiased regression adjustment in completely randomized experiments with moderately high-dimensional covariates

Completely randomized experiment is the gold standard for causal inference. When the covariate information for each experimental candidate is available, one typical way is to include them in covariate adjustments for more accurate treatment effect estimation. In this paper, we investigate this problem under the randomization-based framework, i.e., that the covariates and potential outcomes of all experimental candidates are assumed as deterministic quantities and the randomness comes solely from the treatment assignment mechanism. Under this framework, to achieve asymptotically valid inference, existing estimators usually require either (i) that the dimension of covariates $p$ is much smaller than the sample size $n$; or (ii) certain sparsity constraints on the linear representations of potential outcomes constructed via possibly high-dimensional covariates. In this paper, we consider the moderately high-dimensional regime where $p$ is allowed to be in the same order of magnitude as $n$. We develop a novel debiased estimator with a corresponding inference procedure and establish its asymptotic normality under mild assumptions. Our estimator is model-free and does not require any sparsity constraint on potential outcome's linear representations. We also discuss its asymptotic efficiency improvements over the unadjusted treatment effect estimator under different dimensionality constraints. Numerical analysis confirms that compared to other regression adjustment based treatment effect estimators, our debiased estimator performs well in moderately high dimensions.

stat.ME↗

arXiv2025

Efficient Test-time Adaptive Object Detection via Sensitivity-Guided Pruning

Continual test-time adaptive object detection (CTTA-OD) aims to online adapt a source pre-trained detector to ever-changing environments during inference under continuous domain shifts. Most existing CTTA-OD methods prioritize effectiveness while overlooking computational efficiency, which is crucial for resource-constrained scenarios. In this paper, we propose an efficient CTTA-OD method via pruning. Our motivation stems from the observation that not all learned source features are beneficial; certain domain-sensitive feature channels can adversely affect target domain performance. Inspired by this, we introduce a sensitivity-guided channel pruning strategy that quantifies each channel based on its sensitivity to domain discrepancies at both image and instance levels. We apply weighted sparsity regularization to selectively suppress and prune these sensitive channels, focusing adaptation efforts on invariant ones. Additionally, we introduce a stochastic channel reactivation mechanism to restore pruned channels, enabling recovery of potentially useful features and mitigating the risks of early pruning. Extensive experiments on three benchmarks show that our method achieves superior adaptation performance while reducing computational overhead by 12% in FLOPs compared to the recent SOTA method.

cs.CV↗

arXiv2025

EL4NER: Ensemble Learning for Named Entity Recognition via Multiple Small-Parameter Large Language Models

In-Context Learning (ICL) technique based on Large Language Models (LLMs) has gained prominence in Named Entity Recognition (NER) tasks for its lower computing resource consumption, less manual labeling overhead, and stronger generalizability. Nevertheless, most ICL-based NER methods depend on large-parameter LLMs: the open-source models demand substantial computational resources for deployment and inference, while the closed-source ones incur high API costs, raise data-privacy concerns, and hinder community collaboration. To address this question, we propose an Ensemble Learning Method for Named Entity Recognition (EL4NER), which aims at aggregating the ICL outputs of multiple open-source, small-parameter LLMs to enhance overall performance in NER tasks at less deployment and inference cost. Specifically, our method comprises three key components. First, we design a task decomposition-based pipeline that facilitates deep, multi-stage ensemble learning. Second, we introduce a novel span-level sentence similarity algorithm to establish an ICL demonstration retrieval mechanism better suited for NER tasks. Third, we incorporate a self-validation mechanism to mitigate the noise introduced during the ensemble process. We evaluated EL4NER on multiple widely adopted NER datasets from diverse domains. Our experimental results indicate that EL4NER surpasses most closed-source, large-parameter LLM-based methods at a lower parameter cost and even attains state-of-the-art (SOTA) performance among ICL-based methods on certain datasets. These results show the parameter efficiency of EL4NER and underscore the feasibility of employing open-source, small-parameter LLMs within the ICL paradigm for NER tasks.

cs.CL↗

arXiv2025

ProDiff: Prototype-Guided Diffusion for Minimal Information Trajectory Imputation

Trajectory data is crucial for various applications but often suffers from incompleteness due to device limitations and diverse collection scenarios. Existing imputation methods rely on sparse trajectory or travel information, such as velocity, to infer missing points. However, these approaches assume that sparse trajectories retain essential behavioral patterns, which place significant demands on data acquisition and overlook the potential of large-scale human trajectory embeddings. To address this, we propose ProDiff, a trajectory imputation framework that uses only two endpoints as minimal information. It integrates prototype learning to embed human movement patterns and a denoising diffusion probabilistic model for robust spatiotemporal reconstruction. Joint training with a tailored loss function ensures effective imputation. ProDiff outperforms state-of-the-art methods, improving accuracy by 6.28\% on FourSquare and 2.52\% on WuXi. Further analysis shows a 0.927 correlation between generated and real trajectories, demonstrating the effectiveness of our approach.

cs.LG↗

arXiv2025

Separate the Wheat from the Chaff: A Post-Hoc Approach to Safety Re-Alignment for Fine-Tuned Language Models

Although large language models (LLMs) achieve effective safety alignment at the time of release, they still face various safety challenges. A key issue is that fine-tuning often compromises the safety alignment of LLMs. To address this issue, we propose a method named IRR (Identify, Remove, and Recalibrate for Safety Realignment) that performs safety realignment for LLMs. The core of IRR is to identify and remove unsafe delta parameters from the fine-tuned models, while recalibrating the retained ones. We evaluate the effectiveness of IRR across various datasets, including both full fine-tuning and LoRA methods. Our results demonstrate that IRR significantly enhances the safety performance of fine-tuned models on safety benchmarks, such as harmful queries and jailbreak attacks, while maintaining their performance on downstream tasks. The source code is available at: https://anonymous.4open.science/r/IRR-BD4F.

cs.CL↗

arXiv2025

Psychology-driven LLM Agents for Explainable Panic Prediction on Social Media during Sudden Disaster Events

During sudden disaster events, accurately predicting public panic sentiment on social media is crucial for proactive governance and crisis management. Current efforts on this problem face three main challenges: lack of finely annotated data hinders emotion prediction studies, unmodeled risk perception causes prediction inaccuracies, and insufficient interpretability of panic formation mechanisms. We address these issues by proposing a Psychology-driven generative Agent framework (PsychoAgent) for explainable panic prediction based on emotion arousal theory. Specifically, we first construct a fine-grained open panic emotion dataset (namely COPE) via human-large language models (LLMs) collaboration to mitigate semantic bias. Then, we develop a framework integrating cross-domain heterogeneous data grounded in psychological mechanisms to model risk perception and cognitive differences in emotion generation. To enhance interpretability, we design an LLM-based role-playing agent that simulates individual psychological chains through dedicatedly designed prompts. Experimental results on our annotated dataset show that PsychoAgent improves panic emotion prediction performance by 12.6% to 21.7% compared to baseline models. Furthermore, the explainability and generalization of our approach is validated. Crucially, this represents a paradigm shift from opaque "data-driven fitting" to transparent "role-based simulation with mechanistic interpretation" for panic emotion prediction during emergencies. Our implementation is publicly available at: https://anonymous.4open.science/r/PsychoAgent-19DD.

cs.AI↗

arXiv2025

Learning Joint ID-Textual Representation for ID-Preserving Image Synthesis

We propose a novel framework for ID-preserving generation using a multi-modal encoding strategy rather than injecting identity features via adapters into pre-trained models. Our method treats identity and text as a unified conditioning input. To achieve this, we introduce FaceCLIP, a multi-modal encoder that learns a joint embedding space for both identity and textual semantics. Given a reference face and a text prompt, FaceCLIP produces a unified representation that encodes both identity and text, which conditions a base diffusion model to generate images that are identity-consistent and text-aligned. We also present a multi-modal alignment algorithm to train FaceCLIP, using a loss that aligns its joint representation with face, text, and image embedding spaces. We then build FaceCLIP-SDXL, an ID-preserving image synthesis pipeline by integrating FaceCLIP with Stable Diffusion XL (SDXL). Compared to prior methods, FaceCLIP-SDXL enables photorealistic portrait generation with better identity preservation and textual relevance. Extensive experiments demonstrate its quantitative and qualitative superiority.

cs.CV↗

arXiv2025

NTIRE 2025 Challenge on Efficient Burst HDR and Restoration: Datasets, Methods, and Results

This paper reviews the NTIRE 2025 Efficient Burst HDR and Restoration Challenge, which aims to advance efficient multi-frame high dynamic range (HDR) and restoration techniques. The challenge is based on a novel RAW multi-frame fusion dataset, comprising nine noisy and misaligned RAW frames with various exposure levels per scene. Participants were tasked with developing solutions capable of effectively fusing these frames while adhering to strict efficiency constraints: fewer than 30 million model parameters and a computational budget under 4.0 trillion FLOPs. A total of 217 participants registered, with six teams finally submitting valid solutions. The top-performing approach achieved a PSNR of 43.22 dB, showcasing the potential of novel methods in this domain. This paper provides a comprehensive overview of the challenge, compares the proposed solutions, and serves as a valuable reference for researchers and practitioners in efficient burst HDR and restoration.

eess.IV↗

arXiv2025

Flux Already Knows -- Activating Subject-Driven Image Generation without Training

We propose a simple yet effective zero-shot framework for subject-driven image generation using a vanilla Flux model. By framing the task as grid-based image completion and simply replicating the subject image(s) in a mosaic layout, we activate strong identity-preserving capabilities without any additional data, training, or inference-time fine-tuning. This "free lunch" approach is further strengthened by a novel cascade attention design and meta prompting technique, boosting fidelity and versatility. Experimental results show that our method outperforms baselines across multiple key metrics in benchmarks and human preference studies, with trade-offs in certain aspects. Additionally, it supports diverse edits, including logo insertion, virtual try-on, and subject replacement or insertion. These results demonstrate that a pre-trained foundational text-to-image model can enable high-quality, resource-efficient subject-driven generation, opening new possibilities for lightweight customization in downstream applications.

cs.CV↗

arXiv2025

NTIRE 2025 Challenge on Event-Based Image Deblurring: Methods and Results

This paper presents an overview of NTIRE 2025 the First Challenge on Event-Based Image Deblurring, detailing the proposed methodologies and corresponding results. The primary goal of the challenge is to design an event-based method that achieves high-quality image deblurring, with performance quantitatively assessed using Peak Signal-to-Noise Ratio (PSNR). Notably, there are no restrictions on computational complexity or model size. The task focuses on leveraging both events and images as inputs for single-image deblurring. A total of 199 participants registered, among whom 15 teams successfully submitted valid results, offering valuable insights into the current state of event-based image deblurring. We anticipate that this challenge will drive further advancements in event-based vision research.

cs.CV↗

arXiv2025

Phase transitions of the Erdős-Gyárfás function

Given positive integers $p,q$. For any integer $k\ge2$, an edge coloring of the complete $k$-graph $K_n^{(k)}$ is said to be a $(p,q)$-coloring if every copy of $K_p^{(k)}$ receives at least $q$ colors. The Erdős-Gyárfás function $f_k(n,p,q)$ is the minimum number of colors that are needed for $K_n^{(k)}$ to have a $(p,q)$-coloring. Conlon, Fox, Lee and Sudakov (\emph{IMRN, 2015}) conjectured that for any positive integers $p, k$ and $i$ with $k\ge3$ and $1\le i<k$, $f_k(n,p,{{p-i}\choose{k-i}})=(\log_{(i-1)}n)^{o(1)}$, where $\log_{(i)}n$ is an iterated $i$-fold logarithm in $n$. It has been verified to be true for $k=3, p=4, i=1$ by Conlon et. al (\emph{IMRN, 2015}), for $k=3, p=5, i=2$ by Mubayi (\emph{JGT, 2016}), and for all $k\ge 4, p=k+1,i=1$ by B. Janzer and O. Janzer (\emph{JCTB, 2024}). In this paper, we give new constructions and show that this conjecture holds for infinitely many new cases, i.e., it holds for all $k\ge4$, $p=k+2$ and $i=k-1$.

math.CO↗

arXiv2025

Fractional topological states in rhombohedral multilayer graphene modulated by kagome superlattice

Fractional quantum anomalous Hall effects realized in twisted bilayer MoTe$_2$ and multilayer-graphene-based moiré heterostructures have captured a tremendous growth of interest. In this work, we propose that rhombohedral multilayer graphene coupled with an artificial kagome superlattice potential is a new platform to realize various fractional topological phases. Taking Bernal bilayer graphene as the simplest example, when it is placed on top of a prepatterned SiO$_2$ substrate with periodic arrays of holes arranged into kagome lattice, the system would be subject to a tunable kagome superlattice potential once an electrostatic voltage drop between the top and bottom gates is applied. Then, we theoretically study the electronic band structures, topological properties, and quantum geometric properties of the Bloch states of Bernal bilayer graphene coupled with a realistic kagome superlattice potential, which is well benchmarked by transport measurements in the weak superlattice-potential regime. We find that the system may exhibit nearly ideal topological flat bands in a substantial region of the parameter space spanned by superlattice constant and electrostatic potential strength. When these topological flat bands are fractionally filled, exact diagonalization calculations suggest that the system would exhibit rich fractional topological phases at 1/3, 2/3, 2/5, 3/5 and 1/2 fillings including both fractional Chern insulators and anomalous composite Fermi liquids under zero magnetic field.

cond-mat.mes-hall↗

arXiv2025

Orientation-dependent superconductivity and electronic structure of the rare-earth metal/KTaO3 interfaces

The recent discovery of orientation-dependent superconductivity in KTaO3-based interfaces has attracted considerable interest, while the underlying origin remains an open question. Here we report a different approach to tune the interfacial electron gas and superconductivity by forming interfaces between rare-earth (RE) metals (RE being La, Ce, Eu) and KTaO3 substrates with different orientations. We found that the interfacial superconductivity is strongest for the Eu/KTaO3 interfaces, becomes weaker in La/KTaO3 and is absent in Ce/KTaO3. Using in-situ photoemission, we observed distinct valence bands associated with RE metals, as well as a pronounced orientation dependence in the interfacial electronic structure, which can be linked to the orientation-dependent superconductivity. The photoemission spectra show similar double-peak structures for the (111) and (110) oriented interfaces, with an energy separation close to the LO4 phonon of KTaO3. Detailed analyses suggest that this double-peak structure could be attributed to electron-phonon coupling, which might be important for the interfacial superconductivity.

cond-mat.supr-con↗

arXiv2025

SeqAR: Jailbreak LLMs with Sequential Auto-Generated Characters

The widespread applications of large language models (LLMs) have brought about concerns regarding their potential misuse. Although aligned with human preference data before release, LLMs remain vulnerable to various malicious attacks. In this paper, we adopt a red-teaming strategy to enhance LLM safety and introduce SeqAR, a simple yet effective framework to design jailbreak prompts automatically. The SeqAR framework generates and optimizes multiple jailbreak characters and then applies sequential jailbreak characters in a single query to bypass the guardrails of the target LLM. Different from previous work which relies on proprietary LLMs or seed jailbreak templates crafted by human expertise, SeqAR can generate and optimize the jailbreak prompt in a cold-start scenario using open-sourced LLMs without any seed jailbreak templates. Experimental results show that SeqAR achieves attack success rates of 88% and 60% in bypassing the safety alignment of GPT-3.5-1106 and GPT-4, respectively. Furthermore, we extensively evaluate the transferability of the generated templates across different LLMs and held-out malicious requests, while also exploring defense strategies against the jailbreak attack designed by SeqAR.

cs.CR↗

arXiv2025

Orbital magnetoelectric coupling of three dimensional Chern insulators

Orbital magnetoelectric effect is closely related to the band topology of bulk crystalline insulators. Typical examples include the half quantized Chern-Simons orbital magnetoelectric coupling in three dimensional (3D) axion insulators and topological insulators, which are the hallmarks of their nontrivial bulk band topology. While the Chern-Simons coupling is well defined only for insulators with zero Chern number, the orbital magnetoelectric effects in 3D Chern insulators with nonzero (layer) Chern numbers are still open questions. In this work, we propose a never-mentioned quantization rule for the orbital magnetoelectric response in 3D Chern insulators, the spatial gradient of which is exactly quantized in unit of $e^2/h$. By theoretical analysis and numerical simulations, we demonstrate that such quantized orbital magnetoelectric response is exact for various types of interlayer hoppings and stackings, and remains robust even against disorder and lack of crystalline symmetries. We argue that the exact quantization has a topological origin and is protected by Chern number. Furthermore, we propose two promising material platforms to observe the proposed quantized orbital magnetoelectric response thanks to recent experimental developments in detecting spatial magnetic-field distributions in device systems.

cond-mat.mes-hall↗

arXiv2025

Tunable Fractional Chern Insulators in Rhombohedral Graphene Superlattices

Fractional Chern insulators (FCIs) showing a transport effect with fractionally quantized Hall plateaus emerging under zero magnetic field, provide a radically new opportunity to engineer topological quantum electronics. By construction of topological flat band with moire engineering, intrinsic FCIs have been observed in twisted MoTe2 system and rhombohedral pentalayer graphene/hBN moire superlattices with anomalous Hall resistivity quantization number C <= 2/3 including the gapless composite Fermi-liquid state with C = 1/2. Here, we experimentally demonstrate a new system of rhombohedral hexalayer graphene (RHG)/hBN moire superlattices, which exhibit both integer and fractional quantum anomalous Hall effects with rich tunability including electric displacement field, perpendicular magnetic field and in-plane magnetic field. By tuning the electrical and magnetic fields at 0 < v < 1, we have observed a quantum phase transition showing a sign reversal of the Hall resistivity at finite magnetic fields. Surprisingly, the FCI state at v = 2/3 survives in the phase transitions, exhibiting a robust quantized Hall resistivity across both phases. Finally we have further demonstrated the indispensable role moire potential plays in the formation of the flat Chern band from a theoretical perspective. Our work has established RHG/hBN moire superlattices as a promising platform for exploring quasi-particles with fractional charge and non-Abelian anyons at zero magnetic field.

cond-mat.mes-hall↗