arXiv subjects

Xu Zhang

Publications and source records attributed to Xu Zhang.

At least 199 records · Page 11Linked to original sources

arXiv2025

A General Knowledge Injection Framework for ICD Coding

ICD Coding aims to assign a wide range of medical codes to a medical text document, which is a popular and challenging task in the healthcare domain. To alleviate the problems of long-tail distribution and the lack of annotations of code-specific evidence, many previous works have proposed incorporating code knowledge to improve coding performance. However, existing methods often focus on a single type of knowledge and design specialized modules that are complex and incompatible with each other, thereby limiting their scalability and effectiveness. To address this issue, we propose GKI-ICD, a novel, general knowledge injection framework that integrates three key types of knowledge, namely ICD Description, ICD Synonym, and ICD Hierarchy, without specialized design of additional modules. The comprehensive utilization of the above knowledge, which exhibits both differences and complementarity, can effectively enhance the ICD coding performance. Extensive experiments on existing popular ICD coding benchmarks demonstrate the effectiveness of GKI-ICD, which achieves the state-of-the-art performance on most evaluation metrics. Code is available at https://github.com/xuzhang0112/GKI-ICD.

cs.CL↗

arXiv2025

RSTeller: Scaling Up Visual Language Modeling in Remote Sensing with Rich Linguistic Semantics from Openly Available Data and Large Language Models

Abundant, well-annotated multimodal data in remote sensing are pivotal for aligning complex visual remote sensing (RS) scenes with human language, enabling the development of specialized vision language models across diverse RS interpretation tasks. However, annotating RS images with rich linguistic semantics at scale demands expertise in RS and substantial human labor, making it costly and often impractical. In this study, we propose a workflow that leverages large language models (LLMs) to generate multimodal datasets with semantically rich captions at scale from plain OpenStreetMap (OSM) data for images sourced from the Google Earth Engine (GEE) platform. This approach facilitates the generation of paired remote sensing data and can be readily scaled up using openly available data. Within this framework, we present RSTeller, a multimodal dataset comprising over 1.3 million RS images, each accompanied by two descriptive captions. Extensive experiments demonstrate that RSTeller enhances the performance of multiple existing vision language models for RS scene understanding through continual pre-training. Our methodology significantly reduces the manual effort and expertise needed for annotating remote sensing imagery while democratizing access to high-quality annotated data. This advancement fosters progress in visual language modeling and encourages broader participation in remote sensing research and applications. The RSTeller dataset is available at https://github.com/SlytherinGe/RSTeller.

cs.CV↗

arXiv2025

Ultra Lowrate Image Compression with Semantic Residual Coding and Compression-aware Diffusion

Existing multimodal large model-based image compression frameworks often rely on a fragmented integration of semantic retrieval, latent compression, and generative models, resulting in suboptimal performance in both reconstruction fidelity and coding efficiency. To address these challenges, we propose a residual-guided ultra lowrate image compression named ResULIC, which incorporates residual signals into both semantic retrieval and the diffusion-based generation process. Specifically, we introduce Semantic Residual Coding (SRC) to capture the semantic disparity between the original image and its compressed latent representation. A perceptual fidelity optimizer is further applied for superior reconstruction quality. Additionally, we present the Compression-aware Diffusion Model (CDM), which establishes an optimal alignment between bitrates and diffusion time steps, improving compression-reconstruction synergy. Extensive experiments demonstrate the effectiveness of ResULIC, achieving superior objective and subjective performance compared to state-of-the-art diffusion-based methods with - 80.7%, -66.3% BD-rate saving in terms of LPIPS and FID. Project page is available at https: //njuvision.github.io/ResULIC/.

cs.CV↗

arXiv2025

Angle-Tuned Gross-Neveu Quantum Criticality in Twisted Bilayer Graphene: A Quantum Monte Carlo Study

The fascinating quantum many-body states in twisted bilayber graphene (TBG) at magic angle, due to the interplay of Coulomb interactions and the quantum metrics of flat bands, have been well understood both experimentally and theoretically. However, the phase diagram and excitations as functions of twist angle and permittivity are still largely unknown. Here, via a newly developed momentum-space continuous-field quantum Monte Carlo method fully taking into account long-ranged Coulomb interactions and flat bands' quantum metrics with system sizes that were not accessible before, we show that charge-neutral TBG realizes an angle-tuned quantum phase transition from a gapped Kramers intervalley coherence (KIVC) state to a Dirac semimetal with critical angles around 1.2$°$. In single-particle spectra we demonstrate the evolution of a minimum gap at $Γ$ at the magic angle and towards touching points at Brillouin zone corners as the angle increases. The free energy and KIVC order parameter show that the transition belongs to fermionic Gross-Neveu criticality, and is robust upon varying the permittivity or the interlayer hopping.

cond-mat.str-el↗

arXiv2025

Perceive-IR: Learning to Perceive Degradation Better for All-in-One Image Restoration

Existing All-in-One image restoration methods often fail to perceive degradation types and severity levels simultaneously, overlooking the importance of fine-grained quality perception. Moreover, these methods often utilize highly customized backbones, which hinder their adaptability and integration into more advanced restoration networks. To address these limitations, we propose Perceive-IR, a novel backbone-agnostic All-in-One image restoration framework designed for fine-grained quality control across various degradation types and severity levels. Its modular structure allows core components to function independently of specific backbones, enabling seamless integration into advanced restoration models without significant modifications. Specifically, Perceive-IR operates in two key stages: 1) multi-level quality-driven prompt learning stage, where a fine-grained quality perceiver is meticulously trained to discern three tier quality levels by optimizing the alignment between prompts and images within the CLIP perception space. This stage ensures a nuanced understanding of image quality, laying the groundwork for subsequent restoration; 2) restoration stage, where the quality perceiver is seamlessly integrated with a difficulty-adaptive perceptual loss, forming a quality-aware learning strategy. This strategy not only dynamically differentiates sample learning difficulty but also achieves fine-grained quality control by driving the restored image toward the ground truth while pulling it away from both low- and medium-quality samples.

cs.CV↗

arXiv2025

Attosecond-Resolved Photoionization Dynamics and Interference-Enhanced Photoelectron Circular Dichroism in Chiral Molecules

Chiral molecules exhibit enantiosensitive light-matter interactions, with photoelectron circular dichroism (PECD) serving as a sensitive probe of molecular chirality through the asymmetry in the photoelectron wavepacket amplitude. Here, we demonstrate a photoelectron interferometric approach to access the phase of the photoelectron wavepacket and uncover attosecond dynamics in chiral molecule photoionization. Using circularly polarized attosecond XUV pulse trains synchronized with IR fields, we reveal distinct time delays between forward- and backward-ejected photoelectrons in a randomly oriented ensemble of chiral molecules. Moreover, we predict a pronounced enhancement of PECD due to the interference of the two photoionization pathways. The forward-backward time delay difference and the PECD are more prominent when the IR field counter-rotates with the XUV field. These results imply the counter-rotating IR field is more efficient in generating odd-parity photoelectron wavepackets in continuum-continuum transitions, highlighting the critical role of long-range chiral potential. Our work demonstrates a way of coherent control over the chiral photoelectron wavepackets, providing a route to enhance chiral signals and manipulate ultrafast chiral dynamics on attosecond time scales.

physics.atom-ph↗

arXiv2025

An Enriched Immersed Finite Element Method for 3D Interface Problems

We introduce an enriched immersed finite element method for addressing interface problems characterized by general non-homogeneous jump conditions. Unlike many existing unfitted mesh methods, our approach incorporates a homogenization concept. The IFE trial function set is composed of two components: the standard homogeneous IFE space and additional enrichment IFE functions. These enrichment functions are directly determined by the jump data, without adding extra degrees of freedom to the system. Meanwhile, the homogeneous IFE space is isomorphic to the standard finite element space on the same mesh. This isomorphism remains stable regardless of interface location relative to the mesh, ensuring optimal $\mathcal{O}(h^2)$ conditioning that is independent of the interface location and facilitates an immediate development of a multigrid fast solver; namely the iteration numbers are independent of not only the mesh size but also the relative interface location. Theoretical analysis and extensive numerical experiments are carried out in the efforts to demonstrate these features.

math.NA↗

arXiv2025

Unveiling the Underwater World: CLIP Perception Model-Guided Underwater Image Enhancement

High-quality underwater images are essential for both machine vision tasks and viewers with their aesthetic appeal.However, the quality of underwater images is severely affected by light absorption and scattering. Deep learning-based methods for Underwater Image Enhancement (UIE) have achieved good performance. However, these methods often overlook considering human perception and lack sufficient constraints within the solution space. Consequently, the enhanced images often suffer from diminished perceptual quality or poor content restoration.To address these issues, we propose a UIE method with a Contrastive Language-Image Pre-Training (CLIP) perception loss module and curriculum contrastive regularization. Above all, to develop a perception model for underwater images that more aligns with human visual perception, the visual semantic feature extraction capability of the CLIP model is leveraged to learn an appropriate prompt pair to map and evaluate the quality of underwater images. This CLIP perception model is then incorporated as a perception loss module into the enhancement network to improve the perceptual quality of enhanced images. Furthermore, the CLIP perception model is integrated with the curriculum contrastive regularization to enhance the constraints imposed on the enhanced images within the CLIP perceptual space, mitigating the risk of both under-enhancement and over-enhancement. Specifically, the CLIP perception model is employed to assess and categorize the learning difficulty level of negatives in the regularization process, ensuring comprehensive and nuanced utilization of distorted images and negatives with varied quality levels. Extensive experiments demonstrate that our method outperforms state-of-the-art methods in terms of visual quality and generalization ability.

cs.CV↗

arXiv2025

TVPR: Text-to-Video Person Retrieval and a New Benchmark

Most existing methods for text-based person retrieval focus on text-to-image person retrieval. Nevertheless, due to the lack of dynamic information provided by isolated frames, the performance is hampered when the person is obscured or variable motion details are missed in isolated frames. To overcome this, we propose a novel Text-to-Video Person Retrieval (TVPR) task. Since there is no dataset or benchmark that describes person videos with natural language, we construct a large-scale cross-modal person video dataset containing detailed natural language annotations, termed as Text-to-Video Person Re-identification (TVPReid) dataset. In this paper, we introduce a Multielement Feature Guided Fragments Learning (MFGF) strategy, which leverages the cross-modal text-video representations to provide strong text-visual and text-motion matching information to tackle uncertain occlusion conflicting and variable motion details. Specifically, we establish two potential cross-modal spaces for text and video feature collaborative learning to progressively reduce the semantic difference between text and video. To evaluate the effectiveness of the proposed MFGF, extensive experiments have been conducted on TVPReid dataset. To the best of our knowledge, MFGF is the first successful attempt to use video for text-based person retrieval task and has achieved state-of-the-art performance on TVPReid dataset. The TVPReid dataset will be publicly available to benefit future research.

cs.CV↗

arXiv2025

C-FAITH: A Chinese Fine-Grained Benchmark for Automated Hallucination Evaluation

Despite the rapid advancement of large language models, they remain highly susceptible to generating hallucinations, which significantly hinders their widespread application. Hallucination research requires dynamic and fine-grained evaluation. However, most existing hallucination benchmarks (especially in Chinese language) rely on human annotations, making automatical and cost-effective hallucination evaluation challenging. To address this, we introduce HaluAgent, an agentic framework that automatically constructs fine-grained QA dataset based on some knowledge documents. Our experiments demonstrate that the manually designed rules and prompt optimization can improve the quality of generated data. Using HaluAgent, we construct C-FAITH, a Chinese QA hallucination benchmark created from 1,399 knowledge documents obtained from web scraping, totaling 60,702 entries. We comprehensively evaluate 16 mainstream LLMs with our proposed C-FAITH, providing detailed experimental results and analysis.

cs.CL↗

arXiv2025

Pay More Attention to the Robustness of Prompt for Instruction Data Mining

Instruction tuning has emerged as a paramount method for tailoring the behaviors of LLMs. Recent work has unveiled the potential for LLMs to achieve high performance through fine-tuning with a limited quantity of high-quality instruction data. Building upon this approach, we further explore the impact of prompt's robustness on the selection of high-quality instruction data. This paper proposes a pioneering framework of high-quality online instruction data mining for instruction tuning, focusing on the impact of prompt's robustness on the data mining process. Our notable innovation, is to generate the adversarial instruction data by conducting the attack for the prompt of online instruction data. Then, we introduce an Adversarial Instruction-Following Difficulty metric to measure how much help the adversarial instruction data can provide to the generation of the corresponding response. Apart from it, we propose a novel Adversarial Instruction Output Embedding Consistency approach to select high-quality online instruction data. We conduct extensive experiments on two benchmark datasets to assess the performance. The experimental results serve to underscore the effectiveness of our proposed two methods. Moreover, the results underscore the critical practical significance of considering prompt's robustness.

cs.AI↗

arXiv2025

Enabling Versatile Controls for Video Diffusion Models

Despite substantial progress in text-to-video generation, achieving precise and flexible control over fine-grained spatiotemporal attributes remains a significant unresolved challenge in video generation research. To address these limitations, we introduce VCtrl (also termed PP-VCtrl), a novel framework designed to enable fine-grained control over pre-trained video diffusion models in a unified manner. VCtrl integrates diverse user-specified control signals-such as Canny edges, segmentation masks, and human keypoints-into pretrained video diffusion models via a generalizable conditional module capable of uniformly encoding multiple types of auxiliary signals without modifying the underlying generator. Additionally, we design a unified control signal encoding pipeline and a sparse residual connection mechanism to efficiently incorporate control representations. Comprehensive experiments and human evaluations demonstrate that VCtrl effectively enhances controllability and generation quality. The source code and pre-trained models are publicly available and implemented using the PaddlePaddle framework at http://github.com/PaddlePaddle/PaddleMIX/tree/develop/ppdiffusers/examples/ppvctrl.

cs.CV↗

arXiv2025

Constraints from anti-unitary symmetries on phase diagrams of sign problem-free models

A powerful way to guarantee the absence of a sign problem in determinantal quantum Monte Carlo simulations is imposing a particular type of anti-unitary symmetries. It is shown that these same symmetries give rise to constraints on correlation functions, which can be used to identify local operators whose correlations upper bound those of a large class of physically relevant operators, including for example superconducting order parameters. Our results also help understand why it is difficult to realize generic finite-momentum orders in sign problem-free models.

cond-mat.str-el↗

arXiv2025

AA-CLIP: Enhancing Zero-shot Anomaly Detection via Anomaly-Aware CLIP

Anomaly detection (AD) identifies outliers for applications like defect and lesion detection. While CLIP shows promise for zero-shot AD tasks due to its strong generalization capabilities, its inherent Anomaly-Unawareness leads to limited discrimination between normal and abnormal features. To address this problem, we propose Anomaly-Aware CLIP (AA-CLIP), which enhances CLIP's anomaly discrimination ability in both text and visual spaces while preserving its generalization capability. AA-CLIP is achieved through a straightforward yet effective two-stage approach: it first creates anomaly-aware text anchors to differentiate normal and abnormal semantics clearly, then aligns patch-level visual features with these anchors for precise anomaly localization. This two-stage strategy, with the help of residual adapters, gradually adapts CLIP in a controlled manner, achieving effective AD while maintaining CLIP's class knowledge. Extensive experiments validate AA-CLIP as a resource-efficient solution for zero-shot AD tasks, achieving state-of-the-art results in industrial and medical applications. The code is available at https://github.com/Mwxinnn/AA-CLIP.

cs.CV↗

arXiv2025

Symplectic tracking through curved three dimensional fields by a method of generating functions

Symplectic integrator plays a pivotal role in the long-term tracking of charged particles within accelerators. To get symplectic maps in accurate simulation of single-particle trajectories, two key components are addressed: precise analytical expressions for arbitrary electromagnetic fields and a robust treatment of the equations of motion. In a source-free region, the electromagnetic fields can be decomposed into harmonic functions, applicable to both scalar and vector potentials, encompassing both straight and curved reference trajectories. These harmonics are constructed according to the boundary surface's field data due to uniqueness theorem. Finding generating functions to meet the Hamilton-Jacobi equation via a perturbative ansatz, we derive symplectic maps that are independent of the expansion order. This method yields a direct mapping from initial to final coordinates in a large step, bypassing the transition of intermediate coordinates. Our developed particle-tracking algorithm translates the field harmonics into beam trajectories, offering a high-resolution integration method in accelerator simulations.

physics.acc-ph↗

arXiv2025

Streamer-like red line diffuse auroras driven by time domain structures and ECH waves associated with a plasma injection and braking ion flows

Auroral streamers are important meso-scale processes of dynamic magnetosphere-ionosphere coupling, typically studied using imagers sensitive to energetic (>1 keV) electron precipitation, such as all-sky imagers (ASIs). This paper reports streamer-like red-line auroras, representing low-energy (<1 keV) precipitation, observed poleward of a black aurora and an auroral torch. These red-line auroras were associated with a magnetospheric electron injection and braking ion flows. Observations were made using the THEMIS spacecraft and ground-based imagers, including the ASI, REGO, and meridian scanning photometer (MSP) at Fort Smith. We identify plasma sheet electron pitch-angle scattering by time-domain structures (TDSs) and electron cyclotron harmonics (ECH) waves as the driver of these red-line auroras, because of (1) a strong correlation (~0.9) between observed red-line intensities and precipitating fluxes; (2) consistent red-line intensities from auroral transport code forward modeling, and (3) consistent precipitation characteristic energies from MSP optical inference and quasi-linear estimates.

physics.space-ph↗

arXiv2025

Magnetic Bloch States at Integer Flux Quanta Induced by Super-moiré Potential in Graphene Aligned with Twisted Boron Nitride

Two-dimensional electron systems in both magnetic fields and periodic potentials are described by Hofstadter butterfly, a fundamental problem of solid-state physics. While moiré systems provide a powerful method to realize this spectrum, previous experiments, however, have been limited to fractional flux quanta regime due to the difficulty of building ~ 50 nm periodic modulations. Here, we demonstrate a super-moiré strategy to overcome this challenge. By aligning monolayer graphene (G) with 1.0° twisted hexagonal boron nitride (t-hBN), a 63.2 nm bichromatic G/t-hBN super-moiré is constructed, made possible by exploiting the electrostatic nature of t-hBN potential. Under magnetic field B, magnetic Bloch states at integer flux quanta (1-9) are achieved and observed as integer Brown-Zak oscillations, expanding the flux quanta from factions to integers. Theoretical analysis reproduces these experimental findings. This work opens new avenues to study unexplored Hofstadter butterfly, explore emergent topological order at integer flux quanta and engineer long-wavelength periodic modulations.

cond-mat.mes-hall↗

arXiv2025

Characterization and Optimization of Tunable Couplers via Adiabatic Control in Superconducting Circuits

In the pursuit of scalable superconducting quantum computing, tunable couplers have emerged as a pivotal component, offering the flexibility required for complex quantum operations of high performance. In most current architectures of superconducting quantum chips, such couplers are not equipped with dedicated readout circuits to reduce complexity in both design and operation. However, this strategy poses challenges in precise characterization, calibration, and control of the couplers. In this work, we develop a hardware-efficient and robust technique based on adiabatic control to address the above issue. The critical ingredient of this technique is adiabatic swap (aSWAP) operation between a tunable coupler and nearby qubits. Using this technique, we have characterized and calibrated tunable couplers in our chips and achieved straightforward and precise control over these couplers. For example, we have demonstrated the calibration and correction of the flux distortion of couplers. In addition, we have also expanded this technique to tune the dispersive shift between a frequency-fixed qubit and its readout resonator over a wide range.

quant-ph↗