arXiv Science⌕ Search

arXiv subjects

Xiao Wang

Publications and source records attributed to Xiao Wang.

At least 217 records · Page 12Linked to original sources
arXiv2025

Unsupervised Motion-Compensated Decomposition for Cardiac MRI Reconstruction via Neural Representation

Cardiac magnetic resonance (CMR) imaging is widely used to characterize cardiac morphology and function. To accelerate CMR imaging, various methods have been proposed to recover high-quality spatiotemporal CMR images from highly undersampled k-t space data. However, current CMR reconstruction techniques either fail to achieve satisfactory image quality or are restricted by the scarcity of ground truth data, leading to limited applicability in clinical scenarios. In this work, we proposed MoCo-INR, a new unsupervised method that integrates implicit neural representations (INR) with the conventional motion-compensated (MoCo) framework. Using explicit motion modeling and the continuous prior of INRs, MoCo-INR can produce accurate cardiac motion decomposition and high-quality CMR reconstruction. Furthermore, we introduce a new INR network architecture tailored to the CMR problem, which significantly stabilizes model optimization. Experiments on retrospective (simulated) datasets demonstrate the superiority of MoCo-INR over state-of-the-art methods, achieving fast convergence and fine-detailed reconstructions at ultra-high acceleration factors (e.g., 20x in VISTA sampling). Additionally, evaluations on prospective (real-acquired) free-breathing CMR scans highlight the clinical practicality of MoCo-INR for real-time imaging. Several ablation studies further confirm the effectiveness of the critical components of MoCo-INR.

eess.IV↗
arXiv2025

Numerical renormalization group integrated Hamiltonian truncation: Toward generic deformation of integrable lattice models

We present a hybrid lattice Hamiltonian truncation method that integrates the numerical renormalization group (NRG) with a truncated lattice integrable spectrum. The technique is tailored for generic deformations of integrable lattice models, where the NRG enables a controlled incorporation of high-energy states. The method extends the basis set more effectively and efficiently than brute-force truncation, meanwhile significantly reducing errors. We show its capability on two paradigmatic models: an Ising chain in a magnetic field and a quantum Ising ladder. The resulting dynamical structure factors accurately capture the essential low-energy physics, including the $E_8$ and $\mathcal{D}_8^{(1)}$ excitations of the former and later models, respectively, demonstrating the approach's computational efficiency and high performance.

cond-mat.str-el↗
arXiv2025

Self-Supervised Visual Prompting for Cross-Domain Road Damage Detection

The deployment of automated pavement defect detection is often hindered by poor cross-domain generalization. Supervised detectors achieve strong in-domain accuracy but require costly re-annotation for new environments, while standard self-supervised methods capture generic features and remain vulnerable to domain shift. We propose \ours, a self-supervised framework that \emph{visually probes} target domains without labels. \ours introduces a Self-supervised Prompt Enhancement Module (SPEM), which derives defect-aware prompts from unlabeled target data to guide a frozen ViT backbone, and a Domain-Aware Prompt Alignment (DAPA) objective, which aligns prompt-conditioned source and target representations. Experiments on four challenging benchmarks show that \ours consistently outperforms strong supervised, self-supervised, and adaptation baselines, achieving robust zero-shot transfer, improved resilience to domain variations, and high data efficiency in few-shot adaptation. These results highlight self-supervised prompting as a practical direction for building scalable and adaptive visual inspection systems. Source code is publicly available: https://github.com/xixiaouab/PROBE/tree/main

cs.CV↗
arXiv2025

Foundation Model in Biomedicine

Foundation models, first introduced in 2021, refer to large-scale pretrained models (e.g., large language models (LLMs) and vision-language models (VLMs)) that learn from extensive unlabeled datasets through unsupervised methods, enabling them to excel in diverse downstream tasks. These models, like GPT, can be adapted to various applications such as question answering and visual understanding, outperforming task-specific AI models and earning their name due to broad applicability across fields. The development of biomedical foundation models marks a significant milestone in the use of artificial intelligence (AI) to understand complex biological phenomena and advance medical research and practice. This survey explores the potential of foundation models in diverse domains within biomedical fields, including computational biology, drug discovery and development, clinical informatics, medical imaging, and public health. The purpose of this survey is to inspire ongoing research in the application of foundation models to health science.

cs.LG↗
arXiv2025

CAD-VAE: Leveraging Correlation-Aware Latents for Comprehensive Fair Disentanglement

While deep generative models have significantly advanced representation learning, they may inherit or amplify biases and fairness issues by encoding sensitive attributes alongside predictive features. Enforcing strict independence in disentanglement is often unrealistic when target and sensitive factors are naturally correlated. To address this challenge, we propose \textbf{CAD-VAE} (\textbf{C}orrelation-\textbf{A}ware \textbf{D}isentangled \textbf{VAE}), which introduces a correlated latent code to capture the information shared between the target and sensitive attributes. Given this correlated latent, our method effectively separates overlapping factors without extra domain knowledge by directly minimizing the conditional mutual information between target and sensitive codes. A relevance-driven optimization strategy refines the correlated code by efficiently capturing essential correlated features and eliminating redundancy. Extensive experiments on benchmark datasets demonstrate that CAD-VAE produces fairer representations, realistic counterfactuals, and improved fairness-aware image editing. Source code is available : https://github.com/merry7cherry/CAD-VAE

cs.LG↗
arXiv2025

Learning Straight Flows: Variational Flow Matching for Efficient Generation

Flow Matching has limited ability in achieving one-step generation due to its reliance on learned curved trajectories. Previous studies have attempted to address this limitation by either modifying the coupling distribution to prevent interpolant intersections or introducing consistency and mean-velocity modeling to promote straight trajectory learning. However, these approaches often suffer from discrete approximation errors, training instability, and convergence difficulties. To tackle these issues, in the present work, we propose \textbf{S}traight \textbf{V}ariational \textbf{F}low \textbf{M}atching (\textbf{S-VFM}), which integrates a variational latent code representing the ``generation overview'' into the Flow Matching framework. \textbf{S-VFM} explicitly enforces trajectory straightness, ideally producing linear generation paths. The proposed method achieves competitive performance across three challenge benchmarks and demonstrates advantages in both training and inference efficiency compared with existing methods.

cs.LG↗
arXiv2025

Fundamentals of cubic skein modules

Over the past thirty-seven years, the study of linear and quadratic skein modules has produced a rich and far-reaching skein theory, intricately connected to diverse areas of mathematics and physics, including algebraic geometry, hyperbolic geometry, topological quantum field theories, and statistical mechanics. However, despite these advances, skein modules of higher degree-those depending on more parameters than the linear and quadratic cases-have received comparatively little attention, with only a few isolated explorations appearing in the literature. In this article, we undertake a systematic study of the cubic skein module, the first representative of this broader class. We begin by investigating its structure and properties in the $3$-sphere, and then extend the analysis to arbitrary $3$-manifolds. The results presented here aim to establish a foundational framework for the study of higher skein modules, thereby extending the scope of skein theory beyond its classical domains. Furthermore, studying the structure of cubic skein modules may lead to new polynomial invariants of knots.

math.GT↗
arXiv2025

Berry connection and quantum geometry in time-dependent systems with instantaneous quantum integrable field theory

We study many-body quantum geometric effects in time-dependent system with emergent quantum integrable field theory instantaneously. We establish a theorem stating that the Berry connection matrix thus all associated geometric quantities of the system can be precisely characterized by excitations up to two particles from the initial quantum integrable system. To illustrate the many-body geometric influence, we analyze an Ising chain subjected to both a small longitudinal field and a slowly rotating transverse field, whose low-energy physics in the scaling limit is instantaneously governed by the quantum $E_8$ integrable field theory. Focusing on the quantum geometric potential (QGP), we show the QGP continuously suppresses the instantaneous energy gaps with decreasing longitudinal field, thereby enhancing many-body Landau-Zener tunneling as evidenced by the Loschmidt echo and its associated spectral entropy. The critical threshold for the longitudinal field strength is determined,where the spectral entropy linearly increases with system size and exhibits hyperscaling behavior when approaching to the threshold. As the longitudinal field passes the threshold and decreases toward zero, the QGP continuously leads to vanishing instantaneous energy gaps involving more low-energy excitations, resulting in increasing spectral entropy indicative of many-body Landau-Zener tunneling. Our results unveil telltale quantum geometric signatures in time-dependent many-body systems, elucidating the intricate interplay between quantum geometry and dynamics.

cond-mat.str-el↗
arXiv2025

DeepAndes: A Self-Supervised Vision Foundation Model for Multi-Spectral Remote Sensing Imagery of the Andes

By mapping sites at large scales using remotely sensed data, archaeologists can generate unique insights into long-term demographic trends, inter-regional social networks, and past adaptations to climate change. Remote sensing surveys complement field-based approaches, and their reach can be especially great when combined with deep learning and computer vision techniques. However, conventional supervised deep learning methods face challenges in annotating fine-grained archaeological features at scale. While recent vision foundation models have shown remarkable success in learning large-scale remote sensing data with minimal annotations, most off-the-shelf solutions are designed for RGB images rather than multi-spectral satellite imagery, such as the 8-band data used in our study. In this paper, we introduce DeepAndes, a transformer-based vision foundation model trained on three million multi-spectral satellite images, specifically tailored for Andean archaeology. DeepAndes incorporates a customized DINOv2 self-supervised learning algorithm optimized for 8-band multi-spectral imagery, marking the first foundation model designed explicitly for the Andes region. We evaluate its image understanding performance through imbalanced image classification, image instance retrieval, and pixel-level semantic segmentation tasks. Our experiments show that DeepAndes achieves superior F1 scores, mean average precision, and Dice scores in few-shot learning scenarios, significantly outperforming models trained from scratch or pre-trained on smaller datasets. This underscores the effectiveness of large-scale self-supervised pre-training in archaeological remote sensing. Codes will be available on https://github.com/geopacha/DeepAndes.

cs.CV↗
arXiv2025

When Person Re-Identification Meets Event Camera: A Benchmark Dataset and An Attribute-guided Re-Identification Framework

Recent researchers have proposed using event cameras for person re-identification (ReID) due to their promising performance and better balance in terms of privacy protection, event camera-based person ReID has attracted significant attention. Currently, mainstream event-based person ReID algorithms primarily focus on fusing visible light and event stream, as well as preserving privacy. Although significant progress has been made, these methods are typically trained and evaluated on small-scale or simulated event camera datasets, making it difficult to assess their real identification performance and generalization ability. To address the issue of data scarcity, this paper introduces a large-scale RGB-event based person ReID dataset, called EvReID. The dataset contains 118,988 image pairs and covers 1200 pedestrian identities, with data collected across multiple seasons, scenes, and lighting conditions. We also evaluate 15 state-of-the-art person ReID algorithms, laying a solid foundation for future research in terms of both data and benchmarking. Based on our newly constructed dataset, this paper further proposes a pedestrian attribute-guided contrastive learning framework to enhance feature learning for person re-identification, termed TriPro-ReID. This framework not only effectively explores the visual features from both RGB frames and event streams, but also fully utilizes pedestrian attributes as mid-level semantic features. Extensive experiments on the EvReID dataset and MARS datasets fully validated the effectiveness of our proposed RGB-Event person ReID framework. The benchmark dataset and source code will be released on https://github.com/Event-AHU/Neuromorphic_ReID

cs.CV↗
arXiv2025

Adaptive directional decomposition methods for nonconvex constrained optimization

In this paper, we study nonconvex constrained optimization problems with both equality and inequality constraints, covering deterministic and stochastic settings. We propose a novel first-order algorithm framework that employs a decomposition strategy to balance objective reduction and constraint satisfaction, together with adaptive update of stepsizes and merit parameters. Under certain conditions, the proposed adaptive directional decomposition methods attain an iteration complexity of order \(O(ε^{-2})\) for finding an \(ε\)-KKT point in the deterministic setting. In the stochastic setting, we further develop stochastic variants of approaches and analyze their theoretical properties by leveraging the perturbation theory. We establish the high-probability oracle complexity to find an $ε$-KKT point of order \( \tilde O(ε^{-4}, ε^{-6}) \) (resp. \(\tilde O(ε^{-3}, ε^{-5}) \)) for gradient and constraint evaluations, in the absence (resp. presence) of sample-wise smoothness. To the best of our knowledge, the obtained complexity bounds are comparable to, or improve upon, the state-of-the-art results in the literature.

math.OC↗
arXiv2025

Unifying and Enhancing Graph Transformers via a Hierarchical Mask Framework

Graph Transformers (GTs) have emerged as a powerful paradigm for graph representation learning due to their ability to model diverse node interactions. However, existing GTs often rely on intricate architectural designs tailored to specific interactions, limiting their flexibility. To address this, we propose a unified hierarchical mask framework that reveals an underlying equivalence between model architecture and attention mask construction. This framework enables a consistent modeling paradigm by capturing diverse interactions through carefully designed attention masks. Theoretical analysis under this framework demonstrates that the probability of correct classification positively correlates with the receptive field size and label consistency, leading to a fundamental design principle: an effective attention mask should ensure both a sufficiently large receptive field and a high level of label consistency. While no single existing mask satisfies this principle across all scenarios, our analysis reveals that hierarchical masks offer complementary strengths, motivating their effective integration. Then, we introduce M3Dphormer, a Mixture-of-Experts-based Graph Transformer with Multi-Level Masking and Dual Attention Computation. M3Dphormer incorporates three theoretically grounded hierarchical masks and employs a bi-level expert routing mechanism to adaptively integrate multi-level interaction information. To ensure scalability, we further introduce a dual attention computation scheme that dynamically switches between dense and sparse modes based on local mask sparsity. Extensive experiments across multiple benchmarks demonstrate that M3Dphormer achieves state-of-the-art performance, validating the effectiveness of our unified framework and model design.

cs.CV↗
arXiv2025

EMRRG: Efficient Fine-Tuning Pre-trained X-ray Mamba Networks for Radiology Report Generation

X-ray image-based medical report generation (MRG) is a pivotal area in artificial intelligence that can significantly reduce diagnostic burdens for clinicians and patient wait times. Existing MRG models predominantly rely on Large Language Models (LLMs) to improve report generation, with limited exploration of pre-trained vision foundation models or advanced fine-tuning techniques. Mainstream frameworks either avoid fine-tuning or utilize simplistic methods like LoRA, often neglecting the potential of enhancing cross-attention mechanisms. Additionally, while Transformer-based models dominate vision-language tasks, non-Transformer architectures, such as the Mamba network, remain underexplored for medical report generation, presenting a promising avenue for future research. In this paper, we propose EMRRG, a novel X-ray report generation framework that fine-tunes pre-trained Mamba networks using parameter-efficient methods. Specifically, X-ray images are divided into patches, tokenized, and processed by an SSM-based vision backbone for feature extraction, with Partial LoRA yielding optimal performance. An LLM with a hybrid decoder generates the medical report, enabling end-to-end training and achieving strong results on benchmark datasets. Extensive experiments on three widely used benchmark datasets fully validated the effectiveness of our proposed strategies for the X-ray MRG. The source code of this paper will be released on https://github.com/Event-AHU/Medical_Image_Analysis.

cs.CV↗
arXiv2025

AngularFuse: A Closer Look at Angle-based Perception for Spatial-Sensitive Multi-Modality Image Fusion

Visible-infrared image fusion is crucial in key applications such as autonomous driving and nighttime surveillance. Its main goal is to integrate multimodal information to produce enhanced images that are better suited for downstream tasks. Although deep learning based fusion methods have made significant progress, mainstream unsupervised approaches still face serious challenges in practical applications. Existing methods mostly rely on manually designed loss functions to guide the fusion process. However, these loss functions have obvious limitations. On one hand, the reference images constructed by existing methods often lack details and have uneven brightness. On the other hand, the widely used gradient losses focus only on gradient magnitude. To address these challenges, this paper proposes an angle-based perception framework for spatial-sensitive image fusion (AngularFuse). At first, we design a cross-modal complementary mask module to force the network to learn complementary information between modalities. Then, a fine-grained reference image synthesis strategy is introduced. By combining Laplacian edge enhancement with adaptive histogram equalization, reference images with richer details and more balanced brightness are generated. Last but not least, we introduce an angle-aware loss, which for the first time constrains both gradient magnitude and direction simultaneously in the gradient domain. AngularFuse ensures that the fused images preserve both texture intensity and correct edge orientation. Comprehensive experiments on the MSRS, RoadScene, and M3FD public datasets show that AngularFuse outperforms existing mainstream methods with clear margin. Visual comparisons further confirm that our method produces sharper and more detailed results in challenging scenes, demonstrating superior fusion capability.

cs.CV↗
arXiv2025

Semiclassical analytical solutions of the eigenstate thermalization hypothesis in a quantum billiard

We derive semiclassical analytical solutions for both the diagonal and off-diagonal functions in the eigenstate thermalization hypothesis (ETH) in a quarter-stadium quantum billiard. For a representative observable, we obtain an explicit expression and an asymptotic closed-form solution that naturally separate into a local contribution and a phase-space correlation term. These analytical results predict the band structure of the observable matrix, including its bandwidth and scaling behavior. We further demonstrate that our analytical formula is equivalent to the prediction of Berry's conjecture. Supported by numerical evidence, we show that Berry's conjecture captures the energetic long-wavelength behavior in the space of eigenstates, while our analytical solution describes the asymptotic behavior of the f function in the semiclassical limit. Finally, by revealing the connection between the bandwidth scaling and the underlying classical dynamics, our results suggest that the ETH carries important physical implications in single-particle and few-body systems, where "thermalization" manifests as the loss of information about initial conditions.

quant-ph↗
arXiv2025

Scrutinizing the impact of the solar modulation on AMS-02 antiproton excess

This study examines the impact of solar modulation on the antiproton excess observed by AMS-02, which may indicate dark matter (DM) annihilation. We analyze three solar modulation models: the force-field approximation (FFA), a time-, charge-, and rigidity-dependent FFA, and a three-dimensional numerical simulation based on the Parker transport equation. Based on AMS-02 latest antiproton data (2025), our results show that the significance of the DM signal is sensitive to the chosen modulation model, with a 2$σ$ signal for the FFA (4$σ$ if including data from H, He, C, O, B/C, and B/O) and a reduced significance for more complex models. We also address systematic uncertainties using two methods: the add-in-quadrature method, which assumes uncorrelated uncertainties between energy bins, and the nuisance parameter method, which treats systematic uncertainties as nuisance parameters during the fitting process. Fitted to AMS-02 antiproton data, DM annihilation to the $b\bar{b}$ scenario with three different solar modulation models shows that the add-in-quadrature method causes overfitting, whereas the nuisance parameters approach leads to underfitting. Statistically, the signal region of the FFA model using the add-in-quadrature method is the most reliable. This work highlights the need for refined solar modulation models and a better treatment of uncertainties for a conclusive interpretation of the AMS-02 data.

astro-ph.CO↗
arXiv2025

CTR-LoRA: Curvature-Aware and Trust-Region Guided Low-Rank Adaptation for Large Language Models

Parameter-efficient fine-tuning (PEFT) has become the standard approach for adapting large language models under limited compute and memory budgets. Although previous methods improve efficiency through low-rank updates, quantization, or heuristic budget reallocation, they often decouple the allocation of capacity from the way updates evolve during training. In this work, we introduce CTR-LoRA, a framework guided by curvature trust region that integrates rank scheduling with stability-aware optimization. CTR-LoRA allocates parameters based on marginal utility derived from lightweight second-order proxies and constrains updates using a Fisher/Hessian-metric trust region. Experiments on multiple open-source backbones (7B-13B), evaluated on both in-distribution and out-of-distribution benchmarks, show consistent improvements over strong PEFT baselines. In addition to increased accuracy, CTR-LoRA enhances training stability, reduces memory requirements, and achieves higher throughput, positioning it on the Pareto frontier of performance and efficiency. These results highlight a principled path toward more robust and deployable PEFT.

cs.LG↗