arXiv subjects

Fei Wang

Publications and source records attributed to Fei Wang.

At least 271 records · Page 15Linked to original sources

arXiv2025

PCaM: A Progressive Focus Attention-Based Information Fusion Method for Improving Vision Transformer Domain Adaptation

Unsupervised Domain Adaptation (UDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain. Recent UDA methods based on Vision Transformers (ViTs) have achieved strong performance through attention-based feature alignment. However, we identify a key limitation: foreground object mismatch, where the discrepancy in foreground object size and spatial distribution across domains weakens attention consistency and hampers effective domain alignment. To address this issue, we propose the Progressive Focus Cross-Attention Mechanism (PCaM), which progressively filters out background information during cross-attention, allowing the model to focus on and fuse discriminative foreground semantics across domains. We further introduce an attentional guidance loss that explicitly directs attention toward task-relevant regions, enhancing cross-domain attention consistency. PCaM is lightweight, architecture-agnostic, and easy to integrate into existing ViT-based UDA pipelines. Extensive experiments on Office-Home, DomainNet, VisDA-2017, and remote sensing datasets demonstrate that PCaM significantly improves adaptation performance and achieves new state-of-the-art results, validating the effectiveness of attention-guided foreground fusion for domain adaptation.

cs.LG↗

arXiv2025

BLAST: Balanced Sampling Time Series Corpus for Universal Forecasting Models

The advent of universal time series forecasting models has revolutionized zero-shot forecasting across diverse domains, yet the critical role of data diversity in training these models remains underexplored. Existing large-scale time series datasets often suffer from inherent biases and imbalanced distributions, leading to suboptimal model performance and generalization. To address this gap, we introduce BLAST, a novel pre-training corpus designed to enhance data diversity through a balanced sampling strategy. First, BLAST incorporates 321 billion observations from publicly available datasets and employs a comprehensive suite of statistical metrics to characterize time series patterns. Then, to facilitate pattern-oriented sampling, the data is implicitly clustered using grid-based partitioning. Furthermore, by integrating grid sampling and grid mixup techniques, BLAST ensures a balanced and representative coverage of diverse patterns. Experimental results demonstrate that models pre-trained on BLAST achieve state-of-the-art performance with a fraction of the computational resources and training tokens required by existing methods. Our findings highlight the pivotal role of data diversity in improving both training efficiency and model performance for the universal forecasting task.

cs.LG↗

arXiv2025

Ultra High Energy Cosmic Rays in light of the Lorentz Invariance Violation Effects within the Proton Sector

Tiny Lorentz Invariance Violation (LIV) effects, potentially arising from quantum gravity-induced spacetime structures, may also manifest in the proton sector, offering a plausible pathway to test Planck-scale physics through high-energy cosmic phenomena. Our analysis reveals that even minuscule LIV effects in the proton sector can significantly elevate the photon threshold energy for photopion production to $\cal {O}$(0.1 to $10^3$ eV), orders of magnitude higher than in Lorentz-symmetric scenarios. Consequently, protons in ultra-high-energy cosmic rays (UHECRs) can propagate for very long distances without significant energy loss via photopion interactions with cosmic microwave background (CMB) photons. This suppression of attenuation may provide a plausible explanation for the observed cosmic-ray events exceeding the Greisen-Zatsepin-Kuzmin (GZK) cutoff energy. We further demonstrate that when both leading-order and next-to-leading-order LIV effects are considered, higher-order LIV contributions induce discontinuous transitions in the GZK cutoff energy spectrum. Observations of proton-dominated UHECRs beyond the GZK threshold could provide constraints the LIV energy scale. Offering insights into the ultraviolet regime of LIV theories near the Planck scale, UHECRs may serve as a sensitive probe of LIV and provide a means to test quantum gravity predictions by constraining deviations from Lorentz symmetry in extreme-energy regimes.

hep-ph↗

arXiv2025

You Can Wash Hands Better: Accurate Daily Handwashing Assessment with a Smartwatch

Hand hygiene is among the most effective daily practices for preventing infectious diseases such as influenza, malaria, and skin infections. While professional guidelines emphasize proper handwashing to reduce the risk of viral infections, surveys reveal that adherence to these recommendations remains low. To address this gap, we propose UWash, a wearable solution leveraging smartwatches to evaluate handwashing procedures, aiming to raise awareness and cultivate high-quality handwashing habits. We frame the task of handwashing assessment as an action segmentation problem, similar to those in computer vision, and introduce a simple yet efficient two-stream UNet-like network to achieve this goal. Experiments involving 51 subjects demonstrate that UWash achieves 92.27% accuracy in handwashing gesture recognition, an error of <0.5 seconds in onset/offset detection, and an error of <5 points in gesture scoring under user-dependent settings. The system also performs robustly in user-independent and user-independent-location-independent evaluations. Remarkably, UWash maintains high performance in real-world tests, including evaluations with 10 random passersby at a hospital 9 months later and 10 passersby in an in-the-wild test conducted 2 years later. UWash is the first system to score handwashing quality based on gesture sequences, offering actionable guidance for improving daily hand hygiene. The code and dataset are publicly available at https://github.com/aiotgroup/UWash

eess.SP↗

arXiv2025

Offset Unlearning for Large Language Models

Despite the strong capabilities of Large Language Models (LLMs) to acquire knowledge from their training corpora, the memorization of sensitive information in the corpora such as copyrighted, biased, and private content has led to ethical and legal concerns. In response to these challenges, unlearning has emerged as a potential remedy for LLMs affected by problematic training data. However, previous unlearning techniques are either not applicable to black-box LLMs due to required access to model internal weights, or violate data protection principles by retaining sensitive data for inference-time correction. We propose δ-Unlearning, an offset unlearning framework for black-box LLMs. Instead of tuning the black-box LLM itself, δ-Unlearning learns the logit offset needed for unlearning by contrasting the logits from a pair of smaller models. Experiments demonstrate that δ- Unlearning can effectively unlearn target data while maintaining similar or even stronger performance on general out-of-forget-scope tasks. δ-Unlearning also effectively incorporates different unlearning algorithms, making our approach a versatile solution to adapting various existing unlearning algorithms to black-box LLMs.

cs.CL↗

arXiv2025

PrePrompt: Predictive prompting for class incremental learning

Class Incremental Learning (CIL) based on pre-trained models offers a promising direction for open-world continual learning. Existing methods typically rely on correlation-based strategies, where an image's classification feature is used as a query to retrieve the most related key prompts and select the corresponding value prompts for training. However, these approaches face an inherent limitation: fitting the entire feature space of all tasks with only a few trainable prompts is fundamentally challenging. We propose Predictive Prompting (PrePrompt), a novel CIL framework that circumvents correlation-based limitations by leveraging pre-trained models' natural classification ability to predict task-specific prompts. Specifically, PrePrompt decomposes CIL into a two-stage prediction framework: task-specific prompt prediction followed by label prediction. While theoretically appealing, this framework risks bias toward recent classes due to missing historical data for older classifier calibration. PrePrompt then mitigates this by incorporating feature translation, dynamically balancing stability and plasticity. Experiments across multiple benchmarks demonstrate PrePrompt's superiority over state-of-the-art prompt-based CIL methods. Code available at \href{github.com/libo-huang/preprompt}{github.com/libo-huang/preprompt}.

cs.CV↗

arXiv2025

Recent progress on electron- and magnon-mediated torques

The growing demand for artificial intelligence and complex computing has underscored the urgent need for advanced data storage technologies. Spin-orbit torque (SOT) has emerged as a leading candidate for high-speed, high-density magnetic random-access memory due to its ultrafast switching speed and low power consumption. This review systematically explores the generation and switching mechanisms of electron-mediated torques (including both conventional SOTs and orbital torques) and magnon-mediated torques. We discuss key materials that enable these effects: heavy metals, topological insulators, low-crystal-symmetry materials, non-collinear antiferromagnets, and altermagnets for conventional SOTs; 3d, 4d, and 5d transition metals for orbital torques; and antiferromagnetic insulator NiO- and multiferroic BiFeO3-based sandwich structures for magnon torques. We emphasize that although key components of SOT devices have been demonstrated, numerous promising materials and critical questions regarding their underlying mechanisms remain to be explored. Therefore, this field represents a dynamic and rapidly evolving frontier in spintronics, offering significant potential for advancing next-generation information storage and computational technologies.

cond-mat.mtrl-sci↗

arXiv2025

Federated Causal Inference in Healthcare: Methods, Challenges, and Applications

Federated causal inference enables multi-site treatment effect estimation without sharing individual-level data, offering a privacy-preserving solution for real-world evidence generation. However, data heterogeneity across sites, manifested in differences in covariate, treatment, and outcome, poses significant challenges for unbiased and efficient estimation. In this paper, we present a comprehensive review and theoretical analysis of federated causal effect estimation across both binary/continuous and time-to-event outcomes. We classify existing methods into weight-based strategies and optimization-based frameworks and further discuss extensions including personalized models, peer-to-peer communication, and model decomposition. For time-to-event outcomes, we examine federated Cox and Aalen-Johansen models, deriving asymptotic bias and variance under heterogeneity. Our analysis reveals that FedProx-style regularization achieves near-optimal bias-variance trade-offs compared to naive averaging and meta-analysis. We review related software tools and conclude by outlining opportunities, challenges, and future directions for scalable, fair, and trustworthy federated causal inference in distributed healthcare systems.

cs.LG↗

arXiv2025

High coherence fluxonium manufactured with a wafer-scale uniformity process

Fluxonium qubits are recognized for their high coherence times and high operation fidelities, attributed to their unique design incorporating a superinductor, which is typically implemented using an array of over 100 Josephson junctions. However, this complexity poses significant fabrication challenges, particularly in achieving high yield and junction uniformity with traditional methods. Here, we introduce an overlap process for Josephson junction fabrication that achieves nearly 100% yield and maintains uniformity across a 2-inch wafer with less than 5% variation for the phase slip junction and less than 2% for the entire junction array. We use a compact junction array design that achieves state-of-the-art dielectric loss tangents and flux noise levels, as confirmed by multiple devices. This enables fluxonium qubits to reach energy relaxation times exceeding 1 millisecond at the flux frustration point. This work paves the way for scalable high coherence fluxonium processors using CMOS-compatible processes, marking a significant step towards practical quantum computing.

quant-ph↗

arXiv2025

Talk is Not Always Cheap: Promoting Wireless Sensing Models with Text Prompts

Wireless signal-based human sensing technologies, such as WiFi, millimeter-wave (mmWave) radar, and Radio Frequency Identification (RFID), enable the detection and interpretation of human presence, posture, and activities, thereby providing critical support for applications in public security, healthcare, and smart environments. These technologies exhibit notable advantages due to their non-contact operation and environmental adaptability; however, existing systems often fail to leverage the textual information inherent in datasets. To address this, we propose an innovative text-enhanced wireless sensing framework, WiTalk, that seamlessly integrates semantic knowledge through three hierarchical prompt strategies-label-only, brief description, and detailed action description-without requiring architectural modifications or incurring additional data costs. We rigorously validate this framework across three public benchmark datasets: XRF55 for human action recognition (HAR), and WiFiTAL and XRFV2 for WiFi temporal action localization (TAL). Experimental results demonstrate significant performance improvements: on XRF55, accuracy for WiFi, RFID, and mmWave increases by 3.9%, 2.59%, and 0.46%, respectively; on WiFiTAL, the average performance of WiFiTAD improves by 4.98%; and on XRFV2, the mean average precision gains across various methods range from 4.02% to 13.68%. Our codes have been included in https://github.com/yangzhenkui/WiTalk.

cs.CV↗

arXiv2025

The effects of disorder in superconducting materials on qubit coherence

Introducing disorderness in the superconducting materials has been considered promising to enhance the electromagnetic impedance and realize noise-resilient superconducting qubits. Despite a number of pioneering implementations, the understanding of the correlation between the material disorderness and the qubit coherence is still developing. Here, we demonstrate a systematic characterization of fluxonium qubits with the superinductors made from titanium-aluminum-nitride with varied disorderness. From qubit noise spectroscopy, the flux noise and the dielectric loss are extracted as a measure of the coherence properties. Our results reveal that the $1/f$ flux noise dominates the qubit decoherence around the flux-frustration point, strongly correlated with the material disorderness; while the dielectric loss remains low under a wide range of material properties. From the flux-noise amplitudes, the areal density ($σ$) of the phenomenological spin defects and material disorderness are found to be approximately correlated by $σ\propto ρ_{xx}^3$, or effectively $(k_F l)^{-3}$. This work has provided new insights on the origin of decoherence channels within superconductors, and could serve as a useful guideline for material design and optimization.

quant-ph↗

arXiv2025

The Tenth NTIRE 2025 Image Denoising Challenge Report

This paper presents an overview of the NTIRE 2025 Image Denoising Challenge (σ = 50), highlighting the proposed methodologies and corresponding results. The primary objective is to develop a network architecture capable of achieving high-quality denoising performance, quantitatively evaluated using PSNR, without constraints on computational complexity or model size. The task assumes independent additive white Gaussian noise (AWGN) with a fixed noise level of 50. A total of 290 participants registered for the challenge, with 20 teams successfully submitting valid results, providing insights into the current state-of-the-art in image denoising.

cs.CV↗

arXiv2025

Bridging Stepwise Lab-Informed Pretraining and Knowledge-Guided Learning for Diagnostic Reasoning

Despite the growing use of Electronic Health Records (EHR) for AI-assisted diagnosis prediction, most data-driven models struggle to incorporate clinically meaningful medical knowledge. They often rely on limited ontologies, lacking structured reasoning capabilities and comprehensive coverage. This raises an important research question: Will medical knowledge improve predictive models to support stepwise clinical reasoning as performed by human doctors? To address this problem, we propose DuaLK, a dual-expertise framework that combines two complementary sources of information. For external knowledge, we construct a Diagnosis Knowledge Graph (KG) that encodes both hierarchical and semantic relations enriched by large language models (LLM). To align with patient data, we further introduce a lab-informed proxy task that guides the model to follow a clinically consistent, stepwise reasoning process based on lab test signals. Experimental results on two public EHR datasets demonstrate that DuaLK consistently outperforms existing baselines across four clinical prediction tasks. These findings highlight the potential of combining structured medical knowledge with individual-level clinical signals to achieve more accurate and interpretable diagnostic predictions. The source code is publicly available on https://github.com/humphreyhuu/DuaLK.

cs.LG↗

arXiv2025

The Tenth NTIRE 2025 Efficient Super-Resolution Challenge Report

This paper presents a comprehensive review of the NTIRE 2025 Challenge on Single-Image Efficient Super-Resolution (ESR). The challenge aimed to advance the development of deep models that optimize key computational metrics, i.e., runtime, parameters, and FLOPs, while achieving a PSNR of at least 26.90 dB on the $\operatorname{DIV2K\_LSDIR\_valid}$ dataset and 26.99 dB on the $\operatorname{DIV2K\_LSDIR\_test}$ dataset. A robust participation saw \textbf{244} registered entrants, with \textbf{43} teams submitting valid entries. This report meticulously analyzes these methods and results, emphasizing groundbreaking advancements in state-of-the-art single-image ESR techniques. The analysis highlights innovative approaches and establishes benchmarks for future research in the field.

cs.CV↗

arXiv2025

Light-field dressing of transient photo-excited states above $E_F$

Time-periodic light-field provides an emerging pathway for dynamically engineering quantum materials by forming hybrid states between photons and Bloch electrons. So far, experimental progress on light-field dressed states has been mainly focused on the occupied states, however, it is unclear if the transient photo-excited states above the Fermi energy $E_F$ can also be dressed, leaving the dynamical interplay between photo-excitation and light-field dressing elusive. Here, we provide direct experimental evidence for light-field dressing of the transient photo-excited surface states above $E_F$, which exhibits distinct dynamics with a delay response as compared to light-field dressed states below $E_F$. Our work reveals the dual roles of the pump pulse in both photo-excitation and light-field dressing, providing a more comprehensive picture with new insights on the light-induced manipulation of transient electronic states.

cond-mat.mtrl-sci↗

arXiv2025

Moiré enhanced flat band in rhombohedral graphene

The fractional quantum anomalous Hall effect (FQAHE) is a fascinating emergent quantum state characterized by fractionally charged excitations in the absence of magnetic field,which could arise from the intricate interplay between electron correlation, nontrivial topology and spontaneous time-reversal symmetry breaking. Recently, FQAHE has been realized in aligned rhombohedral pentalayer graphene on BN superlattice (aligned R5G/BN), where the topological flat band is modulated by the moiré potential. However, intriguingly, the FQAHE is observed only when electrons are pushed away from the moiré interface. The apparently opposite implications from these experimental observations, along with different theoretical models, have sparked intense debates regarding the role of the moiré potential. Unambiguous experimental observation of the topological flat band as well as moiré bands with energy and momentum resolved information is therefore critical to elucidate the underlying mechanism. Here by performing nanospot angle-resolved photoemission spectroscopy (NanoARPES) measurements, we directly reveal the topological flat band electronic structures of R5G, from which key hopping parameters essential for determining the fundamental electronic structure of rhombohedral graphene are extracted. Moreover, a comparison of electronic structures between aligned and non-aligned samples reveals that the moiré potential plays a pivotal role in enhancing the topological flat band in the aligned sample. Our study provides experimental guiding lines to narrow down the phase space of rhombohedral graphene, laying an important foundation for understanding exotic quantum phenomena in this emerging platform.

cond-mat.mes-hall↗

arXiv2025

AMMSM: Adaptive Motion Magnification and Sparse Mamba for Micro-Expression Recognition

Micro-expressions are typically regarded as unconscious manifestations of a person's genuine emotions. However, their short duration and subtle signals pose significant challenges for downstream recognition. We propose a multi-task learning framework named the Adaptive Motion Magnification and Sparse Mamba (AMMSM) to address this. This framework aims to enhance the accurate capture of micro-expressions through self-supervised subtle motion magnification, while the sparse spatial selection Mamba architecture combines sparse activation with the advanced Visual Mamba model to model key motion regions and their valuable representations more effectively. Additionally, we employ evolutionary search to optimize the magnification factor and the sparsity ratios of spatial selection, followed by fine-tuning to improve performance further. Extensive experiments on two standard datasets demonstrate that the proposed AMMSM achieves state-of-the-art (SOTA) accuracy and robustness.

cs.CV↗

arXiv2025

One Snapshot is All You Need: A Generalized Method for mmWave Signal Generation

Wireless sensing systems, particularly those using mmWave technology, offer distinct advantages over traditional vision-based approaches, such as enhanced privacy and effectiveness in poor lighting conditions. These systems, leveraging FMCW signals, have shown success in human-centric applications like localization, gesture recognition, and so on. However, comprehensive mmWave datasets for diverse applications are scarce, often constrained by pre-processed signatures (e.g., point clouds or RA heatmaps) and inconsistent annotation formats. To overcome these limitations, we propose mmGen, a novel and generalized framework tailored for full-scene mmWave signal generation. By constructing physical signal transmission models, mmGen synthesizes human-reflected and environment-reflected mmWave signals from the constructed 3D meshes. Additionally, we incorporate methods to account for material properties, antenna gains, and multipath reflections, enhancing the realism of the synthesized signals. We conduct extensive experiments using a prototype system with commercial mmWave devices and Kinect sensors. The results show that the average similarity of Range-Angle and micro-Doppler signatures between the synthesized and real-captured signals across three different environments exceeds 0.91 and 0.89, respectively, demonstrating the effectiveness and practical applicability of mmGen.

cs.CV↗