arXiv subjects

Fei Wang

Publications and source records attributed to Fei Wang.

At least 199 records · Page 11Linked to original sources

arXiv2025

HUTFormer: Hierarchical U-Net Transformer for Long-Term Traffic Forecasting

Traffic forecasting, which aims to predict traffic conditions based on historical observations, has been an enduring research topic and is widely recognized as an essential component of intelligent transportation. Recent proposals on Spatial-Temporal Graph Neural Networks~(STGNNs) have made significant progress by combining sequential models with graph convolution networks. However, due to high complexity issues, STGNNs only focus on short-term traffic forecasting (e.g., 1-h ahead), while ignoring more practical long-term forecasting. In this paper, we make the first attempt to explore long-term traffic forecasting (e.g., 1-day ahead). To this end, we first reveal its unique challenges in exploiting multi-scale representations. Then, we propose a novel Hierarchical U-Net TransFormer~(HUTFormer) to address the issues of long-term traffic forecasting. HUTFormer consists of a hierarchical encoder and decoder to jointly generate and utilize multi-scale representations of traffic data. Specifically, for the encoder, we {\color{black}propose} window self-attention and segment merging to extract multi-scale representations from long-term traffic data. For the decoder, we design a cross-scale attention mechanism to effectively incorporate multi-scale representations. In addition, HUTFormer employs an efficient input embedding strategy to address the complexity issues. Extensive experiments on four traffic datasets show that the proposed HUTFormer significantly outperforms state-of-the-art traffic forecasting and long time series forecasting baselines.

cs.LG↗

arXiv2025

Unbiased Visual Reasoning with Controlled Visual Inputs

End-to-end Vision-language Models (VLMs) often answer visual questions by exploiting spurious correlations instead of causal visual evidence, and can become more shortcut-prone when fine-tuned. We introduce VISTA (Visual-Information Separation for Text-based Analysis), a modular framework that decouples perception from reasoning via an explicit information bottleneck. A frozen VLM sensor is restricted to short, objective perception queries, while a text-only LLM reasoner decomposes each question, plans queries, and aggregates visual facts in natural language. This controlled interface defines a reward-aligned environment for training unbiased visual reasoning with reinforcement learning. Instantiated with Qwen2.5-VL and Llama3.2-Vision sensors, and trained with GRPO from only 641 curated multi-step questions, VISTA significantly improves robustness to real-world spurious correlations on SpuriVerse (+16.29% with Qwen-2.5-VL-7B and +6.77% with Llama-3.2-Vision-11B), while remaining competitive on MMVP and a balanced SeedBench subset. VISTA transfers robustly across unseen VLM sensors and is able to recognize and recover from VLM perception failures. Human analysis further shows that VISTA's reasoning traces are more neutral, less reliant on spurious attributes, and more explicitly grounded in visual evidence than end-to-end VLM baselines.

cs.CV↗

arXiv2025

Moiré-modulated $Γ$ valley in twisted bilayer and twisted double-bilayer MoTe$_2$

Twisted MoTe$_2$ hosts intriguing correlated quantum phenomena including the fractional quantum anomalous Hall effect in twisted bilayer (t-BL) MoTe$_2$ near 3.7$^\circ$, which is sensitive to the twist angle and moiré superlattices. Here, we directly visualize the twist-angle-modulated electronic structure of t-BL and twisted double-bilayer (t-DBL) near this critical angle. We find that the moiré superlattice not only modifies the relative energy between $Γ$ and K valleys in t-BL MoTe$_2$, but also strongly reconstructs the $Γ$ valley for both t-BL and t-DBL. Specifically, the deep $p_z$-derived band at $Γ$ exhibits a distinct splitting that systematically varies with increasing twist angle. Theoretical analysis suggests that this modulation arises from the twist-angle-dependent lattice relaxation, especially interfacial corrugations. Our work directly visualizes the moiré-modulated electronic structure and provides key spectroscopic information of lattice relaxation and interlayer interactions underlying the physics of twisted MoTe$_2$.

cond-mat.str-el↗

arXiv2025

SMART: Semantic Matching Contrastive Learning for Partially View-Aligned Clustering

Multi-view clustering has been empirically shown to improve learning performance by leveraging the inherent complementary information across multiple views of data. However, in real-world scenarios, collecting strictly aligned views is challenging, and learning from both aligned and unaligned data becomes a more practical solution. Partially View-aligned Clustering aims to learn correspondences between misaligned view samples to better exploit the potential consistency and complementarity across views, including both aligned and unaligned data. However, most existing PVC methods fail to leverage unaligned data to capture the shared semantics among samples from the same cluster. Moreover, the inherent heterogeneity of multi-view data induces distributional shifts in representations, leading to inaccuracies in establishing meaningful correspondences between cross-view latent features and, consequently, impairing learning effectiveness. To address these challenges, we propose a Semantic MAtching contRasTive learning model (SMART) for PVC. The main idea of our approach is to alleviate the influence of cross-view distributional shifts, thereby facilitating semantic matching contrastive learning to fully exploit semantic relationships in both aligned and unaligned data. Extensive experiments on eight benchmark datasets demonstrate that our method consistently outperforms existing approaches on the PVC problem.

cs.CV↗

arXiv2025

The Lepton Flavor Changing Decays and One-loop Muon Anomalous Magnetic Moment in the Extended Mirror Twin Higgs Models

Mirror Twin Higgs(MTH) models always contain heavy gauge bosons and extra Higgses. Besides, to accommodate tiny neutrino masses via seesaw mechanism, new heavy neutrinos can also be introduced in MTH extension models. Such new particles and interactions may lead to new contributions to the lepton flavor violating (LFV) processes, including $\ell_i \to \ell_jγ$ and $\ell_i \to \ell_j\ell_k\ell_l$. We find that current experimental data can stringently constrain the parameter spaces and certain LFV processes can possibly be tested by the next generation colliders. One-loop contributions of the new particles to the muon anomalous magnetic momentumare also calculated. Such contributions can still not solve the discrepancy between the experiments and the prediction of the standard model.

hep-ph↗

arXiv2025

On the use of polarized thermal emission to constrain cloud grain size and temperature structure of sub-stellar objects

Emission spectroscopy is an invaluable tool for probing the atmospheres of brown dwarfs and exoplanets, but interpretations based on flux spectra alone often suffer from degeneracies among temperature structure, chemical composition, and cloud properties. Thermal emission spectropolarimetry offers complementary sensitivity to these atmospheric characteristics. Previous studies have shown that linear polarization in fixed bandpasses depends on emission angle, temperature profile, and cloud scattering. In this study, we revisit these dependencies, emphasizing the wavelength-dependent effects that shape polarized spectra. We show that thermal polarization spectrum is primarily governed by: (1) a combination of temperature, temperature gradient, and wavelength; (2) cloud particle size; and (3) cloud optical thickness. Using the 3D Monte Carlo radiative transfer code ARTES, we simulate polarization spectra from a modeled 1D atmosphere. We find that, for a fixed cloud optical thickness, the polarization exhibits peaks at size parameters near 0.2 and 1. However, the dependence on cloud optical thickness is more pronounced and tends to dominate the broadband polarization. We further show that much narrower polarization features in molecular absorption band, can in principle trace the local temperature gradient at the photosphere of each wavelength. Future low-resolution (resolving power around 100) spectropolarimeter operating at 1-2 micron with sensitivities of 1e-5 would be able to capture these polarization features, and may provide a new diagnostic for breaking degeneracies that commonly affect flux-only retrievals. This work represents an incremental step toward the challenging goal of jointly interpreting atmosphere from both intensity and polarization spectra.

astro-ph.EP↗

arXiv2025

Natural solution of SUSY $μ$ problem from modulus stabilization in modular flavor model

We propose a solution to the SUSY $μ$-problem within the framework of modular flavor symmetry. The explicit $μ$-term is prohibited by modular symmetry, and an effective $μ$-term is regenerated following the stabilization of the modulus field. We examine the stabilization mechanism of a single modulus field with the presence of SUSY breaking contributions described by the non-linear SUSY realization scheme involving a nilpotent Goldstino $\textbf{X}_{nl}$ superfield. A natural small $μ_{eff}$, significantly smaller than the SUSY scale, can result from either the expansion of typical modular forms using a small deviation parameter near the fixed point $ω$, or from the combined effects of suppression by powers of $q^{1/24}$ [or $(2\Imτ)^{-1}$] along with the asymptotic suppression behavior of typical modular forms away from the fixed point $i\infty$, taking the form of appropriate power of the tiny deviation parameter. A natural small $μ_{eff}$ can also be achieved by a weighton-like mechanism for $H_uH_d$ bilinear.

hep-ph↗

arXiv2025

Neural Ranging Inertial Odometry

Ultra-wideband (UWB) has shown promising potential in GPS-denied localization thanks to its lightweight and drift-free characteristics, while the accuracy is limited in real scenarios due to its sensitivity to sensor arrangement and non-Gaussian pattern induced by multi-path or multi-signal interference, which commonly occurs in many typical applications like long tunnels. We introduce a novel neural fusion framework for ranging inertial odometry which involves a graph attention UWB network and a recurrent neural inertial network. Our graph net learns scene-relevant ranging patterns and adapts to any number of anchors or tags, realizing accurate positioning without calibration. Additionally, the integration of least squares and the incorporation of nominal frame enhance overall performance and scalability. The effectiveness and robustness of our methods are validated through extensive experiments on both public and self-collected datasets, spanning indoor, outdoor, and tunnel environments. The results demonstrate the superiority of our proposed IR-ULSG in handling challenging conditions, including scenarios outside the convex envelope and cases where only a single anchor is available.

cs.RO↗

arXiv2025

Beyond the Clinic: A Large-Scale Evaluation of Augmenting EHR with Wearable Data for Diverse Health Prediction

Electronic health records (EHRs) provide a powerful basis for predicting the onset of health outcomes. Yet EHRs primarily capture in-clinic events and miss aspects of daily behavior and lifestyle containing rich health information. Consumer wearables, by contrast, continuously measure activity, heart rate, and sleep, and more, offering complementary signals that can fill this gap. Despite this potential, there has been little systematic evaluation of the benefit that wearable data can bring to health outcome prediction on top of EHRs. In this study, we present an extensible framework for multimodal health outcome prediction that integrates EHR and wearable data streams. Using data from the All of Us Program, we systematically compared the combination of different encoding methods on EHR and wearable data, including the traditional feature engineering approach, as well as foundation model embeddings. Across ten clinical outcomes, wearable integration consistently improved model performance relative to EHR-only baselines, e.g., average delta AUROC +6.8% for major depressive disorder, +9.7% for hypertension, and +12.6% for diabetes. On average across all ten outcomes, fusing EHRs with wearable features shows 8.5% improvement in AUROC. To our knowledge, this is the first large-scale evaluation of wearable-EHR fusion, underscoring the utility of wearable-derived signals in complementing EHRs and enabling more holistic, personalized health outcome predictions. Meanwhile, our analysis elucidates future directions for optimizing foundation models for wearable data and its integration with EHR data.

q-bio.QM↗

arXiv2025

Generalized Connes-Kreimer Hopf algebras on decorated rooted forests by weighted cocycles

The Connes-Kreimer Hopf algebra of rooted trees is an operated Hopf algebra whose coproduct satisfies the classical Hochschild 1-cocycle condition. In this paper, we extend the setting from rooted trees to the space $H_{\rm RT}(X,Ω)$ of $(X,Ω)$-rooted trees, in which internal vertices are decorated by a set $Ω$ and leafs are decorated by $X \cup Ω$. We introduce a new coalgebra structure on $H_{\rm RT}(X,Ω)$ whose coproduct satisfies a weighted Hochschild 1-cocycle condition involving multiple operators, thereby generalizing the classical condition. A combinatorial interpretation of this coproduct is also provided. We then endow $H_{\rm RT}(X,Ω)$ with a Hopf algebra structure. Finally, we define weighted $Ω$-cocycle Hopf algebras, characterized by a Hochschild 1-cocycle condition with weights, and show that $H_{\rm RT}(X,Ω)$ is the free object in the category of $Ω$-cocycle Hopf algebras.

math.QA↗

arXiv2025

Motion Matters: Motion-guided Modulation Network for Skeleton-based Micro-Action Recognition

Micro-Actions (MAs) are an important form of non-verbal communication in social interactions, with potential applications in human emotional analysis. However, existing methods in Micro-Action Recognition often overlook the inherent subtle changes in MAs, which limits the accuracy of distinguishing MAs with subtle changes. To address this issue, we present a novel Motion-guided Modulation Network (MMN) that implicitly captures and modulates subtle motion cues to enhance spatial-temporal representation learning. Specifically, we introduce a Motion-guided Skeletal Modulation module (MSM) to inject motion cues at the skeletal level, acting as a control signal to guide spatial representation modeling. In parallel, we design a Motion-guided Temporal Modulation module (MTM) to incorporate motion information at the frame level, facilitating the modeling of holistic motion patterns in micro-actions. Finally, we propose a motion consistency learning strategy to aggregate the motion cues from multi-scale features for micro-action classification. Experimental results on the Micro-Action 52 and iMiGUE datasets demonstrate that MMN achieves state-of-the-art performance in skeleton-based micro-action recognition, underscoring the importance of explicitly modeling subtle motion cues. The code will be available at https://github.com/momiji-bit/MMN.

cs.CV↗

arXiv2025

Adaptive-Growth Randomized Neural Networks for PDEs: Algorithms and Numerical Analysis

Randomized neural network (RaNN) methods have been proposed for solving various partial differential equations (PDEs), demonstrating high accuracy and efficiency. However, initializing the fixed parameters remains challenging. Additionally, RaNNs often struggle to approximate PDE solutions with sharp gradients or discontinuities when using smooth activations and shallow architectures. In this paper, we propose an Adaptive-Growth Randomized Neural Network (AG-RaNN) to address these challenges. We first design a frequency-based initialization for a shallow RaNN. Using the residual as an error indicator, we then adaptively grow the network in width (neuron growth) and depth (layer growth) to improve the accuracy of the numerical solution. The weights and biases of new neurons are constructed rather than trained, which enhances the approximation power without additional nonlinear optimization. To handle discontinuities, we further introduce a domain splitting strategy. We also establish a unified error analysis covering approximation, statistical, and optimization errors. Extensive numerical experiments demonstrate the efficiency and accuracy of AG-RaNN.

math.NA↗

arXiv2025

OmniStruct: Universal Text-to-Structure Generation across Diverse Schemas

The ability of Large Language Models (LLMs) to generate structured outputs that follow arbitrary schemas is crucial to a wide range of downstream tasks that require diverse structured representations of results such as information extraction, table generation, and function calling. While modern LLMs excel in generating unstructured responses in natural language, whether this advancement translates to a strong performance on text-to-structure tasks remains unclear. To bridge this gap, we first introduce OmniStruct, a comprehensive benchmark for assessing LLMs' capabilities on diverse text-to-structure tasks such as information extraction, table generation, and function calling. We build OmniStruct by identifying existing datasets across a wide range of tasks that are suitable for a structured answer format, and adapting them under a unified text-to-structure problem setting. To facilitate the development of efficient text-to-structure models, we collect high-quality training data via synthetic task generation. Without using any supervised data for OmniStruct tasks, our experiments demonstrate the possibility of fine-tuning much smaller models on synthetic data into universal structured generation models that can rival the performance of GPT-4o.

cs.CL↗

arXiv2025

KnowCoder-A1: Incentivizing Agentic Reasoning Capability with Outcome Supervision for KBQA

Knowledge Base Question Answering (KBQA) aims to answer natural-language questions over a structured Knowledge Base (KB). Recent work improves KBQA by adopting an agentic reasoning paradigm, in which Large Language Models (LLMs) iteratively decompose a question, generate its corresponding logical queries, and interact with the KB to derive the answer. However, these methods typically fine-tune LLMs on reasoning trajectories synthesized via process supervision, which offers weak incentives for exploration and thus fails to strengthen the agentic reasoning ability. In this paper, we propose KnowCoder-A1, an LLM that can autonomously perform agentic reasoning on KBs to obtain answers. To incentivize autonomous exploration, KnowCoder-A1 trains the LLM under outcome-only supervision via a multi-stage curriculum reinforcement learning with an easy-to-hard curriculum. To establish foundational agentic capabilities, KnowCoder-A1 first fine-tunes the LLM on a small set of high-quality trajectories obtained through outcome-based rejection sampling. Then, to alleviate the reward sparsity inherent in outcome-only supervision, it applies multi-stage curriculum RL with reward schedules that progress from easy to hard. Trained with outcome-only supervision, KnowCoder-A1 exhibits powerful reasoning behaviors and consistently outperforms prior approaches across three mainstream datasets. Notably, on the zero-shot subset of GrailQA, KnowCoder-A1 achieves up to an 11.1% relative improvement while using only one-twelfth of the training data, demonstrating strong agentic reasoning capabilities.

cs.AI↗

arXiv2025

APT: Affine Prototype-Timestamp For Time Series Forecasting Under Distribution Shift

Time series forecasting under distribution shift remains challenging, as existing deep learning models often rely on local statistical normalization (e.g., mean and variance) that fails to capture global distribution shift. Methods like RevIN and its variants attempt to decouple distribution and pattern but still struggle with missing values, noisy observations, and invalid channel-wise affine transformation. To address these limitations, we propose Affine Prototype Timestamp (APT), a lightweight and flexible plug-in module that injects global distribution features into the normalization-forecasting pipeline. By leveraging timestamp conditioned prototype learning, APT dynamically generates affine parameters that modulate both input and output series, enabling the backbone to learn from self-supervised, distribution-aware clustered instances. APT is compatible with arbitrary forecasting backbones and normalization strategies while introducing minimal computational overhead. Extensive experiments across six benchmark datasets and multiple backbone-normalization combinations demonstrate that APT significantly improves forecasting performance under distribution shift.

cs.LG↗

arXiv2025

Identify and Quantify Various Dissipation Mechanisms of Josephson Junction in Superconducting Circuits

Pinpointing the dissipation mechanisms and evaluating their impacts to the performance of Josephson junction (JJ) are crucial for its application in superconducting circuits. In this work, we demonstrate the junction-embedded resonator (JER) as a platform which enables us to identify and quantify various dissipation mechanisms of JJ. JER is constructed by embedding JJ in the middle of an open-circuit, 1/2 λ transmission-line resonator. When the 1st and 2nd harmonics of JER are excited, JJ experiences different boundary conditions, and is dominated by internal and external dissipations, respectively. We systematically study these 2 dissipation mechanisms of JJ by varying the JJ area and number. Our results unveil the completely different behaviors of these 2 dissipation mechanisms, and quantitatively characterize their contributions, shedding a light on the direction of JJ optimization in various applications.

quant-ph↗

arXiv2025

STA-GANN: A Valid and Generalizable Spatio-Temporal Kriging Approach

Spatio-temporal tasks often encounter incomplete data arising from missing or inaccessible sensors, making spatio-temporal kriging crucial for inferring the completely missing temporal information. However, current models struggle with ensuring the validity and generalizability of inferred spatio-temporal patterns, especially in capturing dynamic spatial dependencies and temporal shifts, and optimizing the generalizability of unknown sensors. To overcome these limitations, we propose Spatio-Temporal Aware Graph Adversarial Neural Network (STA-GANN), a novel GNN-based kriging framework that improves spatio-temporal pattern validity and generalization. STA-GANN integrates (i) Decoupled Phase Module that senses and adjusts for timestamp shifts. (ii) Dynamic Data-Driven Metadata Graph Modeling to update spatial relationships using temporal data and metadata; (iii) An adversarial transfer learning strategy to ensure generalizability. Extensive validation across nine datasets from four fields and theoretical evidence both demonstrate the superior performance of STA-GANN.

cs.LG↗

arXiv2025

We Can Hear You with mmWave Radar! An End-to-End Eavesdropping System

With the rise of voice-enabled technologies, loudspeaker playback has become widespread, posing increasing risks to speech privacy. Traditional eavesdropping methods often require invasive access or line-of-sight, limiting their practicality. In this paper, we present mmSpeech, an end-to-end mmWave-based eavesdropping system that reconstructs intelligible speech solely from vibration signals induced by loudspeaker playback, even through walls and without prior knowledge of the speaker. To achieve this, we reveal an optimal combination of vibrating material and radar sampling rate for capturing high-quality vibrations using narrowband mmWave signals. We then design a deep neural network that reconstructs intelligible speech from the estimated noisy spectrograms. To further support downstream speech understanding, we introduce a synthetic training pipeline and selectively fine-tune the encoder of a pre-trained ASR model. We implement mmSpeech with a commercial mmWave radar and validate its performance through extensive experiments. Results show that mmSpeech achieves state-of-the-art speech quality and generalizes well across unseen speakers and various conditions.

cs.SD↗