arXiv subjects

He Wang

Publications and source records attributed to He Wang.

At least 163 records · Page 9Linked to original sources

arXiv2025

Recent Advances in Simulation-based Inference for Gravitational Wave Data Analysis

The detection of gravitational waves by the LIGO-Virgo-KAGRA collaboration has ushered in a new era of observational astronomy, emphasizing the need for rapid and detailed parameter estimation and population-level analyses. Traditional Bayesian inference methods, particularly Markov chain Monte Carlo, face significant computational challenges when dealing with the high-dimensional parameter spaces and complex noise characteristics inherent in gravitational wave data. This review examines the emerging role of simulation-based inference methods in gravitational wave astronomy, with a focus on approaches that leverage machine-learning techniques such as normalizing flows and neural posterior estimation. We provide a comprehensive overview of the theoretical foundations underlying various simulation-based inference methods, including neural posterior estimation, neural ratio estimation, neural likelihood estimation, flow matching, and consistency models. We explore the applications of these methods across diverse gravitational wave data processing scenarios, from single-source parameter estimation and overlapping signal analysis to testing general relativity and conducting population studies. Although these techniques demonstrate speed improvements over traditional methods in controlled studies, their model-dependent nature and sensitivity to prior assumptions are barriers to their widespread adoption. Their accuracy, which is similar to that of conventional methods, requires further validation across broader parameter spaces and noise conditions.

gr-qc↗

arXiv2025

The Anisotropy of Thermal Activation Energy of 2H-NbS$_2$

We investigate the anisotropic flux dynamics in 2H-NbS$_2$ single crystals through temperature-dependent resistance measurements under in-plane ($H \parallel ab$ plane) and out-of-plane ($H \perp ab$ plane) magnetic fields. Analysis of thermally activated flux flow (TAFF) resistance in the superconducting mixed state reveals stark contrasts in thermal activation energy ($U_0$) scaling and field dependence. For $H \perp ab$, $U_0(0.1 \mathrm{T}) = (1228.76 \pm 53.64)$ K follows the Arrhenius relation with a power-law field decay ($U_0\propto H^{-α}$). In contrast, under $H \parallel ab$, $U_0(0.5 \mathrm{T}) = (7205.58 \pm 619.65)$ K aligns with the modified TAFF theory, where the scaling exponent $q = 2$ potentially reflects two-dimensional vortex behavior in the TAFF region, and the field dependence of $U_0$ follows parabolic relation $H^γ\left[1 - \frac{H}{H^{*}}\right]^2$. These results establish 2H-NbS$_2$ as a model system for probing the anisotropy of flux dynamics in layered superconductors.

cond-mat.supr-con↗

arXiv2025

Investigation on high-order planar Hall effect in trigonal PtBi$_2$

The trigonal PtBi$_2$ (t-PtBi$_2$) as a Weyl semimetal possessing triply degenerate points in its electronic bands near the Fermi level endows it with rich electronic properties. Previous studies have already measured the planar Hall effect (PHE) and in-plane anisotropic magnetoresistance (AMR) of t-PtBi$_2$. We noticed that their experimental results exhibited high-order features in both the PHE and AMR, yet these features were not systematically investigated. In our work, we conducted more systematic measurements and analyses of the PHE and AMR in t-PtBi$_2$. Both PHE and AMR show high-order features under low temperatures and strong magnetic fields, and these features share a similar temperature and magnetic field dependence with the turn-on behavior of resistance and temperature curves, indicating a common physical origin for them. We further summarize the critical conditions for the emergence of high-order PHE in t-PtBi$_2$, which will help to understand the origin of high-order features. In addition, we performed computational simulations on the AMR of t-PtBi$_2$, and the results were consistent with the experiments, indicating the high-order features are the result of the combined contribution of the Fermi surface anisotropy and the scaling behavior of magnetoresistance. Our findings will contribute to a deeper understanding of the origins of high-order features in non-magnetic topological materials.

cond-mat.mtrl-sci↗

arXiv2025

Search for exotic gravitational wave signals beyond general relativity using deep learning

The direct detection of gravitational waves by LIGO has confirmed general relativity (GR) and sparked rapid growth in gravitational wave (GW) astronomy. However, subtle post-Newtonian (PN) deviations observed during the analysis of high signal-to-noise ratio events from the observational runs suggest that standard waveform templates, which assume strict adherence to GR, might overlook signals from alternative theories of gravity. Incorporating these exotic signals into traditional search algorithms is computationally infeasible due to the vast template space required. This paper introduces a proof-of-principle deep learning framework for detecting exotic GW signals, leveraging neural networks trained on GR-based templates. Through their generalization ability, neural networks learn intricate features from the data, enabling the detection of signals that deviate from GR. We present the first study evaluating the capability of deep learning to detect beyond-GR signals, including a variety of PN orders. Our model achieves rapid and accurate identification of exotic GW signals across different luminosity distances, with performance comparable to GR-based detections. In particular, applying the model to the GW150914 event demonstrates excellent performance, highlighting the potential of AI-driven methods for detecting previously overlooked signals beyond GR. This work paves the way for new discoveries in gravitational wave astronomy, enabling the detection of signals that might escape traditional search pipelines.

gr-qc↗

arXiv2025

PIP-Net: Pedestrian Intention Prediction in the Wild

Accurate pedestrian intention prediction (PIP) by Autonomous Vehicles (AVs) is one of the current research challenges in this field. In this article, we introduce PIP-Net, a novel framework designed to predict pedestrian crossing intentions by AVs in real-world urban scenarios. We offer two variants of PIP-Net designed for different camera mounts and setups. Leveraging both kinematic data and spatial features from the driving scene, the proposed model employs a recurrent and temporal attention-based solution, outperforming state-of-the-art performance. To enhance the visual representation of road users and their proximity to the ego vehicle, we introduce a categorical depth feature map, combined with a local motion flow feature, providing rich insights into the scene dynamics. Additionally, we explore the impact of expanding the camera's field of view, from one to three cameras surrounding the ego vehicle, leading to an enhancement in the model's contextual perception. Depending on the traffic scenario and road environment, the model excels in predicting pedestrian crossing intentions up to 4 seconds in advance, which is a breakthrough in current research studies in pedestrian intention prediction. Finally, for the first time, we present the Urban-PIP dataset, a customised pedestrian intention prediction dataset, with multi-camera annotations in real-world automated driving scenarios.

cs.CV↗

arXiv2025

Pedestrian Intention Prediction via Vision-Language Foundation Models

Prediction of pedestrian crossing intention is a critical function in autonomous vehicles. Conventional vision-based methods of crossing intention prediction often struggle with generalizability, context understanding, and causal reasoning. This study explores the potential of vision-language foundation models (VLFMs) for predicting pedestrian crossing intentions by integrating multimodal data through hierarchical prompt templates. The methodology incorporates contextual information, including visual frames, physical cues observations, and ego-vehicle dynamics, into systematically refined prompts to guide VLFMs effectively in intention prediction. Experiments were conducted on three common datasets-JAAD, PIE, and FU-PIP. Results demonstrate that incorporating vehicle speed, its variations over time, and time-conscious prompts significantly enhances the prediction accuracy up to 19.8%. Additionally, optimised prompts generated via an automatic prompt engineering framework yielded 12.5% further accuracy gains. These findings highlight the superior performance of VLFMs compared to conventional vision-based models, offering enhanced generalisation and contextual understanding for autonomous driving applications.

cs.CV↗

arXiv2025

RoboHanger: Learning Generalizable Robotic Hanger Insertion for Diverse Garments

For the task of hanging clothes, learning how to insert a hanger into a garment is a crucial step, but has rarely been explored in robotics. In this work, we address the problem of inserting a hanger into various unseen garments that are initially laid flat on a table. This task is challenging due to its long-horizon nature, the high degrees of freedom of the garments and the lack of data. To simplify the learning process, we first propose breaking the task into several subtasks. Then, we formulate each subtask as a policy learning problem and propose a low-dimensional action parameterization. To overcome the challenge of limited data, we build our own simulator and create 144 synthetic clothing assets to effectively collect high-quality training data. Our approach uses single-view depth images and object masks as input, which mitigates the Sim2Real appearance gap and achieves high generalization capabilities for new garments. Extensive experiments in both simulation and reality validate our proposed method. By training on various garments in the simulator, our method achieves a 75\% success rate with 8 different unseen garments in the real world.

cs.RO↗

arXiv2025

A Kalman-smoother based data imputation strategy to data gaps in spaceborne gravitational wave detectors

Massive black hole binaries (MBHBs) and other sources within the frequency band of spaceborne gravitational wave observatories like the Laser Interferometer Space Antenna (LISA), Taiji and Tianqin pose unique challenges, as gaps and glitches during the years-long observation lead to both loss of information and spectral leakage. We propose a novel data imputation strategy based on Kalman filter and smoother to mitigate gap-induced biases in parameter estimation. Applied to a scenario where traditional windowing and smoothing technique introduce significant biases, our method mitigates the biases and demonstrates lower computational cost compared to existing data augmentation techniques such as noise inpainting. This framework presents a new gap treatment approach that balances robustness and efficiency for space-based gravitational wave data analysis.

astro-ph.IM↗

arXiv2025

DexVLG: Dexterous Vision-Language-Grasp Model at Scale

As large models gain traction, vision-language-action (VLA) systems are enabling robots to tackle increasingly complex tasks. However, limited by the difficulty of data collection, progress has mainly focused on controlling simple gripper end-effectors. There is little research on functional grasping with large models for human-like dexterous hands. In this paper, we introduce DexVLG, a large Vision-Language-Grasp model for Dexterous grasp pose prediction aligned with language instructions using single-view RGBD input. To accomplish this, we generate a dataset of 170 million dexterous grasp poses mapped to semantic parts across 174,000 objects in simulation, paired with detailed part-level captions. This large-scale dataset, named DexGraspNet 3.0, is used to train a VLM and flow-matching-based pose head capable of producing instruction-aligned grasp poses for tabletop objects. To assess DexVLG's performance, we create benchmarks in physics-based simulations and conduct real-world experiments. Extensive testing demonstrates DexVLG's strong zero-shot generalization capabilities-achieving over 76% zero-shot execution success rate and state-of-the-art part-grasp accuracy in simulation-and successful part-aligned grasps on physical objects in real-world scenarios.

cs.CV↗

arXiv2025

StreamFlow: Streaming Flow Matching with Block-wise Guided Attention Mask for Speech Token Decoding

Recent advancements in discrete token-based speech generation have highlighted the importance of token-to-waveform generation for audio quality, particularly in real-time interactions. Traditional frameworks integrating semantic tokens with flow matching (FM) struggle with streaming capabilities due to their reliance on a global receptive field. Additionally, directly implementing token-by-token streaming speech generation often results in degraded audio quality. To address these challenges, we propose StreamFlow, a novel neural architecture that facilitates streaming flow matching with diffusion transformers (DiT). To mitigate the long-sequence extrapolation issues arising from lengthy historical dependencies, we design a local block-wise receptive field strategy. Specifically, the sequence is first segmented into blocks, and we introduce block-wise attention masks that enable the current block to receive information from the previous or subsequent block. These attention masks are combined hierarchically across different DiT-blocks to regulate the receptive field of DiTs. Both subjective and objective experimental results demonstrate that our approach achieves performance comparable to non-streaming methods while surpassing other streaming methods in terms of speech quality, all the while effectively managing inference time during long-sequence generation. Furthermore, our method achieves a notable first-packet latency of only 180 ms.\footnote{Speech samples: https://dukguo.github.io/StreamFlow/}

cs.SD↗

arXiv2025

Moderating the Generalization of Score-based Generative Model

Score-based Generative Models (SGMs) have demonstrated remarkable generalization abilities, e.g. generating unseen, but natural data. However, the greater the generalization power, the more likely the unintended generalization, and the more dangerous the abuse. Research on moderated generalization in SGMs remains limited. To fill this gap, we first examine the current 'gold standard' in Machine Unlearning (MU), i.e., re-training the model after removing the undesirable training data, and find it does not work in SGMs. Further analysis of score functions reveals that the MU 'gold standard' does not alter the original score function, which explains its ineffectiveness. Based on this insight, we propose the first Moderated Score-based Generative Model (MSGM), which introduces a novel score adjustment strategy that redirects the score function away from undesirable data during the continuous-time stochastic differential equation process. Extensive experimental results demonstrate that MSGM significantly reduces the likelihood of generating undesirable content while preserving high visual quality for normal image generation. Albeit designed for SGMs, MSGM is a general and flexible MU framework that is compatible with diverse diffusion architectures (SGM and DDPM) and training strategies (re-training and fine-tuning), and enables zero-shot transfer of the pre-trained models to downstream tasks, e.g. image inpainting and reconstruction. The code will be shared upon acceptance.

cs.LG↗

arXiv2025

OctoNav: Towards Generalist Embodied Navigation

Embodied navigation stands as a foundation pillar within the broader pursuit of embodied AI. However, previous navigation research is divided into different tasks/capabilities, e.g., ObjNav, ImgNav and VLN, where they differ in task objectives and modalities, making datasets and methods are designed individually. In this work, we take steps toward generalist navigation agents, which can follow free-form instructions that include arbitrary compounds of multi-modal and multi-capability. To achieve this, we propose a large-scale benchmark and corresponding method, termed OctoNav-Bench and OctoNav-R1. Specifically, OctoNav-Bench features continuous environments and is constructed via a designed annotation pipeline. We thoroughly craft instruction-trajectory pairs, where instructions are diverse in free-form with arbitrary modality and capability. Also, we construct a Think-Before-Action (TBA-CoT) dataset within OctoNav-Bench to provide the thinking process behind actions. For OctoNav-R1, we build it upon MLLMs and adapt it to a VLA-type model, which can produce low-level actions solely based on 2D visual observations. Moreover, we design a Hybrid Training Paradigm (HTP) that consists of three stages, i.e., Action-/TBA-SFT, Nav-GPRO, and Online RL stages. Each stage contains specifically designed learning policies and rewards. Importantly, for TBA-SFT and Nav-GRPO designs, we are inspired by the OpenAI-o1 and DeepSeek-R1, which show impressive reasoning ability via thinking-before-answer. Thus, we aim to investigate how to achieve thinking-before-action in the embodied navigation field, to improve model's reasoning ability toward generalists. Specifically, we propose TBA-SFT to utilize the TBA-CoT dataset to fine-tune the model as a cold-start phrase and then leverage Nav-GPRO to improve its thinking ability. Finally, OctoNav-R1 shows superior performance compared with previous methods.

cs.CV↗

arXiv2025

The future of gravitational wave science unlocking LIGO potential: AI-driven data analysis and exploration

The advent of gravitational wave astronomy (GW) has revolutionized the observation of cataclysmic cosmic events, such as black hole mergers and neutron star collisions. The Laser Interferometer Gravitational-Wave Observatory (LIGO) has been at the forefront of these discoveries. However, the immense volume and complexity of gravitational wave data present significant challenges for traditional analysis methods. This paper investigates the growing synergy between artificial intelligence (AI) and GW science, emphasizing how AI enhances signal detection, noise reduction, and data interpretation. It begins with an overview of GW fundamentals and the role of machine learning in increasing detector sensitivity. Notable GW events observed by LIGO are discussed alongside persistent analytical challenges such as data quality, generalization, and computational constraints. A comprehensive performance review of AI techniques, including supervised learning, unsupervised learning, deep learning, and reinforcement learning, is presented based on data spanning 2021 to 2024. Evaluation metrics include accuracy, precision, true positive rate (TPR), false positive rate (FPR), and computational efficiency. Findings indicate that deep learning and supervised learning outperform other approaches, particularly in enhancing TPR and minimizing FPR. While unsupervised and reinforcement learning models offer less precision, they demonstrate high efficiency and potential for real-time applications. The study also explores AI integration into next-generation detectors and waveform reconstruction techniques. Overall, the integration of AI into GW research significantly improves the reliability and speed of event detection, unlocking new possibilities for exploring the dynamic universe. This paper provides a comprehensive outlook on the transformative role of AI in shaping the future of GW astronomy.

astro-ph.GA↗

arXiv2025

Accelerating Bayesian Sampling for Massive Black Hole Binaries with Prior Constraints from Conditional Variational Autoencoder

A Conditional Variational Autoencoder (CVAE) model is employed for parameter inference on gravitational waves (GW) signals of massive black hole binaries, considering joint observations with a network of three space-based GW detectors. Our experiments show that the trained CVAE model can estimate the posterior distribution of source parameters in approximately one second, while the standard Bayesian sampling method, utilizing parallel computation across 16 CPU cores, takes an average of 20 hours for a GW signal instance. However, the sampling distributions from CVAE exhibit lighter tails, appearing broader when compared to the standard Bayesian sampling results. By using CVAE results to constrain the prior range for Bayesian sampling, the sampling time is reduced by a factor of $\sim$6 while maintaining the similar precision of the Bayesian results.

astro-ph.IM↗

arXiv2025

Adversarially Robust AI-Generated Image Detection for Free: An Information Theoretic Perspective

Rapid advances in Artificial Intelligence Generated Images (AIGI) have facilitated malicious use, such as forgery and misinformation. Therefore, numerous methods have been proposed to detect fake images. Although such detectors have been proven to be universally vulnerable to adversarial attacks, defenses in this field are scarce. In this paper, we first identify that adversarial training (AT), widely regarded as the most effective defense, suffers from performance collapse in AIGI detection. Through an information-theoretic lens, we further attribute the cause of collapse to feature entanglement, which disrupts the preservation of feature-label mutual information. Instead, standard detectors show clear feature separation. Motivated by this difference, we propose Training-free Robust Detection via Information-theoretic Measures (TRIM), the first training-free adversarial defense for AIGI detection. TRIM builds on standard detectors and quantifies feature shifts using prediction entropy and KL divergence. Extensive experiments across multiple datasets and attacks validate the superiority of our TRIM, e.g., outperforming the state-of-the-art defense by 33.88% (28.91%) on ProGAN (GenImage), while well maintaining original accuracy.

cs.CV↗

arXiv2025

AISHELL-5: The First Open-Source In-Car Multi-Channel Multi-Speaker Speech Dataset for Automatic Speech Diarization and Recognition

This paper delineates AISHELL-5, the first open-source in-car multi-channel multi-speaker Mandarin automatic speech recognition (ASR) dataset. AISHLL-5 includes two parts: (1) over 100 hours of multi-channel speech data recorded in an electric vehicle across more than 60 real driving scenarios. This audio data consists of four far-field speech signals captured by microphones located on each car door, as well as near-field signals obtained from high-fidelity headset microphones worn by each speaker. (2) a collection of 40 hours of real-world environmental noise recordings, which supports the in-car speech data simulation. Moreover, we also provide an open-access, reproducible baseline system based on this dataset. This system features a speech frontend model that employs speech source separation to extract each speaker's clean speech from the far-field signals, along with a speech recognition module that accurately transcribes the content of each individual speaker. Experimental results demonstrate the challenges faced by various mainstream ASR models when evaluated on the AISHELL-5. We firmly believe the AISHELL-5 dataset will significantly advance the research on ASR systems under complex driving scenarios by establishing the first publicly available in-car ASR benchmark.

cs.SD↗

arXiv2025

TrackVLA: Embodied Visual Tracking in the Wild

Embodied visual tracking is a fundamental skill in Embodied AI, enabling an agent to follow a specific target in dynamic environments using only egocentric vision. This task is inherently challenging as it requires both accurate target recognition and effective trajectory planning under conditions of severe occlusion and high scene dynamics. Existing approaches typically address this challenge through a modular separation of recognition and planning. In this work, we propose TrackVLA, a Vision-Language-Action (VLA) model that learns the synergy between object recognition and trajectory planning. Leveraging a shared LLM backbone, we employ a language modeling head for recognition and an anchor-based diffusion model for trajectory planning. To train TrackVLA, we construct an Embodied Visual Tracking Benchmark (EVT-Bench) and collect diverse difficulty levels of recognition samples, resulting in a dataset of 1.7 million samples. Through extensive experiments in both synthetic and real-world environments, TrackVLA demonstrates SOTA performance and strong generalizability. It significantly outperforms existing methods on public benchmarks in a zero-shot manner while remaining robust to high dynamics and occlusion in real-world scenarios at 10 FPS inference speed. Our project page is: https://pku-epic.github.io/TrackVLA-web.

cs.RO↗

arXiv2025

ASGrasp: Generalizable Transparent Object Reconstruction and 6-DoF Grasp Detection from RGB-D Active Stereo Camera

In this paper, we tackle the problem of grasping transparent and specular objects. This issue holds importance, yet it remains unsolved within the field of robotics due to failure of recover their accurate geometry by depth cameras. For the first time, we propose ASGrasp, a 6-DoF grasp detection network that uses an RGB-D active stereo camera. ASGrasp utilizes a two-layer learning-based stereo network for the purpose of transparent object reconstruction, enabling material-agnostic object grasping in cluttered environments. In contrast to existing RGB-D based grasp detection methods, which heavily depend on depth restoration networks and the quality of depth maps generated by depth cameras, our system distinguishes itself by its ability to directly utilize raw IR and RGB images for transparent object geometry reconstruction. We create an extensive synthetic dataset through domain randomization, which is based on GraspNet-1Billion. Our experiments demonstrate that ASGrasp can achieve over 90% success rate for generalizable transparent object grasping in both simulation and the real via seamless sim-to-real transfer. Our method significantly outperforms SOTA networks and even surpasses the performance upper bound set by perfect visible point cloud inputs.Project page: https://pku-epic.github.io/ASGrasp

cs.RO↗