arXiv subjects

Sheng Yang

Publications and source records attributed to Sheng Yang.

At least 73 records · Page 4Linked to original sources

arXiv2025

GUIDE: Gaussian Unified Instance Detection for Enhanced Obstacle Perception in Autonomous Driving

In the realm of autonomous driving, accurately detecting surrounding obstacles is crucial for effective decision-making. Traditional methods primarily rely on 3D bounding boxes to represent these obstacles, which often fail to capture the complexity of irregularly shaped, real-world objects. To overcome these limitations, we present GUIDE, a novel framework that utilizes 3D Gaussians for instance detection and occupancy prediction. Unlike conventional occupancy prediction methods, GUIDE also offers robust tracking capabilities. Our framework employs a sparse representation strategy, using Gaussian-to-Voxel Splatting to provide fine-grained, instance-level occupancy data without the computational demands associated with dense voxel grids. Experimental validation on the nuScenes dataset demonstrates GUIDE's performance, with an instance occupancy mAP of 21.61, marking a 50\% improvement over existing methods, alongside competitive tracking capabilities. GUIDE establishes a new benchmark in autonomous perception systems, effectively combining precision with computational efficiency to better address the complexities of real-world driving environments.

cs.RO↗

arXiv2025

LiDAR-GS++:Improving LiDAR Gaussian Reconstruction via Diffusion Priors

Recent GS-based rendering has made significant progress for LiDAR, surpassing Neural Radiance Fields (NeRF) in both quality and speed. However, these methods exhibit artifacts in extrapolated novel view synthesis due to the incomplete reconstruction from single traversal scans. To address this limitation, we present LiDAR-GS++, a LiDAR Gaussian Splatting reconstruction method enhanced by diffusion priors for real-time and high-fidelity re-simulation on public urban roads. Specifically, we introduce a controllable LiDAR generation model conditioned on coarsely extrapolated rendering to produce extra geometry-consistent scans and employ an effective distillation mechanism for expansive reconstruction. By extending reconstruction to under-fitted regions, our approach ensures global geometric consistency for extrapolative novel views while preserving detailed scene surfaces captured by sensors. Experiments on multiple public datasets demonstrate that LiDAR-GS++ achieves state-of-the-art performance for both interpolated and extrapolated viewpoints, surpassing existing GS and NeRF-based methods.

cs.CV↗

arXiv2025

How does training shape the Riemannian geometry of neural network representations?

In machine learning, there is a long history of trying to build neural networks that can learn from fewer example data by baking in strong geometric priors. However, it is not always clear a priori what geometric constraints are appropriate for a given task. Here, we explore the possibility that one can uncover useful geometric inductive biases by studying how training molds the Riemannian geometry induced by unconstrained neural network feature maps. We first show that at infinite width, neural networks with random parameters induce highly symmetric metrics on input space. This symmetry is broken by feature learning: networks trained to perform classification tasks learn to magnify local areas along decision boundaries. This holds in deep networks trained on high-dimensional image classification tasks, and even in self-supervised representation learning. These results begin to elucidate how training shapes the geometry induced by unconstrained neural network feature maps, laying the groundwork for an understanding of this richly nonlinear form of feature learning.

cs.LG↗

arXiv2025

Detection of Quasi-periodic Oscillations in the $γ$-Ray Light Curve of 4FGL J0309.9-6058

In this work, we report, for the first time, a quasi-periodic oscillation (QPO) in the $γ$-ray band of 4FGL J0309.9-6058, also known as PKS 0308-611. We employed three analytical methods (the Lomb-Scargle periodogram, REDFIT, and the weighted wavelet Z-transform) to analyze the QPO signal using \textit{Fermi} $γ$-ray light curve data. The analysis reveals a potential QPO during MJD 57983$-$60503, with a period of approximately 550 days and a maximum local significance of 3.72$σ$ and global significance of 2.72$σ$ derived from the WWZ analysis. To validate this result, we applied Gaussian Process (GP) to the same light curve, which independently confirms the presence of QPO signal consistent with our Fourier-based results. We further extended the analysis to the full duration of the \textit{Fermi} observations, and the results consistently support and strengthen the presence of this QPO signal. Additionally, a time lag between the optical and $γ$-ray bands indicates separate emission regions for these two bands. Given the year-like timescale of the QPO signal and the fact that a QPO signal with local significance over 3$σ$ for full \textit{Fermi}-LAT observed time, we suggest that the QPO is most likely caused by a precessing jet.

astro-ph.HE↗

arXiv2025

HOLISMOKES XIX: SN 2025wny at $z=2$, the first strongly lensed superluminous supernova

We present imaging and spectroscopic observations of supernova SN 2025wny, associated with the lens candidate PS1 J0716+3821. Photometric monitoring from the Lulin and Maidanak observatories confirms multiple point-like images, consistent with SN 2025wny being strongly lensed by two foreground galaxies. Optical spectroscopy of the brightest image with the Nordic Optical Telescope and the University of Hawaii 88-inch Telescope allows us to determine the redshift to be z_s = 2.008 +- 0.001, based on narrow absorption lines originating in the interstellar medium of the supernova host galaxy. At this redshift, the spectra of SN 2025wny are consistent with those of superluminous supernovae of Type I. We find a high ejecta temperature and depressed spectral lines compared to other similar objects. We also measure, for the first time, the redshift of the fainter of the two lens galaxies (the "perturber") to be z_p = 0.375 +- 0.001, fully consistent with the DESI spectroscopic redshift of the main deflector at z_d = 0.3754. SN 2025wny thus represents the first confirmed galaxy-scale strongly lensed supernova with time delays likely in the range of days to weeks, as judged from the image separations. This makes SN 2025wny suitable for cosmography, offering a promising new system for independent measurements of the Hubble constant. Following a tradition in the field of strongly-lensed SNe, we give SN 2025wny the nickname SN Winny.

astro-ph.CO↗

arXiv2025

Hyperbolic Space Learning Method Leveraging Temporal Motion Priors for Human Mesh Recovery

3D human meshes show a natural hierarchical structure (like torso-limbs-fingers). But existing video-based 3D human mesh recovery methods usually learn mesh features in Euclidean space. It's hard to catch this hierarchical structure accurately. So wrong human meshes are reconstructed. To solve this problem, we propose a hyperbolic space learning method leveraging temporal motion prior for recovering 3D human meshes from videos. First, we design a temporal motion prior extraction module. This module extracts the temporal motion features from the input 3D pose sequences and image feature sequences respectively. Then it combines them into the temporal motion prior. In this way, it can strengthen the ability to express features in the temporal motion dimension. Since data representation in non-Euclidean space has been proved to effectively capture hierarchical relationships in real-world datasets (especially in hyperbolic space), we further design a hyperbolic space optimization learning strategy. This strategy uses the temporal motion prior information to assist learning, and uses 3D pose and pose motion information respectively in the hyperbolic space to optimize and learn the mesh features. Then, we combine the optimized results to get an accurate and smooth human mesh. Besides, to make the optimization learning process of human meshes in hyperbolic space stable and effective, we propose a hyperbolic mesh optimization loss. Extensive experimental results on large publicly available datasets indicate superiority in comparison with most state-of-the-art.

cs.CV↗

arXiv2025

Latent-Info and Low-Dimensional Learning for Human Mesh Recovery and Parallel Optimization

Existing 3D human mesh recovery methods often fail to fully exploit the latent information (e.g., human motion, shape alignment), leading to issues with limb misalignment and insufficient local details in the reconstructed human mesh (especially in complex scenes). Furthermore, the performance improvement gained by modelling mesh vertices and pose node interactions using attention mechanisms comes at a high computational cost. To address these issues, we propose a two-stage network for human mesh recovery based on latent information and low dimensional learning. Specifically, the first stage of the network fully excavates global (e.g., the overall shape alignment) and local (e.g., textures, detail) information from the low and high-frequency components of image features and aggregates this information into a hybrid latent frequency domain feature. This strategy effectively extracts latent information. Subsequently, utilizing extracted hybrid latent frequency domain features collaborates to enhance 2D poses to 3D learning. In the second stage, with the assistance of hybrid latent features, we model the interaction learning between the rough 3D human mesh template and the 3D pose, optimizing the pose and shape of the human mesh. Unlike existing mesh pose interaction methods, we design a low-dimensional mesh pose interaction method through dimensionality reduction and parallel optimization that significantly reduces computational costs without sacrificing reconstruction accuracy. Extensive experimental results on large publicly available datasets indicate superiority compared to the most state-of-the-art.

cs.CV↗

arXiv2025

Quantum Strong-to-Weak Spontaneous Symmetry Breaking in Decohered One Dimensional Critical States

Symmetry breaking has been a central theme in classifying quantum phases and phase transitions. Recently, this concept has been extended to the mixed states of open systems, attracting considerable attention due to the emergence of novel physics beyond closed systems. In this work, we reveal a new type of phase transition in mixed states, termed \emph{quantum} strong-to-weak spontaneous symmetry breaking (SWSSB). Using a combination of field theory calculations and large-scale matrix product state simulations, we map out the global phase diagram of the XXZ critical spin chain under local strong symmetry preserving decoherence, which features an SWSSB phase and a trivial Luttinger liquid phase, separated by a straight critical line that belongs to the boundary Berezinskii-Kosterlitz-Thouless universality class with a varying effective central charge. Importantly, we analyze this transition from two complementary perspectives: on one hand, through the behavior of order parameters that characterize the symmetry breaking; on the other hand, from a quantum information viewpoint by studying entropic quantities and the concept of quantum recoverability. Remarkably, the SWSSB transition in our case is \emph{purely quantum} in the sense that it can only be driven by tuning the Hamiltonian parameter even under arbitrary decoherence strength, fundamentally distinguishing it from the decoherence-driven SWSSB transitions extensively discussed in previous literature. Importantly, our unified theoretical framework is applicable to a broad class of one-dimensional quantum systems, including spin chains and fermionic systems, whose low-energy physics can be described by Luttinger liquid theory, under arbitrary symmetry-preserving decoherence channels. Finally, we also discuss the experimental relevance of our theory on quantum simulator platforms.

cond-mat.str-el↗

arXiv2025

LiDAR-GS:Real-time LiDAR Re-Simulation using Gaussian Splatting

We present LiDAR-GS, a Gaussian Splatting (GS) method for real-time, high-fidelity re-simulation of LiDAR scans in public urban road scenes. Recent GS methods proposed for cameras have achieved significant advancements in real-time rendering beyond Neural Radiance Fields (NeRF). However, applying GS representation to LiDAR, an active 3D sensor type, poses several challenges that must be addressed to preserve high accuracy and unique characteristics. Specifically, LiDAR-GS designs a differentiable laser beam splatting, using range-view representation for precise surface splatting by projecting lasers onto micro cross-sections, effectively eliminating artifacts associated with local affine approximations. Furthermore, LiDAR-GS leverages Neural Gaussian Representation, which further integrate view-dependent clues, to represent key LiDAR properties that are influenced by the incident direction and external factors. Combining these practices with some essential adaptations, e.g., dynamic instances decomposition, LiDAR-GS succeeds in simultaneously re-simulating depth, intensity, and ray-drop channels, achieving state-of-the-art results in both rendering frame rate and quality on publically available large scene datasets when compared with the methods using explicit mesh or implicit NeRF. Our source code is publicly available at https://www.github.com/cqf7419/LiDAR-GS.

cs.CV↗

arXiv2025

GS-RoadPatching: Inpainting Gaussians via 3D Searching and Placing for Driving Scenes

This paper presents GS-RoadPatching, an inpainting method for driving scene completion by referring to completely reconstructed regions, which are represented by 3D Gaussian Splatting (3DGS). Unlike existing 3DGS inpainting methods that perform generative completion relying on 2D perspective-view-based diffusion or GAN models to predict limited appearance or depth cues for missing regions, our approach enables substitutional scene inpainting and editing directly through the 3DGS modality, extricating it from requiring spatial-temporal consistency of 2D cross-modals and eliminating the need for time-intensive retraining of Gaussians. Our key insight is that the highly repetitive patterns in driving scenes often share multi-modal similarities within the implicit 3DGS feature space and are particularly suitable for structural matching to enable effective 3DGS-based substitutional inpainting. Practically, we construct feature-embedded 3DGS scenes to incorporate a patch measurement method for abstracting local context at different scales and, subsequently, propose a structural search method to find candidate patches in 3D space effectively. Finally, we propose a simple yet effective substitution-and-fusion optimization for better visual harmony. We conduct extensive experiments on multiple publicly available datasets to demonstrate the effectiveness and efficiency of our proposed method in driving scenes, and the results validate that our method achieves state-of-the-art performance compared to the baseline methods in terms of both quality and interoperability. Additional experiments in general scenes also demonstrate the applicability of the proposed 3D inpainting strategy. The project page and code are available at: https://shanzhaguoo.github.io/GS-RoadPatching/

cs.CV↗

arXiv2025

ProFusion: 3D Reconstruction of Protein Complex Structures from Multi-view AFM Images

AI-based in silico methods have improved protein structure prediction but often struggle with large protein complexes (PCs) involving multiple interacting proteins due to missing 3D spatial cues. Experimental techniques like Cryo-EM are accurate but costly and time-consuming. We present ProFusion, a hybrid framework that integrates a deep learning model with Atomic Force Microscopy (AFM), which provides high-resolution height maps from random orientations, naturally yielding multi-view data for 3D reconstruction. However, generating a large-scale AFM imaging data set sufficient to train deep learning models is impractical. Therefore, we developed a virtual AFM framework that simulates the imaging process and generated a dataset of ~542,000 proteins with multi-view synthetic AFM images. We train a conditional diffusion model to synthesize novel views from unposed inputs and an instance-specific Neural Radiance Field (NeRF) model to reconstruct 3D structures. Our reconstructed 3D protein structures achieve an average Chamfer Distance within the AFM imaging resolution, reflecting high structural fidelity. Our method is extensively validated on experimental AFM images of various PCs, demonstrating strong potential for accurate, cost-effective protein complex structure prediction and rapid iterative validation using AFM experiments.

cs.CV↗

arXiv2025

The enhanced X-ray Timing and Polarimetry mission -- eXTP for launch in 2030

In this paper we present the current status of the enhanced X-ray Timing and Polarimetry mission, which has been fully approved for launch in 2030. eXTP is a space science mission designed to study fundamental physics under extreme conditions of matter density, gravity, and magnetism. The mission aims at determining the equation of state of matter at supra-nuclear density, measuring the effects of quantum electro-dynamics, and understanding the dynamics of matter in strong-field gravity. In addition to investigating fundamental physics, the eXTP mission is poised to become a leading observatory for time-domain and multi-messenger astronomy in the 2030's, as well as providing observations of unprecedented quality on a variety of galactic and extragalactic objects. After briefly introducing the history and a summary of the scientific objectives of the eXTP mission, this paper presents a comprehensive overview of: 1) the cutting-edge technology, technical specifications, and anticipated performance of the mission's scientific instruments; 2) the full mission profile, encompassing spacecraft design, operational capabilities, and ground segment infrastructure.

astro-ph.HE↗

arXiv2025

Search for the Optical Counterpart of Einstein Probe Discovered Fast X-ray Transients from Lulin Observatory

The launch of the Einstein Probe (EP) mission has revolutionized the detection and follow-up observations of fast X-ray transients (FXTs) by providing prompt and timely access to their precise localizations. In the first year of its operation, the EP-mission reports the discovery of 72 high signal-to-noise FXTs. Subjected to the visibility in the sky and weather conditions, we search for the optical counterparts of 42 EP-discovered FXTs from the Lulin Observatory. We successfully detect the optical counterparts of 12 FXTs, and five of those are first discovered by us from the Lulin Observatory. We find that the optical counterparts are generally faint ($r>20$\,mag) and decline rapidly ($>0.5$\,mag per day). We also find that 12 out of 42 FXTs show direct evidence of their association with Gamma-Ray Bursts (GRBs) through significant temporal and spatial overlapping. Furthermore, the luminosities and redshifts of FXTs with confirmed optical counterparts in our observations are fully consistent with the faintest end of the GRB population. However, the non-detection of any associated optical counterpart with a significant fraction of FXTs suggests that EP FXTs are likely a subset of so-called `dark FXTs', similar to `dark GRBs'. Additionally, the luminosities of {\bf two FXTs with confirmed redshifts} are also consistent with jetted tidal disruption events (TDEs). However, we find that the optical luminosities of FXTs differ significantly from typical supernova shock breakout or kilonova emissions. Thus, we conclude that a significant fraction of EP-discovered FXTs are associated with events having relativistic jets; either a GRB or a jetted TDE.

astro-ph.HE↗

arXiv2025

Language Driven Occupancy Prediction

We introduce LOcc, an effective and generalizable framework for open-vocabulary occupancy (OVO) prediction. Previous approaches typically supervise the networks through coarse voxel-to-text correspondences via image features as intermediates or noisy and sparse correspondences from voxel-based model-view projections. To alleviate the inaccurate supervision, we propose a semantic transitive labeling pipeline to generate dense and fine-grained 3D language occupancy ground truth. Our pipeline presents a feasible way to dig into the valuable semantic information of images, transferring text labels from images to LiDAR point clouds and ultimately to voxels, to establish precise voxel-to-text correspondences. By replacing the original prediction head of supervised occupancy models with a geometry head for binary occupancy states and a language head for language features, LOcc effectively uses the generated language ground truth to guide the learning of 3D language volume. Through extensive experiments, we demonstrate that our transitive semantic labeling pipeline can produce more accurate pseudo-labeled ground truth, diminishing labor-intensive human annotations. Additionally, we validate LOcc across various architectures, where all models consistently outperform state-of-the-art zero-shot occupancy prediction approaches on the Occ3D-nuScenes dataset.

cs.CV↗

arXiv2025

RTMap: Real-Time Recursive Mapping with Change Detection and Localization

While recent online HD mapping methods relieve burdened offline pipelines and solve map freshness, they remain limited by perceptual inaccuracies, occlusion in dense traffic, and an inability to fuse multi-agent observations. We propose RTMap to enhance these single-traversal methods by persistently crowdsourcing a multi-traversal HD map as a self-evolutional memory. On onboard agents, RTMap simultaneously addresses three core challenges in an end-to-end fashion: (1) Uncertainty-aware positional modeling for HD map elements, (2) probabilistic-aware localization w.r.t. the crowdsourced prior-map, and (3) real-time detection for possible road structural changes. Experiments on several public autonomous driving datasets demonstrate our solid performance on both the prior-aided map quality and the localization accuracy, demonstrating our effectiveness of robustly serving downstream prediction and planning modules while gradually improving the accuracy and freshness of the crowdsourced prior-map asynchronously. Our source-code will be made publicly available at https://github.com/CN-ADLab/RTMap.

cs.CV↗

arXiv2025

RGE-GS: Reward-Guided Expansive Driving Scene Reconstruction via Diffusion Priors

A single-pass driving clip frequently results in incomplete scanning of the road structure, making reconstructed scene expanding a critical requirement for sensor simulators to effectively regress driving actions. Although contemporary 3D Gaussian Splatting (3DGS) techniques achieve remarkable reconstruction quality, their direct extension through the integration of diffusion priors often introduces cumulative physical inconsistencies and compromises training efficiency. To address these limitations, we present RGE-GS, a novel expansive reconstruction framework that synergizes diffusion-based generation with reward-guided Gaussian integration. The RGE-GS framework incorporates two key innovations: First, we propose a reward network that learns to identify and prioritize consistently generated patterns prior to reconstruction phases, thereby enabling selective retention of diffusion outputs for spatial stability. Second, during the reconstruction process, we devise a differentiated training strategy that automatically adjust Gaussian optimization progress according to scene converge metrics, which achieving better convergence than baseline methods. Extensive evaluations of publicly available datasets demonstrate that RGE-GS achieves state-of-the-art performance in reconstruction quality. Our source-code will be made publicly available at https://github.com/CN-ADLab/RGE-GS.

cs.CV↗

arXiv2025

Universal Decoding over Finite-State Additive Channels via Noise Guessing

We study universal decoding over unknown discrete additive channels determined by a finite-state (unifilar) random process. Aiming at low-complexity decoders, we study variants of noise-guessing decoders that use estimators for the probability of a noise sequence when the actual channel law is unknown. A deterministic version produces noise sequences in a fixed order, and a new randomised version draws them at random, until finding a sequence that, subtracted from the received sequence, results in a valid codeword. We show that both strategies are random-coding universal (i.e. have the same random-coding error exponent as the optimal maximum likelihood decoding), and derive upper bounds for their complexity. Numerical examples in additive Markov channels illustrate the proposed methods' performance, showing that they consistently outperform a more usual training-based strategy.

cs.IT↗

arXiv2025

SAM4D: Segment Anything in Camera and LiDAR Streams

We present SAM4D, a multi-modal and temporal foundation model designed for promptable segmentation across camera and LiDAR streams. Unified Multi-modal Positional Encoding (UMPE) is introduced to align camera and LiDAR features in a shared 3D space, enabling seamless cross-modal prompting and interaction. Additionally, we propose Motion-aware Cross-modal Memory Attention (MCMA), which leverages ego-motion compensation to enhance temporal consistency and long-horizon feature retrieval, ensuring robust segmentation across dynamically changing autonomous driving scenes. To avoid annotation bottlenecks, we develop a multi-modal automated data engine that synergizes VFM-driven video masklets, spatiotemporal 4D reconstruction, and cross-modal masklet fusion. This framework generates camera-LiDAR aligned pseudo-labels at a speed orders of magnitude faster than human annotation while preserving VFM-derived semantic fidelity in point cloud representations. We conduct extensive experiments on the constructed Waymo-4DSeg, which demonstrate the powerful cross-modal segmentation ability and great potential in data annotation of proposed SAM4D.

cs.CV↗