arXiv Science⌕ Search

arXiv subjects

Lei Yang

Publications and source records attributed to Lei Yang.

At least 145 records · Page 8Linked to original sources

EgoLife: Towards Egocentric Life Assistant

We introduce EgoLife, a project to develop an egocentric life assistant that accompanies and enhances personal efficiency through AI-powered wearable glasses. To lay the foundation for this assistant, we conducted a comprehensive data collection study where six participants lived together for one week, continuously recording their daily activities - including discussions, shopping, cooking, socializing, and entertainment - using AI glasses for multimodal egocentric video capture, along with synchronized third-person-view video references. This effort resulted in the EgoLife Dataset, a comprehensive 300-hour egocentric, interpersonal, multiview, and multimodal daily life dataset with intensive annotation. Leveraging this dataset, we introduce EgoLifeQA, a suite of long-context, life-oriented question-answering tasks designed to provide meaningful assistance in daily life by addressing practical questions such as recalling past relevant events, monitoring health habits, and offering personalized recommendations. To address the key technical challenges of (1) developing robust visual-audio models for egocentric data, (2) enabling identity recognition, and (3) facilitating long-context question answering over extensive temporal information, we introduce EgoButler, an integrated system comprising EgoGPT and EgoRAG. EgoGPT is an omni-modal model trained on egocentric datasets, achieving state-of-the-art performance on egocentric video understanding. EgoRAG is a retrieval-based component that supports answering ultra-long-context questions. Our experimental studies verify their working mechanisms and reveal critical factors and bottlenecks, guiding future improvements. By releasing our datasets, models, and benchmarks, we aim to stimulate further research in egocentric AI assistants.

cs.CV↗

D-ripALM: A Tuning-friendly Decentralized Relative-Type Inexact Proximal Augmented Lagrangian Method

This paper proposes D-ripALM, a Decentralized relative-type inexact proximal Augmented Lagrangian Method for consensus convex optimization over multi-agent networks. D-ripALM adopts a double-loop distributed optimization framework that accommodates a wide range of inner solvers, enabling efficient treatment of both smooth and nonsmooth objectives. In contrast to existing double-loop distributed augmented Lagrangian methods, D-ripALM employs a relative-type error criterion to regulate the switching between inner and outer iterations, resulting in a more practical and tuning-friendly algorithmic framework with enhanced numerical robustness. Moreover, we establish rigorous convergence guarantees for D-ripALM under general convexity assumptions, without requiring smoothness or strong convexity conditions commonly imposed in the distributed optimization literature. Numerical experiments further demonstrate the tuning-friendly nature of D-ripALM and its efficiency in attaining high-precision solutions with fewer communication rounds.

math.OC↗

U-Net Based Image Enhancement for Short-time Muon Scattering Tomography

Muon Scattering Tomography (MST) is a promising non-invasive inspection technique, yet the practical application of short-time MST is hindered by poor image quality due to limited muon flux. To address this limitation, we propose a U-Net-based framework trained on Point of Closest Approach (PoCA) images reconstructed with simulation MST data to enhance image quality. When applied to experimental MST data, the framework significantly improves image quality, increasing the Structural Similarity Index Measure (SSIM) from 0.7232 to 0.9699 and decreasing the Learned Perceptual Image Patch Similarity (LPIPS) from 0.3604 to 0.0270. These results demonstrate that our method can effectively enhance low-statistics MST images, thereby paving the way for the practical deployment of short-time MST.

eess.IV↗

Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directions

Traditional Simultaneous Localization and Mapping (SLAM) systems often face limitations including coarse rendering quality, insufficient recovery of scene details, and poor robustness in dynamic environments. 3D Gaussian Splatting (3DGS), with its efficient explicit representation and high-quality rendering capabilities, offers a new reconstruction paradigm for SLAM. This survey comprehensively reviews key technical approaches for integrating 3DGS with SLAM. We analyze performance optimization of representative methods across four critical dimensions: rendering quality, tracking accuracy, reconstruction speed, and memory consumption, delving into their design principles and breakthroughs. Furthermore, we examine methods for enhancing the robustness of 3DGS-SLAM in complex environments such as motion blur and dynamic environments. Finally, we discuss future challenges and development trends in this area. This survey aims to provide a technical reference for researchers and foster the development of next-generation SLAM systems characterized by high fidelity, efficiency, and robustness.

cs.RO↗

UV-M3TL: A Unified and Versatile Multimodal Multi-Task Learning Framework for Assistive Driving Perception

Advanced Driver Assistance Systems (ADAS) need to understand human driver behavior while perceiving their navigation context, but jointly learning these heterogeneous tasks would cause inter-task negative transfer and impair system performance. Here, we propose a Unified and Versatile Multimodal Multi-Task Learning (UV-M3TL) framework to simultaneously recognize driver behavior, driver emotion, vehicle behavior, and traffic context, while mitigating inter-task negative transfer. Our framework incorporates two core components: dual-branch spatial channel multimodal embedding (DB-SCME) and adaptive feature-decoupled multi-task loss (AFD-Loss). DB-SCME enhances cross-task knowledge transfer while mitigating task conflicts by employing a dual-branch structure to explicitly model salient task-shared and task-specific features. AFD-Loss improves the stability of joint optimization while guiding the model to learn diverse multi-task representations by introducing an adaptive weighting mechanism based on learning dynamics and feature decoupling constraints. We evaluate our method on the AIDE dataset, and the experimental results demonstrate that UV-M3TL achieves state-of-the-art performance across all four tasks. To further prove the versatility, we evaluate UV-M3TL on additional public multi-task perception benchmarks (BDD100K, CityScapes, NYUD-v2, and PASCAL-Context), where it consistently delivers strong performance across diverse task combinations, attaining state-of-the-art results on most tasks.

cs.CV↗

The $Λ_{b} \to Λ$ transition form factors in perturbative QCD approach

In this work, we investigate the $Λ_b \to Λ$ transition form factors in the perturbative QCD (PQCD) approach, incorporating higher-twist light-cone distribution amplitudes (LCDAs). The resulted form factors show that higher-twist LCDAs are dominant numerically. By combining our PQCD predictions at low-$q^2$ with lattice QCD results at high-$q^2$, $z$-series expansion fits are performed to parametrize the form factors over the full kinematic range. We also provide the prediction for physical observables in the rare decay $Λ_b \to Λμ^+ μ^-$, including the differential branching fraction, dilepton longitudinal polarization fraction, and forward-backward asymmetries (lepton-side, hadron-side, and combined lepton-hadron). Our obtained form factors are consistent with those in other theoretical methods within the uncertainties.

hep-ph↗

A Dataset and Benchmark for Robotic Cloth Unfolding Grasp Selection: The ICRA 2024 Cloth Competition

Robotic cloth manipulation suffers from a lack of standardized benchmarks and shared datasets for evaluating and comparing different approaches. To address this, we created a benchmark and organized the ICRA 2024 Cloth Competition, a unique head-to-head evaluation focused on grasp pose selection for in-air robotic cloth unfolding. Eleven diverse teams participated in the competition, utilizing our publicly released dataset of real-world robotic cloth unfolding attempts and a variety of methods to design their unfolding approaches. Afterwards, we also expanded our dataset with 176 competition evaluation trials, resulting in a dataset of 679 unfolding demonstrations across 34 garments. Analysis of the competition results revealed insights about the trade-off between grasp success and coverage, the surprisingly strong achievements of hand-engineered methods and a significant discrepancy between competition performance and prior work, underscoring the importance of independent, out-of-the-lab evaluation in robotic cloth manipulation. The associated dataset is a valuable resource for developing and evaluating grasp selection methods, particularly for learning-based approaches. We hope that our benchmark, dataset and competition results can serve as a foundation for future benchmarks and drive further progress in data-driven robotic cloth manipulation. The dataset and benchmarking code are available at https://airo.ugent.be/cloth_competition.

cs.RO↗

Learning to Trust Experience: A Monitor-Trust-Regulator Framework for Learning under Unobservable Feedback Reliability

Learning under unobservable feedback reliability poses a distinct challenge beyond optimization robustness: a system must decide whether to learn from an experience, not only how to learn stably. We study this setting as Epistemic Identifiability under Unobservable Reliability (EIUR), where each experience has a latent credibility, reliable and unreliable feedback can be locally indistinguishable, and data are generated in a closed loop by the learner's own evolving beliefs and actions. In EIUR, standard robust learning can converge stably yet form high-confidence, systematically wrong beliefs. We propose metacognitive regulation as a practical response: a second, introspective control loop that infers experience credibility from endogenous evidence in the learner's internal dynamics. We formalize this as a modular Monitor-Trust-Regulator (MTR) decomposition and instantiate it with self-diagnosis, which maintains a slowly varying experience-trust variable that softly modulates learning updates, without exogenous reliability labels or an explicit corruption model. Empirically, in the EIUR regimes studied here, self-diagnosis is associated with improved epistemic identifiability. In reinforcement learning, it enables calibrated skepticism and recovery under systematically corrupted rewards. In supervised learning, it exposes a critical dissociation: performance recovery does not imply epistemic recovery. Accuracy can rebound while internal belief dynamics remain locked-in by early misleading data, a failure detectable only through introspective diagnostics. Together, MTR and self-diagnosis provide an organizing abstraction and a concrete design template for intrinsic reliability assessment in autonomous learning under unobservable reliability.

cs.LG↗

Superconductivity in W3Re2C with chiral structure

We discover superconductivity in cubic W3Re2C with chiral structure and the superconducting transition temperature Tc is about 6.2 K. Detailed characterizations and analysis indicate that W3Re2C is a bulk type-II BCS superconductor with full isotropic gap. Moreover, first-principles calculations indicate that the electron-phonon coupling primarily arises from interactions between W/Re 5d electronic states and their low-frequency phonons. Furthermore, the breaking of inversion symmetry in W3Re2C facilitates the emergence of Weyl points in the electronic structure. Therefore, W3Re2C can serve as a promising platform for investigating the influences of chiral structure on both superconductivity and band topology.

cond-mat.supr-con↗

Training instability in deep learning follows low-dimensional dynamical principles

Deep learning systems achieve remarkable empirical performance, yet the stability of the training process itself remains poorly understood. Training unfolds as a high-dimensional dynamical system in which small perturbations to optimization, data, parameters, or learning signals can induce abrupt and irreversible collapse, undermining reproducibility and scalability. We propose a unified dynamical perspective that characterizes training stability as an intrinsic property of learning systems, organized along four interacting dimensions: optimization, environmental/data, parametric, and learning-signal stability. We operationalize this perspective through controlled perturbation auditing of training trajectories, probing how learning dynamics respond to structured disturbances without modifying learning algorithms. Across reinforcement learning and large language model training, we identify three recurring regularities: high final performance is frequently decoupled from training stability; controlled stochasticity consistently buffers learning dynamics across paradigms; and deviations in low-dimensional latent meta-states systematically precede observable performance collapse. Together, these findings establish training stability as a measurable and comparable dynamical property of learning systems, providing a descriptive foundation for studying learning dynamics beyond final performance outcomes.

cs.LG↗

V2X-Radar: A Multi-modal Dataset with 4D Radar for Cooperative Perception

Modern autonomous vehicle perception systems often struggle with occlusions and limited perception range. Previous studies have demonstrated the effectiveness of cooperative perception in extending the perception range and overcoming occlusions, thereby enhancing the safety of autonomous driving. In recent years, a series of cooperative perception datasets have emerged; however, these datasets primarily focus on cameras and LiDAR, neglecting 4D Radar, a sensor used in single-vehicle autonomous driving to provide robust perception in adverse weather conditions. In this paper, to bridge the gap created by the absence of 4D Radar datasets in cooperative perception, we present V2X-Radar, the first large-scale, real-world multi-modal dataset featuring 4D Radar. V2X-Radar dataset is collected using a connected vehicle platform and an intelligent roadside unit equipped with 4D Radar, LiDAR, and multi-view cameras. The collected data encompasses sunny and rainy weather conditions, spanning daytime, dusk, and nighttime, as well as various typical challenging scenarios. The dataset consists of 20K LiDAR frames, 40K camera images, and 20K 4D Radar data, including 350K annotated boxes across five categories. To support various research domains, we have established V2X-Radar-C for cooperative perception, V2X-Radar-I for roadside perception, and V2X-Radar-V for single-vehicle perception. Furthermore, we provide comprehensive benchmarks across these three sub-datasets. We will release all datasets and benchmark codebase at https://huggingface.co/datasets/yanglei18/V2X-Radar and https://github.com/yanglei18/V2X-Radar.

cs.CV↗

Polynomially effective equidistribution for unipotent orbits in products of $\mathrm{SL}_2$ factors

We sketch the proof of an effective equidistribution theorem for one-parameter unipotent subgroups in $S$-arithmetic quotients arising from $\mathbf K$-forms of $\mathrm{SL}_2^{\mathsf n}$ where $\mathbf K$ is a number field. This gives an effective version of equidistribution results of Ratner and Shah with a polynomial rate. The key new phenomenon is the existence of many intermediate groups between the $\mathrm{SL}_2$ containing our unipotent and the ambient group, which introduces potential local and global obstruction to equidistribution. Our approach relies on a Bourgain-type projection theorem in the presence of obstructions, together with a careful analysis of these obstructions.

math.DS↗

Impact of Nuclear Reaction Rates on Calcium Production in Population III Stars: A Global Analysis

We investigate the sensitivity of calcium production to nuclear reaction rates of a 40 solar-mass Population III star using 1D multi-zone stellar models. A comprehensive nuclear reaction network was constructed, and all $(p,γ)$ and $(p,α)$ reaction rates were individually varied by a factor of 10 up and down, identifying 13 preliminary key reactions for calcium production. To propagate the reaction rate uncertainties on calcium production, two sets of Monte Carlo simulations were performed for these key reactions: one adopting STARLIB reaction rates and the other incorporating updated rates from recent experimental data and evaluations. Our results show that Monte Carlo simulations using the updated rates show good agreement with the observed calcium abundance of the extremely iron-poor star SMSS J031300.36-670839.3 within the 68% confidence interval predicted by the models. In contrast, the observed calcium abundance lies marginally outside the 68% C.I. when using the STARLIB rates. Spearman rank-order correlation analysis and SHAP values show that the $(p,γ)$ and $(p,α)$ reactions of F18 and F19 exhibit strong coupled effects on calcium production. These reaction-rate uncertainties need to be reduced to constrain the stellar model predictions. Our study provides insights for future nuclear physics experiments aimed at reducing reaction rate uncertainties in the nucleosynthesis of Population III Stars. Additionally, comparisons between 20 solar-mass and 40 solar-mass Population III stellar models confirm that the latter, with updated reaction rates, is more capable of reproducing the observed Ca abundance and [Ca/Mg] ratio.

astro-ph.SR↗

Channel Knowledge Map-assisted Dual-domain Tracking and Predictive Beamforming for High-Mobility Wireless Networks

This paper introduces a novel channel knowledge map (CKM)-assisted dual-domain tracking and predictive beamforming scheme for high-mobility wireless networks. The central premise is that the CKM integrates both the coordinate and beam domains, thereby enabling tracking in one domain via treating the other domain's input as priors or measurements. In the coordinate domain (C-Domain), an extended Kalman filter (EKF) is employed to predict and track the state (i.e., location and velocity) of a moving communication receiver across time slots under both line-of-sight (LoS)-present and LoS-absent conditions, where the CKM provides a prior mapping from multipath channel parameters to potential target locations. In the beam domain (B-Domain), the updated location of the receiver is fed back to CKM to offer a priori information of angle of arrival (AoA) variations, which are incorporated to establish beam transition models for effective beam tracking, depending on the angular variation situation of each path. Then, we analyze the Cramér-Rao Bound (CRB) for AoA estimation for each path in the considered system and propose a jointly predictive beamforming and power allocation design to minimize AoA estimation errors, directly enhancing multipath beam tracking accuracy and indirectly improving target tracking performance. Simulation results demonstrate that the proposed scheme achieves significant improvements in both target and beam tracking performance compared to the state-of-the-art approaches, particularly in AoA tracking of non-line-of-sight (NLoS) paths, highlighting the potential gain of CKM in facilitating both target and beam tracking in high-mobility communications.

eess.SP↗

Dust-obscured radio-emitting tidal disruption event coincident with a high-energy neutrino event

Despite the growing number of high-energy neutrinos (TeV-PeV) detected by IceCube, their astrophysical origins remain largely unidentified. Recent observations have linked a few tidal disruption events (TDEs) to the production of high-energy neutrino emission, all of which display dust-reprocessed infrared flares, indicating a dust- and gas-rich environment. By cross-matching the neutrino events and a sample of mid-infrared outbursts in nearby galaxies with transient radio flares, we uncover an optically obscured TDE candidate, SDSS J151345.75 $+$ 311125.2, which shows both spatial and temporal coincidence with the sub-PeV neutrino event IC170514B. Using a standard equipartition analysis of the synchrotron spectral evolution spanning 605 days post mid-infrared discovery, we find a little evolution in the radio-emitting region, with a kinetic energy up to $10^{51}$ erg, depending on the outflow geometry and shock acceleration efficiency assumed. High-resolution European VLBI Network imaging reveals a compact radio emission that is unresolved at a scale of $<$ 2.1 pc, with a brightness temperature of $T_b>5\times10^6$ K, suggesting that the observed late-time radio emission might originate from the interaction between a decelerating outflow and a dense circumnuclear medium. If the association is genuine, the neutrino production is possibly related to the acceleration of protons through pp collisions during the outflow expanding process, implying that the outflow-cloud interaction could provide a physical site with a high-density environment for producing the sub-PeV neutrinos. Such a scenario can be tested with future identifications of radio transients coincident with high-energy neutrinos.

astro-ph.HE↗

Theoretical investigation of non-Förster exciton transfer mechanisms in perylene diimide donor, phenylene bridge, and terrylene diimide acceptor systems

The rates of exciton transfer within dyads of perylene diimide and terrylene diimide connected by oligophenylene bridge units have been shown to deviate significantly from those of Förster's resonance energy transfer theory, according to single molecule spectroscopy experiments. The present work provides a detailed computational and theoretical study investigating the source of such discrepancy. Electronic spectroscopy data are calculated by time-dependent density function theory and then compared with experimental results. Electronic couplings between exciton donor and acceptor are estimated based on both transition density cube method and transition dipole approximation. These results confirm that the delocalization of exciton to the bridge parts contribute to significant enhancement of donor-acceptor electronic coupling. Mechanistic details of exciton transfer are examined by estimating the contributions of the bridge electronic states, vibrational modes of the dyads commonly coupled to both donor and acceptor, inelastic resonance energy transfer mechanism, and dark exciton states. These analyses suggest that the contribution of common vibrational modes serves as the main source of deviation from Förster's spectral overlap expression.

physics.chem-ph↗

Holistic Evaluation of Multimodal LLMs on Spatial Intelligence

Multimodal models have achieved remarkable progress in recent years. Nevertheless, they continue to exhibit notable limitations in spatial understanding and reasoning, the very capability that anchors artificial general intelligence in the physical world. With the recent release of GPT-5, allegedly the most powerful AI model to date, it is timely to examine where the leading models (GPT, Gemini, Grok, Seed, Qwen, and Intern) stand on the path toward spatial intelligence (SI). We thus propose EASI for holistic Evaluation of multimodAl LLMs on Spatial Intelligence. EASI conceptualizes a comprehensive taxonomy of spatial tasks that unifies existing benchmarks and a growing collection of newly curated ones, enabling systematic evaluation of state-of-the-art models. In this report, we conduct the study across eight key benchmarks, at a cost exceeding ten billion total tokens. Our empirical study then reveals that (1) GPT-5 demonstrates unprecedented strength in SI, yet (2) still falls short of human performance significantly across a broad spectrum of SI-tasks. Moreover, we (3) show that SI-tasks expose greater model capability deficiency than non-SI tasks, to the extent that (4) proprietary models do not exhibit a decisive advantage when facing the most difficult ones. In addition, we conduct a qualitative evaluation across a diverse set of scenarios that are intuitive for humans, yet fail the most advanced multimodal models. EASI is an ongoing community effort: we have open-sourced the EASI codebase that provides a one-stop and reproducible solution with standardized interfaces, integrated protocols and prompts that significantly reduce the friction of configuring and running multiple benchmarks; we have also launched an accompanying EASI leaderboard to provide a continually updated snapshot of model performance across the full SI spectrum, accelerating collective progress toward robust SI.

cs.CV↗

Detection of disk-jet co-precession in a tidal disruption event

Theories and simulations predict that intense spacetime curvature near black holes bends the trajectories of light and matter, driving disk and jet precession under relativistic torques. However, direct observational evidence of disk-jet co-precession remains elusive. Here, we report the most compelling case to date: a tidal disruption event (TDE) exhibiting unprecedented 19.6-day quasi-periodic variations in both X-rays and radio, with X-ray amplitudes exceeding an order of magnitude. The nearly synchronized X-ray and radio variations suggest a shared mechanism regulating the emission regions. We demonstrate that a disk-jet Lense-Thirring precession model successfully reproduces these variations while requiring a low-spin black hole. This study uncovers previously uncharted short-term radio variability in TDEs, highlights the transformative potential of high-cadence radio monitoring, and offers profound insights into disk-jet physics.

astro-ph.HE↗