arXiv subjects

Jie Chen

Publications and source records attributed to Jie Chen.

At least 163 records · Page 9Linked to original sources

arXiv2025

DyMoDreamer: World Modeling with Dynamic Modulation

A critical bottleneck in deep reinforcement learning (DRL) is sample inefficiency, as training high-performance agents often demands extensive environmental interactions. Model-based reinforcement learning (MBRL) mitigates this by building world models that simulate environmental dynamics and generate synthetic experience, improving sample efficiency. However, conventional world models process observations holistically, failing to decouple dynamic objects and temporal features from static backgrounds. This approach is computationally inefficient, especially for visual tasks where dynamic objects significantly influence rewards and decision-making performance. To address this, we introduce DyMoDreamer, a novel MBRL algorithm that incorporates a dynamic modulation mechanism to improve the extraction of dynamic features and enrich the temporal information. DyMoDreamer employs differential observations derived from a novel inter-frame differencing mask, explicitly encoding object-level motion cues and temporal dynamics. Dynamic modulation is modeled as stochastic categorical distributions and integrated into a recurrent state-space model (RSSM), enhancing the model's focus on reward-relevant dynamics. Experiments demonstrate that DyMoDreamer sets a new state-of-the-art on the Atari $100$k benchmark with a $156.6$\% mean human-normalized score, establishes a new record of $832$ on the DeepMind Visual Control Suite, and gains a $9.5$\% performance improvement after $1$M steps on the Crafter benchmark. Our code is released at https://github.com/Ultraman-Tiga1/DyMoDreamer.

cs.LG↗

arXiv2025

Sparse2Dense: A Keypoint-driven Generative Framework for Human Video Compression and Vertex Prediction

For bandwidth-constrained multimedia applications, simultaneously achieving ultra-low bitrate human video compression and accurate vertex prediction remains a critical challenge, as it demands the harmonization of dynamic motion modeling, detailed appearance synthesis, and geometric consistency. To address this challenge, we propose Sparse2Dense, a keypoint-driven generative framework that leverages extremely sparse 3D keypoints as compact transmitted symbols to enable ultra-low bitrate human video compression and precise human vertex prediction. The key innovation is the multi-task learning-based and keypoint-aware deep generative model, which could encode complex human motion via compact 3D keypoints and leverage these sparse keypoints to estimate dense motion for video synthesis with temporal coherence and realistic textures. Additionally, a vertex predictor is integrated to learn human vertex geometry through joint optimization with video generation, ensuring alignment between visual content and geometric structure. Extensive experiments demonstrate that the proposed Sparse2Dense framework achieves competitive compression performance for human video over traditional/generative video codecs, whilst enabling precise human vertex prediction for downstream geometry applications. As such, Sparse2Dense is expected to facilitate bandwidth-efficient human-centric media transmission, such as real-time motion analysis, virtual human animation, and immersive entertainment.

cs.CV↗

arXiv2025

Neighborhood Sampling Does Not Learn the Same Graph Neural Network

Neighborhood sampling is an important ingredient in the training of large-scale graph neural networks. It suppresses the exponential growth of the neighborhood size across network layers and maintains feasible memory consumption and time costs. While it becomes a standard implementation in practice, its systemic behaviors are less understood. We conduct a theoretical analysis by using the tool of neural tangent kernels, which characterize the (analogous) training dynamics of neural networks based on their infinitely wide counterparts -- Gaussian processes (GPs). We study several established neighborhood sampling approaches and the corresponding posterior GP. With limited samples, the posteriors are all different, although they converge to the same one as the sample size increases. Moreover, the posterior covariance, which lower-bounds the mean squared prediction error, is uncomparable, aligning with observations that no sampling approach dominates.

cs.LG↗

arXiv2025

Symmetry- and energy-resolved entanglement dynamics in a disordered Bose-Hubbard model

Using numerical quantum quenches with the integration of both symmetry and energy resolutions, we comprehensively study the dynamics of symmetry-resolved entanglement in a disordered Bose-Hubbard (dBH) model, concentrating on the two types of inhomogeneous initial states to target the lower- and higher-energy sections of its dynamical phase diagram. (i) Motivated by the recent experiment [A. Lukin et al., Science 364, 256 (2019)] which focused on the lower-energy dynamic behaviors of the dBH chain, we first show that, at low energies, for a thermalizing state, although the second law of thermodynamics prohibits the decrease of the total entropy over time, for part of the channel-resolved entropies, a long-term entropic reduction may arise at weak disorder. (ii) A companion channel-resolved analysis at strong disorder further hints that the priorly observed double-log growth of the number entropy might not directly indicate the breakdown of MBL in spin or fermion chains, providing a refreshing perspective on this major controversy in the community. (iii) From time-evolving the line-shape low-energy product state, we subsequently reveal an abrupt formation of a novel "entropy imbalance pattern" across the different symmetry channels. Intriguingly, this imbalance melts in the strong-disorder limit. We conjecture that the melting of the entropic pattern, together with the freezing of a concurrent particle-density wave, embodies a dual trait inherent to MBL. (iv) Specifically, we find a cluster MBL regime, unique to the Bose statistics, emerging from the higher-energy section. This cluster MBL regime realizable even at weak disorder appears not suffer from the finite-size drift and is distinguished by its absence of the hallmark of MBL - the unbounded growth of the entanglement entropy. Our theoretical predictions are by and large testable via the present experimental facilities.

cond-mat.dis-nn↗

arXiv2025

Automated algorithm design for convex optimization problems with linear equality constraints

Synthesis of optimization algorithms typically follows a {\em design-then-analyze\/} approach, which can obscure fundamental performance limits and hinder the systematic development of algorithms that operate near these limits. Recently, a framework grounded in robust control theory has emerged as a powerful tool for automating algorithm synthesis. By integrating design and analysis stages, fundamental performance bounds are revealed and synthesis of algorithms that achieve them is enabled. In this paper, we apply this framework to design algorithms for solving strongly convex optimization problems with linear equality constraints. Our approach yields a single-loop, gradient-based algorithm whose convergence rate is independent of the condition number of the constraint matrix. This improves upon the best known rate within the same algorithm class, which depends on the product of the condition numbers of the objective function and the constraint matrix.

math.OC↗

arXiv2025

A Dual-Modulation Framework for RGB-T Crowd Counting via Spatially Modulated Attention and Adaptive Fusion

Accurate RGB-Thermal (RGB-T) crowd counting is crucial for public safety in challenging conditions. While recent Transformer-based methods excel at capturing global context, their inherent lack of spatial inductive bias causes attention to spread to irrelevant background regions, compromising crowd localization precision. Furthermore, effectively bridging the gap between these distinct modalities remains a major hurdle. To tackle this, we propose the Dual Modulation Framework, comprising two modules: Spatially Modulated Attention (SMA), which improves crowd localization by using a learnable Spatial Decay Mask to penalize attention between distant tokens and prevent focus from spreading to the background; and Adaptive Fusion Modulation (AFM), which implements a dynamic gating mechanism to prioritize the most reliable modality for adaptive cross-modal fusion. Extensive experiments on RGB-T crowd counting datasets demonstrate the superior performance of our method compared to previous works. Code available at https://github.com/Cht2924/RGBT-Crowd-Counting.

cs.CV↗

arXiv2025

Standardizing Generative Face Video Compression using Supplemental Enhancement Information

This paper proposes a Generative Face Video Compression (GFVC) approach using Supplemental Enhancement Information (SEI), where a series of compact spatial and temporal representations of a face video signal (e.g., 2D/3D keypoints, facial semantics and compact features) can be coded using SEI messages and inserted into the coded video bitstream. At the time of writing, the proposed GFVC approach using SEI messages has been included into a draft amendment of the Versatile Supplemental Enhancement Information (VSEI) standard by the Joint Video Experts Team (JVET) of ISO/IEC JTC 1/SC 29 and ITU-T SG21, which will be standardized as a new version of ITU-T H.274 | ISO/IEC 23002-7. To the best of the authors' knowledge, the JVET work on the proposed SEI-based GFVC approach is the first standardization activity for generative video compression. The proposed SEI approach has not only advanced the reconstruction quality of early-day Model-Based Coding (MBC) via the state-of-the-art generative technique, but also established a new SEI definition for future GFVC applications and deployment. Experimental results illustrate that the proposed SEI-based GFVC approach can achieve remarkable rate-distortion performance compared with the latest Versatile Video Coding (VVC) standard, whilst also potentially enabling a wide variety of functionalities including user-specified animation/filtering and metaverse-related applications.

cs.CV↗

arXiv2025

Stochastic Schrödinger-Korteweg de Vries systems driven by multiplicative noises

In this paper, we consider the well-posedness of stochastic S-KdV driven by multiplicative noises in $H_x^1\times H_x^1$. To get the local well-posedness, we first develop the bilinear and trilinear Bourgain norm estimates of the nonlinear terms with $b\in\left(0,1/2\right)$. Then, to overcome regularity problems, we introduce a series of approximation equations with localized nonlinear terms, which are also cutted-off in both the physical and the frequency space. By limitations, these approximation equations will help us get a priori estimate in the Bourgain space and finish the proof of the global well-posedness of the initial system.

math.PR↗

arXiv2025

Hybrid Two-Stage Reconstruction of Multiscale Subsurface Flow with Physics-informed Residual Connected Neural Operator

The novel neural networks show great potential in solving partial differential equations. For single-phase flow problems in subsurface porous media with high-contrast coefficients, the key is to develop neural operators with accurate reconstruction capability and strict adherence to physical laws. In this study, we proposed a hybrid two-stage framework that uses multiscale basis functions and physics-guided deep learning to solve the Darcy flow problem in high-contrast fractured porous media. In the first stage, a data-driven model is used to reconstruct the multiscale basis function based on the permeability field to achieve effective dimensionality reduction while preserving the necessary multiscale features. In the second stage, the physics-informed neural network, together with Transformer-based global information extractor is used to reconstruct the pressure field by integrating the physical constraints derived from the Darcy equation, ensuring consistency with the physical laws of the real world. The model was evaluated on datasets with different combinations of permeability and basis functions and performed well in terms of reconstruction accuracy. Specifically, the framework achieves R2 values above 0.9 in terms of basis function fitting and pressure reconstruction, and the residual indicator is on the order of $1\times 10^{-4}$. These results validate the ability of the proposed framework to achieve accurate reconstruction while maintaining physical consistency.

cs.LG↗

arXiv2025

DiffAero: A GPU-Accelerated Differentiable Simulation Framework for Efficient Quadrotor Policy Learning

This letter introduces DiffAero, a lightweight, GPU-accelerated, and fully differentiable simulation framework designed for efficient quadrotor control policy learning. DiffAero supports both environment-level and agent-level parallelism and integrates multiple dynamics models, customizable sensor stacks (IMU, depth camera, and LiDAR), and diverse flight tasks within a unified, GPU-native training interface. By fully parallelizing both physics and rendering on the GPU, DiffAero eliminates CPU-GPU data transfer bottlenecks and delivers orders-of-magnitude improvements in simulation throughput. In contrast to existing simulators, DiffAero not only provides high-performance simulation but also serves as a research platform for exploring differentiable and hybrid learning algorithms. Extensive benchmarks and real-world flight experiments demonstrate that DiffAero and hybrid learning algorithms combined can learn robust flight policies in hours on consumer-grade hardware. The code is available at https://github.com/flyingbitac/diffaero.

cs.RO↗

arXiv2025

Sticker-TTS: Learn to Utilize Historical Experience with a Sticker-driven Test-Time Scaling Framework

Large reasoning models (LRMs) have exhibited strong performance on complex reasoning tasks, with further gains achievable through increased computational budgets at inference. However, current test-time scaling methods predominantly rely on redundant sampling, ignoring the historical experience utilization, thereby limiting computational efficiency. To overcome this limitation, we propose Sticker-TTS, a novel test-time scaling framework that coordinates three collaborative LRMs to iteratively explore and refine solutions guided by historical attempts. At the core of our framework are distilled key conditions-termed stickers-which drive the extraction, refinement, and reuse of critical information across multiple rounds of reasoning. To further enhance the efficiency and performance of our framework, we introduce a two-stage optimization strategy that combines imitation learning with self-improvement, enabling progressive refinement. Extensive evaluations on three challenging mathematical reasoning benchmarks, including AIME-24, AIME-25, and OlymMATH, demonstrate that Sticker-TTS consistently surpasses strong baselines, including self-consistency and advanced reinforcement learning approaches, under comparable inference budgets. These results highlight the effectiveness of sticker-guided historical experience utilization. Our code and data are available at https://github.com/RUCAIBox/Sticker-TTS.

cs.AI↗

arXiv2025

Data-driven solar forecasting enables near-optimal economic decisions

Solar energy adoption is critical to achieving net-zero emissions. However, it remains difficult for many industrial and commercial actors to decide on whether they should adopt distributed solar-battery systems, which is largely due to the unavailability of fast, low-cost, and high-resolution irradiance forecasts. Here, we present SunCastNet, a lightweight data-driven forecasting system that provides 0.05$^\circ$, 10-minute resolution predictions of surface solar radiation downwards (SSRD) up to 7 days ahead. SunCastNet, coupled with reinforcement learning (RL) for battery scheduling, reduces operational regret by 76--93\% compared to robust decision making (RDM). In 25-year investment backtests, it enables up to five of ten high-emitting industrial sectors per region to cross the commercial viability threshold of 12\% Internal Rate of Return (IRR). These results show that high-resolution, long-horizon solar forecasts can directly translate into measurable economic gains, supporting near-optimal energy operations and accelerating renewable deployment.

physics.geo-ph↗

arXiv2025

Robust Offline Imitation Learning Through State-level Trajectory Stitching

Imitation learning (IL) has proven effective for enabling robots to acquire visuomotor skills through expert demonstrations. However, traditional IL methods are limited by their reliance on high-quality, often scarce, expert data, and suffer from covariate shift. To address these challenges, recent advances in offline IL have incorporated suboptimal, unlabeled datasets into the training. In this paper, we propose a novel approach to enhance policy learning from mixed-quality offline datasets by leveraging task-relevant trajectory fragments and rich environmental dynamics. Specifically, we introduce a state-based search framework that stitches state-action pairs from imperfect demonstrations, generating more diverse and informative training trajectories. Experimental results on standard IL benchmarks and real-world robotic tasks showcase that our proposed method significantly improves both generalization and performance.

cs.RO↗

arXiv2025

Investigation of $Λ_{b}\to Λ_{c} \ell^-\overlineν_\ell$ Decays in Perturbative QCD Approach

We investigate the semileptonic decays $Λ_{b} \to Λ_{c} \ell^- \barν_\ell$ (with $\ell = e, μ, τ$) within the framework of perturbative QCD (pQCD). The six independent $Λ_b \to Λ_c$ transition form factors are first calculated in the low-$q^2$ region using the $k_T$ factorization approach. These are then extrapolated to the full physical $q^2$ range via the model-independent $z$-expansion, incorporating recent lattice QCD results at high $q^2$. Based on the obtained form factors, we compute the branching fractions of $Λ_b \to Λ_c \ell^- \barν_\ell$ decays. Our prediction for the lepton flavor universality ratio, $\mathcal{R}_{Λ_c} = 0.29^{+0.12}_{-0.11}$, is slightly larger than the latest experimental measurement. In addition, we analyze several angular observables, including forward-backward asymmetries, lepton-side convexity parameters, and polarization asymmetries. These results offer valuable theoretical input for current and future experimental investigations of semileptonic heavy-to-heavy baryon transitions.

hep-ph↗

arXiv2025

SPGrasp: Spatiotemporal Prompt-driven Grasp Synthesis in Dynamic Scenes

Real-time interactive grasp synthesis for dynamic objects remains challenging as existing methods fail to achieve low-latency inference while maintaining promptability. To bridge this gap, we propose SPGrasp (spatiotemporal prompt-driven dynamic grasp synthesis), a novel framework extending segment anything model v2 (SAMv2) for video stream grasp estimation. Our core innovation integrates user prompts with spatiotemporal context, enabling real-time interaction with end-to-end latency as low as 59 ms while ensuring temporal consistency for dynamic objects. In benchmark evaluations, SPGrasp achieves instance-level grasp accuracies of 90.6% on OCID and 93.8% on Jacquard. On the challenging GraspNet-1Billion dataset under continuous tracking, SPGrasp achieves 92.0% accuracy with 73.1 ms per-frame latency, representing a 58.5% reduction compared to the prior state-of-the-art promptable method RoG-SAM while maintaining competitive accuracy. Real-world experiments involving 13 moving objects demonstrate a 94.8% success rate in interactive grasping scenarios. These results confirm SPGrasp effectively resolves the latency-interactivity trade-off in dynamic grasp synthesis.

cs.RO↗

arXiv2025

UniAPO: Unified Multimodal Automated Prompt Optimization

Prompting is fundamental to unlocking the full potential of large language models. To automate and enhance this process, automatic prompt optimization (APO) has been developed, demonstrating effectiveness primarily in text-only input scenarios. However, extending existing APO methods to multimodal tasks, such as video-language generation introduces two core challenges: (i) visual token inflation, where long visual token sequences restrict context capacity and result in insufficient feedback signals; (ii) a lack of process-level supervision, as existing methods focus on outcome-level supervision and overlook intermediate supervision, limiting prompt optimization. We present UniAPO: Unified Multimodal Automated Prompt Optimization, the first framework tailored for multimodal APO. UniAPO adopts an EM-inspired optimization process that decouples feedback modeling and prompt refinement, making the optimization more stable and goal-driven. To further address the aforementioned challenges, we introduce a short-long term memory mechanism: historical feedback mitigates context limitations, while historical prompts provide directional guidance for effective prompt optimization. UniAPO achieves consistent gains across text, image, and video benchmarks, establishing a unified framework for efficient and transferable prompt optimization.

cs.CV↗

arXiv2025

Strichartz type estimates of the Airy equation

In this article, we show the necessary and sufficient conditions for the inequality $\|u\|_{L_t^qL_x^r}\lesssim \|u\|_{X^{s,b}}$, where $$\|u\|_{X^{s,b}}:=\|\hat{u}(τ,ξ)\langle ξ\rangle^s\langle τ-ξ^3\rangle^b \|_{L_{τ,ξ}^2}. $$ Here, we provide a complete classification of the indices relationships for which this inequality holds true. Such estimates will be very useful in solving the well-posedness for low regularity well-posedness of the Korteweg--de Vries equations and stochastic Korteweg--de Vries equations.

math.AP↗

arXiv2025

Universal Entanglement Pattern Formation via a Quantum Quench

We identify a universal short-time structure in symmetry-resolved entanglement dynamics -- the entanglement channel wave (ECW) -- arising from the decomposition of entanglement into conserved-quantum-number sectors that host robust, channel-specific patterns. Focusing on domain-wall melting, we conduct a systematic investigation across three paradigmatic classes of many-body systems: U(1) fermions, U(1) bosons, and SU(2) spinful fermions. For each class, we explore four distinct regimes defined by the presence or absence of interactions and disorder, employing both the Krylov-subspace iterative method and the correlation matrix approach. The ECW emerges universally across all cases, establishing its independence from particle statistics, interaction strength and disorder. In free fermions, the ECW formalism further enables analytical determination of the correlation matrix spectrum. The subsequent melting of the ECW exhibits symmetry- and statistics-dependent signatures, revealing finer structures in the growth of symmetry-resolved entanglement.

cond-mat.str-el↗