arXiv ScienceSearch

arXiv subjects

Lu Li

Publications and source records attributed to Lu Li.

At least 19 recordsLinked to original sources

Beyond Isolation: Unlocking Reinforcement Learning Component Synergy for Sample-Efficient Continuous Control

Reinforcement learning systems are significantly more complex than other machine learning paradigms due to inherent properties, causing RL system design to jointly account for many tightly coupled factors. Despite advances in individual algorithmic components, their functional interdependencies remain underexplored: do they exhibit mutual synergy or counterproductive interference? To bridge this gap, we conduct a systematic investigation and find that the efficacy of different components exhibits significant task-dependency, and naively stacking state-of-the-art techniques does not necessarily yield performance gains; instead, it often triggers emergent challenges, such as compounded non-stationarity. Building upon these findings, we distill a suite of actionable insights into the principled coordination of these components. Guided by these insights, we propose ROSER, an RL framework that coordinates three critical dimensions: Model-based Representation, Optimization Stability, and Experience Replay. Across diverse continuous-control benchmarks, ROSER consistently outperforms vanilla baselines and achieves 17.60% gains over naive stack. Our findings underscore the necessity of a holistic perspective in RL system design and paves the way for developing sample-efficient agents.

cs.LG

PIONEER: Bayesian Joint Modelling of Mechanistic Tumour Growth and Time-to-Event Endpoints for Dynamic Prediction of Ongoing Oncology Trials

High-stakes decisions in oncology clinical trials must often be made while survival data remains immature: progression-free survival (PFS) and overall survival (OS) are heavily censored, few events have accumulated, and the primary endpoint may be months or years from reading out. What is available at interim data cut-offs is information-rich longitudinal tumour measurements and baseline covariates. We present PIONEER, a Bayesian joint modelling framework that couples a mechanistic two-component state-space submodel of longitudinal tumour size dynamics to a multistate proportional-hazard submodel for competing clinical events, fitted simultaneously under a single posterior. The mechanistic submodel infers latent per-patient tumour trajectories - decomposed into treatment-responsive and refractory compartments with Gompertz-attenuated growth - from sparse, noisy sum-of-longest-diameter (SLD) observations. These latent trajectories feed the multistate hazard as time-varying covariates, while the event data simultaneously refines the tumour dynamics through the joint likelihood. All clinical endpoints (PFS, OS, objective response rate) are derived from the joint posterior in a single forward simulation pass, propagating full parameter uncertainty without any two-stage plug-in. Applied to a case study in extensive-stage small-cell lung cancer (two trials, N = 497), leave-future-out cross-validation demonstrates that at month 4 of enrolment (9 patients) the model produces calibrated PFS forecasts covering the mature month-19 Kaplan-Meier curve, and at month 11 (39 patients) the OS forecast converges - representing at least 8 months of advance forecasting with properly quantified uncertainty. We hope this work paves the way for broader adoption of Bayesian mechanistic state-space frameworks in clinical development, enabling earlier and more informed decision-making from immature trial data.

stat.AP

CSympNet-ID: conformal-symplectic map learning for linearly damped Hamiltonian systems

Learning dissipative dynamics from discrete observations is essential for reliable long-horizon prediction and physically meaningful parameter identification. For linearly damped Hamiltonian systems, the exact flow is generally not symplectic but conformally symplectic, contracting the canonical symplectic form by a scalar factor that reflects the net dissipation. We propose Conformal Symplectic Networks with damping identification (CSympNet-ID), a discrete-time map-learning framework that learns the one-step flow map directly from snapshot pairs while enforcing exact discrete conformal symplecticity by construction, without penalty terms or projection. The architecture composes an exact symplectic neural core with explicit diagonal scaling layers whose factors are parameterized exponentially by a scalar damping-rate parameter, thereby guaranteeing positivity and interpretability of the learned dissipation factor. We establish a scaling-conjugacy factorization for conformal symplectic maps and derive a pointwise-in-step density result for CSympNet-ID. We evaluate an irregular-step damped oscillator, a damped spring-mass chain, a damped nonlinear cubic oscillator, and additional high-dimensional extensions. CSympNet-ID gives the most favorable overall results among the compared models in the reported experiments, particularly in data-scarce regimes, target contraction-law recovery, and high-dimensional tests where unstructured baselines degrade rapidly.

cs.LG

Beyond One-Size-Fits-All: Diagnosis-Driven Online Reinforcement Learning with Offline Priors

Online reinforcement learning (RL) agents increasingly depend on knowledge acquired offline to achieve practical efficiency. Originally studied in offline-to-online RL, this paradigm now spans foundation model post-training and embodied intelligence, with prior types expanding from offline datasets and pre-trained policies to increasingly diverse knowledge sources such as multimodal foundation models and generative world models. Offline priors have become central to how deep RL is developed and deployed. However, this reliance introduces a challenge that the prevailing benchmark-driven paradigm cannot resolve: because prior validity varies across deployments and shifts during training, no single approach to managing it is universally optimal, and benchmark rankings offer limited guidance for real-world deployments. Rather than pursuing universal solutions, we argue that the field should shift to diagnosis-driven tension management, in which deployment-specific evidence guides how the learner relates to its priors throughout training, enabling both flexible and adaptive deployment. We support this position with a framework characterizing how priors reshape online optimization through three functional roles, controlled experiments demonstrating help-or-hurt reversals, cross-domain evidence from foundation model post-training to embodied intelligence, and engagement with five substantive counterarguments.

cs.LG

DeformX: A Versatile Co-Simulation Framework for Deformable Linear Objects

Deformable linear objects (DLOs) such as wires, cables, and ropes are common in robotic manipulation tasks, yet simulating them with both visual realism and physical accuracy remains challenging. Existing visual simulation methods typically rely on procedural geometric primitives that lack physically grounded deformation behavior, while physics-based approaches with robot learning support often approximate DLOs as rigid-link chains or generic soft bodies, failing to accurately capture the bending, twisting, and shear mechanics of slender elastic structures. In this work, we introduce DeformX, a co-simulation framework that integrates a dedicated Cosserat rod physics engine with NVIDIA Isaac Sim, enabling DLO simulations that are both physically faithful and visually realistic. Our Cosserat rod engine simulates the dynamics and self-collisions of DLOs, and contact interactions with arbitrary free-form meshes. To achieve high-fidelity visualization, we employ mesh skinning to map discrete rod deformations onto imported CAD models. To the best of our knowledge, DeformX is the one of the first frameworks for DLO simulation that unifies realistic visualization, principled physics, and compatibility with robot learning pipelines. We demonstrate its versatility across synthetic data generation and policy learning for DLO manipulation, and validate visual and physical fidelity through comparisons against real-world experiments. Notably, fine-tuning Segment Anything Model 3 (SAM3) on DeformX-generated data yields a 10.2% mAP@75 improvement in real-image wire segmentation, and a rope-swinging policy trained entirely in DeformX achieves a mean target-hitting error of 6.6 cm on a UR5e manipulator in real-world trials, highlighting its strong sim-to-real transfer capability.

cs.RO

Representation Learning Enables Scalable Multitask Deep Reinforcement Learning

Scaling reinforcement learning (RL) to diverse multitask settings remains a central challenge. While recent advances in model-based RL achieve strong performance, they rely on planning and complex training pipelines, making it unclear which components are essential for scalability. We revisit this question and argue that the primary driver of scalable multitask RL is not model-based control, but \emph{representation learning}. In particular, we show that combining predictive, model-based representations with high-capacity value function approximation is sufficient to achieve strong performance, even without planning. We evaluate a simple model-free algorithm, MR.Q, coupled with auxiliary predictive objectives into a scalable actor-critic architecture. This approach outperforms a recent world-model-based method and a range of deep RL baselines across a diverse suite of multitask continuous control tasks, while significantly reducing computational overhead and improving wall-clock efficiency. We observe consistent improvements with increased model capacity and show through ablations that predictive representation learning is critical for performance.

cs.LG

Evolution of the stellar mass function in open clusters from a universal and unsegregated initial state

The stellar mass function (MF) and its spatial variation (mass segregation) within star clusters encode signatures of early formation physics and subsequent secular evolution. Yet, a coherent evolutionary picture remains elusive due to conflicting reports regarding the universality of the initial mass function (IMF) and the prevalence of primordial mass segregation. These discrepancies often arise from unresolved binaries, field contamination, and completeness bias. Here, we resolve these issues by analyzing 163 high-fidelity open clusters via a Bayesian forward-modeling framework. We reveal a remarkably simple initial state: young clusters ($\lesssim 300$ Myr) share a mean IMF slope of $-2.29$ in the mass range $M \geq 0.5 M_\odot$, consistent with the Salpeter slope but with an intrinsic scatter of 0.17, and exhibit minimal mass segregation at the onset of gas-free evolution ($\sim$10 Myr). This broadly universal "zero-point" for secular evolution disfavors star-forming scenarios that predict strong primordial segregation or significant IMF variations, and suggests that chaotic cluster assembly and gas expulsion efficiently erase any mild primordial inhomogeneities. By tracing the evolutionary sequence from $10^7$ to $10^{9.8}$ yr, we demonstrate that dynamical processing operates on distinct timescales: mass segregation proceeds rapidly via internal relaxation, whereas global MF flattening due to tidal evaporation becomes dominant only after $\sim$600 Myr. These findings impose robust observational constraints on the physics of star formation and early feedback and establish an empirical baseline for modeling secular stellar dynamics.

astro-ph.GA

Non-local low energy neutral excitations in a strongly disordered triangular Mott magnet Cr$_3$Se$_2$Br$_5$

Understanding if low-energy excitations can remain itinerant in the presence of strong disorder remains a central challenge in frustrated quantum magnets, where disorder is generally expected to localize excitations through Anderson-like mechanisms. Here we report the emergence of charge-neutral itinerant excitations in a van der Waals compound Cr$_3$Se$_2$Br$_5$, a strongly disordered $S = 3/2$ Mott insulator with a frustrated triangular lattice. Structural analysis reveals substantial intrinsic disorder arising from Cr-site deficiency and Se/Br-site mixing, which appear to be fixed and cannot be readily tuned. No long-range magnetic order or conventional glassy behavior is observed. In addition to its highly insulating nature, the magnetic specific heat C_mag/T and thermal conductivity \k{appa}_xx/T both exhibit linear temperature dependencies with substantial finite intercepts. In particular, a sizeable field-independent residual term $\kappa/T \approx 0.03~\mathrm{W\,m^{-1}\,K^{-2}}$ is observed, providing compelling evidence of itinerant low-energy excitations that carry entropy without charge. These findings conceptually advance our understanding of quantum matter by demonstrating a rare regime where the interplay of disorder, frustration, and electronic correlations actively reshapes the nature of low-energy excitations, allowing itinerant neutral excitations to coexist with strong intrinsic disorder.

cond-mat.str-el

AnyBand-Diff: A Unified Remote Sensing Image Generation and Band Repair Framework with Spectral Priors

Existing diffusion models have made significant progress in generating realistic images. However, their direct adaptation to remote sensing imagery often disregards intrinsic physical laws. This oversight frequently leads to spectral distortion and radiometric inconsistency, severely limiting the scientific utility of generated data. To address this issue, this paper introduces AnyBand-Diff, a novel spectral-prior-guided diffusion framework tailored for robust spectral reconstruction. Specifically, we design a Masked Conditional Diffusion backbone integrated with a dual stochastic masking strategy, empowering the model to recover complete spectral information from arbitrary band subsets. Subsequently, to ensure radiometric fidelity, a Physics-Guided Sampling mechanism is proposed, leveraging gradients from a differentiable physical model to explicitly steer the denoising trajectory toward the manifold of physically plausible solutions. Furthermore, a Multi-Scale Physical Loss is formulated to enforce rigorous constraints across pixel, region, and global levels in a joint manner. Extensive experiments confirm the effectiveness of AnyBand-Diff in generating reliable imagery and achieving accurate spectral reconstruction, contributing to the advancement of physics-aware generative methods for Earth observation.

cs.CV

Rotation-Preserving Supervised Fine-Tuning

Supervised fine-tuning (SFT) improves in-domain performance but can degrade out-of-domain (OOD) generalization. Prior work suggests that this degradation is related to changes in dominant singular subspaces of pretrained weight matrices. However, directly identifying loss-sensitive directions with Hessian or Fisher information is computationally expensive at LLM scale. In this work, we propose preserving projected rotations in pretrained singular subspaces as an efficient proxy for Fisher-sensitive directions, which we call Rotation-Preserving Supervised Fine-Tuning (RPSFT). RPSFT penalizes changes in the projected top-$k$ singular-vector block of each pretrained weight matrix, limiting unnecessary rotation while preserving task adaptation. Across model families and sizes trained on math reasoning data, RPSFT improves the in-domain/OOD trade-off over standard SFT and strong SFT baselines, better preserves pretrained representations, and provides stronger initializations for downstream RL fine-tuning. Code is available at \href{https://github.com/jinhangzhan/RPSFT.git}{https://github.com/jinhangzhan/RPSFT}.

cs.LG

Foundation Models to Unlock Real-World Evidence from Nationwide Medical Claims

Evidence derived from large-scale real-world data (RWD) is increasingly informing regulatory evaluation and healthcare decision-making. Administrative claims provide population-scale, longitudinal records of healthcare utilization, expenditure, and detailed coding of diagnoses, procedures, and medications, yet their potential as a substrate for healthcare foundation models remains largely unexplored. Here we present ReClaim, a generative transformer trained from scratch on 43.8 billion medical events from more than 200 million enrollees in the MarketScan claims data spanning 2008-2022. ReClaim models longitudinal trajectories across diagnoses, procedures, medications, and expenditure, and was scaled to 140 million, 700 million, and 1.7 billion parameters. Across over 1,000 disease-onset prediction tasks, ReClaim achieved a mean AUC of 75.6%, substantially outperforming disease-specific LightGBM (66.3%) and the transformer-based Delphi model (69.4%), with the largest gains for rare diseases. These advantages held across retrospective and prospective evaluations and in external validation on two independent datasets. Performance improved monotonically with scale, and post-training added 13.8 percentage points over pre-training alone. Beyond disease prediction, ReClaim captured financial outcomes and improved real-world evidence (RWE) analyses: for healthcare expenditure forecasting it increased explained variance from 0.28 to 0.37 relative to LightGBM, and in a target trial emulation it reduced systematic bias by 72% on average relative to Delphi. Together, these results establish administrative claims as a scalable substrate for healthcare foundation models and show that learned representations generalize across time periods and data sources, supporting disease surveillance, expenditure forecasting, and RWE generation.

cs.AI

Experimental investigation of altermagnetic order in Cr-doped FeSb2

Altermagnets are a class of materials with compensated magnetic moments, in which spin sublattices are related by specific rotational symmetries other than inversion or translation. This allows time-reversal symmetry to be broken without a net magnetization. Cr-doped FeSb2 has been theoretically proposed as a candidate d-wave altermagnetic system, yet its magnetic ground state has remained unresolved. Here, we synthesize single crystals of Fe1-xCrxSb2 and investigate their electrical transport and magnetic properties, with a focus on Fe0.85Cr0.15Sb2. Magnetization measurements suggest spin-compensated ordering below ~3.5 K, where magnetic moments align along the crystallographic b-direction. Transport measurements reveal a crossover from large positive to negative magnetoresistance, while an anomalous Hall response emerges below 5 K, indicating time-reversal symmetry breaking. Muon spin relaxation measurements confirm that the magnetic ordering below 3.5 K is bulk in nature. The absence of coherent oscillations in zero-field {\mu}SR spectra and of magnetic Bragg intensity in single-crystal neutron diffraction establishes that the magnetically ordered state is short-range or disordered, rather than collinear altermagnetic order. These results demonstrate that Cr-doping alone breaks time-reversal symmetry without stabilizing long-range altermagnetic order in FeSb2.

cond-mat.mtrl-sci

When 2D Tasks Meet 1D Serialization: On Serialization Friction in Structured Tasks

In the LLM era, many symbolic and structured problems are presented to models through 1D text serialization. Yet some such problems are natively two-dimensional: their relevant relations, such as row--column correspondence or spatial adjacency, are defined by position in a 2D layout rather than by sequential order. This raises a representational question: does preserving the same symbolic entries in a 1D sequence also preserve the relational structure needed for computation? We study this issue through the lens of serialization friction: the representational mismatch in which the same underlying task instances and entries are still present, but relations that depend on layout become implicit under 1D serialization. The study uses a controlled synthetic testbed of three tasks: matrix transpose, Conway's Game of Life, and LU decomposition. In each task, the same instances are presented either as 1D text serialization or as their native 2D layout rendered as an image. Across this testbed, 1D serialization degrades more sharply as task size grows, and errors under serialization exhibit spatially structured patterns, suggesting that this presentation choice is consequential within our testbed. To further interpret these results, we add supplementary analyses that include a within-visual probe and an additional comparison of the two input presentations under the mixed-training transpose setting. These findings suggest that, for layout-defined tasks, reducing inputs to 1D serialization is not a neutral choice of representation.

cs.CL

GRM Scientific Pipeline

The Gamma-Ray Monitor (GRM) is a key payload of the Space-based multiband astronomical Variable Objects Monitor (SVOM) mission, which is designed to detect gamma ray bursts (GRBs) within the energy range of 15 keV to 5 MeV. The GRM Instrument Center (GRM\_IC) features real-time data processing through the X-band, enabling rapid response of high-energy GRB events. The system employs an event-driven architecture and distributed design, achieving efficient processing and real-time monitoring of massive observational data. Through comprehensive data production processes and scientific data product management, the system achieves efficient production of scientific data products of the L1B / C level through the submission of jobs to the task scheduling system. Through modular architecture design and automated processing workflow, the GRM data processing system realizes precise conversion and scientific analysis of GRB detection data, providing robust technical support for future system upgrades and cross-platform collaboration.

astro-ph.IM

The Gamma-Ray Monitor onboard the SVOM satellite

The Gamma-Ray Monitor (GRM) is a key scientific payload onboard the Space-based Multi-band Variable Object Monitor (SVOM) satellite, designed specifically for the detection and study of gamma-ray bursts (GRBs). Launched into a 625 km low-Earth orbit on 22 June 2024, GRM serves as a large-area, wide-field-of-view instrument capable of observing the hard X-ray and soft gamma-ray emissions in the energy range of 15 keV to 5 MeV. Its primary scientific objectives include: promptly triggering and localizing GRBs (with particular sensitivity to short-hard GRBs), measuring spectral and temporal properties of bursts, monitoring charged particle fluxes in orbit. GRM successfully detected its first GRB (GRB 240627B) on 27 June 2024, and has since maintained a detection rate of more than 100 GRBs per year. Cross-instrument comparisons with detectors such as GECAM and Fermi/GBM have validated the performance and data quality of GRM. This paper provides a comprehensive overview of GRM instrument design, reliability verification through ground testing, in-orbit triggering and localization algorithms, performance calibration, and preliminary in-orbit results, demonstrating its capability as a versatile gamma-ray all-sky monitor.

astro-ph.IM

Study on the detector energy response of SVOM/GRM

The SVOM mission is specifically designed to for the detection and localization of Gamma-Ray Bursts (GRBs) and subsequent follow-up observations. Among the four telescopes installed on the SVOM satellite, the Gamma-Ray Monitor (GRM) plays a crucial role in capturing the prompt emission of GRBs due to its wide field of view (FOV) and broad energy range. Accurate determination of the detector's energy response is vital for analyzing GRM data, particularly considering the significant impact of the atmospheric albedo effect on this response. This research focuses on deriving the detector's energy response and establishing a calibration database for the GRM, with particular emphasis on investigating the atmospheric albedo effect. The study shows that the contribution of albedo photons to the detector's effective area depends strongly on the orientation of the GRD line of sight (LoS) relative to Earth and on the incident direction of the GRB. When the GRD LoS is anti-Earth oriented, the albedo effect is minimal, with the highest proportion of albedo effective area accounting for approximately 10% of the total effective area. This occurs when the incident angle of the GRB is nearly perpendicular to the LoS. Conversely, if the GRD LoS is not pointing away from Earth and the GRB arrives from angles greater than about 90$^{\circ}$, the albedo component can become predominant, contributing up to around 100% of the total effective area. This is especially pronounced in the 8-20 keV range, where the direct effective area drops to zero due to the large GRB injection angle. Our results show that, it is necessary for GRM to consider the atmospheric albedo effects in detector response, otherwise the spectral and localization analyses will result in biased measurements.

astro-ph.HE

Culture-Aware Humorous Captioning: Multimodal Humor Generation across Cultural Contexts

Recent multimodal large language models have shown promising ability in generating humorous captions for images, yet they still lack stable control over explicit cultural context, making it difficult to jointly maintain image relevance, contextual appropriateness, and humor quality under a specified cultural background. To address this limitation, we introduce a new multimodal generation task, culture-aware humorous captioning, which requires a model to generate a humorous caption conditioned on both an input image and a target cultural context. Captions generated under different cultural contexts are not expected to share the same surface form, but should remain grounded in similar visual situations or humorous rationales.To support this task, we establish a six-dimensional evaluation framework covering image relevance, contextual fit, semantic richness, reasonableness, humor, and creativity. We further propose a staged alignment framework that first initializes the model with high-resource supervision under the Western cultural context, then performs multi-dimensional preference alignment via judge-based GRPO with a Degradation-aware Prototype Repulsion Constraint to mitigate reward hacking in open-ended generation, and finally adapts the model to the Eastern cultural context with a small amount of supervision. Experimental results show that our method achieves stronger overall performance under the proposed evaluation framework, with particularly large gains in contextual fit and a better balance between image relevance and humor under cultural constraints.

cs.CL

The trigger and localization system of SVOM-GRM

The Space multi-band Variable Object Monitor (SVOM) is an astronomical satellite jointly developed by China and France, primarily focused on the detection of gamma-ray bursts (GRBs) and transient sources. The SVOM satellite was launched on 22nd June, 2024 with four payloads installed onboard. As one of payload, GRM comprises 3 gamma-ray detectors (each detector has an effective area of approximately 200~cm$^{2}$) with distinct pointing directions, enabling the temporal and spectral measurements as well as localization of GRBs in the energy range of 15-5000 keV. This article firstly introduces the on-board localization algorithm design for GRM and presents preliminary test results. Then, leveraging abundant ground-based computational resources, a joint fitting method for spectral and localization analysis using Monte Carlo Markov Chain (MCMC) is implemented. In contrast to the on-board localization algorithm, the on-ground MCMC method comprehensively considers the influence of spectral characteristics, thereby mitigating systematic biases. Finally, a systematic analysis based on this method is provided, highlighting the localization and spectral measurement capabilities of GRM. The preliminary localization analysis result for the on-board detected GRB 240629A by both GRM and Fermi/GBM shows that the localization result (error$\sim$4.14$^{\circ}$) of GRM is consistent with the Fermi/GBM result.

astro-ph.IM