arXiv subjects

Xuanyi Li

Publications and source records attributed to Xuanyi Li.

8 recordsLinked to original sources

arXiv2026

PyRUA-REAL: Robot Exploration and Adaptive Learning through RSI in the Real World

Coding agents powered by models such as GPT-6-Astra connect spatial reasoning with executable robot behavior, raising the question of how such agents can produce lasting improvements in robot capabilities from physical interaction. In this work, we study embodied recursive self-improvement (RSI) through real-world exploration, code refinement, and deployment using PyRUA-REAL, a framework in which coding agents retain interaction experience as persistent memory and reusable executable skills that inform subsequent exploration and improvement. Our empirical study places physical manipulation at the center of the improvement process, examining how agents collaborate, what kinds of execution feedback support effective code refinement, and how task specifications and previously acquired skills influence robustness and task transfer. We further investigate the efficiency and capability of the resulting programs when deployed without involving an online agent for decision-making. Across eight real-world tasks, PyRUA-REAL achieves an average success rate of 91.1%. In complementary evaluation on 42 tasks from the RoboDojo benchmark, it achieves an average success rate of 84.4%. This study provides empirical guidance for turning physical exploration into reusable robot skills that support continued improvement and robust, efficient deployment.

cs.RO↗

arXiv2026

When Does Experience Memory Help Closed-Loop LLM Driving Agents? A Controlled Evaluation with Resampled Warmup Pools, Token-Matched Fillers, and Audited Baselines

When does experience memory help a closed-loop LLM driving agent? Published gains cannot say, because the two factors we find to matter most, which warmup experiences the pool contains and what any injected tokens do to the prompt, are controlled in none of them. We answer with a controlled evaluation on one audited HighwayEnv testbed (1Hz, gpt-4o-mini for the decisive contrasts). We treat the warmup pool as a resampled random factor (ten disjoint pools) and add token-matched irrelevant-filler controls, oracle-certified diagnostics, caution-pricing metrics, and quantified audits of the baseline ports. The probe suite spans flat-text retrieval (a DiLu port), a single-frame grid port (RESPOND-inspired), our episodic temporal-graph memory, a retrieval-free consolidated rulebook, and a flat K-step observation-history baseline. Four findings follow, each a property of this testbed. (1) Headline memory gains belong to the warmup draw. The reported pool is the best of ten for both retrieval memories, which beat No-Memory in only one pool of ten (sign test p=0.011), and even the rulebook's apparent pool-immunity collapsed on five fresh draws. (2) No retrieval design tested exceeds token-matched filler. The collision-only merge ceiling is reached by a single 15-token caution instruction, and metrics that price caution erase the rulebook's lead. (3) Representational sophistication is nowhere robustly operative. (4) Baseline port quality silently inverts conclusions. On this testbed, a single-pool comparison without filler controls would have reported memory gains that these controls reverse. We release the testbed, audited ports, seeds, and caches.

cs.AI↗

arXiv2026

OmniRaindrop: A Comprehensive Benchmark for Dual-Focused Raindrop Removal under Day and Night Scenes

Adherent raindrops on camera lenses are a pervasive source of real-world image degradation, undermining outdoor visual perception for downstream applications such as robotics and 3D scene reconstruction. However, most existing raindrop datasets and methods target only background-focused 2D images, overlooking the equally common raindrop-focused case and the impact of raindrops on 3D scene reconstruction. Moreover, they are almost exclusively daytime, lacking the complex artificial lighting and reflections of nighttime raindrop scenes. To address these issues, we introduce OmniRaindrop, a real-world dataset and benchmark that jointly evaluates 2D raindrop removal and 3D scene reconstruction across raindrop-focused and background-focused captures, under both daytime and nighttime conditions. OmniRaindrop provides spatially aligned raindrop-focused, background-focused, and rain-free ground-truth image sets: a 2D subset of 15,186 aligned pairs/triplets and a 3D subset of 40 real-world scenes evenly split between day and night, totaling 3,822 multi-view images. On top of this data, the benchmark traces how raindrop degradation propagates from 2D restoration to 3D reconstruction by testing representative restoration methods and their effects on pose estimation, point cloud initialization, and 3DGS optimization. Comprehensive experiments reveal that raindrop-focused scenes are substantially harder than background-focused ones, and that errors in 2D restoration and pose/point cloud initialization cascade into degraded 3D reconstruction, pointing to clear directions for more robust 2D restoration and 3DGS design. Building on the dataset, we have organized two consecutive NTIRE challenges (2025 and 2026) on Day and Night Raindrop Removal for Dual-Focused Images.

cs.CV↗

arXiv2026

From Offline Proxies to Online Decisions: A Layered Engagement Evaluation Framework for Conversational AI

Online A/B experiments are the decision standard for user engagement, but traffic and readout time limit how many conversational-AI changes can be tested. We ask whether an offline signal designed to be computable without treatment-arm user exposure agrees with the outcomes of those experiments. We contribute a reusable construction and diagnosis checklist that treats an offline proxy as a chain of three alignments: behavioral label to product outcome, learned classifier to candidate-assistant behavior, and aggregated offline signal to experiment effect. A companion evaluation protocol audits the whole composite by interval-aware decision agreement, which compares offline and online confidence intervals instead of point estimates, and by within-experiment ranking. The instantiation we evaluate comprises a fixed evaluation suite on which candidate behavior is scored, an engagement classifier trained to predict session/prompt level engagements, and a calibration layer mapping sample-level score differences to online model-level engagement deltas. We then report the audit: 489 paired offline-online contrasts (one candidate arm against its control) from 27 experiments on a deployed multi-turn assistant, spanning model checkpoints to system-prompt tuning. Our primary test uses the 113 contrasts from eight experiments that ran after the map was frozen: on these the composite reaches 81.1% F1, against 34.3% for the raw classifier score it is built on, and makes no wrong-direction calls where that raw score makes 31. Every offline prediction was computed before its experiment ran to prevent overfitting. The evidence supports using the composite to prioritize candidates before scarce experiment traffic is allocated---in our deployment of the experiment, selecting among training checkpoints and tuning system prompts.

cs.AI↗

arXiv2026

Learning Human-Like Badminton Skills for Humanoid Robots

Realizing versatile and human-like performance in high-demand sports like badminton remains a formidable challenge for humanoid robotics. Unlike standard locomotion or static manipulation, this task demands a seamless integration of explosive whole-body coordination and precise, timing-critical interception. While recent advances have achieved lifelike motion mimicry, bridging the gap between kinematic imitation and functional, physics-aware striking without compromising stylistic naturalness is non-trivial. To address this, we propose Imitation-to-Interaction, a progressive reinforcement learning framework designed to evolve a robot from a "mimic" to a capable "striker." Our approach establishes a robust motor prior from human data, distills it into a compact, model-based state representation, and stabilizes dynamics via adversarial priors. Crucially, to overcome the sparsity of expert demonstrations, we introduce a manifold expansion strategy that generalizes discrete strike points into a dense interaction volume. We validate our framework through the mastery of diverse skills, including lifts and drop shots, in simulation. Furthermore, we demonstrate the first zero-shot sim-to-real transfer of anthropomorphic badminton skills to a humanoid robot, successfully replicating the kinetic elegance and functional precision of human athletes in the physical world.

cs.RO↗

arXiv2024

Sora Generates Videos with Stunning Geometrical Consistency

The recently developed Sora model [1] has exhibited remarkable capabilities in video generation, sparking intense discussions regarding its ability to simulate real-world phenomena. Despite its growing popularity, there is a lack of established metrics to evaluate its fidelity to real-world physics quantitatively. In this paper, we introduce a new benchmark that assesses the quality of the generated videos based on their adherence to real-world physics principles. We employ a method that transforms the generated videos into 3D models, leveraging the premise that the accuracy of 3D reconstruction is heavily contingent on the video quality. From the perspective of 3D reconstruction, we use the fidelity of the geometric constraints satisfied by the constructed 3D models as a proxy to gauge the extent to which the generated videos conform to real-world physics rules. Project page: https://sora-geometrical-consistency.github.io/

cs.CV↗

arXiv2023

Realistic Spin Model for Multiferroic NiI$_2$

A realistic first-principle-based spin Hamiltonian is constructed for the type-II multiferroic NiI$_2$, using a symmetry-adapted cluster expansion method. Besides single ion anisotropy and isotropic Heisenberg terms, this model further includes the Kitaev interaction and a biquadratic term, and can well reproduce striking features of the experimental helical ground state, that are, {\it e.g.}, a proper screw state, canting of rotation plane, propagation direction and period. Using this model to build a phase diagram, it is demonstrated that, (i) the in-plane propagation direction of $\langle1\bar10\rangle$ is determined by the Kitaev interaction, instead of the long-believed exchange frustrations; and (ii) the canting of rotation plane is also dominantly determined by Kitaev interaction, rather than interlayer couplings. Furthermore, additional Monte Carlo simulations reveal three equivalent domains and different topological defects. Since the ferroelectricity is induced by spins in type-II multiferroics, our work also implies that Kitaev interaction is closely related to the multiferroicity of NiI$_2$.

cond-mat.str-el↗

arXiv2020

Simultaneous Generation of Direct- and Indirect-Gap Photoluminescence in Multilayer MoS2 Bubbles

Transition metal dichalcogenide (TMD) materials have received enormous attention due to their extraodinary optical and electrical properties, among which MoS2 is the most typical one. As thickness increases from monolayer to multilayer, the photoluminescence (PL) of MoS2 is gradually quenched due to the direct-to-indirect band gap transition. How to enhance PL response and decrease the layer dependence in multilayer MoS2 is still a challenging task. In this work, we report, for the first time, simultaneous generation of three PL peaks at around 1.3, 1.4 and 1.8 eV on multilayer MoS2 bubbles. The temperature dependent PL measurements indicate that the two peaks at 1.3 and 1.4 eV are phonon-assisted indirect-gap transitions while the peak at 1.8 eV is the direct-gap transition. Using first-principles calculations, the band structure evolution of multilayer MoS2 under strain is studied, from which the origin of the three PL peaks of MoS2 bubbles is further confirmed. Moreover, PL standing waves are observed in MoS2 bubbles that creates Newton-Ring-like patterns. This work demonstrates that the bubble structure may provide new opportunities for engineering the electronic structure and optical properties of layered materials.

cond-mat.mtrl-sci↗