arXiv ScienceSearch

arXiv subjects

Xinqi Liu

Publications and source records attributed to Xinqi Liu.

2 recordsLinked to original sources

CylindTrack: Depth-Aware Cylindrical Motion Modeling for Panoramic Multi-Object Tracking

Multi-Object Tracking (MOT) is essential for persistent embodied perception in camera-equipped consumer and service robots. Panoramic cameras offer wide surrounding coverage, but equirectangular projection introduces a periodic horizontal domain in which conventional planar motion models and IoU-based association become unreliable near the 0°/360° seam. In addition, large-field-of-view scenes exhibit frequent interactions, scale variation, and occlusion, while frame-wise monocular depth estimates may fluctuate over time. To address these challenges, we propose CylindTrack, a depth-aware cylindrical tracking-by-detection framework for panoramic MOT. CylindTrack introduces Depth-Temporal Trajectory Modeling (DTM) to propagate instance depth as a temporally filtered trajectory-level state, providing more stable geometric cues for association. It further incorporates Spherical Spatio-Temporal Consistency Learning (SSTC), which combines a Temporal Mixer with Spherical Geometry-Aware Attention to improve temporal coherence and panoramic geometric alignment of depth-aware representations. Finally, the Topology-Aware Cylindrical Motion Model (TCMM) lifts horizontal motion into a continuous angular state space and performs seam-consistent prediction and association under panoramic periodicity. By jointly modeling depth dynamics and panoramic topology, CylindTrack improves identity preservation and trajectory continuity. Experiments on QuadTrack and JRDB achieve 33.67/31.12 HOTA and 40.45/34.33 IDF1 at 28.56/21.34 FPS, demonstrating the effectiveness and practical online efficiency of CylindTrack as a persistent perception module for panoramic consumer and service robots. The source code will be released at https://github.com/warriordby/CylindTrack.

cs.CV

TFP: Temporally Conditioned Memory-Fusion Policies for Visuomotor Learning

Vision--Language--Action (VLA) policies such as $π_{0.5}$ and OpenVLA perform well on many manipulation tasks, but they are often reactive: the next action is predicted from the current observation, instruction, and proprioceptive state. This assumption breaks down in stage-dependent manipulation, where visually similar states may require different actions depending on latent task progress and previous interaction outcomes. We argue that such tasks require not only memory, but dynamics-aware belief updates: the policy should preserve task progress during stable or occluded phases and revise its belief near contact, release, or subgoal transitions. We introduce Temporally Conditioned Memory-Fusion Policies (TFP), a lightweight memory-action framework for VLA backbones. TFP maintains an episode-local task-progress belief with Liquid Time-Constant dynamics and injects the updated belief directly into the flow-matching action decoder through adaptive modulation. This lets temporally accumulated context shape the generated action chunk, rather than serving only as passive history context. With a 3.3B-parameter model, TFP improves the average success rate from 96.9% to 98.75% on LIBERO and from 91.4% to 93.77% on LIBERO-plus. On the memory-focused MIKASA ShellGameTouch diagnostic, TFP achieves success up to 75.0%. Mechanistic analyses show that write-gain changes near manipulation events are about 6 times larger than far non-event phases, and hidden-state interventions show that the belief causally modulates generated action chunks. These results suggest that compact, event-sensitive memory dynamics can improve VLA policies under occlusion, visual perturbation, and stage-dependent task structure.

cs.RO