arXiv Science⌕ Search

arXiv subjects

Yuanyuan Tan

Publications and source records attributed to Yuanyuan Tan.

3 recordsLinked to original sources

Interactive Visual Gym: Evaluating Visual Interaction Models with Simulated Users in Interactive Worlds

Visual interaction models that support users during ongoing physical tasks require evaluation in closed loop, where assistant responses can change subsequent user behavior and task outcomes. Existing benchmarks largely rely on offline replay and therefore cannot capture these effects. We introduce Interactive Visual Gym, a framework for closed-loop evaluation and training of visual interaction models through joint simulation of executable task environments and human users. We contribute three simulators that recreate everyday tasks and human-aligned action spaces across cooking, household manipulation, and mobile-interface domains, together with a persona-conditioned user simulation harness that collaborates with the assistant while incorporating controlled execution errors and other out-of-plan behaviors. We instantiate the framework as IVG-Bench, a benchmark with 315 interaction scenarios. Evaluating state-of-the-art VLMs as visual interaction models reveals substantial limitations: the best-performing model, Claude Opus 5.5, completes only 53.5% of tasks within the time limit, exhibits significant weaknesses in factual grounding and actionable guidance, and is often too slow to prevent errors when response latency is considered. We verify our evaluation protocol with a human study which finds 78.5% agreement between our interaction-quality metric and participant preferences. We further show that the environments provide useful learning signals: in a proof-of-concept GRPO experiment, closed-loop training improves both task success and interaction quality for Qwen3.5-4B model in our cooking environment.

cs.CV↗

Quantile Propagation Planning for Budgeted Tail-Risk Evaluation

Risk-aware planning must identify rare, costly outcomes using only a limited number of model evaluations. Monte Carlo rollouts spend this budget on noisy tail estimates, while planning from the mean can miss the tail entirely. We introduce quantile propagation planning (QPP), which propagates a small, fixed set of disturbance quantiles through the dynamics and integrates the resulting cost curve to evaluate both mean and tail risk. The method is exact at the propagated levels, converges as the quantile grid is refined, and admits a one-sided conservatism guarantee under stated structural conditions. In controlled overload and inventory tasks, QPP reduces realized tail cost and constraint violations relative to mean-rollout planning. On overload, it remains competitive with sampled evaluators that use substantially more trajectories. These results position QPP as a transparent, budget-controlled approach to tail-risk evaluation.

cs.LG↗

Investigation into the nature behind the interesting half levitation behavior of claimed superconductor LK-99

A recent article published by Lee et.al. claimed to have successfully achieved superconductivity at room temperature (RT) has become a topical issue. Besides the research paper, Lee and his team provided a demonstration video of LK-99 half levitating (HL) on a magnet. Such interesting HL appearance has drawn tremendous sensation both in academia and the network. However, the true identity of LK-99 still remains unclear, i.e., whether the HL behavior can necessarily indicate the diamagnetism behavior of the sample. Here, we fabricated our own LK-99 samples following the procedures reported by Lee et al. We found quite a few sample pieces showing the typical HL that is similar to those reported. Meanwhile, oxidation during the sample preparation was found to deleterious to acquiring HL in the sample, while furnace cooling or water quenching in the last step revealed little effect. However, our careful observations indicated that those HL pieces are more likely simple ferromagnetic. Then we conducted a comprehensive study on the behavior patterns of typical diamagnetism and ferromagnetic substances interacting with a Nd2Fe14B magnet, and provided instructions to distinguish the characteristics between ferromagnetic and diamagnetic to prevent misunderstanding of LK-99 like levitation behavior.

cond-mat.mtrl-sci↗