arXiv Science⌕ Search

arXiv subjects

Yifan Zhu

Publications and source records attributed to Yifan Zhu.

At least 19 recordsLinked to original sources

Self-Labeled Preference Transfer for Steerable Robot Manipulation

Vision-language-action (VLA) policies can learn to follow execution preferences, such as where to grasp an object or how to move around an obstacle, from demonstrations annotated with preference labels. Providing these annotations for every new task, however, is costly. We study whether learned preference control can transfer to new tasks whose demonstrations contain the desired behaviors but lack preference annotations. We find that a policy trained with preference annotations can follow preferences on a new task before adaptation but achieves limited task success. Fine-tuning on target demonstrations without these annotations improves task success while weakening preference control. Motivated by this finding, we introduce Self-Labeled Preference Transfer (SPT). SPT jointly trains a shared vision-language backbone for preference-conditioned action prediction and preference recognition on annotated source demonstrations. It then freezes the recognizer to preserve its cross-task preference recognition capability and uses it to self-label target demonstrations for policy fine-tuning. Across five types of execution preferences in simulation, the recognizer achieves 96.4% accuracy, and SPT reaches 84.8% preference following and 89.2% task success, compared with 59.4% and 88.0% for naive finetuning. We further extend to multiple preferences, achieving 93.8% preference following compared with 42.5% of baselines. In real-world experiments, SPT increases preference following from 52.5% to 92.5% relative to naive finetuning across two task transfers. These results show that SPT can support preference adaptation across tasks and objects while maintaining success, without additional manual preference annotations.

cs.RO↗

Same Evidence, Different Answers: Canonical-Context On-Policy Distillation for Multi-Turn Language Models

Large language models (LLMs) often solve a task when all instructions are given in a single prompt, but fail when the same information is revealed gradually across turns. When a clean FULL prompt and a RAW-SHARDED conversation contain the same complete user evidence, the model should still arrive at the same answer. We argue that a key reason for this gap is self-anchored drift: responses produced under partial information introduce unsupported assumptions, and those assumptions later distort the final answer. To reduce this effect, we propose Canonical-Context On-Policy Distillation (CCOPD). During training, the same base model is used in two roles: a frozen teacher conditioned on the clean FULL prompt and a trainable student that receives the same evidence incrementally through a multi-turn conversation; CCOPD aligns the student's behavior on its own trajectories with the teacher's canonical full-context behavior. Trained only on math problem conversations, CCOPD yields a 32\% average relative improvement in RAW-SHARDED performance over the original base model across math and five zero-shot out-of-domain task families, while largely preserving full-context performance. Further analyses suggest that CCOPD strengthens grounding in user evidence and reduces sensitivity to contamination from earlier assistant turns.

cs.CL↗

VOMMI: Collecting and Leveraging Portable Demonstrations for Mobile Manipulation

Portable mobile-manipulation demonstrations can help alleviate data scarcity for embodied intelligence, but obtaining reliable, low-cost, and robot-free motion supervision from RGB observations remains challenging. Existing approaches often rely on teleoperation or specialized devices equipped with additional sensing hardware, while directly using estimated visual odometry (VO) trajectories can introduce inconsistencies due to accumulated drift and imperfect motion supervision. We present the Visual-Odometry-Conditioned Mobile Manipulation Interface (VOMMI), a portable demonstration collection and learning framework that connects portable RGB demonstrations to vision-language-action (VLA) post-training through offline trajectory reconstruction and online visual-motion conditioning. VOMMI synchronizes body and hand views to capture navigation context and local object interactions without requiring human-robot kinematic correspondence calibration. R2-VO refines offline demonstration trajectories using sparse geometric anchors and produces causal local-motion tokens over multiple prediction horizons for online policy conditioning. An action-group residual adapter incorporates these tokens only into the base branch. Experiments use a 500-trajectory portable for each task, with 75 trajectories held out for RGB-VO evaluation, and 200 robot demonstrations as references. Our policy, post-trained only on portable demonstrations, achieves 18.2% lower base-velocity error than a policy trained with robot-collected demonstrations, while maintaining comparable end-effector translation accuracy. Offline reconstruction reduces absolute trajectory errors for the body and hand streams by 24.6% on average relative to the best evaluated baseline for each stream. The complete system improves the mean success rate by 8.3 percentage points over OpenPI 0.5 across three real-robot tasks.

cs.RO↗

OmniConfess: Eliciting Token Confessions to Mitigate Omni-Modal Hallucination

Omni-modal large language models (OmniLLMs) unify text, images, audio, and video, yet hallucinate when generation relies on the wrong evidence. Existing inference-time methods can reduce hallucinations, but rarely reveal which evidence sustains a generated commitment. We introduce OmniConfess, a training-free method for mitigating omni-modal hallucinations. It fixes a candidate response and re-scores it at token resolution under controlled channel-wise evidence interventions, producing a structured token-by-channel confession that reveals the response's evidential dependence. OmniConfess uses this confession to preserve grounded content and correct commitments driven by irrelevant or contradictory evidence. To evaluate OmniConfess, we construct OmniHalluBench, a 3,540-example benchmark built from six datasets spanning text, image, audio, and video settings and both judgment and free-form generation. Experiments show that OmniConfess mitigates hallucinations across heterogeneous modality and task settings. Our code and benchmark are publicly available at https://github.com/RongHuiQiang/OmniConfess.

cs.CL↗

InternW0: A Foundational Physical World Model for Efficient Real-World Interactions

Physical intelligence requires more than predicting how the world may evolve: predictions must remain actionable as the world continues to change. We introduce InternW0, the first instantiation of the InternW physical world model series from Shanghai AI Laboratory, built around omnimodal interfaces, asynchronous multi-frequency processing, and local physical modeling under partial observations and external influences. InternW0 jointly learns future visual dynamics and continuous robot control through an asymmetric video--action architecture with flow matching. A high-capacity video expert provides longer-horizon predictive context, while a lightweight action expert operates at a faster timescale. Instead of regenerating the future for every action update, InternW0 reuses layerwise K/V and adapts it to newly observed states through observation-conditioned context routing. Domain-specific interfaces and soft prompts support heterogeneous embodiments, while contact-aware post-training incorporates force and tactile signals for contact-rich manipulation. We train InternW0 on approximately 7,200 hours of heterogeneous robot and egocentric data, including EgoLab, a 275-hour real-laboratory egocentric dataset. Evaluation spans simulation benchmarks and real-world scientific tasks, including a 15-stage metal--organic framework synthesis workflow and 5-stage contact- and force-aware dexterous manipulation for general-purpose quantitative pipetting. These results advance scalable, asynchronous, and science-native physical world models for universal and efficient real-world interactions.

cs.RO↗

Mind the Gap: Theory-of-Mind-Grounded Friction for Epistemic Alignment

Productive dialogue alignment requires distinguishing \emph{surface coordination} (acknowledgments and smooth task progression) from \emph{epistemic alignment} (convergence of belief states); standard preference-based methods typically optimize response-level preferences without explicitly modeling the latter. We operationalize Theory-of-Mind (ToM) inference as a control signal within Frictive Policy Optimization by extracting, at each referring expression, a four-part belief structure: the speaker's intended referent, the addressee's interpretation, and each participant's model of the other's belief. This makes friction mechanically computable from epistemic-state comparisons, capturing \emph{silent divergence}, where both participants proceed confidently while grounding to different referents. We evaluate the signal at two levels. At the representation level, ablating the second-order channel reduces misunderstanding recall from $65\%$ to $26\%$. At the policy level, reward-shaping (FAR) and trust-region (FTR) variants improve intervention F1 and warranted-context calibration over DPO, with Brier scores independently supporting the calibration gains. Across three training runs, FAR and FTR remain substantially more stable, whereas DPO varies widely and can degrade intervention competence already present in the base policy. Thus, ToM-grounded friction provides a trainable signal for context-sensitive intervention under referential belief divergence.

cs.CL↗

Diamond Agent: Agentic Control of Federated HPC Resources as a Service

Efficiently aggregating and orchestrating computing power across heterogeneous clusters for HPC workflows faces four practical challenges: preserving workflow context across independently administered clusters, moving large datasets between sites, reasoning about site-specific environments and scheduler policies, and exploiting live queue and resource states for efficient task scheduling. To this end, we design Diamond Agent, an agentic system that enables intelligent execution of HPC workflows across heterogeneous clusters with typed skills as the interface. Diamond Agent provides an agent-facing workspace and skills that unify cross-site resource discovery, resource specification, data movement, task execution, and result retrieval. A centralized Diamond Agent instance can operate multiple supercomputers without being deployed separately on each login node. Diamond Agent translates high-level agent actions into valid site-specific executions, moves data through Globus Transfer, and uses live system capability and queue information to select feasible placements. Its event-driven continuation mechanism decouples agent actions from long-running batch jobs: persistent services monitor remote execution and resume the agent only when a result or decision-relevant event is available. We experiment with 27 hours of telemetry and 19 matched multi-site submission rounds comprising 83 jobs across four production supercomputers. Compared with a fixed-site baseline, Diamond Agent reduces the median additional completion time relative to the fastest observed placement from 42 seconds to 4 seconds, a 10.5x reduction.

cs.DC↗

Finite-sample nonparametric mean tests: Leave-one-out duality and asymptotic optimality

We study finite-sample valid tests of the one-sided mean hypothesis $H_0:μ\leq 1$ against $H_1:μ>1$ for nonnegative random variables. To do so, we develop a leave-one-out dual certificate framework, where certain pointwise inequalities imply p-value validity under the conditional mean null $\mathbb{E}[X_i\mid\mathbf{X}_{-i}]\leq 1$, and which also gives conditions that allow combining dual certificates for p-values to show that their pointwise minimum is also a valid p-value. The framework proves finite-sample validity of Wang and Zhao's nonparametric likelihood-ratio statistic $T_{\mathrm{nplr}}$, yields a new p-value $T_{\mathrm{bin}+}$ extending the Clopper--Pearson binomial test to general nonnegative random variables, and shows that the pointwise minimum $\min\{T_{\mathrm{nplr}},T_{\mathrm{bin}+}\}$ is itself a valid and more powerful p-value. We establish sharp optimality results for such testing problems in two regimes: both $T_{\mathrm{nplr}}$ and $T_{\mathrm{bin}+}$ attain a universal detectability boundary for the null $H_0$ without moment or tail assumptions, and $T_{\mathrm{bin}+}$ attains a nonparametric power lower bound under $n^{-1/2}$-local alternatives to $H_0$. Efficient algorithms and numerical experiments demonstrate substantial finite-sample power gains over existing valid methods.

math.ST↗

Propose to Learn, Learn to Propose: Evaluability-Aware Assistance under Bounded Rationality

AI assistants often collaborate by proposing candidate edits, plans, or designs that users evaluate before adoption. Existing assistance methods focus on proposal quality or user-goal inference, often assuming that the user can reliably evaluate any proposal, which can fail in practice because of bounded rationality. We study evaluability-aware proposal planning, where proposals serve both as task interventions and as probes for learning latent preferences and evaluation constraints, where the resulting belief updates then guide later proposals. We formalise this setting as ProSE, a hidden-parameter sequential assistance problem, and instantiate it with a KL-regularised bounded-rational binary response model in which acceptance trades off value gain against a distance-dependent evaluability penalty. Analysing the planning consequence of this likelihood reveals that likely accepted proposals and informative probes need not coincide, which explains why planners that only pursue acceptance systematically underperform. We operationalise ProSE with \textsc{ProSE-Plan}, a depth-2 Bayes-adaptive planner that scores proposals by possible responses and response-induced posterior beliefs. In controlled graph simulations, \textsc{ProSE-Plan} improves over evaluability-unaware and myopic baselines when evaluation cost is the bottleneck, and a probe-commit ablation confirms that our approach selects informative proposals that simpler methods miss. Our results thus identify user evaluability as a planning-relevant dimension of AI assistance, complementary to generation quality and preference inference.

cs.AI↗

Assessing Parameter Redundancy in Transformers for Jet Tagging

Transformer-based jet taggers, such as the Particle Transformer (ParT) and the More-Interaction Particle Transformer (MIParT), achieve excellent discrimination by exploiting correlations among jet constituents, but often require more trainable parameters than earlier deep-learning taggers. In this paper, we investigate whether comparable discriminating power can be achieved with substantially fewer parameters. We introduce an hourglass structure that replaces the feed-forward networks (FFNs) in the attention blocks while leaving the particle-interaction attention unchanged. We also introduce a lightweight particle-embedding layer to replace the original dense embedding network. Applying both modifications to ParT and MIParT yields the hourglass (HG) variants ParT-HG and MIParT-HG, respectively. We evaluate both models on benchmark datasets for top tagging and quark-gluon discrimination. Both variants retain comparable tagging performance, including background rejection at fixed signal efficiencies, while using only approximately 48% and 39.7% of the parameters of their respective baselines. On the larger JetClass dataset, accuracy and AUC decrease by less than 1%, and background rejection also decreases for several signal classes. Overall, our approach provides an alternative way to reduce the parameter count of Transformer jet taggers while largely retaining their tagging performance.

hep-ph↗

Global Convergence of an SQP Method for Contact-Implicit Trajectory Optimization

Contact-Implicit Trajectory Optimization (CITO) is a powerful framework for planning motions of robots that interact with complex environments, but its convergence behavior remains difficult to characterize. Existing formulations either rely on off-the-shelf nonlinear programming solvers whose guarantees require constraint qualifications that are hard to verify for contact-rich systems, or require differentiable explicit dynamics maps that are difficult to formulate in the presence of impacts, changing contact modes, and geometric non-smoothness. This paper studies CITO for a broader class of constraint-rich dynamic systems formulated through implicit physics constraints. By exploiting maximal-coordinate structure, penalty relaxations of equality and inequality constraints, and finite-horizon Hamiltonian bounds, we prove global convergence in the numerical-optimization sense for a specific line-search Sequential Quadratic Programming (SQP) method with adaptive timestep refinement. Under the stated constraint-rich dynamic-system assumptions and fixed pre-horizon data satisfying the strict-interior predecessor condition, the method terminates finitely from any finite discretized optimized trajectory guess at an $ε$-feasible, force-parameterized stationary point---a unit-objective, penalty-induced force-parameterized Fritz--John certificate for smooth damping, weakening to a homogeneous force-parameterized Clarke--Fritz--John certificate whose objective multiplier may vanish under nonsmooth frictional contact.

math.OC↗

Multi-Branch Policy Optimization for Multimodal Large Language Models

Group-based reinforcement learning methods for multimodal large language models typically rely on trajectory-level credit assignment that applies a single advantage to all tokens in a response. However, multimodal reasoning involves substantially higher perceptual uncertainty than text-only settings, where the model must repeatedly re-examine visual information to verify intermediate interpretations, and different visual groundings can lead to divergent reasoning paths, making such uniform credit assignment particularly inadequate and causing relative advantages to progressively degenerate toward zero. To address these challenges, we propose Multi-Branch Policy Optimization (MBPO), a tree-based framework that constructs reasoning trees at vision-language decision boundaries, enabling sibling branches to explore diverse visual hypotheses and assigning segment-level credit through branch-relative advantages. We further introduce a temporal replay buffer to reuse informative segments while controlling policy staleness. Experiments on several multimodal reasoning benchmarks show that MBPO outperforms representative baselines, improving both learning signal quality and optimization efficiency. The code is publicly available at https://github.com/ShuaiLyu0110/MBPO.

cs.CV↗

Pressure-induced Superconductivity in Thermoelectric Semiconductor Mg3Sb2

The intrinsic electronic structures of narrow bandgap thermoelectric (TE) materials serve as a platform for the investigation of coupling effects of quasi-particles under high pressure, enabling the exploration of emerging electronic and phonon transport, superconductivity, and topological transition. Here, we report the discovery of pressure-induced superconductivity in the TE semiconductor Mg3Sb2. Upon the increased pressure, the metallization occurs at 8.7 GPa, followed by a superconducting transition concomitant with a carrier-type crossover from p- to n-type. This phenomenon arises from a pressure-induced structural phase transition from the semiconducting P-3m1 to the metallic C2/m-I phase. The superconducting critical temperature (Tc) exhibits a dome-shaped pressure dependence, peaking at 3.3 K at 12.6 GPa. Combined theoretical calculations, high-pressure Raman spectroscopy, and X-ray diffraction (XRD) measurements reveal an additional structural transition above 20 GPa, yielding a distinct C2/m-II phase. Our findings establish the high-pressure phase diagram of Mg3Sb2, elucidate its pressure-dependent electronic properties, and provide valuable insights for future investigations of TE materials under high pressure.

cond-mat.supr-con↗

SAGG: Sample-Adaptive Gradient Gating for Robust Multimodal Learning under Heterogeneous Corruption

Multimodal gradient balancing methods modulate encoder gradients with a shared scalar per modality, implicitly assuming that corruption is uniform across the training batch. In practice, corruption is sample-heterogeneous: within a single mini-batch, different samples may have different modalities corrupted. We prove that under this heterogeneous corruption model, any batch-level sample-agnostic linear estimator with a shared modulation parameter incurs an irreducible bias with respect to the clean-data gradient, and that sample-level all-or-nothing gating is the unique unbiased strategy within a natural distribution-free estimator class. Motivated by this result, we propose Sample-Adaptive Gradient Gating (SAGG), which makes a binary retain-or-discard decision per sample via an online feature-norm quality test and incorporates a truncation mechanism for variance control. We prove that SAGG-based SGD converges at the standard O(1/sqrt(T)) rate to stationary points of the clean loss without a corruption-dependent error floor, and derive a certified robustness radius for the independent-encoder architecture that connects per-modality Lipschitz constants to the classification margin. Experiments on Kinetics-Sounds and UCF-101 under Gaussian noise injection, partial modality missing, and natural contribution imbalance show that SAGG consistently outperforms ten existing methods, with the largest gains in high-corruption regimes where batch-level bias is most severe.

cs.LG↗

Deep-learning jet flavor tagging for precision hadronic Higgs measurements at future $e^+e^-$ Higgs factories

Precise measurements of Higgs decays into quarks and gluons are essential for probing the Yukawa couplings of the Higgs boson and testing the flavor structure of the Standard Model. We investigate the process $e^+e^- \to ZH$ at $\sqrt{s}=240~\mathrm{GeV}$ at a future $e^+e^-$ Higgs factory, taking the CEPC design as a benchmark. The analysis focuses on events with $Z\toν\barν$ and hadronic Higgs decays $H\to b\bar{b}$, $c\bar{c}$, $s\bar{s}$ and $gg$. Jet flavor is identified using state-of-the-art particle-level deep neural network taggers (ParticleNet, Particle Transformer and More-Interaction Particle Transformer), whose per-jet outputs are combined with global event observables in a two-stage analysis employing XGBoost classifiers to separate the four Higgs decay modes from the dominant two- and four-fermion Standard Model backgrounds. Assuming an integrated luminosity of $20~\mathrm{ab}^{-1}$, we obtain projected relative precision on $σ(ZH)\times\mathrm{Br}(H\to X)$ of 0.17% for $X=b\bar{b}$, 1.06% for $c\bar{c}$, 0.50% for $gg$ and 68% for $s\bar{s}$. Compared with the CEPC published results, the precisions for $H\to c\bar{c}$ and $H\to gg$ are improved by about 43% and 29%, respectively. For $H\to s\bar{s}$ we present a quantitative sensitivity estimation corresponding to a statistical significance of about $1.5σ$. These results highlight the potential of deep-learning-based jet flavor tagging for precision studies of Higgs decays at future $e^+e^-$ Higgs factories.

hep-ph↗

Elastic Trapped States at Dislocation Defects in Scaled Coupling and Hofstadter Models

Elastic topological dislocations provide a pathway for trapping elastic wave energy at internal defects, rather than being confined solely to external boundaries or corners, which are typically associated with topological insulators (TIs). However, two practical constraints persist. First, highly confined dislocation states based on conventional Su-Schrieffer-Heeger (SSH) dimerization usually require a large coupling contrast and a correspondingly enlarged bandgap, which may be challenging to realize. Second, some Hamiltonians with richer topological physics often contain complex hopping terms, synthetic gauge fields or nonlocal couplings, which substantially increase the geometric complexity of experimental samples. Here, dislocation-induced trapped states are demonstrated in both a scaled coupling (SC) model and a Hofstadter model (HM) within an elastic platform. In the SC model, the trapped mode is treated as a higher localized state in the continuum rather than an in-gap mode in the SSH model. Consequently, the SC-induced dislocation can trap an enhanced mode without the requirement of an enlarged bandgap. For the HM, Householder tridiagonalization is used to map the original tight-binding Hamiltonian with complex hopping terms onto a tridiagonal matrix with only positive-real-valued nearest-neighbour (NN) hopping terms. Truncation at a weak-hopping position preserves the topological phenomena and allows a dislocation defect to be constructed from the shortened aperiodic chain. The results establish a practical route for designing highly localized modes without relying solely on bandgap enlargement or complex couplings, which advance the topological physics of elastic wave systems and promise enhanced possibilities for elastic functional devices.

physics.app-ph↗

Chiral Landau levels induced by two in-plane pseudomagnetic fields in underwater acoustic metamaterials

The chiral zeroth Landau levels (LLs) constitute topologically protected bulk states that enable robust control of acoustic wave propagation. Given the central role of underwater acoustics in marine engineering, realizing such Landau-level physics in underwater acoustic systems is highly desirable. Nevertheless, existing studies have primarily been limited to airborne acoustic systems, and the implementation of chiral zeroth LLs in underwater acoustics remains a challenge due to the unavoidable fluid-solid interactions. In this study, we realize two kinds of chiral LLs in an open underwater spoof surface acoustic wave (SSAW) platform by introducing two perpendicular in-plane artificial pseudomagnetic fields (PMFs), oriented along the x and y directions, respectively, and reveal that scalar acoustic fields in water and vectorial elastic vibrations in solids can be jointly manipulated within a unified framework. Specifically, by strategically opening bandgaps at the Dirac points, position-dependent effective mass terms are introduced into the Dirac Hamiltonians, thereby synthesizing two in-plane PMFs. This results in the emergence of chiral LLs, which is confirmed both numerically and experimentally. The unidirectional propagation of the chiral LLs and their robustness against defects are also demonstrated. In addition, we achieve flexible manipulation of underwater ultrasonic energy carried by SSAWs, including beam splitting and arbitrary wave steering. Dual-band chiral LLs are also observed in small-scale underwater topological metamaterials. Our work provides a new route toward SSAW-based underwater ultrasonic control, opening opportunities for multiband underwater acoustic signal processing and detection, as well as underwater acoustic energy harvesting.

physics.app-ph↗

A GPU-Accelerated Framework for Multi-Attribute Range Filtered Approximate Nearest Neighbor Search

Range-filtered approximate nearest neighbor search (RFANNS) is increasingly critical for modern vector databases. However, existing solutions suffer from severe index inflation and construction overhead. Furthermore, they rely exclusively on CPUs for the heavy indexing and query processing, significantly restricting the throughput due to the limited memory bandwidth and parallelism. In this paper, we present Garfield, a GPU-accelerated framework for multi-attribute range filtered ANNS that overcomes these bottlenecks through designing a lightweight index structure and hardware-aware execution pipeline. Garfield introduces the GMG index, which partitions data into cells and builds local graph indexes. It guarantees linear storage and indexing overhead by adding a constant number of cross-cell edges. For queries, Garfield utilizes a cluster-guided ordering strategy that reorders query-relevant cells, enabling a highly efficient cell-by-cell traversal on the GPU that aggressively reuses candidates as entry points across cells. To handle datasets exceeding GPU memory, Garfield features a cell-oriented out-of-core pipeline. It dynamically schedules cells to minimize the number of active queries per batch and overlaps GPU computation with CPU-to-GPU index streaming. Extensive evaluations demonstrate that Garfield reduces index size by 4.4x, while delivering 119.8x higher throughput than state-of-the-art RFANNS methods.

cs.DB↗