arXiv subjects

Bin Zhu

Publications and source records attributed to Bin Zhu.

At least 73 records · Page 4Linked to original sources

arXiv2026

Teacher-Student Diffusion Model for Text-Driven 3D Hand Motion Generation

Generating realistic 3D hand motion from natural language is vital for VR, robotics, and human-computer interaction. Existing methods either focus on full-body motion, overlooking detailed hand gestures, or require explicit 3D object meshes, limiting generality. We propose TSHaMo, a model-agnostic teacher-student diffusion framework for text-driven hand motion generation. The student model learns to synthesize motions from text alone, while the teacher leverages auxiliary signals (e.g., MANO parameters) to provide structured guidance during training. A co-training strategy enables the student to benefit from the teacher's intermediate predictions while remaining text-only at inference. Evaluated using two diffusion backbones on GRAB and H2O, TSHaMo consistently improves motion quality and diversity. Ablations confirm its robustness and flexibility in using diverse auxiliary inputs without requiring 3D objects at test time.

cs.CV↗

arXiv2026

RC-NF: Robot-Conditioned Normalizing Flow for Real-Time Anomaly Detection in Robotic Manipulation

Recent advances in Vision-Language-Action (VLA) models have enabled robots to execute increasingly complex tasks. However, VLA models trained through imitation learning struggle to operate reliably in dynamic environments and often fail under Out-of-Distribution (OOD) conditions. To address this issue, we propose Robot-Conditioned Normalizing Flow (RC-NF), a real-time monitoring model for robotic anomaly detection and intervention that ensures the robot's state and the object's motion trajectory align with the task. RC-NF decouples the processing of task-aware robot and object states within the normalizing flow. It requires only positive samples for unsupervised training and calculates accurate robotic anomaly scores during inference through the probability density function. We further present LIBERO-Anomaly-10, a benchmark comprising three categories of robotic anomalies for simulation evaluation. RC-NF achieves state-of-the-art performance across all anomaly types compared to previous methods in monitoring robotic tasks. Real-world experiments demonstrate that RC-NF operates as a plug-and-play module for VLA models (e.g., pi0), providing a real-time OOD signal that enables state-level rollback or task-level replanning when necessary, with a response latency under 100 ms. These results demonstrate that RC-NF noticeably enhances the robustness and adaptability of VLA-based robotic systems in dynamic environments.

cs.CV↗

arXiv2026

Actor-Critic for Continuous Action Chunks: A Reinforcement Learning Framework for Long-Horizon Robotic Manipulation with Sparse Reward

Existing reinforcement learning (RL) methods struggle with long-horizon robotic manipulation tasks, particularly those involving sparse rewards. While action chunking is a promising paradigm for robotic manipulation, using RL to directly learn continuous action chunks in a stable and data-efficient manner remains a critical challenge. This paper introduces AC3 (Actor-Critic for Continuous Chunks), a novel RL framework that learns to generate high-dimensional, continuous action sequences. To make this learning process stable and data-efficient, AC3 incorporates targeted stabilization mechanisms for both the actor and the critic. First, to ensure reliable policy improvement, the actor is trained with an asymmetric update rule, learning exclusively from successful trajectories. Second, to enable effective value learning despite sparse rewards, the critic's update is stabilized using intra-chunk $n$-step returns and further enriched by a self-supervised module providing intrinsic rewards at anchor points aligned with each action chunk. We conducted extensive experiments on 25 tasks from the BiGym and RLBench benchmarks. Results show that by using only a few demonstrations and a simple model architecture, AC3 achieves superior success rates on most tasks, validating its effective design.

cs.RO↗

arXiv2026

SAM3-LiteText: An Anatomical Study of the SAM3 Text Encoder for Efficient Vision-Language Segmentation

Vision-language segmentation models such as SAM3 enable flexible, prompt-driven visual grounding, but inherit large, general-purpose text encoders originally designed for open-ended language understanding. In practice, segmentation prompts are short, structured, and semantically constrained, leading to substantial over-provisioning in text encoder capacity and persistent computational and memory overhead. In this paper, we perform a large-scale anatomical analysis of text prompting in vision-language segmentation, covering 404,796 real prompts across multiple benchmarks. Our analysis reveals severe redundancy: most context windows are underutilized, vocabulary usage is highly sparse, and text embeddings lie on low-dimensional manifold despite high-dimensional representations. Motivated by these findings, we propose SAM3-LiteText, a lightweight text encoding framework that replaces the original SAM3 text encoder with a compact MobileCLIP student that is optimized by knowledge distillation. Extensive experiments on image and video segmentation benchmarks show that SAM3-LiteText reduces text encoder parameters by up to 88%, substantially reducing static memory footprint, while maintaining segmentation performance comparable to the original model. Code: https://github.com/SimonZeng7108/efficientsam3/tree/sam3_litetext.

cs.AI↗

arXiv2026

Table-as-Search: Formulate Long-Horizon Agentic Information Seeking as Table Completion

Current Information Seeking (InfoSeeking) agents struggle to maintain focus and coherence during long-horizon exploration, as tracking search states, including planning procedure and massive search results, within one plain-text context is inherently fragile. To address this, we introduce \textbf{Table-as-Search (TaS)}, a structured planning framework that reformulates the InfoSeeking task as a Table Completion task. TaS maps each query into a structured table schema maintained in an external database, where rows represent search candidates and columns denote constraints or required information. This table precisely manages the search states: filled cells strictly record the history and search results, while empty cells serve as an explicit search plan. Crucially, TaS unifies three distinct InfoSeeking tasks: Deep Search, Wide Search, and the challenging DeepWide Search. Extensive experiments demonstrate that TaS significantly outperforms numerous state-of-the-art baselines across three kinds of benchmarks, including multi-agent framework and commercial systems. Furthermore, our analysis validates the TaS's superior robustness in long-horizon InfoSeeking, alongside its efficiency, scalability and flexibility. Code and datasets are publicly released at https://github.com/AIDC-AI/Marco-Search-Agent.

cs.CL↗

arXiv2026

LLMBind: A Unified Modality-Task Integration Framework

Despite recent progress in Multi-Modal Large Language Models (MLLMs), it remains challenging to integrate diverse tasks ranging from pixel-level perception to high-fidelity generation. Existing approaches often suffer from either restricted task extensibility or severe performance degradation due to modality interference. n this paper, we present LLMBind, an extensible framework that unifies multimodal tasks through a dual-pathway mechanism: In-Situ semantic embeddings for localization-sensitive tasks like semantic segmentation and Ex-Situ task-prompts for generation across image, video, and audio modalities. Additionally, we employ a Mixture-of-Experts (MoE) architecture to route task-specific tokens, thereby achieving modality disentanglement and mitigating negative transfer. We also curate a 400k multi-turn interactive dataset focused on iterative visual refinement to enable human-like interaction. Extensive experiments demonstrate that LLMBind achieves excellent performance across multiple perception and generation benchmarks while maintaining superior expandability.

cs.CL↗

arXiv2026

Line Spectral Estimation Using a G-Filter: Atomic Norm Minimization with Multiple Output Vectors

We propose an atomic norm minimization (ANM) estimator of frequencies in a noisy complex sinusoidal signal that integrates Georgiou's filter bank (G-filter) with multiple output vectors (MOV). Unlike our previous work on the G-filter version of ANM which is restricted to a single filtered output vector, the proposed method in this paper uses MOV to improve data utilization and robustness of the estimate. The ANM problem with MOV can be reformulated as a semidefinite program thanks to a Carathéodory--Fejér-type decomposition for output covariance matrices of the G-filter. Numerical simulations demonstrate that the proposed approach significantly outperforms the standard ANM and the G-filter version of ANM with a single output vector in recovering the correct number of frequency components when the frequencies fall within the band(s) selected by the G-filter, particularly in the low SNR regime.

math.OC↗

arXiv2026

Enhancing Action and Ingredient Modeling for Semantically Grounded Recipe Generation

Recent advances in Multimodal Large Language Models (MLMMs) have enabled recipe generation from food images, yet outputs often contain semantically incorrect actions or ingredients despite high lexical scores (e.g., BLEU, ROUGE). To address this gap, we propose a semantically grounded framework that predicts and validates actions and ingredients as internal context for instruction generation. Our two-stage pipeline combines supervised fine-tuning (SFT) with reinforcement fine-tuning (RFT): SFT builds foundational accuracy using an Action-Reasoning dataset and ingredient corpus, while RFT employs frequency-aware rewards to improve long-tail action prediction and ingredient generalization. A Semantic Confidence Scoring and Rectification (SCSR) module further filters and corrects predictions. Experiments on Recipe1M show state-of-the-art performance and markedly improved semantic fidelity.

cs.CL↗

arXiv2026

Geomagnetic constraints on Millicharged Dark Matter

Millicharged particles are well-motivated dark matter candidates arising in many extensions of the Standard Model. We show that, despite their tiny coupling $e_m$ to photons, millicharged dark matter (mDM) in the Earth's geomagnetic field can generate a quasi-static, monochromatic magnetic signal with angular frequency twice the mDM mass. Using null results from the SuperMAG and SNIPE Hunt collaborations, we constrain the effective charge of bosonic mDM in the mass range $10^{-18}$--$10^{-14}\,\text{eV}$. The resulting upper bounds exceed stellar cooling constraints by over thirteen orders of magnitude, demonstrating the power of this method.

hep-ph↗

arXiv2026

From AdS correlators to Carrollian amplitudes with the scattering equation

The scattering equations relate massless scattering kinematics to marked points on a Riemann sphere, and underpin remarkable formulae for the full tree-level S-matrices of many interesting QFTs, including cubic biadjoint scalars, Yang-Mills theory and general relativity. The scattering equations arise from worldsheet correlators of ambitwistor string theories, which has enabled their generalisation to anti-de Sitter (AdS) space in certain cases. In this paper, we use the scattering equations and ambitwistor strings to prove the correspondence between an appropriate flat limit of boundary correlators in AdS and Carrollian scattering amplitudes -- massless amplitudes written in position space on the null conformal boundary -- for any number of external states and spacetime dimensions in tree-level, cubic scalar theories. We first derive the Carrollian version of the scattering equations in Minkowski space and their associated Carrollian amplitude formulae, by direct Fourier transform from momentum space and from ambitwistor strings with a Carrollian basis of vertex operators. We then take the flat limit of known formulae for all tree-level boundary correlators of cubic scalar theories in AdS, recovering the Carrollian amplitudes in flat space. In the special case of AdS$_3$, we also make some comments on the flat space limit of spinning boundary correlators.

hep-th↗

arXiv2026

Revisiting a Fast Newton Solver for a 2-D Spectral Estimation Problem: Computations with the Full Hessian

Spectral estimation plays a fundamental role in frequency-domain identification and related signal processing problems. This paper revisits a 2-D spectral estimation problem formulated in terms of convex optimization. More precisely, we work with the dual optimization problem and show that the full Hessian of the dual function admits a Toeplitz-block Toeplitz structure which is consistent with our finding in a previous work. This particular structure of the Hessian enables a fast inversion algorithm in the solution of the dual optimization problem via Newton's method whose superior speed of convergence is illustrated via simulations.

math.OC↗

arXiv2025

Resonant ALP-Portal Dark Matter Annihilation as a Solution to the $B^{\pm} \to K^{\pm} ν\barν$ Excess

The Belle II collaboration recently reported a $2.7σ$ excess in the rare decay $B^\pm \to K^\pm ν\barν$, potentially signaling new physics. We propose an axion-like particle (ALP)-portal dark matter (DM) framework to explain this anomaly while satisfying the observed DM relic abundance. By invoking a resonant annihilation mechanism ($m_a \sim 2m_χ$), we demonstrate that the ALP-mediated interactions between the Standard Model and DM sectors simultaneously account for the $B^\pm \to K^\pm ν\barν$ anomaly and thermal freeze-out dynamics. Two distinct scenarios-long-lived ALPs decaying outside detectors (displaced diphotons) and ALPs decaying invisibly to DM pairs (missing energy)-are examined. While the displaced diphotons scenario is excluded by kaon decay bounds ($K^\pm \to π^\pm + \text{inv.}$), the invisible decay channel remains unconstrained and aligns with Belle II's missing energy signature. Using the coupled Boltzmann equation formalism, we rigorously incorporate early kinetic decoupling effects, revealing deviations up to a factor of 20 from traditional relic density predictions in resonance regions. For the missing energy scenario, the viable parameter space features ALP-SM and ALP-DM couplings: $g_{aWW}(g_{aγγ}) \in (7.13 \times 10^{-5} - 9.60 \times 10^{-5})\, \text{GeV}^{-1}$ (from $B^\pm \to K^\pm a$) and $g_{aχχ} \in (7.12\times10^{-5} - 7.73\times 10^{-3})\, \text{GeV}^{-1}$ (for resonant annihilation), accommodating ALP masses $m_a \in (0.6, 4.8)\, \text{GeV}$. Therefore, this work establishes the ALP portal as a viable bridge between the $B^\pm \to K^\pm ν\barν$ anomaly and thermal DM production, emphasizing precision calculations of thermal decoupling in resonance regimes.

hep-ph↗

arXiv2025

Benchmarking Gaslighting Negation Attacks Against Reasoning Models

Recent advances in reasoning-centric models promise improved robustness through mechanisms such as chain-of-thought prompting and test-time scaling. However, their ability to withstand gaslighting negation attacks-adversarial prompts that confidently deny correct answers-remains underexplored. In this paper, we conduct a systematic evaluation of three state-of-the-art reasoning models, i.e., OpenAI's o4-mini, Claude-3.7-Sonnet and Gemini-2.5-Flash, across three multimodal benchmarks: MMMU, MathVista, and CharXiv. Our evaluation reveals significant accuracy drops (25-29% on average) following gaslighting negation attacks, indicating that even top-tier reasoning models struggle to preserve correct answers under manipulative user feedback. Built upon the insights of the evaluation and to further probe this vulnerability, we introduce GaslightingBench-R, a new diagnostic benchmark specifically designed to evaluate reasoning models' susceptibility to defend their belief under gaslighting negation attacks. Constructed by filtering and curating 1,025 challenging samples from the existing benchmarks, GaslightingBench-R induces even more dramatic failures, with accuracy drops exceeding 53% on average. Our findings highlight a fundamental gap between step-by-step reasoning and resistance to adversarial manipulation, calling for new robustness strategies that safeguard reasoning models against gaslighting negation attacks.

cs.CV↗

arXiv2025

RL-I2IT: Image-to-Image Translation with Deep Reinforcement Learning

Most existing Image-to-Image Translation (I2IT) methods generate images in a single run of a deep learning (DL) model. However, designing such a single-step model is always challenging, requiring a huge number of parameters and easily falling into bad global minimums and overfitting. In this work, we reformulate I2IT as a step-wise decision-making problem via deep reinforcement learning (DRL) and propose a novel framework that performs RL-based I2IT (RL-I2IT). The key feature in the RL-I2IT framework is to decompose a monolithic learning process into small steps with a lightweight model to progressively transform a source image successively to a target image. Considering that it is challenging to handle high dimensional continuous state and action spaces in the conventional RL framework, we introduce meta policy with a new concept Plan to the standard Actor-Critic model, which is of a lower dimension than the original image and can facilitate the actor to generate a tractable high dimensional action. In the RL-I2IT framework, we also employ a task-specific auxiliary learning strategy to stabilize the training process and improve the performance of the corresponding task. Experiments on several I2IT tasks demonstrate the effectiveness and robustness of the proposed method when facing high-dimensional continuous action space problems. Our implementation of the RL-I2IT framework is available at https://github.com/Algolzw/SPAC-Deformable-Registration.

cs.CV↗

arXiv2025

Search for Ultralight Dark Matter with Quantum Magnetometry in the Earth's Cavity

Ultralight dark matter candidates, such as axions and dark photons, are leading dark matter candidates. They may couple feebly to photons, sourcing oscillating electromagnetic signals in the Earth's conducting cavity formed between the ground and the ionosphere, providing detectable magnetic field signatures at wavelengths above the Earth's size. We carry out a project aiming to search for new physics using an unshielded high-sensitivity atomic magnetometer, termed the Geomagnetic Probe for nEw physiCS (GPEX). In this work, we report our first search for axion and dark photon dark matter, conducted in the desert of XiaoDushan in Gansu Province, China. Analysis of the collection of one-hour data shows no robust evidence for axion- or dark photon-induced magnetic signals. Correspondingly, we set the constraints on the axion-photon coupling with $g_{aγγ} < 7\times10^{-10}\, \mathrm{GeV^{-1}}$ and the dark photon kinetic-mixing parameter $ε< 2\times10^{-6}$ in the mass range $3.5 \times 10^{-16}\, \mathrm{eV} \sim 1.8 \times 10^{-14}\, \mathrm{eV}$. Our findings demonstrate the feasibility of using ground-based quantum magnetic sensors for ultralight dark matter searches. Future networks of such detectors operating over extended periods could improve the sensitivity by about three orders of magnitude.

hep-ph↗

arXiv2025

DevPiolt: Operation Recommendation for IoT Devices at Xiaomi Home

Operation recommendation for IoT devices refers to generating personalized device operations for users based on their context, such as historical operations, environment information, and device status. This task is crucial for enhancing user satisfaction and corporate profits. Existing recommendation models struggle with complex operation logic, diverse user preferences, and sensitive to suboptimal suggestions, limiting their applicability to IoT device operations. To address these issues, we propose DevPiolt, a LLM-based recommendation model for IoT device operations. Specifically, we first equip the LLM with fundamental domain knowledge of IoT operations via continual pre-training and multi-task fine-tuning. Then, we employ direct preference optimization to align the fine-tuned LLM with specific user preferences. Finally, we design a confidence-based exposure control mechanism to avoid negative user experiences from low-quality recommendations. Extensive experiments show that DevPiolt significantly outperforms baselines on all datasets, with an average improvement of 69.5% across all metrics. DevPiolt has been practically deployed in Xiaomi Home app for one quarter, providing daily operation recommendations to 255,000 users. Online experiment results indicate a 21.6% increase in unique visitor device coverage and a 29.1% increase in page view acceptance rates.

cs.AI↗

arXiv2025

Dual-LoRA and Quality-Enhanced Pseudo Replay for Multimodal Continual Food Learning

Food analysis has become increasingly critical for health-related tasks such as personalized nutrition and chronic disease prevention. However, existing large multimodal models (LMMs) in food analysis suffer from catastrophic forgetting when learning new tasks, requiring costly retraining from scratch. To address this, we propose a novel continual learning framework for multimodal food learning, integrating a Dual-LoRA architecture with Quality-Enhanced Pseudo Replay. We introduce two complementary low-rank adapters for each task: a specialized LoRA that learns task-specific knowledge with orthogonal constraints to previous tasks' subspaces, and a cooperative LoRA that consolidates shared knowledge across tasks via pseudo replay. To improve the reliability of replay data, our Quality-Enhanced Pseudo Replay strategy leverages self-consistency and semantic similarity to reduce hallucinations in generated samples. Experiments on the comprehensive Uni-Food dataset show superior performance in mitigating forgetting, representing the first effective continual learning approach for complex food tasks.

cs.LG↗

arXiv2025

FlashI2V: Fourier-Guided Latent Shifting Prevents Conditional Image Leakage in Image-to-Video Generation

In Image-to-Video (I2V) generation, a video is created using an input image as the first-frame condition. Existing I2V methods concatenate the full information of the conditional image with noisy latents to achieve high fidelity. However, the denoisers in these methods tend to shortcut the conditional image, which is known as conditional image leakage, leading to performance degradation issues such as slow motion and color inconsistency. In this work, we further clarify that conditional image leakage leads to overfitting to in-domain data and decreases the performance in out-of-domain scenarios. Moreover, we introduce Fourier-Guided Latent Shifting I2V, named FlashI2V, to prevent conditional image leakage. Concretely, FlashI2V consists of: (1) Latent Shifting. We modify the source and target distributions of flow matching by subtracting the conditional image information from the noisy latents, thereby incorporating the condition implicitly. (2) Fourier Guidance. We use high-frequency magnitude features obtained by the Fourier Transform to accelerate convergence and enable the adjustment of detail levels in the generated video. Experimental results show that our method effectively overcomes conditional image leakage and achieves the best generalization and performance on out-of-domain data among various I2V paradigms. With only 1.3B parameters, FlashI2V achieves a dynamic degree score of 53.01 on Vbench-I2V, surpassing CogVideoX1.5-5B-I2V and Wan2.1-I2V-14B-480P. Project page: https://pku-yuangroup.github.io/FlashI2V/

cs.CV↗