arXiv Science⌕ Search

arXiv subjects

Yu Fu

Publications and source records attributed to Yu Fu.

At least 19 recordsLinked to original sources

ResponsibleRobotBench: Benchmarking Risk-Aware Task-Level Decision Making for Robotic Manipulation with Large Multimodal Models

Safe task-level manipulation requires a planner to recognize hazards, select appropriate mitigation actions, and satisfy their execution prerequisites without abandoning the original goal. We introduce ResponsibleRobotBench, a benchmark of 23 manipulation task configurations with separately specified goals and safety conditions. It connects hazard-category predictions, planned actions, execution feedback, and terminal outcomes at the episode level. Across evaluations of five large multimodal models, terminal safety and safe task completion can diverge: defense prompts increase terminal safety for three tested models but affect safe success in different directions. Correct hazard-category predictions also fail to ensure executable mitigation. In a cutting task under the default configuration, GPT-4o mini identifies the human hazard in all 100 episodes but never requests assistance, and every episode ends unsafe. Offering a help action and actually requesting it lead to different comparisons: outcomes differ between action menus even for a model that never requests help, and repeated requests can leave execution failures unresolved. Imitation-learning evaluations and physical robot sequences illustrate the need to coordinate mitigation with goal actions. Together, these results motivate evaluating mitigation selection, action prerequisites, and recovery alongside hazard recognition and terminal outcomes. The appendix provides task definitions, checker conditions, and prompts. Project website: https://responsible-robot-benchmark.github.io/.

cs.RO↗

Biharmonic submanifolds in nonpositive space forms

We prove that there are no proper biharmonic submanifolds with parallel normalized mean curvature vector field in a nonpositive space form, in arbitrary dimension and codimension. We also prove that every biharmonic surface with flat normal bundle in a four-dimensional nonpositive space form is minimal. These results provide substantial support for Chen's conjecture and the generalized Chen's conjecture for hyperbolic space in higher codimensions.

math.DG↗

Coordinating Humanoid Loco-Manipulation through Action-Conditioned Latent Foresight

Humanoid loco-manipulation requires coordinated body motion and hand interaction over time, and a plausible-looking command sequence can still drop a held object or leave an interaction incomplete. We present action-conditioned latent foresight, a latent world-action model (WAM) that evaluates proposed command sequences before execution. An action generator proposes joint motion-hand command sequences from vision, language, and the robot state. An action-conditioned endpoint predictor estimates the visual features each sequence prefix reaches and measures progress toward a demonstration-derived subgoal, while a joint temporal prior scores temporal consistency given the robot state and preceding commands. The robot executes the first commands of the best-scoring sequence and replans from the next observation. During training, action consistency regularization reconstructs the first demonstrated command from observed and predicted feature changes, encouraging the predictor to retain action-relevant information. On ten tasks in the humanoid loco-manipulation simulation benchmark SIMPLE, our method achieves 89.7% average success, compared with 73.7% for Psi-Zero and 82.0% for DiT4DiT. On seven real-robot tasks, it achieves 85.7% under standard conditions and 65.7% under unseen object configurations, while GR00T N1.7 achieves 70.0% and 48.6%, respectively. Project page: https://ju6276.github.io/Action-Grounded-Foresight/

cs.RO↗

Where and What to Reward? Understanding Generalization Between Verifiable and Open-Ended Domains in Reinforcement Learning

Reinforcement learning with verifiable rewards (RLVR) is widely used to improve the reasoning capability of language models, since model-generated answers can be easily verified by a rule-based verifier. In contrast, reinforcement learning from human feedback (RLHF) is mainly used to optimize open-ended conversation with a learned reward model, because such responses are not easy to verify. RLVR and RLHF are usually trained separately with their own domain data and training protocols. How gains transfer between these domains is unclear, partly because comparisons change both where a model is trained (the prompts) and what is rewarded (by a verifier or a reward model). We separate the two in a controlled study of RL on multiple base models that fixes the optimizer and the number of training prompts, and varies only the source domain of the prompts (math, multi-domain, chat, or mixtures) and the reward. We find that RLHF on open-ended prompts substantially improves conversational ability and also brings large gains in reasoning and coding, whereas RLVR improves reasoning but its gains in open-ended conversation plateau far below those of RLHF, suggesting that RL on open-ended prompts with a reward model can serve as an effective approach for generalizing across domains.

cs.LG↗

ForceDelta-VLA: Distilling Force-Conditioned Action Corrections for Contact-Rich Manipulation

Force-aware Vision-Language-Action (VLA) policies improve contact-rich manipulation, but typically combine task-level motion and contact-dependent adjustment in a single action prediction. Demonstrations provide no explicit labels for decomposing that prediction into a reusable reference action and a correction. We present ForceDelta-VLA, a correction-distillation framework that constructs an explicit force-correction target using paired predictions from a frozen teacher's force-conditioned and learned force-agnostic modes. A separate delay-correction target accounts for reference-action mismatch and the change in reference state. Training uses asynchronous schedule replay with the cached task context available during execution. The resulting lightweight policy adjusts the reference actions using recent force history and robot state, responding to contact changes between reference-action updates without regenerating complete action chunks. Across nine single-arm and bimanual contact-rich tasks, ForceDelta-VLA achieves an 82.2% mean success rate, compared with 54.4% for the original ForceVLA baseline. Direct execution of our Stage-1 Temporal Teacher achieves 70.6%. Relative to ForceVLA, the complete system reduces mean peak contact force over successful trials by approximately 26% on both platforms.

cs.RO↗

Biharmonic Lagrangian surfaces with constant Gaussian curvature in $2$-dimensional complex space forms

Constant curvature is one of the most fundamental intrinsic conditions in submanifold geometry. Investigating the existence and classification of biharmonic submanifolds under intrinsic curvature constraints is generally difficult, since the biharmonic equation is expressed in terms of extrinsic data. In this paper, we obtain a complete classification of proper, that is non-minimal, biharmonic Lagrangian surfaces with constant Gaussian curvature in 2-dimensional complex space forms. As a consequence, we classify the proper biharmonic Lagrangian surfaces with flat normal bundle and prove that pseudo-umbilical biharmonic Lagrangian surfaces are necessarily minimal.

math.DG↗

Hecke Orbits on Globally Drinfeld-Uniformized Shimura Varieties Are $p$-adically Nowhere Dense

Fix a projective unitary Shimura datum satisfying Varshavsky's global Drinfeld uniformization hypotheses at a place $v\mid p$ of its reflex field $E$. Let $\mathcal{S}h$ be the base change of the Shimura variety to $\mathbb C_p$ at a sufficiently small neat finite level. We prove that for every closed reduced algebraic subvariety $Z\subset\mathcal{S}h$ with $\operatorname{dim} Z<\operatorname{dim} \mathcal{S}h$, the $p$-adic closure of its full finite adelic Hecke orbit has empty interior in $\mathcal{S}h(\mathbb C_p)$. At certain compatible levels, the nowhere density theorem also holds for Shimura varieties associated with a related PEL datum having the same adjoint datum as Varshavsky's. Moreover, for every rational prime $p$ and every integer $d\geq2$, there is a projective unitary Shimura variety of dimension $d-1$ satisfying these uniformization hypotheses at a place above $p$ for which the nowhere density theorem holds.

math.NT↗

Overton Pluralistic Reinforcement Learning for Large Language Models

Existing alignment paradigms remain limited in capturing the pluralistic nature of human values. Overton Pluralism (OP) addresses this gap by generating responses with diverse perspectives from a single query. This paper introduces OP-GRPO (Overton Pluralistic Group Relative Policy Optimization), a reinforcement learning framework for implicit Overton Pluralism that enables a single LLM to produce pluralistic responses without explicit prompting or modular orchestration. Our workflow consists of two main steps: 1) Similarity estimator training, which fine-tunes a Sentence Transformer for OP tasks to provide a more accurate coverage evaluation of the given responses; and 2) OP-GRPO training, which incorporates this similarity estimator into a carefully designed dual-reward system to ensure both broad coverage of genuine human perspectives and the uniqueness of each perspective, thereby promoting diversity. Empirical results demonstrate that OP-GRPO achieves a "Small models, Big perspective coverage" effect: our trained Qwen2.5-3B-Instruct surpasses the GPT-OSS (20B) baseline with a 37.4% relative accuracy gain on the Natural Language Inference (NLI) benchmark. It also outperforms a modular-architecture baseline with a 19.1% relative improvement. Evaluations with GPT-5.4 as the LLM judge and OP-Benchmark further confirm the robustness of our approach.

cs.CL↗

Complete self-shrinkers with constant norm of the second fundamental form in \(\RR^4\)

Let \(X:M^3\to\RR^4\) be a complete self-shrinker with constant squared norm \(S\) of the second fundamental form. We prove that \(S=0\) or \(S=1\), and that \(X(M)\) is isometric to a hyperplane or a standard product \(\SSS^k(\sqrt{k})\times\RR^{3-k}\), \(1\leq k\leq3\). This proves a conjecture proposed by Cheng and Wei for three-dimensional hypersurfaces.

math.DG↗

StepAudio 3 Realtime Technical Report

Realtime spoken interaction demands deep reasoning, prompt responses, and fluid turn-taking. We present StepAudio 3 Realtime, an audio-language foundation model organized around a continuous listen-converse-think-act loop. Deep Perception captures rich acoustic cues to interpret user intent, while Seamless Duplex models synchronized audio streams to handle pauses, backchannels, and interruptions naturally. Crucially, we resolve the tension between deep deliberation and latency via Think-While-Speaking, executing private reasoning in parallel with spoken delivery. In reasoning mode, StepAudio 3 reaches a 73.0 macro average on StepAudioChat. With Think-While-Speaking, it achieves dialogue and reasoning performance comparable to dedicated reasoning models while speaking in real time. Furthermore, an integrated Voice Agent handles asynchronous tool execution without disrupting the dialogue flow. StepAudio 3 Realtime achieves top-tier performance across key dimensions: an exceptional 90.6 on the MMSU benchmark, 98.9 Overall on the Artificial Analysis Full-Duplex Bench, and a 56.0% macro task-success rate on $τ$-Voice.

cs.SD↗

Biharmonic hypersurfaces in space forms

We prove that every biharmonic hypersurface in a space form of nonpositive sectional curvature is minimal in arbitrary dimension. This settles the hypersurface case of the generalized Chen's conjecture in hyperbolic space and gives a unified treatment of nonpositive space forms. For biharmonic hypersurfaces in the unit sphere, we derive quantitative restrictions on every possible nonconstant-mean-curvature solution. In particular, we obtain pointwise criteria forcing constant mean curvature, a strict scalar-curvature bound in dimensions at least five, and local classification results above the classical CMC gap threshold. These results provide further evidence for the BMO conjecture.

math.DG↗

A Rigid Analytic Curve Can Have a Dense $p$-adic Orbit

Let $\mathcal D$ be a product of Drinfeld upper half spaces and let $J$ be the corresponding product of projective linear groups acting on $\mathcal D$. We prove that if $Y$ is a reduced, quasi-compact separated strict $\mathbb C_p$-analytic space and $f: Y\to\mathcal D$ is analytic with $\dim Y<\dim\mathcal D$, then $J f(Y(\mathbb C_p))$ is closed and nowhere dense in $\mathcal D(\mathbb C_p)$. The quasi-compactness assumption is necessary even when the source is a strict rigid analytic curve, while a quasi-compact perfectoid source can still have an orbit closure with nonempty interior. For every finite extension $F/\mathbb Q_p$ and $d\geq3$, we construct a closed smooth irreducible non-quasi-compact curve in $Ω_F^{d-1}$ with dense orbit under a fixed diagonal one-parameter subgroup. We also construct a $\mathbb Q_p$-defined analytic map from the open unit disc to $\mathbf P^2$ with dense $\operatorname{PGL}_3(\mathbb Q_p)$-orbit, and an analytic map from a one-dimensional affinoid perfectoid torus to $\mathbf P^2$ whose $\operatorname{PGL}_3(\mathbb Q_p)$-orbit closure has nonempty interior.

math.NT↗

p-adic Rigidity and Supercongruences at Rank Two Attractors

We study a $p$-adic rigidity phenomenon suggested by rank two attractors. Near an ordinary special fiber of a Calabi--Yau family, the excellent Frobenius of Beukers and Vlasenko acts on the parameter disk. Achinger--Zdanowicz construct a canonical $W_2$-lift of the Frobenius twist, while Brantner--Taelman construct a canonical formal lift. We conjecture that the Dwork and Achinger--Zdanowicz first-order obstruction maps agree and that the fixed points of the excellent Frobenius are precisely the parameters of the Brantner--Taelman canonical formal lifts. Our main theorem gives a cohomological criterion in arbitrary dimension. Under its hypotheses, a Frobenius-stable rank two factor of the $p$-adic cohomology containing the holomorphic class forces that class to span a Cartier-stable line and gives supercongruences modulo $p^{2s}$ for every $s\geq1$. Moreover, if the hypotheses of the Beukers--Vlasenko excellent lift theorem hold, then the excellent Frobenius fixes the corresponding parameter. We apply the criterion to the Hulek--Verrill $A_4$ family at $t_*=-1/7$, a parameter predicted to be a rank two attractor. Assuming Dummigan's Conjecture~1.1, we prove that the excellent Frobenius fixes $t_*$, the supercongruences hold, and the fiber with parameter $t_*\bmod p^2$ is the Achinger--Zdanowicz canonical lift at every prime where the required Dwork ordinarity conditions are satisfied. A CM fiber of the mirror quartic K3 pencil gives a second application. We also prove that the $q$-power map on a split formal torus has the unit section as its unique periodic point in the identity residue disk over every finite extension of $W(\mathbb{F}_q)[1/p]$, where $q$ is the cardinality of the residue field.

math.NT↗

StepAudio 3 Gen Technical Report

We introduce StepAudio 3 Gen, a general-purpose audio generation model that supports zero-shot text-to-speech (TTS), voice design, vocal generation, sound effects, music, vibe speech, and mixtures of multiple audio types within a unified framework. At its core, StepAudio 3 Gen is a discrete autoregressive generator that models audio directly over residual vector quantization (RVQ) tokens, departing from the diffusion Transformer-based continuous generation paradigm prevalent in recent general audio models. Its StepAudio Tokenizer represents general audio at 12.5 Hz in a shared $16 \times 2048$ residual code space, jointly quantizing semantic and waveform-level acoustic features so that each code layer preserves both types of information. For generation, the backbone predicts the first codebook along the time axis using autoregressive modeling, while a lightweight causal Transformer completes the remaining fifteen codebooks along the codebook axis. Our study further identifies three key design principles: (1) interference-aware progressive pretraining for acquiring audio capabilities while preserving the textual abilities of the large language model, (2) RVQ Adaptor for effectively incorporating multi-codebook acoustic representations, and (3) discrete autoregressive modeling over a shared representation across general audio domains. With progressive pretraining, multi-task instruction training, and supervised fine-tuning, StepAudio 3 Gen achieves state-of-the-art performance on both TTS and voice design, while retaining strong generation capabilities across speech, vocals, sound effects, and music. Audio samples are available at https://stepaudiollm.github.io/step-audio-3-gen/.

cs.SD↗

$ϕ$-Scene: Physically Grounded Image-to-3D Scene Reconstruction

Recent image-to-3D scene methods recover high-fidelity 3D objects with plausible arrangements, but often leave floatings and interpenetrations that limit physical validity and downstream use in interactive environments. We present $ϕ$-Scene, a physically grounded approach for open-vocabulary and compositional image-to-3D scene reconstruction that treats a scene not merely as a set of objects with predicted poses, but as a globally stable physical system. $ϕ$-Scene formulates reconstruction as topology-driven physical assembly: given an initial scene of reconstructed objects, it infers how objects support one another and settles them one by one in topological order. For each object, SDF-based optimization first resolves penetrations against the already-settled support context, and rigid-body simulation then settles the object into a stable equilibrium under real-world physical constraints. The resulting scene stays aligned to the reference image, with every object resting at a physically valid, stable contact configuration. On the 3D-Front benchmark, $ϕ$-Scene achieves the strongest overall performance among out-of-domain methods and remains highly competitive with in-domain baselines on standard reconstruction metrics. Human and MLLM studies prefer $ϕ$-Scene in visual quality, reference alignment, and physical plausibility. Dedicated physical metrics show that it substantially reduces penetration artifacts and yields much lower post-simulation drift. To our knowledge, $ϕ$-Scene is among the first image-to-3D scene reconstruction methods that explicitly reaches dynamic rigid-body equilibrium while preserving reference alignment.

cs.CV↗

AgentMV: A State-Guided Multi-Agent Framework for Budget-Aware Music Video Generation

Generating a complete music video from a song requires more than synthesizing visually plausible clips for individual lyric prompts. A practical system must maintain long-range visual consistency, coordinate recurring motifs, synchronize edits with musical structure, and manage the cumulative cost of video generation. Existing approaches typically generate segments independently or adopt fixed generation strategies, limiting their ability to perform global planning over an entire song. We present AgentMV, a state-guided multi-agent framework for budget-aware music video generation. AgentMV decomposes the production process into specialized agents for music perception, script planning, visual asset provision, segment realization, and final assembly, coordinated through a Structured Persistent State that enables information exchange and state tracking throughout the generation process. To optimize generation resources, we formulate motif-aware segment realization as a group-level Multiple-Choice Knapsack Problem solved via dynamic programming, considering segment importance, generation quality, cost, and motif reuse under a global budget constraint. Experiments on song benchmarks demonstrate that AgentMV improves quality-cost trade-offs over existing MV generation frameworks, highlighting the potential of state-guided multi-agent coordination and budget-aware planning for long-form music video generation with improved quality and efficiency.

cs.CV↗

SemiSAM-O1: Pushing the Boundary of Annotation-Efficient Medical Image Segmentation with Generalist Knowledge Fusion

Semi-supervised learning (SSL) has become a promising solution to alleviate the annotation burden of deep learning-based medical image segmentation models. While recent advances in foundation model-driven SSL have pushed the boundary to extremely limited annotation scenarios, they fail to maintain robust competitive performance in complex imaging modalities. In this paper, we propose SemiSAM-O1, an annotation-efficient framework using only one annotated template case for segmentation. SemiSAM-O1 extends the specialist-generalist collaborative learning framework to the extreme one-label setting by fully exploiting the foundation model's feature representation capability beyond its prompting interface. SemiSAM-O1 operates in two stages. In the first stage, the foundation model's encoder extracts dense features from all volumes, and class prototypes derived from the single annotated template are propagated to the unlabeled pool via feature similarity to produce coarse initial pseudo-labels. In the second stage, an iterative training-and-refinement loop progressively improves both the segmentation model and the pseudo-labels over multiple rounds, where each round trains the model from scratch on current pseudo-labels and generates updated predictions with voxel-wise uncertainty estimates. An uncertainty-guided refinement step further leverages the foundation model's global feature space to correct high-uncertainty regions by aggregating labels from their most similar confident neighbors, establishing a virtuous cycle of mutual improvement. Extensive experiments on a wide range of segmentation tasks across different modalities and anatomical targets demonstrate that SemiSAM-O1 significantly narrows the performance gap between one-label semi-supervised learning and full supervision, while significantly reducing the computational overhead of online foundation model inference.

cs.CV↗

SCP-NL2TL: Selective Conformal Prediction with Semantic Verification for Natural Language to Temporal Logic Specifications

Translating natural language instructions into machine-interpretable formal specifications enables robots and autonomous systems to plan, reason, and formally verify their behavior. However, existing translation models typically generate a specification for every input, even when the result is unreliable or fails to capture the user's intent, creating risks in safety-critical applications. Inspired by selective conformal prediction, we propose a selective translation framework that not only generates formal specifications but also determines when they can be trusted. Reliability is scored by two complementary black-box signals, the fidelity of the specification back-translated into natural language and the dispersion of repeated translations under exact semantic equivalence, which fail on different errors and jointly separate incorrect translations more sharply than either alone. Conformal risk control calibrates this score into a decision that accepts a specification or abstains, with a distribution-free bound on the rate at which incorrect specifications are accepted for execution, and a conformal anomaly detector on instruction embeddings screens out-of-distribution inputs before any translation is attempted. The proposed framework is general across formal specification languages, with experiments on Signal Temporal Logic (STL), Linear Temporal Logic (LTL), and geometric Spatio-Temporal Logic (SpaTiaL) demonstrating improved translation reliability, robustness under the evaluated cross-tier shifts, and effective uncertainty-aware abstention. This work establishes a foundation for trustworthy natural language interfaces by enabling AI systems to recognize when generated specifications may not be reliable.

cs.AI↗