arXiv Science⌕ Search

arXiv subjects

Bo Zhang

Publications and source records attributed to Bo Zhang.

At least 19 recordsLinked to original sources

STAPO: Stabilizing Reinforcement Learning for LLMs by Silencing Rare Spurious Tokens

Reinforcement Learning (RL) has significantly improved large language model reasoning, but existing RL fine-tuning methods rely heavily on heuristic techniques such as entropy regularization and reweighting to maintain stability. In practice, they often suffer from late-stage performance collapse, leading to degraded reasoning quality and unstable training. We identify a key factor behind this instability: a small fraction of tokens, termed spurious tokens (around 0.01%), which contribute little to the reasoning outcome but receive disproportionately amplified gradient updates due to inheriting the full sequence-level reward. We present a unified framework for evaluating token-level optimization impacts across spurious risk, gradient norms, and entropy changes. Building on the analysis of token characteristics that severely disrupt optimization, we propose the Silencing Spurious Tokens (S2T) mechanism to efficiently suppress their gradient perturbations. Incorporating this mechanism into a group-based objective, we propose Spurious-Token-Aware Policy Optimization (STAPO), which promotes stable and effective large-scale model refinement. Across six mathematical benchmarks and three model scales, STAPO consistently demonstrates superior entropy stability and achieves average accuracy improvements over baselines including GRPO, 20-Entropy, and JustRL under two widely-adopted evaluation settings.

cs.CL↗

HoloBoxing: A Simple Recipe for Humanoid Boxing with 7 Minutes of Single-GPU Training

HoloBoxing presents a simple recipe for learning humanoid boxing by building on a pretrained whole-body controller. The recipe separates reusable motor skills from task decisions: a compact planner requests future body-point targets, while the frozen controller handles joint-level execution. A learned decoder maps 32-dimensional actions to structured target windows, and measured-state imitation initializes the planner before reinforcement learning. Task learning then refines interaction behavior while reusing the decoder and controller, avoiding the need to relearn whole-body control. This combination keeps task optimization focused on a compact upper policy and supplies an initial behavior before reward-driven exploration. Starting from that available controller, the recipe accounts for about seven minutes of additional training, including reused representation fitting and a single-GPU task run. This excludes controller pretraining, data preparation, evaluation, and search. Simulated boxing experiments and component controls evaluate the resulting behavior and the roles of imitation initialization and the target representation.

cs.RO↗

Voevodsky's motives and zeroth slice of motivic sphere

Let $S$ be a noetherian scheme of finite Krull dimension and let $R$ be a commutative ring in which every positive residue characteristic of $S$ is invertible. We prove that Voevodsky's stable Nisnevich category of motives with $R$-coefficients is canonically equivalent to modules over the zeroth slice of the motivic sphere with derived $R$-coefficients. The comparison identifies the corresponding commutative coefficient algebras and is compatible with arbitrary pullback. The theorem applies to singular and nonreduced schemes, including mixed-characteristic bases, and requires no excellence or finite-type hypothesis. Its special cases include rational coefficients over arbitrary bases, arbitrary coefficients over $\mathbb Q$-schemes, and $\mathbb Z[1/p]$-algebra coefficients over $\mathbb Z_{(p)}$-schemes. The proof establishes base change for finite-cycle spectra using permutation quotients, families of cycles, and arithmetic power homotopies, then passes to general bases by universal homeomorphism invariance and continuity.

math.AG↗

RoboDuo: Attempt, Check and Atomic Recovery through Code for Vision-Language-Action Models

Vision-Language-Action (VLA) models map a language instruction and the current observation directly to actions, without checking whether the instruction has been completed. For long-horizon tasks, a single failed step therefore goes unnoticed and leaves the whole task unfinished. Such failed episodes, however, often end with the task partially complete. Moreover, the unfinished steps are reusable atomic skills that recur across demonstrations. A failed attempt can thus be recovered by composing with atomic skills. We propose RoboDuo, a closed-loop dual-system framework that uses code as the interface between a coding agent and two VLAs. The agent writes a program that lets a full-task VLA attempt the whole task and checks whether it is complete; on failure, an atomic VLA finishes the remaining steps. Since the agent emits no actions and only decides which VLA for execution, RoboDuo wraps an existing full-task VLA without updating its weights. To train the atomic VLA and the coding agent with the completion-checking ability, we build LIBERO-Atomic, LIBERO-Code, and LIBERO-Judge from a single set of LIBERO demonstrations. RoboDuo consistently improves X-VLA and $π_{0.5}$ on LIBERO and LIBERO-PRO, with the largest gains on long-horizon tasks, and recovers failed rollouts of a frozen full-task VLA on a real robot.

cs.RO↗

EXE: Egocentric Cross-Embodiment Pretraining via Factorized Latent Actions for VLA Models

Vision-Language-Action (VLA) models are bottlenecked by the scarcity of robot data. Egocentric human manipulation videos offer an abundant, diverse, and semantically-rich alternative that inherently captures manipulation intent. However, the embodiment gap makes it difficult to extract action-relevant representations from these videos. From the perspective of action execution, human hands and robots share analogous manipulation primitives---reaching, grasping, placing---yet exhibit distinct kinematics tied to their embodiments. This might motivate our key approach: egocentric video pretraining can yield shared action representations capturing transferable manipulation skills, while human-specific motion patterns should be disentangled to avoid interfering with robot policy learning. To this end, we propose EXE, an Egocentric Cross(X)-Embodiment pretraining framework that learns a factorized latent action representation from egocentric human videos, separating shared manipulation priors from embodiment-specific signals. By leveraging the shared action space, the robot policy acquires generalizable manipulation semantics from diverse human demonstrations without being biased by human-specific kinematics. This shared knowledge transfers across embodiments with different kinematic structures, enabling the same pretraining to benefit both parallel grippers and dexterous hands. EXE yields consistent gains over baseline without pretraining on RoboTwin 2.0, RoboCasa GR1, and real-world manipulation tasks.

cs.RO↗

Étale motives with and without transfers

We compare stable étale motives defined with and without finite transfers. For every noetherian scheme $S$ of finite Krull dimension and every commutative ring $R$, the canonical functor $\mathrm{DA}_{\mathrm{\acute{e}t}}(S,R)\to\mathrm{DM}_{\mathrm{\acute{e}t}}(S,R)$ is an equivalence of symmetric monoidal stable $\infty$-categories. No excellence, geometric unibranchness, or restriction on the residue characteristics is imposed on $S$, and no flatness or finiteness condition is imposed on $R$. The rational comparison is proved by relating divided effective-cycle monoids on split tori to geometric symmetric powers. For wild permutation actions, coordinate power maps and invariant symmetric polynomials give a vanishing theorem after passage to arithmetic neighbourhoods and sequential telescopes. A homotopy of roots-of-unity cycles removes these telescopes on the divided cycle spaces. Seminormal descent and weak continuity extend the comparison to general bases. Bachmann's rigidity theorem and the rigidity theorem with transfers then give the comparison with finite-field coefficients. Compatibility of the forgetful right adjoint with rationalization allows these comparisons to be assembled integrally, after which extension of coefficients gives the result for $R$. As a consequence, rational motivic cohomology defined by finite correspondences is the rational plus sphere and commutes with arbitrary base change in this class of schemes.

math.AG↗

When Agents Fail: Model or Harness--Who's to Blame?

LLM agents combine models with execution harnesses, so agentic benchmark performance reflects their joint behavior. We argue that harnesses should therefore be evaluated through their interactions with underlying models. We develop a framework combining five complementary measures: (i) Valid Completion Rate (VCR), how reliably agents finish normally and deliver evaluable results, irrespective of task correctness; (ii) Model-Harness Fit, how well a harness supports task achievement through valid completion for a given model; (iii) Cross-Model Fit, a harness's overall suitability across evaluated models; (iv) Interaction Residuals, pairing-specific execution strengths and weaknesses hidden by component-level summaries; and (v) Token Load, the token demands of agent execution, including failed attempts. We evaluate four general-purpose harnesses (OpenCode, Codex CLI, Pi CLI, and DeepAgents) with four core models, plus two fixed native model-harness systems, on six benchmarks covering context management, tool use, long-context planning, multimodal interaction, and artifact handoff. Including native references and stress conditions, 111 evaluation settings yield 52,168 trajectories. Harness rankings vary across models and benchmarks; task performance and valid completion can favor different pairings, and similar task scores can accompany distinct execution profiles. OpenCode ranks first in cross-model performance, while DeepSeek V4 Flash Preview maintains consistently high Mean VCR across harnesses on the shared four-benchmark panel. These findings support evaluating model-harness interactions, training transferable harness-use capabilities in models, and harness designs adapted to the model and task.

cs.AI↗

Sci-CoE: Co-evolving Scientific Reasoning LLMs via Geometric Consensus with Sparse Supervision

Large language models (LLMs) have demonstrated exceptional reasoning capabilities, and co-evolving paradigms have shown promising results in domains with verifiable reward signals, such as code and math. However, in unverifiable domains, such as scientific reasoning, these methods remain fragile due to unreliable solution evaluation and limited diversity in verification strategies. In this work, we propose Sci-CoE, a two-stage co-evolving framework for domains without verifiable feedback. The framework enables models to self-evolve as both solvers and verifiers by transitioning from sparse supervision to unsupervised learning. In the first stage, the model uses a small set of annotated data to establish fundamental correctness judgment anchors for the Verifier. In the second stage, we introduce a geometric reward mechanism that jointly considers consensus, reliability, and diversity, driving large-scale self-iteration on unlabeled data. Experiments on several general scientific benchmarks demonstrate that Sci-CoE enhances complex reasoning capabilities and exhibits strong scalability, facilitating the construction of more robust and diverse evaluation systems. Codes are available at https://github.com/InternScience/Sci-CoE.

cs.AI↗

MLEvolve: A Self-Evolving Framework for Automated Machine Learning Algorithm Discovery

Large language model (LLM) agents are increasingly applied to long-horizon tasks such as scientific discovery and machine learning engineering (MLE), where sustained self-evolution becomes a key capability. However, existing MLE agents suffer from isolated exploration, inefficient experience reuse, and lack of hierarchical control, which together hinder long-horizon optimization. We present MLEvolve, an LLM-based self-evolving multi-agent framework for end-to-end machine learning algorithm discovery. By extending tree search to Progressive MCGS, MLEvolve enables cross-branch information flow through graph-based reference edges and gradually shifts the search from broad exploration to focused exploitation with an entropy-inspired progressive schedule. To allow the agent to evolve with accumulated experience, we introduce Retrospective Memory, which combines a cold-start domain knowledge base with a dynamic global memory for task-specific experience retrieval and reuse. For stable long-horizon iteration, we further decouple strategic planning from code generation with adaptive coding modes. Evaluation on MLE-Bench shows that MLEvolve achieves state-of-the-art performance across multiple dimensions including average medal rate and valid submission rate under a 12-hour budget (half the standard runtime). Moreover, MLEvolve also outperforms specialized algorithm discovery methods including AlphaEvolve on mathematical algorithm optimization tasks, demonstrating strong cross-domain generalization. Code is available at https://github.com/InternScience/MLEvolve.

cs.AI↗

Liouville Theorems and Sharp Homogeneity Defects for Weighted Potential Systems

In this paper, we consider \[ \begin{cases} u=K*(|x|^αa_0(x)v^p)&\quad\hbox{in }\mathbb R^n,\\ v=K*(|x|^βb_0(x)u^q)&\quad\hbox{in }\mathbb R^n, \end{cases} \] where $n\ge2$, $0<ρ 0$, and $α,β>-ρ$. The radial kernel is nonincreasing and satisfies $K(r)\asymp r^{ρ-n}$. The coefficients satisfy $0 n-ρ+\varepsilon_K, \] where the defects bound the radial logarithmic derivatives. No symmetry, finite-energy condition, or prescribed decay is assumed. The proof combines a localized virial identity with a source-layer pressure estimate whose constants are uniform under centered dilations, including the low-order range $0<ρ\le1$. We also identify the necessary scaling range for existence. For radial weighted Newton systems with unequal powers, we prove that the combined coefficient defect has a sharp, unattained infimum equal to the subcritical gap. A fixed bound on the coefficient ratios forces a strictly larger defect, whereas suitable coefficient--solution pairs approach the threshold with excess at most $C/\log M$. In the scalar Newton case, the threshold is explicit and the approximating family converges, after normalization, to an explicit critical weighted profile. The sharpness results concern the Newton kernel; no corresponding construction is asserted for general fractional kernels.

math.AP↗

Selective strain tuning of nonequilibrium multiferroic dynamics in BiFeO$_\text3$

Quantum materials are characterized by intertwined orders, and a fundamental goal in condensed matter physics is to achieve their selective control in such a way that one order parameter can be tuned while leaving others largely unaffected. Although significant progress has been made in thermal equilibrium, realizing such control out of equilibrium remains highly challenging. Here we employed in-situ tensile strain to selectively manipulate the photoinduced lattice dynamics associated with ferroelectric and magnetic orders in multiferroic BiFeO$_3$. By applying MeV ultrafast electron diffraction to freestanding BiFeO$_3$ membranes under tunable strain, we showed that tensile strain markedly suppresses the ultrafast photoinduced reduction of the ferroelectric displacement. By contrast, the photoinduced dynamics of the antiferrodistortive rotation of the oxygen octahedra, which modulates the magnetic order, remains insensitive to strain. Not only do these findings reveal distinct microscopic pathways underlying nonequilibrium multiferroic dynamics, they also establish tunable strain as an effective route for engineering ultrafast phase control in correlated materials.

cond-mat.mtrl-sci↗

Sage-A1.5: From Long-Horizon Execution to Scientific Exploration with Capability Composition

In this report, we introduce Sage-A1.5, a 35B Mixture-of-Experts agentic model that builds on A1 to advance long-horizon problem solving through adaptive capability composition. Compared with A1, Sage-A1.5 learns not only to solve individual tasks, but also to organize work and revise its approach during execution. Sage-A1.5 highlights three improvements: agentic orchestration, verification, and open scientific discovery. First, agentic orchestration extends single-agent execution through task delegation and parallel collaboration among subagents with isolated contexts, enabling complex tasks to be decomposed and addressed concurrently and supporting efficient execution while reducing interference across concurrent subagents. Second, agentic verification strengthens long-horizon reliability through progress checking, evidence validation, and reflective strategy revision, allowing the agent to recognize unproductive search paths and pursue alternative approaches. Third, open scientific discovery extends agentic capabilities beyond answering predefined questions to conducting exploratory research, connecting scientific inquiry with interactive analysis and inspectable research artifacts. We showcase these capabilities through complicated agentic tasks and multidisciplinary scientific applications. Besides, we hope Sage-A1.5 provides the community with an accessible foundation for open scientific discovery, offering a practical path from long-horizon task execution to collaborative, verifiable, and inspectable scientific exploration.

cs.AI↗

IMF-aware N-body forward modelling of membership selection functions for young open clusters

We present an IMF-aware N-body forward-modelling framework, in which the stellar initial mass function (IMF) is an explicit input, to quantify the membership selection functions of open clusters, namely completeness and contamination as functions of magnitude. Accurate derivation of the IMF requires correcting for these selection effects, which otherwise distort the inferred present-day mass function. Our framework simulates clusters with IMF slopes $α_2 = -2.7, -2.3, -1.9$, converts them into synthetic Gaia observations, adds mock field populations, and recovers members with HDBSCAN to mimic observational membership selection. Applying this framework to 35 young open clusters (ages $\lesssim100$ Myr, distances $\lesssim600$ pc), we find declining completeness towards the faint limit; older, more expanded, and more diffuse models have lower completeness and higher contamination. For a given cluster, models with flatter IMFs yield modestly but systematically lower global completeness and higher contamination, despite initial cluster masses calibrated to the same observed member count. These models undergo more stellar evolution mass loss and expand more, resulting in lower projected stellar densities; their lower completeness is consistent with more diffuse clusters being harder to separate from field stars. Corrections derived from a mismatched IMF largely recover the total star counts but leave a larger distortion in the shape of the present-day luminosity function than those derived with the correct IMF. Because membership recovery is tied to a cluster's structural evolution and the specific membership algorithm used, our findings emphasize that selection functions should be inferred jointly with the IMF rather than assumed in advance.

astro-ph.GA↗

RoboHarness: A Simple Harness Outperforms VLA and World Action Models

The rise of large language models (LLMs) has opened a path toward generalist embodied AI, raising the question of how LLMs can act in the physical world. One straightforward approach is training the model to generate actions: collect robot-action data and video demonstration, refine LLM architecture with an action head, and train a vision-language-action (VLA) model at scale. However, we argue that coding agents have the potential to realize generalist embodied manipulation. All they need is a simple yet effective robot harness. We present RoboHarness: a robotic harness that gives LLM agents a visual-geometric control panel so that they can directly understand and invoke embodied tasks. With RoboHarness, Qwen3.8-Flash-Next outperforms state-of-the-art VLA models on BEHAVIOR Challenge 2025 tasks. The implementation is open source.

cs.RO↗

World Action Critic (WAC) Model: Joint Foresight and Criticism for Policy Learning

World models have shown considerable promise in sequential decision-making by anticipating the consequences of actions and providing predictive foresight for policy learning. However, learning to reason about counterfactual actions remains challenging, since predictive objectives may underemphasize information critical for action evaluation, while unexecuted actions lack observed futures for direct supervision. To address these challenges, we propose the World Action Critic (WAC) Model, which proposes multimodal action candidates and jointly learns candidate-conditioned future prediction and consequence evaluation. In our proposed framework, critic supervision directly shapes intermediate predictive representations during rollout, encouraging them to retain information needed to distinguish action quality. Observed futures supervise prediction for executed actions, while external task-quality targets provide evaluation signals for counterfactual candidates. Through joint optimization, critic signals from these candidates propagate into predictive representations without requiring their observed futures. Our theoretical analysis characterizes critic-guided feature retention and bounds candidate-selection regret. Applied to autonomous driving, WAC achieves 93.4 PDMS on NAVSIM-v1, demonstrating the effectiveness of jointly learning predictive foresight and consequence evaluation.

cs.AI↗

MLExpert: Towards a Generalist Agentic Model for Autonomous Machine Learning Engineering

Large language models (LLMs) are expanding from assisting scientific research and engineering to autonomously developing and improving AI systems, advancing AI for AI (AI4AI) as a pathway toward recursive self-improvement (RSI). Workflow-driven machine learning engineering (MLE) systems provide a practical path toward this pursuit through complex orchestration that manages long-horizon experimentation, while recent MLE systems adopt model-directed interaction, allowing models to autonomously organize experiments and adapt optimization strategies based on execution feedback. However, feedback from each experiment reflects several preceding decisions, and a long MLE run contains many such costly experiments. Training must therefore select useful supervision from long interaction trajectories and learn from intermediate outcomes. We propose a post-training method for autonomous long-horizon MLE optimization and apply it to train MLExpert, a 35B Mixture-of-Experts agentic model. We design the Kaggle-MLE Factory to construct executable tasks and an interaction harness for model-directed experimentation. Hierarchical agentic SFT transfers general tool-use and coding capabilities to MLE through outcome-guided supervision. Windowed Interaction RL (WIRL) treats the multi-turn decisions between successive experiment results as an execution window and assigns it a shared outcome-based reward. Asynchronous collection and policy correction support policy updates before the trajectory ends. On MLE-Bench Lite, MLExpert improves the average medal rate of the base model from 37.9% to 72.7%, achieving performance comparable to larger frontier models such as Kimi-K3 and GLM-5.3. Further experiments show that MLExpert improves performance on NatureBench Lite, agent scaffold optimization, and algorithm optimization, suggesting that the learned optimization capability generalizes to other tasks.

cs.AI↗

LabCompiler: A Framework for Verifiable Human-Machine Laboratory Execution from Imperfect Protocols

Closing the loop of AI-driven science requires reliably translating natural-language protocols into executable laboratory workflows despite protocol defects and heterogeneous hardware. Existing approaches often couple scientific interpretation with device-specific code generation, making errors difficult to localize and limiting reuse across laboratory platforms. We introduce LabCompiler, a robust protocol-to-execution framework that transforms imperfect natural-language protocols into verifiable human-machine workflows. Its protocol firewall diagnoses and repairs defects before compilation while preserving unaffected content, guided by troubleshooting knowledge accumulated through perturbation-guided self-evolution. A two-level, device-agnostic graph representation separates experimental semantics from hardware-specific implementation and supports capability-based device assignment with coordinated human execution. We further introduce a protocol recovery benchmark covering four controlled perturbation types and naturally occurring errors collected from protocols written by iGEM participants. Experiments show that LabCompiler outperforms frontier LLMs in protocol error correction while enabling coordinated human-machine execution across heterogeneous, partially automated laboratory settings.

cs.AI↗

LabOPBench: A Multimodal Benchmark for Evidence-Grounded Laboratory Decision Making

Laboratory experiments involve more than following predefined protocols; they require adaptive decision-making as the experimental state changes. Existing scientific benchmarks rarely assess such evidence-based decisions in laboratory settings. Here we present LabOPBench, a multimodal benchmark of 756 expert-authored, independently reviewed questions in organic synthesis and materials science. Each item pairs laboratory evidence with procedural context and an open-ended judgment, evaluated using a question-specific scoring rubric. Eight multimodal models obtain overall normalized scores of 28.8-45.8%, leaving substantial room for improvement. On a controlled 100-question subset, the strongest models outperform undergraduate participants on average but remain below the average performance of PhD participants. Expert analysis of responses from the three leading models identifies Evidence Misreading and Evidence-Decision Conflict as the dominant error patterns. These results reveal that current models still struggle to turn multimodal perception into reliable laboratory decision-making.

cs.AI↗