arXiv subjects

Shuo Liu

Publications and source records attributed to Shuo Liu.

At least 19 recordsLinked to original sources

arXiv2026

Belief-Conditioned Multi-Agent Actor Critic for Decentralized LLM Collaboration

Recent work has explored optimizing LLM collaboration through Multi-Agent Reinforcement Learning (MARL), but many approaches still rely on predefined workflows, limiting efficiency and scalability. Decentralized LLM collaboration is challenging because agents execute independently with limited communication, share a joint objective, and must infer useful information from communication traces. In this paper, we propose BCMAAC, a Belief-Conditioned Multi-Agent Actor-Critic method that maintains beliefs over contextual information and uses them to facilitate training. Experiments on Minecraft game-playing, web searching and tool-using tasks show that BCMAAC improves task performance and collaborative behavior compared to naive actor-critic baselines. The improvements are particularly pronounced in multi-turn tasks with richer contextual information, where belief modeling provides a clear advantage.

cs.AI↗

arXiv2026

Time is Knowledge: Response Times in Binary Response Models

Response times contain information about economically relevant but unobserved variables like willingness to pay, preference intensity, quality, or happiness. We provide a general characterization of the properties of latent variables that can be detected using response time data. Our theoretical framework unifies and generalizes existing results in the literature and gives rise to many new applications. We illustrate the novel insights that the method can deliver through three empirical applications: identifying an optimal nudge, testing decreasing marginal happiness of income, and predicting treatment heterogeneity.

econ.GN↗

arXiv2026

MolmoMotion: Forecasting Point Trajectories in 3D with Language Instruction

Motion forecasting is central to visual intelligence: agents must anticipate how objects will move in order to plan actions, reason about physical interactions, and synthesize realistic futures. We argue that 3D points in world coordinates provide a general representation that is class-agnostic, view-stable, compact, and directly useful for downstream tasks. We formalize the task of goal-conditioned 3D point motion forecasting: given a short visual history, a set of 3D query points on an object of interest, and a language description of the intended goal, the model predicts the future 3D trajectory of each point. We introduce a full stack to study this task at scale: (1) MolmoMotion-1M is a large corpus of action-described, object-grounded 3D point trajectories annotated from 1.16M unconstrained videos; (2) PointMotionBench is a human-verified benchmark spanning 111 object categories and 61 motion types; and (3) MolmoMotion is a general motion forecasting model that supports both autoregressive coordinate prediction and flow-matching-based trajectory generation. MolmoMotion accurately predicts diverse motion patterns with different language instructions, and significantly outperforms existing motion prediction baselines on PointMotionBench. Finally, we show that the learned 3D motion prior transfers well to downstream applications: it improves training efficiency and generalization for robot manipulation, and its predicted trajectories provide effective motion guidance for generative models to synthesize videos with more realistic object motion.

cs.CV↗

arXiv2026

Programmable memristive circuits for reconfigurable collective pseudomagnetic ordering, transport, and learning

Programmable hardware typically uses fixed architectures, whereas complex physical systems obtain diverse behavior by connecting reusable local elements through different interaction rules. Memristive devices combine writable states with nonlinear dynamics, but translating these local properties into reconfigurable collective order and symmetry-governed transport remains challenging. Here we develop modular circuits configured through programmable connections between identical memristive units. Experiments establish binary conductance states as Ising-type pseudospins and show that signed feedback between units selects uniform or staggered pseudospin order. Circuit-model simulations then examine controllable domain-wall motion and pattern recovery. A symmetry encoder combines measured conductance patterns with sublattice labels and a selected symmetry rule to configure a fixed transport layer, implementing circuit analogs of ferromagnetic, antiferromagnetic, and altermagnetic transport symmetries. Although the antiferromagnetic and altermagnetic encodings share a compensated pattern, their distinct voltage spreading illustrates how programmed circuit symmetry affects transport. Device-calibrated simulations show that memristive dynamics generates history-dependent features for reservoir computing. By separating local memory from programmable interactions, symmetry encoding and task-specific readout, this architecture provides a modular route from device dynamics to collective order, symmetry-dependent transport, and learning.

cond-mat.mtrl-sci↗

arXiv2026

Imagine Before Acting: Prospective Skill Identification for LLM Agents

Effective skill identification is crucial for LLM agents to reuse task-solving experience for complex task execution, which however remains challenging as agents must accurately identify useful skills from a large skill gallery and invoke them on demand. Existing studies have explored various strategies for skill retrieval and invocation, but largely overlook the natural discrepancy between task descriptions and skill documents. To be specific, our empirical study reveals that task descriptions mainly specify task objectives, whereas skill documents describe the required capabilities and procedural guidance for achieving the objectives. Such a so-called Task--Skill Misalignment (TSM) problem would cause desirable skills to be neglected during retrieval or remain unselected during invocation, thus hindering task execution. As a remedy, inspired by human prospective cognition, we propose SkillDreamer, a prospective skill identification framework to mitigate TSM. In brief, SkillDreamer first infers execution-required capabilities and imagines their realizations as pseudo skills, thereby translating task objectives into execution-oriented guidance for skill retrieval. As execution proceeds, SkillDreamer reevaluates the capabilities required by emerging subtasks to determine which skills should be invoked, thereby aligning skill invocation with evolving execution needs. Extensive experiments on three representative agent skill benchmarks not only verify the effectiveness of SkillDreamer in mitigating TSM, but also demonstrate its generalizability across diverse retrievers and LLM agents. The code will be released upon acceptance.

cs.IR↗

arXiv2026

MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement

Reinforcement learning (RL) is the central training paradigm for advancing large foundation models towards self-improvement. This report introduces the MiMo-V2.6 series, an omni-modal family that pushes the frontier of model intelligence by scaling RL compute. Prior to RL, we conduct mid-training on a broad multimodal corpus to provide ample exploration space, and build a solid infrastructure on the pretrained hybrid-SWA architecture to support subsequent scale-up. We scale RL compute along three dimensions: (1) larger batches and higher throughput, with an asynchronous training that consumes 1,568 samples and 2.7-3.7B tokens per step at context lengths of up to 1M; (2) more diverse and complex environments, spanning code, general, visual, and cyber domains under a mixture of agent harnesses; and (3) more grader compute, via groupwise agentic grading that yields more accurate reward signals for long-horizon tasks and steers the model towards shorter, more token-efficient solutions. To keep training stable at scale, we freeze the MoE router and establish a multi-layer defense against reward hacking. We further build infrastructure for mixed-task agentic RL, including a unified trajectory representation, high-concurrency multi-framework rollout, decoupled control and data planes, and training-inference consistency. We open-source the training dynamics, RL environments, and RL framework to facilitate reproduction and further research on scaled RL and model self-improvement.

cs.CL↗

arXiv2026

MRCert: Towards Post-deployment Patch Robustness Certification for Adversarially Patched Samples via Type-specific Masking

In post-deployment time, inputs to deep learning models may or may not be adversarially patched. Patch robustness certification on such inputs within a patch bound can verify their label benignity and should retain high prediction accuracy. However, existing smoothing-based and masking-based recovery defenders cannot achieve both simultaneously: they degrade the prediction accuracy much and cannot verify the benignity of the returned label of an adversarially patched input, respectively. We propose MRCert, the first masking-based certified recovery defender that shows the feasibility of achieving both. Unlike all existing works to apply a common condition across both types of input (benign and adversarially patched samples) for certification, MRCert infers type-specific necessary properties of deep learning models for both types in post-deployment time and formally relates them to verify the label benignity through a novel type-oriented design of label recovery and certification function pair. Without incurring the degradation in clean accuracy caused by smoothing, experimental results confirm that MRCert achieves 35.1\% adversarial certified accuracy on ImageNet at patch size 16 pixels, whereas the SOTA PatchCURE fails completely.

cs.CR↗

arXiv2026

Observing the magic Mpemba effect in localized dynamics on a digital quantum computer

The Mpemba effect challenges the intuition that states closer to equilibrium must relax faster. We ask whether an analogous magic-ordering reversal can occur in the generation of quantum magic (nonstabilizerness), a key resource for universal quantum computation: can a state with less initial magic overtake one with more and reach its asymptotic value sooner? Here, we uncover interaction-induced dephasing as a distinct mechanism for this magic Mpemba effect, requiring neither transport nor conventional thermalization. For tilted product states in an interacting $\ell$-bit model, a random-phase analysis predicts a reversal of the magic ordering: states with less initial magic attain higher saturated magic, independent of their spatial pattern. Exact simulations of the $\ell$-bit model and localized spin chains further show that these states also saturate earlier. We observe both features on IBM superconducting quantum processors. An effective $\ell$-bit implementation accesses long dephasing times at fixed circuit depth by encoding time in gate angles, while a microscopic spin model exhibits the reversal universally across initial patterns in the localized regime but only selectively in the ergodic regime. These results establish interaction-induced dephasing as a route to anomalous quantum-resource relaxation beyond transport-driven thermalizing dynamics.

quant-ph↗

arXiv2026

GJK-CBF: Control Barrier Functions for Convex Rigid Body Collision Avoidance on SE(3)

Collision avoidance among convex bodies is a fundamental problem in robotics. Control Barrier Functions (CBFs) provide a practical framework for real-time safety filtering due to their computational efficiency. For general convex bodies, exact separation measures, such as distance or scaling factor, are typically computed through optimization. Existing CBF formulations often obtain the required gradient via differentiable optimization (diffOpt), adding computational overhead. In contrast, we leverage the Gilbert-Johnson-Keerthi (GJK) algorithm to obtain the current witness pair---the pair of points realizing the minimum distance or penetration depth---and formulate a CBF, termed GJK-CBF, whose gradient is constructed directly from the relative rigid-body motion of the witness pair, without resorting to diffOpt. This formulation applies to both 2D and 3D environments across a broad class of convex body pairs, provided that at least one in each one-to-one interaction is strictly convex. The proposed GJK-CBF is validated in various scenarios, including multi-robot position swapping in both 2D and 3D, navigation through a vertical slit in 3D, and its applicability to manipulators. The results demonstrate collision-free motion across all scenarios while reducing the conservativeness introduced by geometric approximations, particularly in narrow environments.

cs.RO↗

arXiv2026

Event-Triggered Adaptive Taylor-Lagrange Control for Safety-Critical Systems

This paper studies safety-critical control for nonlinear systems under sampled-data implementations of the controller. The recently proposed Taylor--Lagrange Control (TLC) method provides safety guarantees but relies on a fixed discretization-related parameter, which can lead to infeasibility or unsafety in the presence of input constraints and inter-sampling effects. To address these limitations, we propose an adaptive Taylor--Lagrange Control (aTLC) framework with an event-triggered implementation, where the key parameter defines the discretization time interval and is selected online as state-dependent rather than fixed. This enables the controller to dynamically balance feasibility and safety by adjusting the effective time interval of the Taylor expansion. The resulting controller is implemented as a sequence of Quadratic Programs (QPs) with input constraints. We further introduce a selection rule to choose the largest feasible discretization time interval from a finite candidate set while preserving safety. Simulation results on an adaptive cruise control (ACC) problem demonstrate that the proposed approach improves feasibility, guarantees safety, achieves smoother control actions, and reduces triggering events compared to TLC while avoiding the class $\mathcal K$ function tuning required by Control Barrier Function (CBF)-based methods.

eess.SY↗

arXiv2026

Model Predictive Control for Safety-Critical Systems Using Taylor's Theorem with Lagrange Remainder

Safety-critical Model Predictive Control (MPC) formulations based on Control Barrier Functions (CBFs) often require multiple tuning parameters and may become conservative or difficult to keep feasible, particularly for high-relative-degree constraints. To address these limitations, in this paper we draw inspiration from the recently introduced Taylor-Lagrange Control (TLC) method, and propose an MPC formulation based on a Taylor expansion with Lagrange remainder (MPC-TLR). To enable digital implementation, we develop a numerical approximation of the Lagrange remainder under zero-order-hold control. The resulting safety constraint includes a tunable margin to account for approximation errors and balance safety, feasibility, and conservativeness. Comparisons with MPC using high-order CBFs (MPC-HOCBF), discrete-time high-order CBFs (MPC-DHOCBF), and direct safety constraints (MPC-DC) on a unicycle obstacle-avoidance problem show that MPC-TLR yields safer trajectories than MPC-DHOCBF and MPC-DC, while requiring fewer tuning parameters and being less conservative than MPC-HOCBF. Its broader control-input coverage under the adopted discretization can improve feasibility and control performance for short prediction horizons.

eess.SY↗

arXiv2026

Improving LLM Collaboration via Multi-Agent Preference Learning

Several works have explored multi-agent reinforcement learning (MARL) in LLM collaboration. However, constructing reliable rewards is difficult in practice, as complete and accurate metrics are often unavailable and hard to aggregate. Preference learning provides an alternative by learning from comparative human or AI feedback. Yet, its extension to multi-agent systems remains underexplored. To address this gap, we formulate preference-based multi-agent systems (MAS) from decentralized and centralized collaboration perspectives. We also introduce a general multi-agent preference learning framework (MAPL) to solve these problems. MAPL allows iterative updates by comparing the current solution with decentralized or centralized solutions generated by various agents. We instantiate MAPL using MARL from human feedback (MARLHF) with a learned reward model and multi-agent direct preference optimization (MADPO). Experiments on collaborative writing, coding, tool use, and travel planning show that MAPL can improve collaboration quality and efficiency while approaching the performance of MARL with fixed, well-defined rewards. Within MAPL, MARLHF generally outperforms MADPO on most tasks but remains sensitive to data coverage, agent and comparator models, and the underlying MARL algorithms.

cs.AI↗

arXiv2026

Passive LWIR Hyperspectral Ranging via Transmittance Extraction and Distance Alignment

Passive long-wave infrared (LWIR) hyperspectral ranging enables distance estimation in low-light and nighttime scenes by exploiting atmospheric absorption features in thermal radiance received through the atmosphere.Joint estimation of temperature, emissivity, and distance is computationally expensive. Reference-range joint inversion also uses a distance-invariant effective attenuation coefficient, which can bias range estimates.We introduce transmittance extraction and distance alignment (TEDA), which decouples range estimation from temperature--emissivity inversion. In the first stage, a baseline estimator with a data-fidelity term invariant to the known absorption direction yields two closed-form smoothing branches for the slowly varying thermal continuum. An observation-derived gate combines the branches, and subtracting the blended baseline in the log domain recovers atmospheric transmittance. The second stage estimates range by matching the recovered transmittance to sensor-domain transmittance models recomputed for each candidate distance. Monte Carlo simulations show that TEDA effectively reduces the ranging bias caused by the distance-invariant attenuation coefficient approximation. In a measured scene, TEDA's mean range estimates are closer to the LiDAR medians than those of reference-range joint inversion in both evaluated patches. TEDA processes a complete $256\times256$ region of interest in 8.19~s versus 159.47~s for reference-range joint inversion, an approximately 20-fold speedup.

cs.CV↗

arXiv2026

Entanglement Embezzlement from Diffusive Hydrodynamics

Entanglement embezzlement asks how much entanglement can be borrowed from a many-body state by local operations and classical communication while returning that state with a small error. We uncover a conservation-law mechanism that redistributes the dominant probability mass of the Schmidt spectrum in the logarithmic Schmidt-rank coordinate and thereby controls this operational resource. For typical random pure states at fixed U(1) charge, we prove a finite-error conversion law: away from half filling, the charge bias converts $O(\sqrt L)$ charge fluctuations into $O(\sqrt L)$ borrowable entanglement, whereas particle--hole symmetry at half filling removes this contribution entirely. We then show how the resource develops dynamically in charge-conserving random circuits. Combining hydrodynamic analysis with large-scale replica tensor-network calculations, we find that diffusion broadens the operationally relevant distribution in the logarithmic Schmidt-rank coordinate on the scale $t^{1/4}$ and increases the amount of entanglement that can be borrowed. Charge transport therefore continues to reorganize the entanglement spectrum and activate embezzlement after the leading volume-law entropy has saturated.

quant-ph↗

arXiv2026

Koopman-Based Linear MPC for Safe Control using Control Barrier Functions

This paper proposes a Koopman-based linear model predictive control (LMPC) framework for safety-critical control of nonlinear discrete-time systems. Existing MPC formulations based on discrete-time control barrier functions (DCBFs) enforce safety through barrier constraints but typically result in computationally demanding nonlinear programming. To address this challenge, we construct a DCBF-augmented dynamical system and employ Koopman operator theory to lift the nonlinear dynamics into a higher-dimensional space where both the system dynamics and the barrier function admit a linear predictor representation. This enables the transformation of the nonlinear safety-constrained MPC problem into a quadratic program (QP). To improve feasibility while preserving safety, a relaxation mechanism with slack variables is introduced for the barrier constraints. The resulting approach combines the modeling capability of Koopman operators with the computational efficiency of QP. Numerical simulations on a navigation task for a robot with nonlinear dynamics demonstrate that the proposed framework achieves safe trajectory generation and efficient real-time control.

eess.SY↗

arXiv2026

DR-MPC: Fast and Feasible Dynamics-Relaxed Model-Predictive Control for Legged Locomotion

This paper presents dynamics-relaxed model predictive control (DR-MPC), a novel MPC formulation for legged locomotion, and a tailored interior-point method (IPM) solver. The formulation combines online optimization feasibility by construction with a contact-aware input parameterization. DR-MPC moves the dynamics equality and affine input constraints into quadratic penalties and retains only nonempty box constraints. The resulting box-constrained quadratic program (QP) has a block-arrow Hessian that enables the state and affine-output directions to be eliminated through a Schur complement. The solver factors only the reduced control system after swing-force elimination and contact-aligned move blocking. For the evaluated implementations using the same DR-MPC formulation, our method achieves median end-to-end MPC speedups of $16.0\times$ over HPIPM and $4.4\times$ over OSQP, with comparable locomotion performance in simulation. DR-MPC achieves a median onboard MPC end-to-end time of $4.4$ ms and is validated on a Unitree Go1 quadruped. Open-source code will be made available after publication.

cs.RO↗

arXiv2026

Transport and Temperature: Exact spectrum and Drude weight for the one-dimensional infinite-$U$ Hubbard model

Understanding charge transport in strongly correlated systems remains a central challenge in condensed matter physics, while exact analytical results for finite-temperature transport remain rare. Here, we investigate charge transport in the one-dimensional Hubbard model in the infinite-interaction limit. We first construct the exact \emph{and explicit - i.e. beyond Bethe ansatz} energy spectrum and eigenstates. Building on these explicit eigenstates, we derive a closed-form analytical expression for the charge Drude weight at arbitrary temperatures in the hole-dilute limit with a fixed number of doped holes, as well as analytical expressions in the low- and high-temperature limits at fixed hole density. We further show that, at low temperatures, the leading correction to the charge Drude weight is linear in $T$ when the number of holes is fixed, whereas it is quadratic in $T$ when the hole density is fixed. This analytically controlled example highlights the importance of identifying the underlying thermodynamic trajectory when interpreting finite-size numerical studies of charge transport in more general models.

cond-mat.str-el↗

arXiv2026

Towards Requirements Engineering for GenAI-Enabled Software: Bridging Responsibility Gaps through Human Oversight Requirements

Context: Responsibility gaps, long-recognized challenges in socio-technical systems where accountability becomes diffuse or ambiguous, have become increasingly pronounced in GenAI-enabled software. This study seeks to establish a coherent perspective for a systematic analysis of responsibility gaps from a human oversight requirements standpoint, encompassing how these responsibility gaps should be conceptualized, identified, and represented throughout the requirements engineering process. Methods: The proposed design methodology is structured across three analytical layers. At the conceptualization layer, it establishes a conceptual framing that defines the key elements of responsibility across the human and system dimensions and explains how potential responsibility gaps emerge from their interactions. At the methodological layer, it introduces a deductive pipeline for identifying responsibility gaps by analyzing interactions between these dimensions and deriving corresponding oversight requirements within established requirements engineering frameworks. At the artifact layer, it formalizes the results in a Deductive Backbone Table, a reusable representation that traces the reasoning path from responsibility gaps identification to human oversight requirements derivation. Results: A user study compared the proposed methodology with a baseline goal-oriented requirements engineering approach. Participant-perception results indicated generally favorable views of the enhanced approach across the evaluated dimensions, while expert ratings of the generated requirement artifacts showed higher mean scores for six of the seven artifact-quality items, with the strongest descriptive improvements observed for consistency and representational traceability.

cs.SE↗