arXiv Science⌕ Search

arXiv subjects

Xu Chu

Publications and source records attributed to Xu Chu.

At least 37 records · Page 2Linked to original sources

FOCUS: Decoupling Expert Personas in LLMs to Enhance Domain Expert Capabilities

Large Language Models (LLMs) can exhibit diverse personas, and activating expert personas has been shown to improve domain expertise and task accuracy. However, existing persona control methods often suffer from cross-domain coupling, which may lead to overly aggressive behavior in high-caution domains such as healthcare, or excessive conservatism in risk-sensitive domains such as financial trading. To address this issue, we propose FOCUS (\textbf{\underline{F}}ine-tuning with \textbf{\underline{O}}rthogonal \textbf{\underline{C}}ontrol for \textbf{\underline{U}}ncoupled persona\textbf{\underline{S}}). FOCUS first automatically extracts expert persona vectors from LLMs, then applies orthogonal decomposition to decouple domain-specific expert personas, and finally introduces an expert gating module to adaptively control persona activation according to task contexts. With a two-stage training strategy and a gated selection regularizer, the model learns to activate appropriate personas for both single-domain and cross-domain tasks. Experiments on financial, legal, medical, and cross-domain benchmarks show that FOCUS improves task accuracy and outperforms existing persona control methods. Our code is available at \href{https://anonymous.4open.science/r/openpersona-48F4}{this url}.

cs.CL↗

SpikingNav: Robust Embodied Navigation with Spiking Neural Policies

Embodied navigation requires an agent to make sequential decisions from egocentric observations in a physical environment. Existing Artificial Neural Network (ANN)-based navigation models have achieved strong performance, yet they often rely on dense computation and may degrade under visual corruptions. Spiking neural networks (SNNs) provide event-driven computation and intrinsic temporal dynamics, which are promising for compact and robust navigation on resource-constrained platforms. However, whether spike-based sensing and policy dynamics can improve robustness in visually rich embodied navigation remains an open problem. This paper proposes SpikingNav, a spiking framework for robust indoor embodied navigation. It contains a Spiking Sensing Encoder (SSE) and a Spiking Policy Network (SPN). The SSE extracts task-conditioned visual features with a spike-based backbone. The SPN maintains a recurrent policy state through membrane integration, thresholding, and spike-triggered reset. In this way, SpikingNav exploits the dynamic properties and spike activations of SNNs to improve navigation performance and robustness. We evaluate SpikingNav on PointNav and ObjectNav under clean observations and visual corruptions. SpikingNav achieves competitive clean performance and stronger robustness with fewer parameters and lower per-step computation than a matched ANN baseline. For instance, SpikingNav improves ObjectNav success from 31.05% to 34.12%, and raises the average success under visual corruptions from 8.45% to 13.71%, demonstrating the benefits of spike-based sensing and policy dynamics. We further validate the deployability of our spike-based sensing method on the Thruster-V2 neuromorphic chip. This physical hardware validation shows that SpikingNav can be instantiated on a real neuromorphic substrate for cyber-physical systems.

cs.RO↗

JoyNexus: Service-Oriented Multi-Tenant Post-Training for VLA Models

The post-training of Vision-Language-Action (VLA) models is essential due to the diversity of simulators, robot embodiments, and task objectives. Existing compute services, whether offered as direct accelerator rental or batch-workload submission, typically allocate an exclusive set of GPU and CPU resources to a single tenant. While this paradigm maximizes client flexibility, it burdens users with infrastructure adaptation, and the fixed card-hour accounting model renders short or bursty workloads both expensive for tenants and inefficient for the service provider. To address these challenges, we present JoyNexus, a unified service for multi-tenant VLA supervised fine-tuning, reinforcement learning, and evaluation. JoyNexus decouples the Training Model Service, Inference Model Service, and Environment Service, each accessed through APIs and backed by resident shared base models with tenant-specific slots. Tenants can directly invoke high-level semantic APIs for training, rollout, and evaluation, or compose custom algorithms using lower-level APIs and their assigned endpoints. Multiple tenants submit workloads concurrently; their action modules, optimizers, rollout records, and policy versions remain isolated, and the service is scheduled by the global Training Queue and Inference Queue. To further improve multi-tenant training efficiency, JoyNexus introduces group batching for heterogeneous VLA data schemas that share a compatible model-facing prefix, enabling a single shared backbone forward pass over grouped samples. Finally, we evaluate JoyNexus through workload simulation and a group-batching pipeline in a realistic embodied scenario. Results show that, compared with isolated single-tenant execution, JoyNexus reduces aggregate GPU time and improves service utilization via cross-tenant scheduling on shared resources.

cs.DC↗

Robust Explanations for User Trust in Enterprise NLP Systems

Robust explanations are increasingly required for user trust in enterprise NLP, yet pre-deployment validation is difficult in the common case of black-box deployment (API-only access) where representation-based explainers are infeasible and existing studies provide limited guidance on whether explanations remain stable under real user noise, especially when organizations migrate from encoder classifiers to decoder LLMs. To close this gap, we propose a unified black-box robustness evaluation framework for token-level explanations based on leave-one-out occlusion, and operationalize explanation robustness with top-token flip rate under realistic perturbations (swap, deletion, shuffling, and back-translation) at multiple severity levels. Using this protocol, we conduct a systematic cross-architecture comparison across three benchmark datasets and six models spanning encoder and decoder families (BERT, RoBERTa, Qwen 7B/14B, Llama 8B/70B; 64,800 cases). We find that decoder LLMs produce substantially more stable explanations than encoder baselines (73% lower flip rates on average), and that stability improves with model scale (44% gain from 7B to 70B). Finally, we relate robustness improvements to inference cost, yielding a practical cost-robustness tradeoff curve that supports model and explanation selection prior to deployment in compliance-sensitive applications.

cs.CL↗

Deployment-Time Memorization in Foundation-Model Agents

Foundation-model agents are increasingly long-lived systems that remember users across interactions, making memorization an explicit deployment-time function rather than solely a property of model weights. Existing work addresses parametric memorization or audits fixed memory configurations, but does not characterize how memory-design choices jointly shape personalization utility, extraction risk, and deletion fidelity. We study this surface as deployment-time memorization, formulating agent memory as a privacy-utility frontier measured by Personalization Recall (PR) and Adversarial Extraction Rate (AER), and sweeping three memory-design knobs: summarization aggressiveness, retrieval breadth (k), and deletion mode. We further introduce the Forgetting Residue Score (FRS) to quantify whether deleted information remains recoverable from derived memory tiers. On LongMemEval, key-fact summarization reduces canary extraction by 76% on Gemma 3 12B and 64% on GPT-4o-mini while preserving nearly all personalization recall; critically, once content is compressed away, increasing k no longer restores leakage. The same compression, however, induces a deletion-fidelity failure: raw-only deletion leaves derived summary copies recoverable in approximately 20% of instances, and only full-pipeline purge or tombstone redaction drives worst-tier residue to zero. Together, these results establish that persistent agent memory must be evaluated as a first-class memorization mechanism -- assessed by what it helps agents recall, what it makes extractable, and what it can truly erase.

cs.AI↗

StackPlanner: A Centralized Hierarchical Multi-Agent System with Task-Experience Memory Management

Multi-agent systems based on large language models, particularly centralized architectures, have recently shown strong potential for complex and knowledge-intensive tasks. However, central agents often suffer from unstable long-horizon collaboration due to the lack of memory management, leading to context bloat, error accumulation, and poor cross-task generalization. To address both task-level memory inefficiency and the inability to reuse coordination experience, we propose StackPlanner, a hierarchical multi-agent framework with explicit memory control. StackPlanner addresses these challenges by decoupling high-level coordination from subtask execution with active task-level memory control, and by learning to retrieve and exploit reusable coordination experience via structured experience memory and reinforcement learning. Experiments on multiple deep-search and agent system benchmarks demonstrate the effectiveness of our approach in enabling reliable long-horizon multi-agent collaboration.

cs.AI↗

When Does Deep RL Beat Calibrated Baselines? A Benchmark Study on Adaptive Resource Control

A properly calibrated rule-based autoscaler can beat every one of six mainstream deep reinforcement learning (DRL) algorithms on cost across every workload we test - so when, if ever, does DRL actually help? We study this in RLScale-Bench, a reproducible benchmark and evaluation protocol for DRL on adaptive resource control, where an agent allocates compute to a dynamic workload under cost and service-level constraints. We evaluate PPO, DQN, A2C, SAC, TD3, and DDPG under matched architectures, training budgets, and reward functions against a calibrated rule-based baseline across six workload patterns and five seeds (240 runs), instantiate the benchmark on Kubernetes Horizontal Pod Autoscaling, and probe distribution-shift generalization. Three findings challenge common assumptions: (i) the calibrated controller achieves the lowest cost on all six workloads, though it trails the best RL agents on bursty and flash traffic; (ii) discrete-action algorithms outperform continuous-action ones by one to two orders of magnitude in constraint violations due to action-space mismatch; and (iii) no single algorithm dominates across workloads, with rankings shifting by up to four positions. The bottleneck in RL-based resource control is not algorithm selection but baseline calibration, reward engineering, and realistic evaluation protocols.

cs.LG↗

EvalStop: Using World Feedback to Detect and Correct Reward Overoptimization in Multi-Tenant RLHF Platforms

Cloud LLM fine-tuning platforms increasingly serve RLHF workloads, where a learned reward model is optimized as a proxy for human quality. As Gao et al. (2023) showed, this proxy diverges from world feedback (downstream eval metrics) under sustained optimization pressure, a phenomenon known as reward overoptimization. Existing platform schedulers ignore this divergence: non-clairvoyant schedulers optimize JCT without any quality signal, SLAQ-style quality-aware schedulers use training loss (a weaker proxy that drops monotonically through hacking), and classical per-job early stopping requires human monitoring and does not free shared GPUs. We propose EvalStop, a composable scheduling primitive that terminates jobs on k consecutive eval-score declines, releases GPUs, preserves the best checkpoint, and delegates to any base scheduler. We frame scheduler-level early stopping as a detection problem and evaluate it in a discrete-event simulator whose RLHF workload mixes reward-hacking and structurally healthy runs, with ground-truth labels hidden from schedulers. On RLHF-heavy workloads (80% RLHF, 64 GPUs), EvalStop achieves precision 98% / recall 99% / FPR 1.5% while improving JCT by 9% and cutting wasted compute by 22% over SRTF-Est (p<0.05). Trivial fixed-progress and loss-plateau competitors either incur 65% FPR on healthy RLHF or miss over half of true hacking cases. Gains compose across every base scheduler tested (9-25% JCT) and detection quality stays stable under eval noise (precision at least 91% at noise std <= 0.05) and hacking base rate (precision at least 89% across 20-80% hacking fractions).

cs.LG↗

Total-Lagrangian vectorial lattice Boltzmann method for finite-strain hyperelasticity with curved boundaries

Finite-strain hyperelasticity on curved embedded domains poses a geometric challenge for lattice Boltzmann methods. After streaming across an embedded material surface, the missing population is recovered at the physical cut-link point, where the lattice direction, surface normal, and tangential deformation directions are generally distinct. We develop a total-Lagrangian vectorial lattice Boltzmann method that resolves this geometric mismatch for two- and three-dimensional hyperelastic dynamics. The continuum equations are written as a conservative first-order system for material velocity and deformation gradient. Vector-valued populations are chosen so that their moments recover the state and the material-coordinate Piola fluxes, giving D2Q4\(\times\)6 and D3Q6\(\times\)12 schemes from one \(D\)-dimensional construction. Curved boundaries are embedded by a level set and closed link by link through opposite-population moment identities, cut-link interpolation, and local geometric information at the boundary point. The reconstruction is coupled to a compatibility projection that keeps the recovered displacement aligned with the evolved deformation gradient on embedded active-node graphs. The resulting method extends the previous grid-aligned two-dimensional formulation to curved domains and three-dimensional lattices while retaining explicit collide-stream updates on Cartesian grids. Benchmarks in two and three dimensions show agreement with exact finite-strain fields, nonlinear radial boundary-value problems, and finite-element references.

physics.comp-ph↗

A total-Lagrangian vectorial lattice Boltzmann method for finite-strain hyperelastic dynamics

Inspired by the vectorial lattice Boltzmann method for linear elastodynamics \citep{boolakee2025linear}, we construct a total-Lagrangian vectorial lattice Boltzmann formulation for two-dimensional finite-strain hyperelastic dynamics. The governing equations are first written as a conservative first-order system for the material velocity and the full deformation gradient. This representation separates the kinematic part of the dynamics from the constitutive closure: the first Piola--Kirchhoff stress is evaluated locally from the current deformation gradient and enters the lattice only through nonlinear flux moments. A D2Q4 stencil with six-component vector populations is then used to match the state and the two material-coordinate fluxes. The formulation includes a second-order population initialization, trapezoidally centered body forcing, displacement reconstruction by velocity quadrature, and half-way reconstructions for velocity Dirichlet and Neumann traction boundaries on grid-aligned domains. The resulting method preserves the local collide--stream structure of standard lattice Boltzmann schemes while adapting the vectorial first-order strategy from linear elastodynamics to hyperelastic finite-strain dynamics.

physics.flu-dyn↗

Transient and asymptotic Taylor--Aris dispersion of Brownian rods in arbitrary regular-polygonal ducts

Taylor--Aris dispersion of Brownian rods in non-circular ducts is governed by a coupling absent from passive-scalar theory. Pressure-driven shear aligns the rods and makes translational diffusion tensorial, while duct geometry determines how this tensor is sampled across the cross-section. We formulate this problem for dilute rods in regular-polygonal ducts of arbitrary side number. At each cross-sectional point, a local shear-aligned Jeffery--Brownian closure gives four transport fields, namely two transverse diffusivities, a direct axial diffusivity and a signed shear--axial cross coefficient. Because the shear frame rotates through a polygon, these fields enter a conservative two-dimensional transverse operator rather than a radial scalar-diffusion problem. Its zero mode is a non-uniform invariant density, which replaces the area measure in the Taylor--Aris reduction and reduces, in the circular-pipe limit, to a weighting proportional to the inverse shear-direction diffusivity. The resulting cell problem separates the effects of rod alignment on streamline sampling and transverse relaxation. Alignment produces only a small, non-monotone shift in mean speed, but gives a larger enhancement of the Taylor coefficient by reducing transverse mixing. Normalization by the same-geometry spherical coefficient removes most passive shape dependence and exposes the approach to the fully aligned transverse-mixing limit. Finite regular polygons converge smoothly to the circular-pipe branch, whereas low-sided polygons retain distinct shear-sampling signatures. A biorthogonal spectral formulation resolves finite-time releases. Localized, multi-peaked and broad injections excite different non-zero transverse modes and exhibit different pre-asymptotic variance growth, but modal decay selects the common long-time Taylor--Aris coefficient given by the cell problem.

physics.flu-dyn↗

Shear alignment and tensorial Taylor--Aris dispersion of Brownian rods in a circular tube

Brownian rods disperse in pressure-driven flow through a coupling between axial shear, anisotropic translational diffusion and Jeffery--Brownian rotation. Classical tube Taylor--Aris theory treats transverse mixing as a scalar process, and existing passive-rod reductions have mainly addressed planar geometries. A circular tube adds two ingredients: the shear strength varies with radius and freely rotating rods sample a three-dimensional orientation space. We formulate a tensorial Taylor--Aris theory for dilute axisymmetric rods in Poiseuille flow by solving the local steady orientation Fokker--Planck problem and using its second moments to close a conservative axisymmetric transport equation. The long-wave reduction shows how each part of the diffusion tensor enters the one-dimensional limit. The radial diffusivity sets the invariant cross-sectional measure and the cell problem for the leading Taylor coefficient; the radial--axial component produces an inverse-P{é}clet correction to the migration speed; the axial component gives the direct diffusivity. The central mechanism is the streamwise alignment generated in high-shear annular layers. Alignment reduces radial diffusivity there, shifts the long-time sampling of the velocity profile toward slower streamlines, and amplifies the radial cell response. In strong shear this raises the Taylor coefficient by about \(23\%\) for aspect ratio \(p=1000\) and by about \(30\%\) in the infinitely slender limit, approaching the fully aligned bound. Direct simulations of the full tensorial equation validate the asymptotic coefficients. The same radial mixing operator also gives a Sturm--Liouville spectral model that tracks finite-time relaxation from different radial injections to the long-time Taylor regime.

physics.flu-dyn↗

LERA: LLM-Enhanced RAG for Ad Auction in Generative Chatbots

The integration of advertising auction mechanisms into large language model (LLM)-based chatbots presents a significant opportunity for commercialization, yet poses unique challenges in balancing relevance, efficiency, and user experience. Recently, Feizi et al.~\citep{feizi2023online} and Hajiaghayi et al.~\citep{hajiaghayi2024ad} outlined a retrieve-then-generate paradigm that decouples retrieval and generation, offering lightweight ad insertion and payment determination. However, current retrieval relies solely on text embedding similarity, which may lead to commercial misinterpretation and issues such as repetitive insertions. In this paper, we propose LERA, a two-stage retrieve-then-generate auction framework tailored for LLM chatbots. In the first stage, embedding-based coarse filtering pre-selects a small set of candidate advertisers. In the second stage, the LLM itself is queried with a carefully designed prompt to produce logits over candidates, which serve as refined organic relevance scores. These scores are combined with bids, and a critical-value payment rule accounts for both the coarse-filtering and fine-ranking thresholds, ensuring truthfulness for utility-maximizing advertisers. The framework naturally extends to multiple ad insertions within dynamic dialogue flows and long responses. Experiments on a synthetic advertiser-query benchmark show that LERA substantially improves ad selection accuracy and insertion diversity while incurring only controllable latency overhead.

cs.IR↗

Towards Order Fairness: Mitigating LLMs Order Sensitivity through Dual Group Advantage Optimization

Large Language Models (LLMs) suffer from order bias, where their performance is affected by the arrangement order of input elements. This unfairness limits the model's applications in scenarios such as in-context learning and Retrieval-Augmented Generation (RAG). Recent studies attempt to obtain optimal or suboptimal arrangements based on statistical results or using dataset-based search, but these methods increase inference overhead while leaving the model's inherent order bias unresolved. Other studies mitigate order sensitivity through supervised fine-tuning using augmented training sets with multiple order variants, but often at the cost of accuracy, trapping the model in consistent yet incorrect hallucinations. In this paper, we propose \textbf{D}ual \textbf{G}roup \textbf{A}dvantage \textbf{O}ptimization (\textbf{DGAO}), which aims to improve model accuracy and order stability simultaneously. DGAO calculates and balances intra-group relative accuracy advantage and inter-group relative stability advantage, rewarding the policy model for generating order-stable and correct outputs while penalizing order-sensitive or incorrect responses. This marks the first time reinforcement learning has been used to mitigate LLMs' order sensitivity. We also propose two new metrics, Consistency Rate and Overconfidence Rate, to reveal the pseudo-stability of previous methods and guide more comprehensive evaluation. Extensive experiments demonstrate that DGAO achieves superior order fairness while improving performance on RAG, mathematical reasoning, and classification tasks. Our code is available at: https://github.com/Hyalinesky/DGAO.

cs.LG↗

Entropic lattice Boltzmann method for general anisotropic advection--diffusion

Many transport processes exhibit direction-dependent diffusion, described macroscopically by the full-tensor anisotropic advection--diffusion equation (ADE). Numerical discretization is demanding when the principal axes are rotated relative to the mesh, since mixed derivatives and oblique fluxes amplify grid-orientation errors under large tensor contrasts. This paper develops a local entropic lattice Boltzmann discretization for the general anisotropic ADE. The non-equilibrium population is split into a first-order flux sector and a residual ghost sector. The diffusion tensor is imposed through local tensorial relaxation of the flux, while higher-order kinetic content is controlled by an ADE-corrected entropic stabilizer with positivity fallback. Chapman--Enskog analysis shows the scheme recovers the target full-tensor equation with a discrete-time diffusivity relation between the physical tensor and the flux-relaxation matrix. The update is local, matrix-free, and applies to rotated, spatially varying, heterogeneous, and dynamically coupled tensor transport. We validate it on 3D benchmarks--advected Gaussian plumes, decay of rotated Fourier modes, and source-driven transport with varying tensors--covering off-diagonal diffusion, high-Péclet advection, anisotropy ratios of O(104)O(10^4) O(104), and local contrasts up to $3\times10^4:1$. It is then applied to orientation-induced Taylor dispersion of Brownian rods, quantifying enhancement from shear-driven rotation. Heat-conduction tests include rotated thermal-conductivity measurements and effective conduction in heterogeneous porous media with anisotropy up to $10^4:1. Finally, anisotropic Rayleigh--Bénard convection is simulated to examine how plume morphology and heat transfer change over seven decades of anisotropy ratios, demonstrating an accurate, stable local solver for strongly anisotropic advection--diffusion.

physics.flu-dyn↗

FOREVER: Forgetting Curve-Inspired Memory Replay for Language Model Continual Learning

Continual learning (CL) for large language models (LLMs) aims to enable sequential knowledge acquisition without catastrophic forgetting. Memory replay methods are widely used for their practicality and effectiveness, but most rely on fixed, step-based heuristics that often misalign with the model's actual learning progress, since identical training steps can result in varying degrees of parameter change. Motivated by recent findings that LLM forgetting mirrors the Ebbinghaus human forgetting curve, we propose FOREVER (FORgEtting curVe-inspired mEmory Replay), a novel CL framework that aligns replay schedules with a model-centric notion of time. FOREVER defines model time using the magnitude of optimizer updates, allowing forgetting curve-inspired replay intervals to align with the model's internal evolution rather than raw training steps. Building on this approach, FOREVER incorporates a forgetting curve-based replay scheduler to determine when to replay and an intensity-aware regularization mechanism to adaptively control how to replay. Extensive experiments on three CL benchmarks and models ranging from 0.6B to 13B parameters demonstrate that FOREVER consistently mitigates catastrophic forgetting.

cs.LG↗

Residual Decoding: Mitigating Hallucinations in Large Vision-Language Models via History-Aware Residual Guidance

Large Vision-Language Models (LVLMs) can reason from image-text inputs and perform well in various multimodal tasks. Despite this success, they are affected by language priors and often produce hallucinations. Hallucinations denote generated content that is grammatically and syntactically coherent, yet bears no match or direct relevance to visual input. To address this problem, we propose Residual Decoding (ResDec). It is a novel training-free method that uses historical information to aid decoding. The method relies on the internal implicit reasoning mechanism and token logits evolution mechanism of LVLMs to correct biases. Extensive experiments demonstrate that ResDec effectively suppresses hallucinations induced by language priors, significantly improves visual grounding, and reduces object hallucinations. In addition to mitigating hallucinations, ResDec also performs exceptionally well on comprehensive LVLM benchmarks, highlighting its broad applicability.

cs.CV↗

MORE-R1: Guiding LVLM for Multimodal Object-Entity Relation Extraction via Stepwise Reasoning with Reinforcement Learning

Multimodal Object-Entity Relation Extraction (MORE) is a challenging task in information extraction research. It aims to identify relations between visual objects and textual entities, requiring complex multimodal understanding and cross-modal reasoning abilities. Existing methods, mainly classification-based or generation-based without reasoning, struggle to handle complex extraction scenarios in the MORE task and suffer from limited scalability and intermediate reasoning transparency. To address these challenges, we propose MORE-R1, a novel model that introduces explicit stepwise reasoning with Reinforcement Learning (RL) to enable Large Vision-Language Model (LVLM) to address the MORE task effectively. MORE-R1 integrates a two-stage training process, including an initial cold-start training stage with Supervised Fine-Tuning (SFT) and a subsequent RL stage for reasoning ability optimization. In the initial stage, we design an efficient way to automatically construct a high-quality SFT dataset containing fine-grained stepwise reasoning tailored to the MORE task, enabling the model to learn an effective reasoning paradigm. In the subsequent stage, we employ the Group Relative Policy Optimization (GRPO) RL algorithm with a Progressive Sample-Mixing Strategy to stabilize training and further enhance model's reasoning ability on hard samples. Comprehensive experiments on the MORE benchmark demonstrate that MORE-R1 achieves state-of-the-art performance with significant improvement over baselines.

cs.MM↗