arXiv Science⌕ Search

arXiv subjects

Wei Zhang

Publications and source records attributed to Wei Zhang.

At least 19 recordsLinked to original sources
arXiv2026

Protonic thermoelectric effect of Superionic H$_2$O and magnetic field generation in Uranus and Neptune

The origin of the anomalous magnetic fields of Uranus and Neptune, with significant tilts and multi-dipole configurations, is central to understanding the internal structure and evolution of the ice giants. Recent investigations confirmed that superionic H$_2$O ice is thermodynamically stable and constitutes the dominant H$_2$O phase within their icy mantles. Here, we use deep learning and ab initio molecular dynamics to investigate the thermal and protonic transport properties of superionic H$_2$O ice. We demonstrate that superionic H$_2$O ice exhibits a pronounced protonic thermoelectric effect, with a maximum Seebeck coefficient that can reach $\sim 620$ $μ$V K$^{-1}$ within the interior of Uranus, whereas Neptune's is lower, within the range of 570-585 $μ$V K$^{-1}$. Consequently, the temperature gradients in the icy mantles can induce proton migration, thereby driving magnetic field generation. Based on this mechanism, and within a dipolar approximation that captures the mean field, the disparities in mean dipolar magnetic field strength between Uranus and Neptune can be explained exclusively by their differing internal temperature gradients, and the predicted mean field strengths are comparable to those observed by Voyager 2.

astro-ph.EP↗
arXiv2026

MuSID-KD: Multigranularity Knowledge Distillation for Generative Recommendation with Semantic IDs

Generative recommendation with semantic IDs (SIDs) represents each item as a sequence of discrete tokens and autoregressively predicts the next item's SID. Despite strong recommendation performance, repeated decoding over multiple SID positions incurs substantial inference cost. Knowledge distillation transfers knowledge from a powerful generative teacher to a lightweight student, yet conventional objectives do not fully account for multi-token SID generation. We identify two limitations: item-level distribution alignment may not adequately preserve the teacher's ranking of candidate groups sharing SID prefixes, while uniform alignment across SID positions may affect final item ranking differently. We propose MuSID-KD, which combines Hierarchical Candidate Distribution Alignment (HCDA) and Ranking Impact Guided Levelwise Distillation (RIGD). HCDA aggregates item probabilities according to shared SID prefixes and aligns candidate distributions at successive levels, from candidate groups to individual items. RIGD evaluates the reduction in pairwise ranking surrogate loss when one student score contribution is replaced with the teacher's contribution, and allocates supervision accordingly. Experiments on real-world recommendation datasets using three lightweight student architectures demonstrate improved recommendation accuracy and better alignment of prefix marginal distributions and pairwise item rankings, without modifying the student's online inference architecture. Code is available at https://anonymous.4open.science/r/m7k2-review-83f9/.

cs.AI↗
arXiv2026

SAP-ViT: A Self-Attributing Patch Vision Transformer for Medical Image Classification

Vision Transformer (ViT) classifiers commonly rely on a global classification (CLS) token for image-level prediction, which is poorly aligned with local interpretability requirements in medical imaging. We propose SAP-ViT, a Self-Attributing Patch Vision Transformer that replaces CLS-based classification with direct aggregation of last-layer patch embeddings. This design makes class predictions decomposable into patch-level contributions as part of the forward pass. To encourage concise and readable evidence, SAP-ViT applies sparsity regularization to the patch-weight distribution. Since self-attention mixes information across patch tokens, we further introduce an input-space back-mapping mechanism to estimate which input patches contribute to influential output patch embeddings. We evaluate SAP-ViT qualitatively and quantitatively on multiple medical image classification datasets spanning different imaging modalities. The results show that SAP-ViT maintains strong classification performance while providing consistent and interpretable patch-level explanations across datasets. Ablation results further show that both sparsity regularization and the alignment component of input-space back-mapping contribute to the final explanation quality. Overall, SAP-ViT provides a favorable trade-off between predictive accuracy and interpretability for ViT-based medical image classification.

cs.AI↗
arXiv2026

Higher-Order Marginal Likelihood Approximation for Nonlinear State Space Models

Bayesian comparison of nonlinear state space models requires integrating over a growing latent state path and a low-dimensional parameter vector. We propose a marginal likelihood approximation that integrates out the states with a numerical or simulation-based evaluator and applies a second-order corrected Laplace approximation to the integral over the static parameters. The correction is expressed through smoothing cumulants of the complete-data log density and, under derivative-growth and posterior-concentration conditions, reduces the log marginal likelihood error from $O(T^{-1})$ to $O(T^{-2})$. In stochastic volatility experiments, it removes 64\% to 99\% of the Laplace error at far lower cost than simulation-based estimators. Applications to bivariate exchange-rate volatility models and to a sample of $T = 19{,}266$ five-minute stock returns find the strongest support for heavy-tailed observations and for a transitory volatility factor.

econ.EM↗
arXiv2026

SLAB: Time-Lag-Aware Deep Reinforcement Learning for Flexible Job-Shop Scheduling in PPVC Module Factories

Prefabricated prefinished volumetric construction (PPVC) builds room-sized modules in factories that operate as flexible job shops. A module waits 12 to 48 h after casting, waterproofing, and painting, while its station is free for other modules. Existing learned dispatchers release the next operation before this wait ends, so their plans need repair. This paper presents SLAB (Scheduling under time-Lags with an Admissible Bound), a decision process for dispatchers trained by deep reinforcement learning. Its transition releases a module only after its wait, and its reward is the decrease of a proven lower bound that includes the waits. Training on 10-module orders with halved waits also teaches the policy the station contention of larger orders. On three existing networks, repaired plans are 42% to 133% longer than the same network's schedules inside SLAB. On orders generated from Singapore's PPVC guidebook, one trained policy gives schedules 2.2% to 8.1% shorter than the shortest-processing-time rule at 10 to 80 modules. At 50 and 80 modules, it outperforms a time-lag memetic algorithm by 6.7% and 7.4% and constraint-programming search started from that rule's schedule and given 600 s by 6.6% and 7.6%. The memetic algorithm gives shorter schedules on orders of 10 modules, and the same search given 300 s on orders of 10 and 20 modules. A module factory can therefore train one dispatcher on small orders and run it without a solver on production batches of 50 to 80 modules.

cs.LG↗
arXiv2026

Arbitrary-order exceptional points in a nanomechanical cavity

Exceptional points (EPs), non-Hermitian spectral singularities, shape the evolution dynamics ranging from topological mode control to high-precision sensing. Higher-order EPs unlock enriched and sharpened spectral topology beyond the minimal second-order counterpart, thus expanding capabilities in those domains. However, the intrinsic topological fragility of higher-order EPs has long hindered their robust experimental realization. Here, we present a scalable architecture that implements arbitrary-order EPs via an optically mediated recurrent network comprising a single nanomechanical resonator and an ensemble of digital synthetic resonators. We experimentally validate this architecture's scalability for both linear and nonlinear mechanical EPs, demonstrating EPs up to the seventh order. Moreover, we reveal that the fundamental noise component, in contrast to some technical-noise contributions, shares the same system coupling channel and undergoes identical root-response amplification as the measured signal. The co-amplification mechanism sets the fundamental sensitivity limit near EPs of any order, as verified by direct signal-to-noise ratio measurements. Our work establishes a general platform for exploring higher-order EP-based phenomena while clarifying the fundamental boundary of non-Hermitian sensitivity enhancement. More broadly, it facilitates a connection between non-Hermitian physics and AI-inspired recurrent architectures across diverse physical systems.

physics.optics↗
arXiv2026

OccamView: Object-Conditioned View Selection for Frame-Budgeted Active 3D Gaussian Reconstruction

Active 3D Gaussian reconstruction fundamentally relies on selecting informative next-best views under limited sensing budgets. Existing active 3DGS methods primarily plan viewpoints according to geometric information gain, treating object-induced hidden regions in the same manner as general unexplored space. Under tight frame budgets, such geometry-driven strategies may prioritize global scene coverage while leaving partially observed objects incompletely reconstructed. To address this limitation, we propose OccamView, an object-conditioned view-selection framework for frame-budgeted active 3D Gaussian reconstruction. Rather than predicting unseen object geometry or performing shape completion, OccamView maintains an online object memory from open-vocabulary detections grounded in measured RGB-D observations and represents unresolved local occupancy around detected objects as conservative hidden-region proxies. Candidate viewpoints are then evaluated using an occlusion-aware proxy-coverage score. Furthermore, we introduce a Geo-Floor mechanism that restricts object-conditioned re-ranking to geometrically competitive candidates, allowing object-conditioned cues to guide complementary observations while preserving the geometry-driven exploration behavior of the underlying planner. Experiments on Replica and Matterport3D under a unified frame-budgeted protocol show that OccamView consistently reduces Completion and improves Completion Ratio across five frame budgets, with particularly pronounced gains under limited frame budgets. These results demonstrate that lightweight object-conditioned cues effectively complement geometry-driven active view planning.

cs.RO↗
arXiv2026

Every Coin Has Two Sides: On the Dual Nature of Generalization in On-Policy Distillation of Large Language Models

On-policy distillation (OPD) transfers teacher capabilities by supervising trajectories sampled from the student's own policy, yet its generalization behavior remains poorly understood, as most studies evaluate OPD on a single domain and on benchmarks close to the training data. We present a controlled study that varies one generalization factor at a time, from in-domain distribution shifts to cross-domain transfer and the multi-teacher setting. We find that OPD transfers a teacher's reasoning behavior rather than its answers to particular problems: training difficulty barely matters, and even problems the teacher never solves are useful. Transfer depends strongly on the origin relationship between teacher and student: same-origin pairs bring the student close to the teacher across languages, reasoning horizons, and even other domains, whereas cross-origin pairs mostly fit the trained distribution. This broad reach is a double-edged sword: since routing prompts to domain experts cannot confine each teacher's influence, combining them yields a mixture-dependent seesaw among their capabilities. These results clarify when OPD generalizes and offer a useful perspective for diagnosing multi-teacher OPD.

cs.CL↗
arXiv2026

RMMBench: A Comprehensive Benchmark for Robotic Mobile Manipulation

Although the advancement of vision-language models (VLMs) has endowed robots with enhanced environmental understanding and task reasoning, a comprehensive evaluation methodology is important to advance the integration of VLMs in robotic navigation and manipulation. However, current benchmarks lack a comprehensive method to evaluate diverse robotic tasks, and evaluation metrics remain relatively constrained, making it difficult to assess the embodied capabilities of VLMs in a thorough and fine-grained manner. To address this issue, we propose RMMBench, an evaluation benchmark that requires robots to understand language instructions and perform long-horizon tasks in continuous spaces. RMMBench seamlessly integrates high- and low-level embodied tasks into a unified framework, constructing a "navigation-manipulation" task suite comprising 70 canonical task scenarios that range from localized manipulation to long-horizon composite navigation. The results reveal that leading VLMs still face major challenges in spatial localization when performing mobile manipulation tasks, and also highlight the necessity of enhancing the spatial perception capability of robots during long-horizon interactions. RMMBench can be accessed at https://mxxq-stack.github.io/rmmbench-project/

cs.RO↗
arXiv2026

Repair Changes Which Layers to Remove: Exact Optima for Depth Pruning of Language Models

Depth pruning removes entire transformer layers to make large language models faster, and recent methods recover quality by replacing the removed layers with a training-free linear map. Which layers to remove, however, is chosen with heuristic scores whose distance from the best choice is unknown. We evaluate every subset of layer groups exactly (about 53,000 pruned models across four families, with and without repair) and find that the best layers to remove depend on the repair: linear repair absorbs the interaction among nearby layers and turns the optimum from a split layout into a contiguous block, so methods that choose layers without the repair miss the repaired optimum by up to 189%. We therefore select layers under the repair that will be applied. A greedy search at the cost of SLEB lowers perplexity by 20% to 66% relative to ReplaceMe on five models up to 27B parameters, and with a task objective it is up to 25 points more accurate given the same data. A second-order expansion of the loss yields a score that selects the repaired block from one forward and one backward pass of the intact model.

cs.DC↗
arXiv2026

Know When to Escalate: Critic-Guided Adaptive Execution for Cloud-Local Embodied Agents

Recent advances in foundation-model agents have enabled increasingly capable embodied systems for long-horizon planning and interaction. However, embodied agents require fast, closed-loop decisions as they continuously perceive and act on a changing environment. Deploying strong cloud agents leaves the platform idle for seconds between consecutive actions, while lightweight local models respond quickly but are more vulnerable to errors. Existing hierarchical architectures typically assign models fixed roles, whereas conventional model routers make stateless per-request decisions. We present CARE, a critic-guided adaptive execution framework that dynamically determines when to escalate control from a local executor to a stronger cloud model. A lightweight critic model monitors execution reliability and triggers escalation when local execution becomes unreliable; once escalated, control persists until the agent recovers, avoiding step-wise switching. To support such control transfer, a shared handoff memory maintains execution context and task-level progress across executors, enabling the model to intervene without restarting from scratch. Across diverse embodied benchmarks, CARE improves task success by 6.3-18.3 percentage points over the strongest evaluated collaboration baseline. CARE further approaches or exceeds Cloud-only success while reducing median time-between-action latency by 28.8-82.6%.

cs.RO↗
arXiv2026

IQuest-Q1: Advancing Foundation Capabilities for Agentic CLI Systems

We present IQuest-Q1, a sparse Mixture-of-Experts (MoE) agentic foundation model with 320B total parameters (15B activated). IQuest-Q1 is developed through a three-stage process: (1) stable and efficient pre-training, combining Stable SplitNorm, Muon, and muP with a two-stage curriculum whose second stage increases the coding-data mixture, preserving a wide stability margin between safe and optimal learning rates; (2) fine-grained mid-training, expanding the data mixture across domains and formats and progressively extending the context; and (3) multi-scaffold with multi-version post-training, combining SFT, domain-specialized RL, and MOPD across various scaffolds to integrate complementary training signals and strengthen agentic coding capabilities. Furthermore, model merging combines different experts and checkpoints from different stages while mitigating conflicts among their parameter updates. The resulting IQuest-Q1 demonstrates capabilities in both coding and general tasks. We release IQuest-Q1 as an open-source model to support community research and development.

cs.CL↗
arXiv2026

ProductWebBench: Evaluating Website Continuity Beyond Task Completion

Frontend coding agents are usually graded on one question: did the requested target get built. Real engineering changes carry a second obligation, because the rest of the site has to keep working. We call that second obligation website continuity, and introduce ProductWebBench, a benchmark that scores both on living frontend repositories: 320 Change tasks over existing code and 80 long-horizon Build tasks. Every task freezes a repository snapshot, staged requirements, browser evidence and deterministic checks before evaluation, and enters only once a reference passes every check and plausible-wrong ones fail. A simulated user reveals the requirements one stage at a time, and every check cleared earlier stays armed for the rest of the run. Across 8,737 runs from 13 models the two come apart: of the Change runs passing every requested-work check, 28.2% still fail a continuity check -- a blank route, horizontal overflow, console errors -- and 10.8% push a browser state they had already passed back to failing. Because the same checks also run on the untouched repository, each regression carries exact provenance, not a post-hoc label: on the 586 runs where both readings exist, 18.3% are caught breaking a verified state. Interaction is a further blind spot, failing in 29.5% of runs whose static DOM already passes. ProductWebBench therefore scores a patch against the living system it lands in, not the target alone.

cs.SE↗
arXiv2026

Stream4D: Streaming 4D Reconstruction with Training-free Motion Decoupling via Causal KV-Cache Attention

4D scene reconstruction requires robust handling of dynamic objects, yet existing streaming methods commonly assume static scenes, leading to pose drift and ghosting artifacts over long sequences. We introduce Stream4D, a training-free, motion-decoupled streaming reconstruction framework that can be directly integrated into causal Transformer backbones (e.g., StreamVGGT, Stream3R). Our key observation is that causal attention implicitly encodes rich temporal motion cues within the KV cache. We adaptively aggregate these cues from multiple attention layers and across temporal windows, and fuse them with depth priors to handle challenging cases such as occlusions and textureless regions, producing precise dynamic masks that decouple static and dynamic regions. We then apply a soft key masking scheme that leverages these dynamic masks to suppress interference from dynamic regions in causal attention, thereby improving camera pose estimation accuracy. Stream4D inherits the efficiency of causal attention and remains compatible with existing streaming architectures. On diverse dynamic-scene benchmarks, Stream4D significantly improves camera pose estimation and static-scene reconstruction quality, yields reliable dynamic masks, and effectively mitigates long-sequence ghosting.

cs.CV↗
arXiv2026

Not All Tasks Quantize Equally: Fisher-Guided Quantization for Visual Geometry Transformer

Feed-forward 3D reconstruction models, represented by Visual Geometry Grounded Transformer (VGGT), jointly predict multiple visual geometry tasks such as depth estimation, camera pose prediction, and point cloud reconstruction in a single forward pass. They have been widely adopted in 3D vision applications, but their billion-scale parameters bring substantial memory and computation overhead, posing challenges for on-device deployment. Post-Training Quantization (PTQ) is an effective technique to reduce this overhead. Existing PTQ methods for feed-forward 3D models mainly focus on handling heavy-tailed activation distributions and constructing diverse calibration datasets. However, we observe that feed-forward 3D models predict multiple geometric attributes through a shared backbone, where different transformer blocks and hidden channels contribute distinctly to each task, resulting in substantially different sensitivities to quantization errors across tasks, blocks, and channels. Consequently, treating all tasks equally over-emphasizes insensitive tasks and causes significant accuracy loss on the sensitive ones. To address this issue, we propose Fisher-Guided Quantization (FGQ) for feed-forward 3D reconstruction models. Specifically, FGQ uses the diagonal Fisher information matrix to quantify the different sensitivities across tasks, blocks, and channels, and incorporates these sensitivities into the Learnable Affine Transformation during calibration to better preserve the channels and blocks most critical to each task. Extensive experiments across camera pose estimation, point map reconstruction, and depth estimation show that FGQ consistently outperforms state-of-the-art quantization baselines on VGGT, achieving up to 39% relative improvement under the 4-bit quantization. Code is available at https://github.com/ypzhng/FGQ.

cs.CV↗
arXiv2026

Adaptive Entangled Neurons in the Brain and Natural Intelligence Simulations for Artificial General Intelligence

Understanding the brain's mechanisms is crucial in neuroscience, particularly for simulating natural intelligence and advancing artificial general intelligence (AGI). Liu et al. (2024) and Deco et al. (2025) propose that quantum entanglement may underlie the synchronization of millions of neurons, introducing the Liu-Chen-Ao (LCA) hypothesis of entangled nerve fibers. However, directly testing this idea remains challenging. Here we employ a nonlocal many-body wave equation, introducing a generalized probability-wave framework to model collective behaviors among adaptive, interacting agents, particles, or neurons. This approach enables testable eigenmodes, offering an indirect means of examining the LCA hypothesis by observing patterns in collective trading behaviors. These patterns, rooted in behavioral psychology, are thought to mirror the internal brain's decision-making and underlying mechanisms. Our analysis of Chinese intraday stock market data shows that adaptive entangled game modes explain 82%-94% of decision patterns, sharply contrasting neoclassical finance predictions assuming independent rational agents. Additionally, 2-12% of actions adapt to news, events, and environmental changes, marked by rapid equilibrium shifts, while truly independent behaviors make up less than 5%. These results empirically support the LCA hypothesis and underscore the need to simulate the brain's mechanisms and generate adaptive, entangled modules for AGI. They also expose the shortcomings of conventional artificial neural networks (ANNs) that depend on vast, opaque parameters. By combining ANN-based AI with probability-wave-based entangled brain simulations, machine learning enables the creation of human-like processing units (HPUs). Such HPUs promise more efficient and robust AGI, particularly for embodied intelligence and robotics.

cs.AI↗
arXiv2026

Tag loss models for capture-recapture data without double tagging

Standard capture-recapture (CR) models assume that marked individuals do not lose their tags during the sampling period. When this assumption is violated, the estimates of model parameters can be biased. Existing tag-loss models generally rely on double-tagging all or a subset of captured individuals, permanent marks, or auxiliary information on tag retention. However, double-tagging and permanent marking may be impractical, and reliable auxiliary information may be unavailable or difficult to obtain in many situations. In this paper, we develop a novel latent multinomial modelling framework for analysis of CR data with tag loss, without requiring double-tagging or permanent marking. The proposed model framework applies to both closed-population and open-population Cormack-Jolly-Seber (CJS) settings. Through simulation studies, we demonstrate that key model parameters can be reliably estimated in both settings. We illustrate the application of the method using a dataset from a long-term study on elephant seals. The results suggest that robust inference on tag loss and demographic parameters can be achieved without double tagging, thereby avoiding logistical challenges and broadening the framework's applicability to a wider range of studies.

stat.ME↗
arXiv2026

The Token-Energy Law of LLM Decode: Active Bytes and Realized Time Account for Joules per Token

Energy-efficient deployment of large language models requires understanding how model architecture, hardware, and serving settings shape energy per generated token. We introduce the Token-Energy Law, a compact, interpretable model of GPU-board energy per output token for dense, full-history decoding. It relates token energy to two core dimensions: active bytes and realized decode time. Active bytes describe logical byte demand per output, separating dense weights shared within a decode iteration from private key--value (KV) histories read and updated for each request. Realized decode time is the elapsed decode duration divided by the number of output tokens produced. We combine the two byte coordinates and time in a common affine form, with coefficients calibrated for each model and hardware/runtime configuration. This formulation explains how batching amortizes shared-weight work, longer attended histories increase private KV demand, and throughput determines the time-associated cost per output. Our experiments cover three models under BF16 decoding on NVIDIA Hopper and Blackwell GPUs, including two-GPU tensor parallelism on Hopper. Using fixed coefficients and observed decode time, held-out condition-mean energy estimates differ from measurements by at most 3.73%.

cs.LG↗