arXiv subjects

Peng Wang

Publications and source records attributed to Peng Wang.

At least 19 recordsLinked to original sources

arXiv2026

Quaternion Approximate Networks for Enhanced Image Classification and Oriented Object Detection

This paper introduces Quaternion Approximate Networks (QUAN), a novel deep learning framework that leverages quaternion algebra for rotation equivariant image classification and object detection. Unlike conventional quaternion neural networks attempting to operate entirely in the quaternion domain, QUAN approximates quaternion convolution through Hamilton product decomposition using real-valued operations. This approach preserves geometric properties while enabling efficient implementation with custom CUDA kernels. We introduce Independent Quaternion Batch Normalization (IQBN) for training stability and extend quaternion operations to spatial attention mechanisms. QUAN is evaluated on image classification (CIFAR-10/100, ImageNet), object detection (COCO, DOTA), and robotic perception tasks. In classification tasks, QUAN achieves higher accuracy with fewer parameters and faster convergence compared to existing convolution and quaternion-based models. For objection detection, QUAN demonstrates improved parameter efficiency and rotation handling over standard Convolutional Neural Networks (CNNs) while establishing the SOTA for quaternion CNNs in this downstream task. These results highlight its potential for deployment in resource-constrained robotic systems requiring rotation-aware perception and application in other domains. Code: https://cwru-aism.github.io/ QUANpaper/

cs.CV↗

arXiv2026

Not All Features Are Created Equal: A Mechanistic Study of Vision-Language-Action Models

A fine-tuned Vision-Language-Action (VLA) policy can easily place the alphabet soup in the basket on command, just as it saw during fine-tuning. However, if the basket is shifted five centimeters to the left, it drops the soup off the table. We developed an interpretability pipeline to investigate what such a policy is computing. Injecting task A's activations into the action expert while the policy looks at task B's scene makes pi0.5 execute task A's motor trajectory in 99.6\% of episodes ($n{=}1{,}968$). The injected program is bound to absolute workspace coordinates and ignores the visible scene, which provides a mechanistic account of the perturbation brittleness that concurrent benchmarks report. The binding holds on a physical UR10e: directed replay redirects the commanded task in 26/26 rollouts in one direction and 18/26 in the other, with no-injection and random-direction controls at the floor, and once the source object is moved 10--15\,cm the arm grasps and releases at the recorded coordinates in 50/50 trials, picking up the wrong block when one sits there and closing on empty air when none does. Applying the same interventions to six VLAs on LIBERO, MetaWorld, SimplerEnv, and ALOHA over 420{,}000+ rollouts yields three further findings: every architecture encodes the instruction, and four of the five weight it below vision whenever the scene alone identifies the goal; under the standard replacement write-back the SAE pooling that preserves behavior is architecture-specific (pi0.5 per-token, SmolVLA indifferent), and goal selection and motor generation separate into VLM and expert pathways wherever the two are distinguishable. We release \textbf{Action Atlas} (https://action-atlas.com), an interactive platform covering all 520+ trained SAEs, 79 identified concepts, and the scored UR10e rollouts. Code: https://github.com/CWRU-AISM/action-atlas

cs.RO↗

arXiv2026

Scalarized Einstein-Maxwell black holes in external scalar fields

We construct static black holes in Einstein-Maxwell-scalar theory under prescribed external scalar fields, mapping their existence domain and determining how their scalar charges vary with the external field. Focusing on solutions with positive scalar charge, we find that a positive external field induces scalar charge in Reissner-Nordström (RN) black holes below the zero-source scalarization threshold and extends the allowed charge-to-mass range. A negative external field instead introduces a finite lower existence boundary and permits distinct black holes under identical external conditions. Coupling these isolated responses through the leading companion-generated scalar fields, we find mutual scalar induction in binaries whose components are RN black holes in isolation. For binaries with scalar charges of the same sign, their scalar charges need not increase as the separation decreases, while some binaries with opposite scalar charges admit multiple equilibria and cannot continue along their original equilibrium branches to smaller separations.

gr-qc↗

arXiv2026

ZipFusion: Fusing Lossless KV Decompression with Attention for Efficient LLM Decoding

The key-value (KV) cache places growing demands on GPU memory capacity and bandwidth as large language models serve longer contexts and more concurrent requests. Its footprint limits concurrency, while repeated KV reads during attention can make decoding memory-bandwidth bound. Prior lossless KV cache compression methods reduce transfers between devices but restore the uncompressed KV cache in GPU memory before attention. They therefore leave these repeated KV reads unchanged and require additional work and memory for decompression. We present ZipFusion, which enables attention to consume the losslessly compressed KV cache directly. ZipFusion co-designs the compression format and attention kernel to reduce the bytes read from GPU memory during attention. The kernel reconstructs the original values directly in registers using simple bit operations, avoiding a separate decompression pass and easing the memory-bandwidth bound. ZipFusion also reassigns memory freed by compression across layers to store additional KV cache. Its memory manager reserves space for ongoing generation and makes the remaining capacity available to new requests. We implement ZipFusion on top of FlashInfer and integrate it with SGLang. On an NVIDIA H100, ZipFusion achieves about 1.25x speedup over FlashInfer in decode attention. With 8K context, it improves model decode throughput by up to 26.3% over uncompressed SGLang under the same GPU memory budget. At each method's largest supported batch, it also delivers up to 2.76x the throughput of the best-performing lossless KV cache compression baseline.

cs.AR↗

arXiv2026

J-Comm: Jacobian-Guided Latent Communication between LLM Agents

Latent communication requires both an effective continuous reasoning process and an interface through which an external model can leverage its intermediate computation. We present J-Comm, a framework comprising two core components. First, a training-free Geometric Agreement for Latent Reasoning (GEAR) reweights token candidates over existing model embeddings, which monotonically optimizes geometric consensus among candidate tokens in embedding space at each step. Second, we introduce an H+J (Hidden-and-Jacobian) communication interface that gives the Receiver two complementary views of the Sender's reasoning. The H channel supplies continuous inputs derived from feedback distributions, while the J channel conveys intermediate-state cues in vocabulary-indexed Jacobian-lens coordinates. Intuitively, H provides inputs for the Receiver to reason from, while J offers additional guidance within its computation. The Receiver reconstructs these cues using its own dictionary and injects them into intermediate layers during prefill, enabling communication without sharing key-value caches or requiring identical model widths. In Qwen3-8B to Qwen3-4B communication, J-Comm achieves the highest mean score across seven benchmarks, including 94.80% on MATH500, 54.55% on GPQA-Diamond, 73.33% on AIME2024+2025, and 62.93% success on ALFWorld. Compared with TextMAS, it improves performance by 1.29-8.59 percentage points and reduces generated text tokens by 19.2-74.8%.

cs.CL↗

arXiv2026

To Route or to Adapt? Multi-Expert Diffusion Planners in Unseen Regions

Diffusion trajectory planners with domain-specific experts face a practical question in unseen regions: can they rely on selecting among existing experts, or must the planner itself adapt? We study this question using a planner with a shared adapter and per-domain expert adapters. Across three real-world held-out maps, none of eight test-time routing schemes improves the fleet-mean lateral offset over the static default, which uses the same expert for every scene. Even an oracle that selects the best expert for each scene reduces the mean offset by only 0.9 m. In contrast, reward-based fine-tuning on just 20 target-region scenes yields substantially larger gains. On matched evaluation slices, joint replay achieves a fleet-mean offset of 6.9 m, compared with 12.4 m for the static default. Comparisons under the same target-region training budget show that target-region training drives the improvement, while replaying training scenes limits forgetting on the original ODDs. On nuPlan, fine-tuning across training cities also improves open-loop offsets, although closed-loop performance deteriorates. Further diagnostics reveal that two test-time adaptation baselines achieve low offsets by producing degenerate trajectories. These results show the limited headroom for selecting among existing experts and the greater open-loop gains available from adapting the planner.

cs.RO↗

arXiv2026

Fine-Grained Analysis of Catastrophic Forgetting in Continual Learning via Algorithmic Stability

Understanding catastrophic forgetting, in which learning new tasks degrades performance on previously learned tasks, remains a fundamental challenge in continual learning (CL). Existing theoretical analyses often rely on specific model or task structures and offer limited insight into how iterative optimization affects forgetting. To address this gap, we develop an algorithmic stability framework for expected population forgetting under SGD without prescribing a particular model architecture. Specifically, we decompose forgetting into intra-task and cross-task generalization gaps and empirical forgetting. To bound the generalization gaps, we track how a sample perturbation affects updates within a task and propagates through subsequent tasks. We consider constant, intra-task decaying, and continuously decaying learning-rate schedules. Comparing the two decaying schedules allows us to characterize how restarting learning-rate decay at task boundaries affects the propagation of historical sample perturbations. For empirical forgetting, we derive bounds for all three schedules by retaining cumulative gradient alignment along the optimization trajectory, without requiring convexity. Combining these results yields upper bounds on expected forgetting that capture the effects of training set size, the number of updates per task, the total number of tasks, learning-rate schedules, and cumulative gradient alignment. Finally, we conduct experiments on Split CIFAR-100 and Split MiniImageNet to examine the empirical implications of our theoretical findings.

cs.LG↗

arXiv2026

A cosmic filament catalog for COSMOS-Web Data Release 1 across 0.5 < z < 3.5

Cosmic filaments represent the environments in which most galaxies form and evolve. However, the spatial distribution of filaments and the link between galaxy properties and their positions relative to filaments remains unclear, particularly at high redshifts. In this work, using the deep-field catalog COSMOS-Web Data Release 1, we construct a filament catalog spanning 0.5 < z < 3.5 that can be directly applied to studies of galaxy evolution and the galaxy--large-scale-structure connection at the peak epoch of galaxy and black hole formation. We developed a new procedure based on the DisPerSE method that fully incorporates the probability distribution functions (PDFs) of galaxy photometric redshifts by generating multiple realizations for each tomographic 2D slice. We then stacked these realizations to construct ``filament probability maps'' (w_ fil maps), from which filaments were subsequently extracted. The filament extraction parameters were optimized using mock catalogs generated from TNG simulations by minimizing the discrepancies between 3D and projected 2D filaments. Applying this procedure to the COSMOS-Web data, we detected 12,523 filaments (comprising 136,210 segments) across 0.5 < z < 3.5 and released a filament catalog, a companion segment catalog, and filament probability maps for each slice. Validation against astrophysical properties shows a strong agreement between the extracted filaments and those in the simulations, supporting the robustness of the filament extraction. These data products provide a robust foundation for investigating galaxy--environment coevolution at cosmic noon and beyond.

astro-ph.CO↗

arXiv2026

ECHO: Emergent Common-Mode Hidden Offsets Drive Vocabulary Collapse in Preference Optimization

Preference optimization can improve every ranking metric while building a hidden, shared representation shift that the relative loss barely sees, one that can eventually destroy generation. We trace this failure to the common-mode offset, a shared directional shift in the model's hidden states that appears across token positions, prompts, and both chosen and rejected responses. Because it moves chosen and rejected representations together, the relative ranking loss barely reacts to its accumulation. As this offset grows, it projects onto the output layer to form a vocabulary well, elevating a single token's probability until it dominates decoding and causes generation collapse. The isolated offset alone reconstructs the vocabulary well, injecting the learned offset into an untreated base model recreates the collapse where norm-matched random directions do not, and masking this common component from the loss prevents the well in our flagship setting. Under the per-token ranking loss we study, the same collapse appears in 14 of 17 base-model lineages and under full-parameter fine-tuning. Moreover, the offset is not merely an artifact of collapse, since it is already present in textbook DPO and SimPO runs that form no well. Textbook DPO keeps it weakly aligned with any single vocabulary direction even with three times our base budget. Trained from base models for that budget, however, full-parameter SimPO drives it into collapse on both Llama-2 and Llama-3.1, and the same kind of offset grows, without a well, from a public SFT checkpoint under the official SimPO recipe. Across 17 UltraFeedback runs, the better a run ranks held-out responses, the less often two public reward models prefer its samples to the base model's. These findings expose a blind spot in standard ranking metrics and introduce a representation-level signal that can warn of generation collapse before it occurs.

cs.CL↗

arXiv2026

Single-step phase-engineered pulse for active readout cavity reset with a known qubit state

In a circuit QED architecture, we experimentally demonstrate a hardware-efficient and qubit-state-dependent Single-Step Phase-Engineered (SSPE) pulse scheme for actively depopulating a readout cavity. The protocol appends a reset segment with tailored amplitude and phase to a square readout pulse. Within the linear-response regime, the optimal reset amplitude scales proportionally with the readout amplitude, while the optimal reset phase remains invariant, significantly simplifying the experimental calibration procedure. For a known qubit state, time-resolved measurements demonstrate that the SSPE pulse achieves faster cavity depletion than the CLEAR protocol. Crucially, this approach enables arbitrarily fast, overshoot-free depletion of the cavity photon population, with the ultimate reset rate constrained by the available drive amplitude and the finite analog bandwidth of the measurement chain. A comprehensive evaluation of the QND character reveals no measurable increase in non-QNDness relative to the free-decay and CLEAR protocols. The remaining non-QNDness is predominantly attributable to state switching induced by qubit relaxation during the readout process. These results establish the SSPE scheme as a practical and scalable approach for achieving rapid and smooth cavity reset in superconducting quantum circuits in the case of a known qubit state.

quant-ph↗

arXiv2026

Area gaps for minimal surfaces in spheres

In this paper, we prove that a linearly full minimal $2$-torus in $\mathbb{S}^N$ with $N\geq 5$ must have area $>2π^2$, and that a linearly full closed minimal surface in $\mathbb{S}^N$ with $N\geq 9$ must have area $>8π$. These results verify the Willmore conjecture and the generalized Willmore conjecture in higher codimension for minimal surfaces. The area gaps are obtained by applying the Cheng--Li--Yau comparison theorem and deriving a lower bound of the heat trace, where the monotonicity of the shifted normalized Riesz mean is used. We also establish a volume gap above the balanced Clifford product for linearly full closed minimal $n$-submanifolds in $\mathbb{S}^N$ when $n=3$, $N\geq 9$, or $n\geq 4$, $N\geq 3n-1$.

math.DG↗

arXiv2026

Sequential Planning via Anchored Robotic Keypoints

Changes in a robot's observations do not automatically imply changes in the task it is solving, but language-conditioned manipulation systems often fail to separate the two. If an object moves, for example, the locations at which actions should be executed may change while the underlying manipulation plan remains valid. We introduce Sequential Planning via Anchored Robotic Keypoints (SPARK), which separates a task's symbolic plan from its execution-time perceptual grounding, and we experimentally isolate whether a fixed symbolic plan can survive substantial changes to the scene through execution-time re-grounding. SPARK represents the task as a symbolic behavior tree whose object references are grounded to current 3D observations during execution, allowing the robot to update where actions are performed while preserving the plan. Runtime verification then enables local recovery and renewed grounding, only resorting to a new plan if necessary. To test the separation between plan and perceptual-grounding, we perform a set of manipulation experiments with a fixed plan while moving objects during execution. Under a 10 cm displacement, verification and adaptation maintain $66.7\%$ task success, compared with $2.2\%$ when disabled, demonstrating the importance of the underlying principle. Without task-specific model training and with an open-weight planner, SPARK also achieves $66.8\%$ mean success across six LIBERO-PRO settings, and $68\%$ across eleven physical task-embodiment settings on three robot platforms. Together, these results show that robustness does not require re-planning the task and for an important class of failures, it is sufficient to preserve the plan and update the system's perception of a changing world. Code and videos can be found at \url{https://cwru-aism.github.io/spark-page/}

cs.RO↗

arXiv2026

REATS: LLM Reasoning-based Ensemble Learning for Adaptive Time Series Forecasting

Due to the diversity of real-world time series, no single forecasting model consistently dominates across all samples. Ensemble learning addresses this by combining complementary model strengths, yet existing methods rely on fixed rules or black-box models based solely on numerical inputs, failing to leverage LLM reasoning for interpretable weighting decisions. We propose REATS, which leverages LLM reasoning capabilities as an intelligent ensemble router that jointly processes textual temporal pattern descriptions and numerical features to produce interpretable, sample-adaptive ensemble weights through chain-of-thought reasoning. To enable effective LLM-based ensembling, we study its key design choices and propose: (i) a structured input pipeline that transforms raw time series into hybrid textual--numerical representations with fixed token cost, enabling rule-based chain-of-thought construction without API dependency, augmented with retrieved similar-sample priors; (ii) a diverse multi-row weight supervision scheme coupled with a token-efficient percentage-table format that reduces numerical complexity and mitigates LLM hallucinations; and (iii) a two-stage fine-tuning framework combining SFT with GRPO, where a reciprocal reward mapping transforms the continuous unbounded MSE gap into bounded signals with amplified near-oracle sensitivity, addressing the uniform sensitivity and outlier-dominated advantage compression inherent in naive reward designs for regression-based GRPO. Experiments on eight benchmarks demonstrate that REATS outperforms competitive ensemble baselines while providing natural language explanations and demonstrating strong transfer learning and out-of-domain generalization to unseen candidate models.

cs.LG↗

arXiv2026

When Privileged Guidance Misaligns: State-Matched Routing and Contextualized Self-Distillation for Multi-Turn Agents

Multi-turn agents trained with sparse outcome rewards receive limited supervision for intermediate decisions. Privileged on-policy self-distillation provides denser guidance by having a synchronized teacher re-score student responses with training-only references. However, the student may take different actions or complete subgoals in another order, reaching states for which the reference provides no applicable continuation. The resulting state--reference mismatch can lead the reference-conditioned teacher to penalize valid actions. We introduce State-Matched Routing and Contextualized Self-Distillation (SMRC-SD), which uses the student's reached state to decide when and how a reference should guide the student. At each turn, SMRC-SD checks state compatibility with the reference, distills only on matched turns, and contextualizes the reference by augmenting it with a reached-state summary and a compatible continuation. At inference, the policy requires neither references nor state matching. Experiments spanning three model sizes show gains over unconditional full-path self-distillation in embodied interaction (ALFWorld), web navigation (WebShop), and tool use (FTRL). FTRL-trained policies also transfer to BFCL and ToolHop without additional training. Code is available at https://github.com/liujunzhuo/SMRC-SD.

cs.AI↗

arXiv2026

Colossal Spin--Lattice--Charge Coupling in Noncollinear Ferrimagnetic NbMnX$_2$ ($X$ = S, Se, Te) Monolayers

Noncollinear ferrimagnets combine a net magnetic moment with internal spin degrees of freedom, creating opportunities to couple magnetic, mechanical, thermal, and electronic responses. Using first-principles calculations, symmetry analysis, atomistic spin simulations, and transport modeling, we identify stable NbMnX$_2$ ($X$ = S, Se, Te) monolayers with noncollinear ferrimagnetic ground states and Curie temperatures up to 313 K. Competing exchange, Dzyaloshinskii--Moriya interactions, and magnetic anisotropy produce field-responsive canted states that couple strongly to the lattice and charge carriers. Magnetization rotation changes the elastic modulus of NbMnTe$_2$ by up to 36\%, while lattice entropy substantially enhances the near-room-temperature magnetocaloric response of NbMnS$_2$ and NbMnSe$_2$. In NbMnSe$_2$, rotation restores a mirror-protected crossing, continuously closes an approximately 0.13 eV gap, and produces a conductivity-based anisotropic magnetoresistance ratio up to 10,000\% at 100 K. The combined results establish noncollinear NbMnX$_2$ monolayers as a multifunctional platform for two-dimensional spintronics, nanomechanics, and thermal control.

cond-mat.mtrl-sci↗

arXiv2026

Environmental Dependence of Satellite Planarity and Orbital-Pole Coherence around Milky Way Analogues in a Hydrodynamical Cosmological Simulation

We examine whether the unusual spatial flattening and orbital-plane coherence of the Milky Way's classical satellites are connected to the Galaxy's location in the cosmic web. We compare the 11 classical satellites with the 11 most massive satellites of 11,922 Milky Way-mass hosts in the TNG300-1 hydrodynamical simulation. We measure flattening with both the simple inertia tensor (SIT), which retains radial information, and the reduced inertia tensor (RIT), which isolates angular anisotropy. Orbital-plane coherence is characterized by the minimum opening angle containing the axes of the eight most coplanar satellite orbits. For the Milky Way, we find $(c/a,b/a)=(0.183,0.558)$ for SIT and $(0.364,0.736)$ for RIT, together with an eight-orbit opening angle of $21.9^\circ$. The corresponding fractions of simulated systems at least as extreme are $4.94\%$, $12.28\%$, and $5.04\%$, respectively. We describe the environment using the velocity-shear tensor smoothed on $2\,h^{-1}\mathrm{Mpc}$ and compare the full sample with Local Group-like pairs, systems whose shear eigenvalues match those reconstructed for the Local Group, and hosts in knots, filaments, sheets, and voids. Among the well-sampled environmental subsets, the shape and opening-angle distributions differ only weakly. Although the cosmic web imprints preferred orientations on host spins and satellite orbital-plane axes, the Milky Way combines orientations that are uncommon in the simulation. We conclude that the present-day cosmic-web environment alone does not substantially increase the occurrence of Milky Way-like satellite configurations. This result does not rule out an origin in anisotropic accretion, since neither the present-day web class nor its shear eigenvalues fully encodes the assembly history of an individual satellite system.

astro-ph.GA↗

arXiv2026

Gluing Local Contexts into Global Meaning: A Sheaf-Theoretic Decomposition of Transformer Representations

Existing interpretability tools do not test whether a representation keeps the same content when only the phrasing changes. We treat each paraphrase pair as a local witness that two activations should agree and build a cellular sheaf over the paraphrase graph; its Laplacian $L_\mathcal{F}$ answers the question on a frozen model with no training. The kernel $H^0$ is a content subspace: at 20 dimensions it beats the preserved subspace of the concept eraser LEACE on held-out CounterFact fact retrieval across eight architectures by a mean $+17.1$\,pp, and constraining all paraphrases of a fact jointly adds a further $+6.5$\,pp. The spectral complement concentrates causal influence: ablating the most paraphrase-variable coordinates, a coordinate-wise proxy for it, changes model outputs $5.6$ to $26.5\times$ more than ablating coordinates of matched per-coordinate variability, across nine models from 124M to 13B parameters. Stacking layers into a grid creates $b_1 = N(L-1)$ algebraic 1-cycles, and the resulting model-derived harmonic mass varies by nearly three orders of magnitude across six architectures and ranks them as their steering fragility does (Spearman $ρ= 0.90$, exact one-sided permutation $p = 0.014$). The same paraphrase graph yields the content subspace, the influence directions, and the fragility measure. Project page: https://cwru-aism.github.io/gluing-lc-page/

cs.CL↗

arXiv2026

Criticality Concentrates Extensive Sensing Information into a Local Readout

We show that criticality concentrates extensive sensing information into a local trajectory. In the rapid-readout limit of an all-to-all dissipative feedback network, a single binary trajectory has a Fisher-information rate linear in $N$ for a common weak field, as does the full record. Critical slowing does not remove this gain because the local weight of the slow mode decreases with $N$. An analytic bound guarantees that the local record retains more than half of the full information across the entire channel-parameter range. We also identify how parameter drives and observation dynamics determine local access to collective information beyond permutation symmetry. Furthermore, our sparse-readout theorem establishes a $k^{-1}$ decay of fractional information loss: only $Θ(\varepsilon^{-1})$ trajectories are needed to retain a fraction $1-\varepsilon$ of the full information rate. Any growing readout set, even of vanishing density, asymptotically recovers the full common-field Fisher-information rate.

quant-ph↗