arXiv Science⌕ Search

arXiv subjects

Zhenyu Zhang

Publications and source records attributed to Zhenyu Zhang.

At least 19 recordsLinked to original sources
arXiv2026

Accordion: Elastic-Depth Inference via Fixed-Prefix Layer Looping

Large language models serve applications with diverse inference budgets, but training and maintaining separate models for each budget incurs substantial costs. Recent Looped Transformers enable flexible inference computation through parameter reuse, but maintaining strong performance across different inference budgets remains an open challenge. We introduce Accordion, a mixture-of-experts-based model that supports five inference budgets through fixed-prefix layer looping. Each budget follows a pre-defined execution path, while the minimum budget retains the unlooped model. Joint pretraining samples one budget per micro-batch and optimizes its next-token prediction loss without additional cross-budget consistency objectives. We further preserve these inference budgets through supervised fine-tuning and reinforcement learning, where parameter-group merging and budget-matched multi-teacher on-policy distillation integrate three domain experts into one model. After 3.6T tokens of pretraining, increasing inference depth improves Accordion-6B-A0.5B's five-category macro-average across 37 tasks by 3.01 percentage points, with the middle budget capturing 89% of this gain using half as many additional layer executions. The final model surpasses each domain expert on its corresponding task-and-budget average, while achieving strong instruction-following performance across all budgets and retaining depth-dependent gains in mathematical reasoning and code generation.

cs.LG↗
arXiv2026

Heartbeat Thinking: Speculative Reasoning and Tool Execution While Listening in Realtime Voice Agents

Tool-using voice agents often leave users waiting after speech ends, even when actionable information arrives earlier in the request. Speculative approaches begin work during speech, but chunk-bounded or interrupt-on-update generation can truncate a tool call before its arguments are complete. This couples computation time to speech updates, limiting useful work completed in advance. We introduce Heartbeat Thinking, which handles updated input through new Thinker invocations while allowing ongoing invocations and dispatched tools to finish. Periodic invocations read the latest partial transcript and a shared record of completed reasoning and tool results. These results help resolve missing arguments and initiate dependent calls, allowing preparation to progress across speech updates. Across SpeechFCEval, FDBench v3, and AudioCRAG, Heartbeat improves aggregate speculative tool coverage or retrieval reuse over a SHANKS-style windowed baseline, with benchmark-dependent effects on final task quality. On FDBench v3, it increases tool coverage by 16 percentage points and reduces mean final-response latency by 36.4\%. The results show that heartbeat thinking paradigm preserving ongoing computation during speech can turn listening time into reusable preparation for faster and more capable voice-agent responses.

cs.CL↗
arXiv2026

SweepANN: A GPU-Accelerated Large-K Approximate Vector Search for Drug Discovery

DrugCLIP places small molecules and protein pockets in one space, turning genome-wide drug discovery into large-K retrieval by vector proximity. A campaign fixes over 20K pockets in advance for one library of over 500M molecules. Each pocket keeps K = 500K candidates, 0.1% of the collection, versus 100 in ANN benchmarks. Missed hits never get tested, so mean recall must reach 99% relative to exact search. Large answers make IVF probe every list holding a result and graph search track K or more candidates, so costs grow with K. On our CPUs and GPUs, neither index family reaches the target without losing most of its edge over scanning. SweepANN partitions compressed vectors across GPUs and scans each resident partition. One matrix multiplication scores each block for a whole query batch, reading it once. Several plans perform the K-dependent selection and merging of each query's K answers, each returning an exact top-K under compressed scoring. The window plan retains each query's best K from sampled blocks as its seed, and only rows above each seed's minimum score, shared once across GPUs, enter the buffers. Four Blackwell GPUs (RTX PRO 6000) answer all 26,562 pockets with a resident time of about 61 seconds, excluding library loading, and 99.6% mean recall relative to exact FP32 search. DrugCLIP reports roughly 24 hours with eight A100 GPUs in its own campaign. On 500M rows, the window plan runs 1.41x faster than SweepANN's grouped plan in the same memory. Across 25M-500M rows and K of 10K-500K, all GPU IVF configurations meeting the recall target take 8.2-24x SweepANN's resident time. On DEEP1B's 1B vectors across eight GPUs, against SweepANN's exact full-score scan of uncompressed FP32 rows, the window plan cuts resident time by 5.4x and 3.2x at K = 100K and 500K. It also cuts per-GPU peak memory by 6.0x and 5.3x, losing 1.0 and 0.7 mean-recall points.

cs.DB↗
arXiv2026

LLMs Can Get "Brain Rot": A Pilot Study on Twitter/X

We propose and test the LLM Brain Rot Hypothesis: continual exposure to junk web text induces lasting cognitive decline in large language models (LLMs). To unveil junk effects, we designed a novel controlled experiment on real Twitter/X corpora, by constructing junk and reverse-controlled datasets via two orthogonal operationalizations: M1 (engagement degree) and M2 (semantic quality), with matched token scale and training operations across conditions. Compared to the control group, continual pre-training of 4 LLMs on the junk dataset causes non-trivial declines (Hedges' g>0.3) on reasoning, long-context understanding, safety, and inflating "dark traits" (e.g., psychopathy, narcissism). The gradual mixtures of junk and control datasets also yield dose-response cognition decay: for example, under M1, ARC-Challenge with Chain-of-Thought drops 72.1 -> 57.2 and RULER-CWE 83.7 -> 52.3 as junk ratio rises from 0% to 100%. Error forensics reveal several key insights. First, we identify thought-skipping as the primary lesion in reasoning: models increasingly truncate or skip chains. Second, partial but incomplete healing is observed: scaling instruction tuning and clean continual pre-training improve the declined cognition, yet cannot restore baseline capability, suggesting persistent representational drift rather than format mismatch. Finally, we discover that the popularity, a non-semantic metric, of a tweet is a better indicator of the Brain Rot effect than the length in M1. Together, the results provide significant, multi-perspective evidence that social effects of data could be a causal driver of LLM capability decay in continual pre-training, thereby motivating routine "cognitive health checks" for deployed and evolving LLMs.

cs.CL↗
arXiv2026

Learning Dynamic Evidence Routes for Vision Transformer Probing

Probing frozen vision transformers typically uses permutation-invariant aggregation (GAP or $\texttt{[CLS]}$), treating patch tokens as an unstructured set. Content-dependent probes such as self-attention are useful accuracy controls, but they do not expose a fixed token schedule or fixed position weights for auditing. We introduce SSMProbe, a probe of frozen vision transformers that learns a Sinkhorn patch route and reads it with a diagonal S4 decoder. The decoder's causal linear time-invariant (LTI) recurrence yields fixed position coefficients, exposing how patch arrangement interacts with sequential weighting. Held-out spatial predictability measures route organization beyond a location-bias null. On CUB and Cars, MAE, BEiT, DINOv2, and supervised ViT yield spatially organized routes with distinct readout profiles: DINOv2 is $\texttt{[CLS]}$-dominant, while MAE benefits from learned routing over fixed scans. On MAE/ImageNet, Sinkhorn reaches 70.33% accuracy, 5.55 percentage points above the strongest fixed scan.

cs.CV↗
arXiv2026

Delta Tokenizer: Reference-Identical Tokenization of Session Deltas and Segment-Parallelism for Long Prompts on Multicore CPUs

An agent that drives an LLM sends the model the same conversation again and again, and each turn adds only a little text at the end. Inference engines reuse the KV cache of the shared prefix, so only the new tokens pass through the model. However, tokenization has no such shortcut. The CPU front end of the serving engine converts every request back into token IDs from its first character, which lengthens the time to first token (TTFT) and consumes CPU on every turn. We present Delta Tokenizer, a CPU tokenization front end that tokenizes only the delta between a request and the previous request of the same session. It retains the earlier token sequence, encodes again only the appended text and the short tail whose tokens the append could affect, and joins the two only at a position the tokenizer's splitting rules themselves cannot move, which keeps the result exact. For long requests with no state to reuse, it cuts the text where practical tokenizers already keep neighboring pieces independent, encodes the pieces on several cores at once, and concatenates the outputs into the reference encoding, exactly. A shared CPU pool schedules these chunks together with the short incremental updates, so an update runs between two chunks rather than behind an entire long job. The incremental path shortens the tokenization of a session turn by roughly 40x relative to the Hugging Face reference tokenizer, and on 16 cores the chunk-parallel path encodes a four-million-character request 8.2x faster than a serial encode and 1.6-2.1x faster than LoPT. Inside SGLang, Delta Tokenizer reduces the median TTFT through the chat interface by 59% at 100K tokens and brings the P99 TTFT of agent sessions down 9.5x under load and 23x when long requests tie up the front end. Every output we checked matches the reference, among them 41.8 billion documents encoded by its fast encoder.

cs.CL↗
arXiv2026

Fully-heavy multiquarks in neural-network quantum states

Exotic hadrons beyond the conventional quark model provide a direct window into the dynamics of strong interaction. However, extracting the multiquark spectroscopy has to face the quantum many-body problem, which is still a theoretical challenge. In this case, diquark-antidiquark model is proposed as an approximation. Although this model can describe the spectroscopy roughly, it cannot describe the detailed dynamics. Furthermore, the methods aiming at dealing with many-body problem, e.g. the Gaussian expansion method and Diffusion Monte Carlo, are proposed, but face severe computational bottlenecks. In this work, we introduce the neural-network quantum state (NNQS) approach to investigate the spectra of fully-heavy multiquark states within the non-relativistic potential quark model. By employing deep neural networks to represent the complex many-body spatial wave function, and constructing the color-spin part exactly from group theory to enforce fermionic antisymmetry, our approach effectively overcomes the dimensionality obstacles inherent in traditional methods. The results are compared with various model calculations, demonstrating that NNQS offers superior accuracy and flexibility, particularly in treating high-dimensional correlations. This work establishes NNQS as a promising tool for exploring the spectroscopy of exotic hadrons.

hep-ph↗
arXiv2026

RiftANN: Efficient Graph Traversal for Vector Search with RDMA-Based Memory Disaggregation

Graph indexes for billion-scale vector collections can exceed a single server's DRAM capacity. Passive RDMA-based disaggregated memory provides scalable capacity without memory-node computation, but conventional best-first search performs poorly in this setting. Fine-grained and unnecessary remote reads increase communication cost, while dependencies between candidate evaluation and subsequent expansion serialize traversal and leave CPUs idle. We present RiftANN, a graph-based approximate nearest neighbor search (ANNS) system for passive RDMA-based disaggregated memory. RiftANN navigates using compact vectors at compute nodes and selectively verifies exact vectors using a threshold calibrated from observed approximation errors. A bounded one-sided RDMA pipeline batches and overlaps the remaining remote accesses with local processing. RiftANN evaluates returned neighbors in parallel and incrementally incorporates completed results. An impact gate estimates whether unfinished evaluations may change the candidate set, allowing traversal to continue when their expected influence is small while preventing unsafe advancement from incomplete search state. A lightweight feedback controller coordinates RDMA concurrency with background evaluation capacity as search configurations and query loads change. We evaluate RiftANN on SIFT, DEEP, and SPACEV at 100M scale and SIFT1B. At matched recall, RiftANN achieves 1.6x to 4.3x latency speedups and 1.1x to 2.2x higher throughput than DistVS, and 1.6x to 5.6x latency speedups over SSD-based DiskANN and PipeANN. These results show that passive disaggregated memory can support low-latency graph-based vector retrieval without query-time computation at memory nodes.

cs.DB↗
arXiv2026

TPCS: A Cycle-Level Simulation Paradigm with Native Execution Semantics for RTL Modeling and Generation

The growing diversity of domain-specific architectures and microarchitectural designs demands fast and accurate evaluation methods during early design stages. However, existing approaches suffer from a fundamental trade-off: high-level simulators offer speed but lack fidelity, while RTL-based tools provide accuracy at the cost of significant simulation overhead. This gap limits efficient pre-RTL microarchitecture exploration. Therefore, we propose Transaction-Pruned Cycle Simulation (TPCS), a novel modeling and simulation framework. It serves as a unified intermediate abstraction spanning microarchitecture modeling, cycle-accurate simulation, and synthesizable RTL implementation. TPCS organizes combinational logic as transaction-based function invocations and leverages host CPU control flow to naturally prune inactive logic, eliminating the need for explicit event scheduling or signal tracking. This enables cycle-accurate simulation with significantly improved performance. TPCS preserves structural correspondence with RTL and supports automatic generation of synthesizable designs. TPCS achieves 36$\times$-42$\times$ speedups over parallel Verilator on SMP systems and 3.4$\times$-7.2$\times$ over single-threaded Verilator on accelerators, with cycle-level waveform agreement on the evaluated traces. The generated RTL demonstrates comparable timing and area to handcrafted implementations, with relative changes of -4.7\% to +2.6\% in clock period and -3.3\% to +4.0\% in standard-cell area. By bridging the abstraction gap between high-level modeling and RTL design, TPCS enables a unified and agile pre-RTL workflow, allowing efficient microarchitecture exploration with both high performance and implementation fidelity.

cs.AR↗
arXiv2026

Autocorrelation in black hole flare movies: Departures from Kerr

Autocorrelation in black hole movies encodes the time delays and angular separations between gravitationally lensed images, offering a means of testing the spacetime geometry. Using an orbiting hot spot in the parametrized Johannsen-Psaltis metric with a single deformation parameter, we investigate the ability of lensing-induced correlations to distinguish departures from Kerr. From ray-traced movies, we extract the slope (k) and intercept (b) of an approximately linear secondary ridge in the time-angle autocorrelation map as potential future observables. Variations in the spin and the metric deformation parameter produce distinctive trajectories in the (k,b) plane, allowing the two observables to jointly constrain both parameters when the orbital radius, observer inclination, and orbital angular velocity are specified. By varying the orbital angular velocity, we construct a Kerr reference region in the (k,b) plane, and we find that, for some low-spin configurations with negative deformation parameters, the measured slope-intercept pairs of the secondary peaks lie outside this reference region. This feature appears for sub-Keplerian, Keplerian, and super-Keplerian motion, indicating that secondary-ridge measurements from black hole flare movies have the potential to distinguish non-Kerr signatures.

astro-ph.HE↗
arXiv2026

Fully charmed tetraquarks on the Lattice with controlled errors

We introduce the lattice quark potential model (LQPM), which discretizes the nonrelativistic quark potential model on a periodic cubic lattice and diagonalizes the resulting many-body Hamiltonian exactly. Unlike variational approaches, which provide only upper bounds on the energy, LQPM removes this variational bias, and its remaining finite-volume uncertainty is removed by extrapolation. Formulated directly in coordinate space, the method is indifferent to the specific form of the potential and accommodates arbitrary interactions, such as including three-body forces and spin-orbit and tensor couplings, that are difficult to treat in conventional few-body approaches. As a benchmark, the charmonium and $Ω_{ccc}$ spectra are reproduced within a few MeV of experiment. For the fully charmed tetraquark $cc\bar{c}\bar{c}$, we obtain a $J^P=0^+$ ground state at $5934.8(13)~\mathrm{MeV}$, $33.2(13)~\mathrm{MeV}$ below the $η_cη_c$ threshold, unambiguously identified as a deeply bound tetraquark whose existence is robust against the choice of potential. Such a state can decay into two dileption pairs $2(e^+e^-)$ via $J/ψe^+e^-$, with significance similar to $X(6400)$, or about one order of magnitude smaller. Lying below the lowest strong-decay channel, it can decay only through electromagnetic and weak interactions. Our results establish exact lattice diagonalization as a controlled, systematically improvable, and broadly applicable route to multiquark spectroscopy, providing a quantitative benchmark for the strong interaction and valuable guidance for future experimental searches for exotic hadrons.

hep-ph↗
arXiv2026

RESUME: Recurrent State Updates from Motion and Residual Signals for Efficient Video Language Modeling

Existing video language models encode sampled RGB frames independently, so a long video must either exhaust the token budget or drop the changes between sampled frames. Codec-aware front-ends read the motion vectors and residuals that encoding produced, but in their deployed form each predictive frame is still tokenized on its own: the tokens are a function of the current primitives, not of a carried reference. We argue that a more natural function is of both---the current primitives and a carried reference. A clip and its time reversal share the same frames and differ only in the order of changes---an axis that symmetric pooling discards by construction, and that is non-empty in the frozen vision features VideoLMs use---and the codec recurrence already composes those changes in order against a reference state. We introduce RESUME, a stateful codec representation: an anchor I-frame initializes a compact latent state, each subsequent predictive frame is consumed as an update to that state, and a shared readout exposes VideoLM-compatible tokens from the accumulated state. Codec prediction is thereby kept at the representation level and handed to the language model as a trajectory, not as a set of independent token groups. At the same per-predictive-frame token budget as prior codec-aware methods, a predictive frame enters the language model as a readout of what the front-end already knows, not as an encoding of the current primitives alone. Across ten benchmarks, the gains concentrate on temporal reasoning: on all three temporal benchmarks RESUME improves over both the RGB-frame baseline LLaVA-Video-7B (by 2.8, 5.1, and 3.9 points on TempCompass, TOMATO, and MVBench) and the codec-based baseline CoPE-7B, while staying competitive on general and long-form QA. Frozen-transition tests further show anchor dependence, order sensitivity, and useful rollout behavior beyond the training horizon.

cs.CV↗
arXiv2026

CoVisco: Codec-Native Vision Encoder with Native Token Compression for Unified Image-Video Understanding

Vision-language models face a fundamental scaling bottleneck: the number of visual tokens grows with both temporal duration and spatial resolution, making long-video understanding expensive for the vision encoder and the language model. Existing methods often compress visual tokens after dense encoding, creating a mismatch between the representation used during training and the compact interface required at deployment. We present CoVisco, a codec-native vision encoder with native token compression for unified image-video understanding. By combining codec-native input support with segmented attention, CoVisco can encode long visual inputs in a single forward pass without forming dense patch-to-patch interactions across all frames. Each temporal segment is equipped with learnable abstract tokens that learn a compact segment-level representation, while fine-grained patch tokens remain available throughout the encoder. Alternating intra-segment and abstract-communication layers preserve video-level context through the abstract-token channel. A lightweight selector further exposes either abstract tokens alone or abstract tokens augmented with a runtime-selected subset of patch tokens, yielding a compact visual interface that reduces the visual context and prefill burden of downstream MLLMs while retaining fine-grained evidence when needed. Pretrained with contrastive objectives on 565M image--text pairs and 6.4M videos, CoVisco shows competitive performance on video-oriented embedding and multimodal understanding benchmarks. In the evaluated four-segment, 64-frame setting, abstract-only inference uses only 400 visual tokens while achieving video-understanding performance close to, and on some benchmarks exceeding, OneVision-Encoder. Selected patch tokens further improve fine-grained video reasoning. Project URL: https://github.com/ernie-research/CoVisco.git

cs.CV↗
arXiv2026

LIBERO-MAX: Do Robot Policies Adapt When the World Changes?

Robots must often continue a task after a target moves, the viewpoint shifts, or an obstacle appears, even though their earlier observations and committed actions reflect the previous scene. Many simulation robustness benchmarks fix external conditions at reset, leaving this temporal challenge underexamined. We introduce LIBERO-MAX, a benchmark of 8,000 paired cases spanning eight types of changes to geometry, observations, appearance, clutter, and paths. Each pair compares task execution with and without a mid-task event, holding the task, initial state, policy seed, and pre-event action sequence fixed. This controlled comparison distinguishes event-associated regressions from failures already present without the change. Across fourteen current VLA, hybrid, and world-action policies, events reduce success by 11.0-25.7 percentage points. Event profiles reveal shared vulnerabilities to geometry and observation changes, while policy-family rankings interleave. Camera controls show that robustness reflects both competence under the changed conditions and the trajectory from which they are encountered; varying query cadence does not eliminate the gap. Together, the paired protocol and temporal diagnostics establish LIBERO-MAX as a reproducible testbed for diagnosing failures under mid-execution changes and measuring progress toward robot policies that remain effective as the world changes.

cs.RO↗
arXiv2026

Investigation of Hopping Conduction and Its Impact on the Subthreshold and Transition Region Transport in Oxide Semiconductor Transistors by Magneto-Transport Measurements

In this work, magneto-transport measurements, including Hall effects and magnetoresistance (MR) at various temperatures, are employed to directly probe the electron transport properties in crystalline indium oxide (In2O3) and amorphous indium-zinc oxide (IZO) transistors. For the first time, we develop a subgap density of states (DOS) extraction method based on the MR measurements at low temperature, considering both the interference and orbital shrinkage effects. The sign and magnitude of MR are used as direct evidence to distinguish the dominating transport mechanisms between hopping conduction and free-electron conduction. It is found that crystalline In2O3 exhibits a subgap DOS more than two orders of magnitude lower than that of amorphous IZO, together with a smaller localization radius of hopping sites. As a result, crystalline In2O3 not only enhances the carrier mobility but also significantly reduces the supply voltage (VDD) because of the smaller transition region enabled by the much-suppressed subgap DOS. This study reveals that structural disorder critically influences the device operation in the subthreshold and transition regions of oxide semiconductor transistors.

cond-mat.mtrl-sci↗
arXiv2026

Emergence of Chiral Dynamical Multiferroicity in a Ferroelectric Lattice Nonadiabatically Driven by Ultrafast Achiral Electric Fields

It has been shown recently that chiral dynamical multiferroicity can be generated on a ferroelectric lattice whose electric dipoles respond masslessly under chiral optical pumping. Here we demonstrate that, when driven by ultrafast electric pulses, chiral dynamical multiferroicity can also emerge even in situations where the external field is achiral. We reveal this striking phenomenon using a prototypical system of a BaTiO$_3$ moiré ferroelectric lattice, emphasizing the key factor that its chiral electric dipoles inevitably behave massively upon ultrafast driving. At a deeper level, the massive nature is attributed to the anisotropic and nonadiabatic dipolar responses, as captured by the phase difference between the faster longitudinal and slower transverse components of the ferroelectric polarization. Crucially, such a phase difference naturally also gives rise to dynamical magnetization, which exhibits chiral magnetic textures with monopole-like topology coexisting with the ferroelectric chirality. These findings establish the dipolar mass as an enabling and tunable degree of freedom in inducing chiral dynamical multiferroicity, offering new avenues for ultrafast, non-contact magnetic control using pure electric probes.

cond-mat.mtrl-sci↗
arXiv2026

Spectral Overfitting in Noisy Linear Probing of Pretrained Representations

Frozen pretrained features are often treated as a safe interface for downstream learning: only a small linear readout is trained, while the backbone is fixed. We show that this readout can still overfit noisy labels in a structured way. A label-blind PCA rank sweep reveals a sharp spectral pattern: under label noise, exposing all pretrained directions can hurt clean accuracy, and intermediate ranks often recover much of the lost performance. Rank-matched random projections help less, and measured between-class signal is strongly concentrated in leading PCs. The pattern appears across three ImageNet-pretrained backbones on CIFAR-10, with gains up to $36.0\pm0.8$ points over the default full-rank probe at 40\% noise. Tuned full-rank probes outperform validation-selected PCA probes, so we present the sweep as a diagnostic of spectral overfitting rather than a competitive noisy-label method.

cs.LG↗
arXiv2026

Dense Dump Codec: Error-Controlled, Random-Access Compression of GRMHD Time Series for Slow-Light Radiative Transfer

Black-hole movies provide a unique venue to study the time evolution of accreting plasma. Modeling this evolution with slow-light radiative transfer requires closely spaced simulation outputs, because the plasma changes as light propagates through it. Saving these outputs in full is costly, whereas sparse sampling introduces time-interpolation errors. We present the Dense Dump Codec (DDC), a compression method for dense GRMHD time series. DDC stores exact anchor states and compactly represents the intermediate evolution, while allowing direct access to selected times and variables. Applied to eight production sequences spanning SANE and MAD simulations at several black-hole spins with 0.1M output, DDC archives are about 10 times smaller than the original dense data and even about 50% smaller than the original 0.5M output in aggregate. We further integrate a native DDC reader into polarized slow-light radiative transfer. Tests at 86, 230, and 345 GHz show that DDC may reduce aggregate Stokes-image errors by 54-79% relative to slow-light calculations using original 0.5M input. These results indicate that DDC enables high-cadence slow-light calculations without the prohibitive cost of saving every dense GRMHD state in its original form.

astro-ph.HE↗