arXiv subjects

Rui Zhu

Publications and source records attributed to Rui Zhu.

At least 19 recordsLinked to original sources

arXiv2026

What Drives the Zero-to-One Jump? Diagnosing and Steering Hard-Prompt Learning in RLVR

Reinforcement Learning with Verifiable Rewards (RLVR) has substantially improved mathematical reasoning, yet progress on hard prompts often stalls: a prompt can remain unsolved for many training steps before abruptly transitioning to solved--a discrete "zero-to-one" jump whose underlying dynamics and steerability remain poorly understood. We investigate two questions: what drives this transition, and can it be steered? Through event-based analysis measuring the time-to-first-positive (TTFP), we find that negative rollouts preceding successful transitions consistently retain higher early-stage generation entropy, distinguishing near-solvable failures from dead ends. This signal motivates NAPO (Negative-Augmented Policy Optimization), a method integrated with Group Relative Policy Optimization (GRPO) that ranks negatives in unsolved groups via an early-branching driver and assigns graded advantages, injecting informative gradients precisely where standard group-relative updates vanish. Under fixed rollout budgets, NAPO accelerates early solution discovery and improves Pass@256 by 10.0 points on AIME24 and 6.6 points on AIME2025, demonstrating that zero-to-one transitions are diagnosable and steerable through driver-guided negative learning. Our code is available at https://github.com/jameszhu-pixel-time/Z2O.

cs.LG↗

arXiv2026

Reducing the Computational Cost Scaling of Tensor Network Algorithms via Field-Programmable Gate Array Parallelism

Improving the computational efficiency of quantum many-body calculations from a hardware perspective remains a critical challenge. Although field-programmable gate arrays (FPGAs) have recently been exploited to improve the computational scaling of algorithms such as Monte Carlo methods, their application to tensor network algorithms is still at an early stage. In this work, we propose a fine-grained parallel tensor network design based on FPGAs to substantially enhance the computational efficiency of two representative tensor network algorithms: the infinite time-evolving block decimation (iTEBD) and the higher-order tensor renormalization group (HOTRG). By employing a quad-tile partitioning strategy to decompose tensor elements and map them onto hardware circuits, our approach effectively translates algorithmic computational complexity into scalable hardware resource utilization, enabling an extremely high degree of parallelism on FPGAs. Compared with conventional CPU-based implementations, our scheme exhibits superior scalability in computation time, reducing the bond-dimension scaling of the computational cost from $O(D_b^3)$ to $O(D_b)$ for iTEBD and from $O(D_b^6)$ to $O(D_b^2)$ for HOTRG. This work provides a theoretical foundation for future hardware implementations of large-scale tensor network computations.

cond-mat.str-el↗

arXiv2026

On buoyancy in disperse two-phase flow and its impact on the well-posedness of two-fluid models

The Maxey--Riley--Gatignol equation for the flow around a sphere at low particle Reynolds number tells us that the fluid-particle interaction force decomposes into a contribution from the local flow disturbance caused by the particle's boundary---consisting of the drag, virtual-mass, and history forces, and their Faxén corrections---and another contribution from the stress of the background flow, termed generalized-buoyancy force. There is also a consensus that, for general disperse two-phase flow, the interfacial force density, coupling the average fluid phase and dispersed-phase momentum balances, decomposes in a like manner. However, there has been a long-standing controversy about the physical closure separating the generalized-buoyancy from the interfacial force density, especially whether or not pseudo-stresses, such as the Reynolds stress, should be attributed to the background flow. Furthermore, most existing propositions for this closure involve small-particle approximations. Here, we show that all existing buoyancy closures are inconsistent with particle-resolving numerical simulations and/or at least one of two simple thought experiments designed to determine the roles of pseudo-stresses and small-particle approximations. We then derive the unique consistent closure. It requires no approximation and implies that all stresses and pseudo-stresses in the average fluid phase momentum balance, except the Reynolds stress, fully contribute to the background flow responsible for buoyancy. Remarkably, it exhibits a low-pass filter property, attenuating buoyancy at short wavelengths, that prevents it from causing Hadamard instabilities, constituting a first-principles-based solution to the long-standing ill-posedness problem of two-fluid models. When employing the derived closure, even simplistic two-fluid models are linearly well-posed.

physics.flu-dyn↗

arXiv2026

Training-Data Extraction from Genomic Language Models

Genomic language models generate long nucleotide continuations from short prefixes, exposing a direct route for studying training-sequence extraction through the generation interface. We present an output-only black-box attack on Evo 2 that selects convergent groups of repeated generations without gradients, token likelihoods, or training-corpus access during candidate selection. Recovered content is then scored by an evaluator combining aligned length, nucleotide identity, match multiplicity, and sequence complexity. Across 304 runs on Evo 2 7B with bacteriophage and plasmid prefixes, the attack yields 888 candidate clusters, of which 85 match training segments of at least 500 bp, giving a cluster-level attack success rate of 9.57%. Final filtering retains 22 uniquely matched extraction events at the 500-bp threshold and 15 at 1,000 bp, covering 14 and 7 distinct training-sequence regions, respectively. Within-category source-homology screening retains 11 of the 22 events at a 99% exclusion threshold and four at 98%, with the latter mapping to two reference regions. The results establish convergence among repeated nucleotide generations as a practical output-only signal for recovering long training-sequence segments and characterize how recovery depends on prefix length, cluster size, perplexity, early stopping, and sequence domains.

cs.CR↗

arXiv2026

Analysis of p-Wave Sommerfeld Resonance Behavior in Finite-Size Dark Matter

Different stages of cosmic evolution impose different requirements on the dark matter annihilation cross section. Sommerfeld enhancement provides a possible way to accommodate them. However, in the point-like dark matter scenario, satisfying these requirements with either $s$-wave or $p$-wave Sommerfeld enhancement can strongly constrain the dark matter and mediator masses and their coupling. A finite dark matter size introduces an additional parameter and may relax these constraints. Motivated by this possibility, in this work we study the $p$-wave Sommerfeld resonances of finite-size dark matter (like proton or neutron) without specifying its internal structure. We find that the $p$-wave contribution can exceed the $s$-wave contribution. Nevertheless, the finite-size $p$-wave resonances are weaker than those in the point-like case. Despite this suppression, their velocity dependence remains similar to that of point-like dark matter. We then extend our analysis to nugget dark matter composed of a small number of constituents. In this case, the $p$-wave Sommerfeld enhancement exhibits behavior similar to that of point-like dark matter.

hep-ph↗

arXiv2026

ACPruner: Visual Token Pruning as Biased Attention Coverage Maximization in LVLMs

Large Vision-Language Models (LVLMs) face significant computational inefficiencies caused by the large number of visual tokens. Existing visual token pruning methods mainly focus on either retaining individually important tokens or selecting mutually diverse ones. In this work, we revisit visual token pruning from a coverage perspective and formulate it as a biased attention coverage maximization problem. The key idea is to select a compact token subset whose encoder-side outgoing attention can jointly cover the image while assigning higher coverage priority to more informative regions. From this perspective, we propose ACPruner, a training-free visual token pruning framework for efficient LVLM inference. ACPruner first estimates token importance by combining intra-modal saliency and inter-modal relevance, then derives token-wise coverage from attention patterns within the vision encoder, and finally performs greedy selection to maximize the proposed coverage objective. Extensive experiments across multiple LVLM backbones, including LLaVA-1.5-7B/13B, LLaVA-NeXT-7B/13B, Qwen2.5-VL-7B, and LLaVA-OneVision-7B, show that ACPruner consistently achieves strong performance retention while delivering substantial end-to-end inference speedups.

cs.CV↗

arXiv2026

How to Compress KV Cache in RL Post-Training? Shadow Mask Distillation for Memory-Efficient Alignment

Reinforcement Learning (RL) has emerged as a crucial paradigm for unlocking the advanced reasoning capabilities of Large Language Models (LLMs), encompassing frameworks like RLHF and RLAIF. Regardless of the specific optimization algorithm (e.g., PPO, GRPO, or Online DPO), online RL inherently requires an exploratory trajectory generation (rollout) phase. However, for long-context reasoning tasks, this rollout phase imposes a severe ``memory wall'' due to the exorbitant Key-Value (KV) cache footprint. While applying KV cache compression during rollouts mitigates this memory overhead, it induces a critical off-policy bias. Although modern KV compression is often nearly lossless during standard inference, even minuscule approximation errors are drastically amplified by the inherent instability of RL optimization. Specifically, the sampler generates responses under a sparse context, whereas the learner updates parameters using the full, dense context. Existing statistical solutions, such as importance reweighting, struggle to correct this magnified bias, suffering from high gradient variance and severe sample inefficiency.

cs.LG↗

arXiv2026

How Calibration Content Shapes Attention-Based Reranking

Attention-based rerankers score documents by aggregating query-to-document attention and subtracting a null-query calibration pass to remove positional and structural bias. Although widely used, this calibration assumes that the null pass removes irrelevant signal from each document. We show that modern prompt content, e.g. constraints, instructions, personas, and demonstrations can violate this assumption when it enters the scoring readout, making the null pass relevance-aware rather than null. We find that calibration is especially harmful when applied to prompts containing longer, more detailed instructions as the null-pass step removes relevant signal. Based on these findings, we propose interpolated null calibration, a training-free modification that controls how much of the instruction content enters the null baseline. It recovers attention-based reranking performance on instruction-heavy tasks where standard calibration fails, while preserving calibration's benefits when the null pass remains relevance-agnostic. On instruction heavy tasks, the recovered rankings surpass generative rerankers. We also show that in-context demonstrations improve attention-based reranking with little calibration interference, since demonstrations act only through the query pass and leave the null pass unchanged.

cs.CL↗

arXiv2026

Partial GFlowNet: Accelerating Convergence in Large State Spaces via Strategic Partitioning

Generative Flow Networks (GFlowNets) have shown promising potential to generate high-scoring candidates with probability proportional to their rewards. As existing GFlowNets freely explore in state space, they encounter significant convergence challenges when scaling to large state spaces. Addressing this issue, this paper proposes to restrict the exploration of actor. A planner is introduced to partition the entire state space into overlapping partial state spaces. Given their limited size, these partial state spaces allow the actor to efficiently identify subregions with higher rewards. A heuristic strategy is introduced to switch partial regions thus preventing the actor from wasting time exploring fully explored or low-reward partial regions. By iteratively exploring these partial state spaces, the actor learns to converge towards the high-reward subregions within the entire state space. Experiments on several widely used datasets demonstrate that \modelname converges faster than existing works on large state spaces. Furthermore, \modelname not only generates candidates with higher rewards but also significantly improves their diversity.

cs.LG↗

arXiv2026

Beyond Verified Answers: Solver-Informed Self-Distillation for Bootstrapping Operations Research Language Models

Modern large language models (LLMs) can translate natural-language descriptions into operations research (OR) formulations. Post-training techniques including reinforcement learning and on-policy self-distillation have further improved this capability. However, three limitations remain in training LLMs for OR formulations. First, training commonly relies on synthetic formulations validated by human experts or stronger models, constraining scalable supervision. Second, credit assignment is either coarse or costly: outcome rewards score an entire trajectory without locating the responsible modeling decision, whereas process-level supervision requires an additional evaluator. Third, privileged self-distillation can induce style mismatch by using solver context unavailable at deployment. We find that a model can improve from solver-artifact feedback generated by its own rollouts, making self-distillation a practical, evaluator-free source of dense supervision. Therefore, we propose SOLID: Solver-Informed On-Policy LearnIng through Self-Distillation, a novel framework for self-improving OR language models without verified answers or external evaluators. SOLID executes candidate programs from multiple rollouts, clusters their objectives, and selects a majority-group artifact as a pseudo-reference. The model then performs updates using group-relative advantages and dense self-supervision signals. Across multiple OR benchmarks, SOLID improves solution accuracy for both general-purpose and OR-tuned models over outcome-only group-relative training. These results show that solver artifacts can support scalable self-improvement without trusted answers.

math.OC↗

arXiv2026

GenFirst: Generation Before Reconstruction for Stable End-to-End Latent Generative Modeling

Latent generative models typically follow a two-stage pipeline, training a variational autoencoder for reconstruction and then a generative model on the frozen latent space. Since reconstruction-optimized latents are not necessarily generation-friendly, jointly training both models is an appealing alternative. However, direct end-to-end training remains challenging, as it is prone to latent collapse and faces a generation-reconstruction conflict. We revisit this problem by analyzing how different objectives shape the latent space and identify two key insights. First, the entropy term in the Kullback-Leibler divergence objective is essential for preventing collapse: reconstruction and prior fitting tend to shrink the posterior, while entropy preserves non-degenerate latent uncertainty. Second, reconstruction and generation exhibit asymmetric learning dynamics: reconstruction is fast and strongly supervised, whereas generation is slower and harder to optimize. Based on these insights, we achieve the first direct end-to-end training without latent collapse and propose GenFirst, a simple generation-before-reconstruction strategy. The generative objective first shapes the latent space under weak reconstruction pressure, after which reconstruction is progressively strengthened to recover visual details. We validate GenFirst with continuous autoregressive priors with exact likelihoods and SiT priors with implicit likelihoods. With our end-to-end objective and GenFirst, SiT achieves a gFID of 0.97 with CFG and 1.45 without CFG on ImageNet-256, while MMDiT reaches a GenEval score of 0.90 on text-to-image generation. Beyond image generation, we extend the framework to shared visual latents for generation and representation learning, and to continuous unified text-image generation. These results demonstrate the generality of stable end-to-end latent learning across generative priors and modalities.

cs.CV↗

arXiv2026

Gradient-extrapolation-based distributed mirror descent algorithm for multi-cluster aggregative games

This paper studies a class of multi-cluster aggregative games characterized by the coexistence of cooperation and competition, where each agent's cost function depends on its own strategy and the aggregate of all agents' strategies. To address the Nash equilibrium seeking problem for such games in the non-Euclidean setting, a distributed mirror descent algorithm with gradient extrapolation is proposed over time-varying intra-cluster and inter-cluster networks. The mirror descent framework employs a general Bregman divergence as the distance measure, providing greater flexibility than Euclidean-based methods, while gradient extrapolation exploits historical gradient information to improve convergence performance. Under the restricted strong monotonicity characterized by the Bregman divergence, the convergence of the proposed algorithm is established, and it achieves the $\mathcal{O}(1/k)$ convergence rate with the appropriately selected step-size and parameters. Finally, the effectiveness of the proposed algorithm is verified by an example on the demand response of energy systems.

cs.GT↗

arXiv2026

Memorization in Large Language Models in Medicine: Prevalence, Characteristics, and Implications

Large Language Models (LLMs) have demonstrated significant potential in medicine, with many studies adapting them through continued pre-training or fine-tuning on medical data to enhance domain-specific accuracy and safety. However, a key open question remains: to what extent do LLMs memorize medical training data. Memorization can be beneficial when it enables LLMs to retain valuable medical knowledge during domain adaptation. Yet, it also raises concerns. LLMs may inadvertently reproduce sensitive clinical content (e.g., patient-specific details), and excessive memorization may reduce model generalizability, increasing risks of misdiagnosis and making unwarranted recommendations. These risks are further amplified by the generative nature of LLMs, which can not only surface memorized content but also produce overconfident, misleading outputs that may hinder clinical adoption. In this work, we present a study on memorization of LLMs in medicine, assessing its prevalence (how frequently it occurs), characteristics (what is memorized), volume (how much content is memorized), and potential downstream impacts (how memorization may affect medical applications). We systematically analyze common adaptation scenarios: (1) continued pretraining on medical corpora, (2) fine-tuning on standard medical benchmarks, and (3) fine-tuning on real-world clinical data, including over 13,000 unique inpatient records from Yale New Haven Health System. The results demonstrate that memorization is prevalent across all adaptation scenarios and significantly higher than that reported in the general domain. Moreover, memorization has distinct characteristics during continued pre-training and fine-tuning, and it is persistent: up to 87% of content memorized during continued pre-training remains after fine-tuning on new medical tasks.

cs.CL↗

arXiv2026

AUCH-Net: Action Unit-Based Consistency-Aware Hypergraph Network for Cross-Domain Few-Shot Facial Expression Recognition

Recently, cross-domain few-shot facial expression recognition (CF-FER) has received considerable attention. However, the performance of existing CF-FER methods is still unsatisfactory due to inferior transferable feature learning under large domain discrepancy and limited target samples. Fortunately, the action units (AUs), which indicate the movements of different facial muscles, provide consistent conceptual semantics for describing expressions within and across domains. Inspired by this, we propose a novel Action Unit-based Consistency-aware Hypergraph Network (AUCH-Net), which constructs consistency-aware hypergraphs on AUs, for CF-FER. Specifically, AUCH-Net presents a new AU feature learning (AFL) module and a new visual feature learning (VFL) module. The AFL module learns AU features under the guidance of a novel relation consistency loss and an AU regularization loss, while the VFL module learns visual features supervised by a relation consistency loss and a classification loss. By learning consistent AU features, AUCH-Net effectively models the connections between AUs and expression categories. As a result, we can bridge the gap between fine-grained facial variations and high-level expression categories, greatly facilitating the learning of transferable feature representations.Extensive experiments on both in-the-lab and in-the-wild datasets show that our method consistently outperforms several state-of-the-art methods. Our results clearly show that modeling the relationships among AUs holds significant potential for FER under cross-domain few-shot scenarios.

cs.CV↗

arXiv2026

Demographically-Informed Heat-Mortality Risk Curves via Risk Graph Neural Networks

Estimating heat-related mortality risk is a core task in environmental epidemiology, typically addressed with Distributed Lag Non-linear Models (DLNMs); interpretable exposure-response surfaces fitted to temperature-mortality time series. DLNMs are effective but ignore demographic and geographic context, despite well-established relevance to heat vulnerability. We propose Risk Graph Neural Networks (RGNNs), a hierarchical GNN encoder that uses granular census features to optimise DLNM coefficient vectors, preserving interpretable risk curve outputs while substantially improving predictive calibration. Evaluated across 10 regions of England and Wales on two unprecedented heat years, RGNN variants maintain both lower point-errors and near-nominal uncertainty coverage during the 2022 heatwave where baselines collapse.

cs.LG↗

arXiv2026

Far-Infrared Star Formation Rates of Quasar Host Galaxies from Multiwavelength Spectral Energy Distribution Decomposition

Reliable star formation rates (SFRs) are essential for studying the connection between black hole growth and quasar host galaxies. We study the far-infrared (FIR) SFRs and the host galaxy properties of 202 SDSS and PG quasars at $0.02<z\lesssim0.8$, spanning $\log({\rm SFR}_{\rm FIR}/M_\odot\,{\rm yr}^{-1})\simeq-0.45$--$2.76$, using multiwavelength spectral energy distribution (SED) decomposition. The photometry covers wavelengths from the optical to the FIR and is supplemented by JCMT/SCUBA-2 observations at 450 and 850 $μ$m. We model the SEDs with CIGALE and AGNfitter and adopt multiple cold dust templates to quantify systematic uncertainties. The median model-dependent scatter among the five FIR SFR estimates is $0.14$ dex, and AGNfitter gives FIR SFRs lower than the mean CIGALE estimate by a median of $0.09$ dex. For the 58 quasars with SCUBA-2 coverage, including SCUBA-2 data changes the adopted FIR SFR by only $\sim$0.01 dex on average but can affect individual sources with limited Herschel coverage or radio-loud emission. Within our FIR-constrained sample, many quasar hosts lie on or above the star-forming main sequence, but the redshift-dependent FIR selection of the SDSS subsample limits conclusions about the full quasar-host population. We find no clear correlation between the main-sequence (MS) offset and the direct Eddington ratio, while the offset is positively related to the infrared-based $L_{\rm tor}/L_{\rm Edd}$ proxy. The minimum radiation field intensity in the dust model, $U_{\rm min}$, increases with bolometric luminosity and dust temperature. WISE W2 (4.6 $μ$m) and W3 (12 $μ$m) combined with Herschel bands can also provide useful empirical indicators of $f_{\rm AGN}$.

astro-ph.GA↗

arXiv2026

Testing [O II] $\lambda3727$ as a Star Formation Rate Tracer in Quasar Host Galaxies

The [O II] $\lambda3727$ emission line is a widely used star formation rate (SFR) tracer. However, its application to type I quasars is not straightforward, because the line can be affected by dust extinction, metallicity and contamination from the AGN narrow-line region (NLR). We test the reliability of [O II] SFRs using a sample of 202 SDSS and PG quasars, by comparing [O II] SFRs and reference far-infrared (FIR) SFRs derived from multiwavelength SED decomposition. We measure [O II], [O III], and narrow Balmer emission lines by spectral fitting. Then, we calculate [O II] SFRs after correcting dust extinction and metallicity. We then compare these SFRs with the FIR SFRs, both with and without subtracting the AGN contribution estimated from [O III]. After this correction, the median offset between [O II] and FIR SFRs is $-0.20\pm0.72$ dex for the full analysis sample and $-0.17\pm0.69$ dex for sources with S/N $>5$ in both [O II] and [O III]. Without subtracting the AGN contribution, the corresponding offsets are $0.00\pm0.69$ and $0.12\pm0.66$ dex. We conclude that [O II] is useful as a statistical SFR tracer for quasar host galaxies, but individual objects still require careful treatment of AGN contamination, extinction, metallicity, aperture effects, and redshift-dependent systematics.

astro-ph.GA↗

arXiv2026

CRISP: Pre-LLM Yet Text-Driven Visual Token Pruning for Efficient LVLM Inference

Large Vision-Language Models (LVLMs) typically require processing hundreds to thousands of visual tokens, leading to substantial inference overhead. Existing visual token pruning methods either operate before the LLM using text-agnostic heuristics or prune inside the LLM at the cost of efficiency and noisy cross-modal attention. To address these limitations, we propose CRISP, a pre-LLM yet text-driven visual token pruning framework that preserves both instruction-relevant evidence and essential scene context. CRISP works in a two-stage pipeline: Stage 1 first identifies text-aligned visual tokens, and Stage 2 enhances contextual completeness through semantic diversity. Extensive experiments on LLaVA-1.5 and LLaVA-NeXT demonstrate that CRISP achieves superior performance retention under aggressive pruning ratios, maintaining up to 99.5% accuracy while reducing inference cost and latency by more than 2 times. CRISP serves as a practical solution for efficient LVLM inference, especially in resource-constrained scenarios.

cs.CV↗