arXiv Science⌕ Search

arXiv subjects

Yi Xu

Publications and source records attributed to Yi Xu.

At least 37 records · Page 2Linked to original sources
arXiv2026

The Role of Gradient Modification in Heavy-Tailed Nonconvex Stochastic Min-Max Optimization

Stochastic min-max optimization has attracted increasing attention due to its applications in modern machine learning, while existing theoretical studies mainly rely on the bounded variance assumption for stochastic gradients. Under heavy-tailed noise, where stochastic gradients only possess a finite $p$-th moment for $p\in(1,2]$, gradient clipping or normalization is commonly believed to be necessary to guarantee convergence. In this work, we revisit stochastic min-max optimization under heavy-tailed noise and provide a comprehensive theoretical study of stochastic gradient descent ascent (SGDA). We first show that vanilla SGDA, without any modification to its update rule, can converge under heavy-tailed noise in both nonconvex-strongly-concave (NC-SC) and nonconvex-concave (NC-C) settings, establishing the first convergence guarantees for SGDA in these regimes. Beyond unregularized problems, we further investigate regularized stochastic min-max optimization, where directly incorporating gradient normalization into proximal updates is nontrivial due to the incompatibility between normalization and proximal structures. We overcome this difficulty by developing new clipping-free algorithms, i.e., Stoc-TRGDAM and Stoc-TRGDmax, and they both can achieve the optimal dependence on the target accuracy without using gradient clipping.

math.OC↗
arXiv2026

Post-Corrected Raw-Score Martingale Posterior Sampling for von Mises-Fisher Models

We develop a finite-horizon calibration method for raw-score martingale posteriors, with von Mises--Fisher models as the main worked example. Starting from the maximum likelihood estimator, predictive paths are generated by simulating future observations from the current fitted model and updating the natural parameter by unpreconditioned score increments. The main methodological step is to separate predictive simulation from covariance calibration. Raw-score increments have Fisher-information covariance, whereas Bernstein--von Mises calibration requires inverse-information covariance. We therefore apply a terminal linear correction based on a local information estimate. For more efficient implementation, we also introduce a hybrid version that replaces the omitted tail of the infinite predictive continuation by a Gaussian approximation with matching leading-order quadratic variation. We prove fixed-n convergence, a finite-horizon approximation bound for the Gaussian tail, and a Bernstein--von Mises limit for the hybrid post-corrected sampler under local regularity and consistent terminal calibration. Simulations show that tail correction reduces truncation-induced underdispersion, and an OSCAR ocean-current example illustrates local directional uncertainty summaries.

stat.ME↗
arXiv2026

Occamy-1.0: Open Pareto-frontier 35B Intelligence for Co-work

Co-work agents execute complex workflows that combine information gathering, tool use, coding, and file manipulation across many model invocations. Because cost and latency accumulate over the full episode, their practical value depends not only on peak capability but also on how efficiently that capability is delivered. Yet many steps in everyday work emphasize state tracking, coordination, recovery, and follow-through rather than frontier-scale reasoning. We present Occamy-1.0, a cost-efficient co-work model obtained by further training the post-trained Qwen3.6-35B-A3B checkpoint. We construct execution-grounded data and environments, capture replayable long-horizon trajectories across multiple harnesses, and use staged post-training to develop and consolidate complementary execution capabilities. Across a broad suite of co-work benchmarks, Occamy-1.0 is consistently among the strongest comparably sized models and remains competitive with substantially larger frontier systems on several tasks. Under our stated evaluation and pricing protocol, its aggregate performance across four representative benchmarks places it at the low-cost knee of the observed cost--performance Pareto frontier. Supporting evaluations in tool calling, coding, and instruction following further show that this specialization preserves broad agentic capability. We release the model weights and a subset of the training data to support research on practical co-work agents and agentic post-training.

cs.AI↗
arXiv2026

Attention Amnesia in Hybrid LLMs: When CoT Fine-Tuning Breaks Long-Range Recall, and How to Fix It

Chain-of-thought (CoT) supervised fine-tuning (SFT) is widely adopted to improve reasoning ability, yet we find that it systematically degrades long-context recall in hybrid linear-attention models. Across architectures including HypeNet and Jet-Nemotron, retrieval performance on Needle-In-A-Haystack (NIAH) deteriorates substantially after CoT-SFT, and the degradation becomes more severe under harder retrieval settings and longer context windows. For example, HypeNet-9B on NIAH-S2@256K decreases from $67.2\%$ to $9.4\%$. We attribute this to CoT-SFT biasing attention gradients toward short-range patterns, disrupting query-key projections ($W_Q, W_K$) that are responsible for long-range routing. Motivated by this observation, we propose QK-Restore, a training-free method that restores only $W_Q$ and $W_K$ from the pre-SFT checkpoint while preserving all other post-SFT parameters. We further introduce a Procrustes variant to balance routing preservation and reasoning adaptation. Across architectures, QK-Restore consistently restores long-context capability at zero training cost while preserving reasoning performance; for instance, on HypeNet-5B it improves S3@256K from $65.4\%$ to $76.4\%$ while maintaining strong reasoning performance.

cs.CL↗
arXiv2026

SPLG-Mamba: Structure-Preserving Local-Global Mamba Network for Salient Object Detection in Optical Remote Sensing Images

Salient object detection in optical remote sensing images (ORSI-SOD) requires dense predictions that preserve object completeness and structural continuity under complex backgrounds, scale variation, and irregular object shapes. Existing methods often localize salient regions, but their predictions may still suffer from structural degradation, including fragmented, incomplete, or locally missing foreground responses. This degradation is closely related to hierarchical feature propagation, where shallow details can introduce texture-induced background responses, deep semantics may over-smooth weak structures, and uncontrolled cross-scale fusion can disturb coherent regions. To address this issue, we propose a novel Structure-Preserving Local-Global Mamba Network, SPLG-Mamba, for ORSI-SOD. Specifically, SPLG-Mamba integrates Smooth-Detail Recalibration (SDR), hierarchy-aware Local-Global Mamba, and Gated Cross-Scale Fusion (GCSF). SDR recalibrates smoothed responses and detail residuals before state-space modeling, Local-Global Mamba assigns local modeling to shallow feature levels and global modeling to deep feature levels, and GCSF controls cross-scale detail injection during decoding. Experiments on ORSSD, EORSSD, and ORSI-4199 demonstrate state-of-the-art results and improved structural completeness and continuity. The code is available at https://github.com/yxu9910/SPLG-Mamba

cs.CV↗
arXiv2026

Optimization Models and Computational Bounds for Limited Augmented Zarankiewicz Numbers in the Incidence-Graph Family of Complete Graphs

Let $G_1$ denote the incidence graph of the complete graph $K_{q+1}$. We study limited augmented Zarankiewicz numbers in this family through structured 0--1 optimization models for admissible 2-edge augmentation. For the original framework, we combine exact ILP formulations for the smallest instances with constructive search followed by exact admissibility verification for larger instances. This yields \[ {z_L(6,4)=14,\qquad z_L(10,5)=26,\qquad z_L(15,6)\ge 43,\qquad z_L(21,7)\ge 64,\qquad z_L(28,8)\ge 88.} \] The first two values are exact, whereas the latter three are rigorous lower bounds obtained from explicitly verified admissible families. We then formulate the global weak problem determined by \((S),(W2),(W2'),(W3)\). On the larger incidence-family cases, the corresponding global exact optimization problem is currently computationally out of reach, and our computations provide the certified lower bounds \[ {z_{WL}(6,4)=14,\quad z_{WL}(10,5)\ge 29,\quad z_{WL}(15,6)\ge 46,\quad z_{WL}(21,7)\ge 65,\quad z_{WL}(28,8)\ge 90.} \] On the fourteen literal-grid benchmarks from $(4,3)$ through $(7,7)$, by contrast, the global weak problem is solved exactly. Across this exact benchmark block, the weak framework is never worse than the strong framework and is strictly better in several cases. These computations improve the corresponding classical Zarankiewicz numbers and therefore strengthen available lower bounds for $\operatorname{BSR}(m,n)$ within this family.

math.CO↗
arXiv2026

GRAND-HC: Graph-Refined Author Name Disambiguation

From-Scratch Name Disambiguation (SND) groups papers sharing an ambiguous name into clusters of distinct real-world authors. Existing methods suffer from two critical limitations: (1) inherent long-tailed author distribution biases representation learning, causing over-merging of tail authors; (2) existing cluster number estimation methods are unreliable for long paper sequences, hindering large-scale deployment. We propose \textbf{GRAND-HC}, a complete end-to-end SND framework. We construct a heterogeneous paper graph via co-author, co-organization, and co-venue relations, using a graph attention network as the embedding backbone. \textbf{Harmony Contrastive Learning (HCL)} dynamically reweights training loss to suppress overfitting to prolific authors, learning discriminative embeddings. A \textbf{Graph-Refined Distance Matrix (GRDM)} leverages graph topology to optimize pairwise distances, further preventing tail author over-merging. Meanwhile, a lightweight \textbf{Paper Compression Module (PCM)} achieves accurate cluster number estimation across varying scales. Finally, Hierarchical Agglomerative Clustering outputs the final clusters. Extensive experiments demonstrate state-of-the-art macro F1 performance. GRAND-HC has been deployed in a billion-scale academic database. Source code: https://github.com/baokou-fw2/GRAND-HC.

cs.IR↗
arXiv2026

Machine learning correction of satellite precipitation is governed by mechanism purity, not algorithmic complexity: a proof-of-concept study in Hunan, China, with pre-registered cross-regional validation

Satellite precipitation products such as IMERG exhibit biases that vary with terrain, season, and precipitation regime, leaving the applicability boundaries of machine learning correction unclear. This study proposes the Terrain-Moisture-Intensity (TMI) framework, centered on mechanism purity, extending the correction problem from purely algorithmic optimization to physical consistency diagnosis. A proof-of-concept study in Hunan Province employs IMERG V07, SRTM DEM, and ERA5 variables (tcwv, u10, v10). Ablation results indicate that, under the conditions of this study, terrain-moisture relationships are predominantly additive: RF-Full yields merely +0.001 R^2 gain over LR-Full, while bias rises to 1.282 mm d^-1; MAE decreases by approximately 14%, reflecting a trade-off between tail-fitting improvement and mean shift. SHAP diagnostics identify three categories of boundaries. Spatially, Central Hunan exhibits significant degradation (R^2=0.133) despite strong variable activation, consistent with mechanism fragmentation induced by mixed terrain. Temporally, u10 undergoes directional reversal between summer and spring (+0.096 to -0.156), presenting "silent failure." Extreme precipitation (>=50 mm d^-1) approximates a mechanism saturation frontier rather than isolated out-of-distribution samples, with DEM showing the largest relative amplification in SHAP disorder (+150%). The results demonstrate that machine learning correction performance is primarily constrained by mechanism purity. A pre-registered cross-regional test (Hunan, Guangxi, Guangdong) confirms this screening capability out of sample: a priori coherence proxies predict correction efficiency with a mean absolute error of 2.6 percentage points, while the transfer-versus-retraining contrast separates mechanism mismatch (coastal Guangdong) from portability (Guangxi), establishing the framework as a validated applicability screen.

physics.ao-ph↗
arXiv2026

How Can Driving World Models Do Counterfactual Prediction?

Driving world models are often interpreted as counterfactual simulators for observed driving episodes: given a factual driving log, they are asked what would have happened under an alternative ego action. In this paper, we identify a fundamental mismatch between this goal and direct action-conditioned prediction. The direct prediction uses the shared history and the alternative action but not the factual continuation observed after that history. It can therefore generate a plausible future without preserving what actually happened in this episode. We formalize this gap using the causal recipe of abduction, action, and prediction and study it in a setting with a short time horizon, where the alternative ego action does not alter how surrounding agents evolve. To make the gap measurable, we construct a controlled simulation benchmark with factual outcomes and matched counterfactual outcomes. Across two representative world models, direct predictions fail to match the counterfactual ground truth, supporting our analysis. As a constructive check of this analysis, we introduce a deliberately simple, training-free pipeline that moves observed evidence into the counterfactual view and lets the frozen model complete what remains unknown. Even this simple construction raises the overall recovered fraction substantially and reduces perceptual distance to the matched counterfactual on both models. We hope this work draws attention to this gap and motivates better counterfactual prediction methods for driving world models.

cs.CV↗
arXiv2026

Event-by-event analysis of chiral charge separation in $p^{\uparrow}+$Au collisions within an improved AMPT model

We study the charge separation induced by chiral magnetic effect (CME) in $p^{\uparrow}$+Au collisions at $\sqrt{s_{NN}}=200$ GeV event-by-event with an improved string-melting AMPT model. In this model, an impact-parameter-dependent formation-time delay is introduced to reduce the peak Bjorken energy density from $\sim$2 to $\sim$0.3 GeV/fm$^3$ and reproduces the illiptic flow $v_2(p_T)$ measured by PHENIX in $p+$Au simultaneously. The event-by-event CME source, whose quark momentum-exchange fraction scales with $|\mathbf{B}|_{\mathrm{event}}/|\mathbf{B}|_{\mathrm{max}}$ and is capped at the 7\% value from Au+Au, transmits the field geometry directly to the observable. We find that the initial correlator shows a clear scheme hierarchy tracking $B^2$. The parton cascade preserves $\sim$80--90\% of the signal, while coalescence and ART hadronic rescattering dissipate the bulk, leaving $\sim$10--30\% in the final state. The $γ_{OS}/γ_{SS}$ splitting remains visible. These results support the use of the inter-scheme difference $Δγ_{\mathrm{IV}}-Δγ_{\mathrm{II}}$ as an essentially background-free CME observable as we proposed in previous work.

hep-ph↗
arXiv2026

Change point analysis of high-dimensional data using random projections

This paper develops a novel change point identification method for high-dimensional data using random projections. By projecting high-dimensional time series into a one-dimensional space, we are able to leverage the rich literature for univariate time series. We propose applying random projections multiple times and then combining the univariate test results using existing multiple comparison methods. Simulation results suggest that the proposed method tends to have better size and power, with more accurate location estimation. At the same time, random projections may introduce variability in the estimated locations. To enhance stability in practice, we recommend repeating the procedure, and using the mode of the estimated locations as a guide for the final change point estimate. An application to an Australian temperature dataset is presented. This study, though limited to the single change point setting, demonstrates the usefulness of random projections in change point analysis.

stat.ME↗
arXiv2026

A Weak Condition for Limited Augmented Zarankiewicz Numbers

This paper introduces the weak augmented Zarankiewicz number $z_{wA}(m,n)$ and the weak limited augmented Zarankiewicz number $z_{wL}(m,n)$, which are combinatorial extensions of the classical Zarankiewicz number obtained by relaxing the original admissibility conditions for augmented bipartite graphs. We show that the resulting weak framework still guarantees irreducibility of the associated doubly simple biquadratic forms, with SOS rank equal to the total number of edges. This yields the inequality chain \[ \mathrm{BSR}(m,n) \geq z_{wA}(m,n) \geq z_{wL}(m,n) \geq z_L(m,n) \geq z(m,n). \] We provide three complementary constructions demonstrating the power of the weak framework. First, a $5\times 3$ construction using degenerate 2-edges yields $z_{wL}(5,3)\ge 10>9=z_L(5,3)$, giving $\mathrm{BSR}(5,3)\ge 10$. Second, a $15\times 6$ construction on the incidence graph of $K_6$ with 14 nondegenerate 2-edges gives $z_{wL}(15,6)\ge 44>43$, improving the previously known bound. Third, a critical $6\times 3$ construction with complementary 2-cycles gives $z_{wL}(6,3)\ge 12>11=z_L(6,3)$, yielding $\mathrm{BSR}(6,3)\ge 12$ and demonstrating that complementary 2-cycles are safe.

math.CO↗
arXiv2026

Generation of dense relativistic electron beams via vortex laser-driven self-generated magnetic pinching

In multi-petawatt laser plasma accelerators, achieving high-density relativistic electron beams is typically accompanied by large transverse divergence, limiting the attainable effective electron density needed for high-flux interaction regimes relevant to laboratory astrophysics. Here we report experimental demonstration of self-generated magnetic pinching (SMP), a collective mechanism that actively regulates transverse beam dynamics using a Laguerre-Gaussian laser at strong relativistic intensity (~8 x 10^19 W/cm^2) interacting with an underdense plasma. The electron beam evolves from a two-lobe high-charge injection structure into a compressed, high-density profile, yielding a threefold reduction in divergence and nearly an order-of-magnitude enhancement in effective beam density compared with a Gaussian driver. Particle-in-cell simulations agree with the experimental observations and reveal that a self-generated azimuthal magnetic field governs the electron dynamics within the SMP regime, which is defined by the forming condition S = 0.717 l a0 [ne(10^18 cm^-3)]^-3/4 = 1, where l, a0, and ne are topological charge, laser amplitude, and plasma density, respectively. A transient kick from a dense inner sheath electron population drives collective magnetic pinching, transforming an initially separated electron distribution into a compressed and well-collimated beam. For higher-power laser systems, the forming condition can be extended to higher plasma densities and larger orbital angular momentum modes, potentially enabling electron beams with charges exceeding several nC and effective densities above 10^19 cm^-3. This mechanism provides a route to overcoming transverse expansion and enhancing rare interaction processes relevant to high-flux particle sources.

physics.plasm-ph↗
arXiv2026

JEPA-WAM: Connecting Generated Visual Instructions to World Action Models through JEPA Latent Representations

World Action Models (WAMs) have demonstrated strong robotic manipulation capabilities by augmenting pretrained video generative models with action experts. However, current WAMs still show limited instruction-following ability when conditioned solely on text instructions. We argue that this limitation stems in part from a structural imbalance in robot-learning data: rich visual-action trajectories are often paired with sparse and repetitive language annotations, allowing policies to identify tasks from visual context and motion regularities rather than grounding the instruction itself. To address this limitation, we introduce JEPA-WAM, which augments each text instruction with a bank of stochastically generated visual instructions, providing diverse visual cues for instruction following. Specifically, JEPA-WAM uses an off-the-shelf text-to-image generator to sample multiple task-completion images conditioned on the text instruction, without training the generator. Although these generated images may differ from the current visual scene in appearance and layout, they remain semantically aligned with the instruction and serve as visual goal references. To focus on task-level semantics beyond appearance, we encode these references with a frozen V-JEPA 2.1 encoder. The resulting dense goal representations are compressed into compact goal tokens that condition both the video and action experts through cross-attention. We further construct a real-robot instruction-following benchmark covering in-distribution, out-of-distribution scene, and out-of-distribution instruction settings. On this benchmark, JEPA-WAM achieves success rates of 87.3%, 74.5%, and 80.9% in these three settings, outperforming π0 and Fast-WAM by at least 10.0, 27.3, and 14.5 percentage points, respectively.

cs.AI↗
arXiv2026

SpecFormer: Mitigating Embedding and Attention Collapse via Spectral-Aware Transformer for Recommendation

Transformer architectures have achieved remarkable success across diverse domains; however, directly applying their standard self-attention mechanism to recommendation often yields suboptimal performance, sometimes even trailing behind well-designed simple recommendation models. In this paper, we reveal that this performance bottleneck stems from severe embedding and attention collapse unique to recommendation scenarios. The heterogeneity and long-tail nature of recommendation data lead to a severe spectral collapse dominated by a few principal singular values. We further theoretically demonstrate that this triggers a vicious cycle in recommendation model's forward and backward propagation, which accelerates embedding and attention collapse and limits the model's scaling capability with increased depth. To address these issues, we propose SpecFormer, a novel Spectral-Aware Transformer designed for mitigating embedding and attention collapse in recommendation. Specifically, SpecFormer introduces 1) a Learnable Spectral Softening module to dynamically smooth the singular values distribution of the input token embeddings; 2) a Spectrum-softened Attention mechanism to model feature interaction under a more uniform spectral distribution space; 3) a Spectral Residual Position Encoding via Taylor expansion of singular values, explicitly providing a spectral inductive bias for feature interactions. Extensive experiments on one industrial and two public datasets demonstrate that SpecFormer significantly outperforms state-of-the-art baselines. Notably, SpecFormer has been successfully deployed in a real-world commercial recommender system and exhibits exceptional scaling capabilities: stacking SpecFormer layers actively improves the attention effective rank and recommendation performance.

cs.IR↗
arXiv2026

SAFE-Merge: Data-Free Continual Model Merging with General Knowledge Preservation

Data-free continual model merging must incorporate a stream of specialized models while retaining both pretrained general knowledge and previously acquired tasks, without access to task data. Existing methods mainly merge task updates by suppressing interference among downstream tasks; while this protects previously acquired tasks, it overlooks the safety of the pretrained knowledge itself, whose erosion degrades generalization to held-out distributions and weakens the foundation for future task acquisition. We propose SAFE-Merge, a simple data-free continual-merging framework that first decides which parameter updates are safe to retain, and then recovers the task information lost through masking. Specifically, to ensure safety, risk-aware sparse masking selects parameter updates that carry task-specific information while posing low risk to general knowledge. Masked low-rank recovery then compensates for the lost task information using only the same retained parameter updates, while leaving all masked-out parameters strictly unchanged. Finally, the combined update is fused into the backbone, incurring no additional inference cost. Across vision and language benchmarks, SAFE-Merge consistently achieves the best H-score. On longer CLIP task sequences, it substantially improves H-score over NUFILT while also achieving the highest accuracy.

cs.LG↗
arXiv2026

OrthKD: Extracting Generalized Clinical Knowledge from Heterogeneous Teachers for Lightweight Deployment

Deploying diabetic retinopathy (DR) screening models in primary care requires edge-efficient systems that remain accurate, safe, and reliable under domain shift. Multi-teacher knowledge distillation (KD) is a natural compression strategy, but existing approaches largely assume that all teachers provide equally trustworthy supervision. In our setting, this assumption fails: a strong CNN teacher (EfficientNet-B3, 0.876 QWK) and a weaker Transformer teacher (Swin-Base, 0.830 QWK) are complementary, yet the Transformer's logits can still mislead the student. We therefore propose OrthKD, a selective-trust distillation framework that transfers full supervision from the strong CNN, uses feature-only distillation from the weak ViT, and enforces orthogonality between teacher-specific student projections to encourage complementary rather than redundant evidence. This design preserves local lesion precision, injects global structural context, and improves robustness to distribution shift. On 132,049 retinal images, a 5.4M-parameter MobileNetV3 student reaches 0.885 QWK on EyePACS and improves zero-shot Messidor-2 performance from 0.507 to 0.728 QWK, while also achieving strong referral AUC and calibration. These results show that selectively distilling heterogeneous teachers can enable practical DR screening on resource-constrained devices.

cs.LG↗
arXiv2026

Tensor Spectral Stability for Uniform Hypergraphs with Bounded Matching Number

We establish a tensor spectral stability theorem for uniform hypergraphs with bounded matching number. More precisely, for fixed integers $k\geq 3$ and $β\geq2$, and sufficiently large $n$, we prove that every $n$-vertex $k$-uniform hypergraph $H$ with matching number at most $β$ and tensor spectral radius close to the maximum possible value among all such hypergraphs must be structurally close to the extremal hypergraph $S_{n,k,β}$, whose edges consist of all $k$-sets intersecting a fixed set of $β$ vertices. Furthermore, we show that every edge of $H$ intersects this distinguished vertex set and that $H$ contains all but a small proportion of the edges of $S_{n,k,β}$. As an application, we obtain a new proof of the spectral version of the Erdős matching conjecture for sufficiently large $n$.

math.CO↗