arXiv Science⌕ Search

arXiv subjects

Yifan Zhang

Publications and source records attributed to Yifan Zhang.

At least 55 records · Page 3Linked to original sources

Information Bottleneck-Guided Adaptive Hypergraph Transformer for Brain Disease Diagnosis

Exploring high-order correlations and long-range dependencies in brain networks holds significant value for both neuroscience research and clinical diagnosis. However, previous studies have lacked a unified integration of high-order and long-range dependency information in brain networks, and there is substantial redundancy behind various types of information. These issues limit their effectiveness in the diagnosis of brain diseases. To address this, we propose an Information Bottleneck-Guided Adaptive HyperGraph Transformer (IBAHGT). By incorporating the information bottleneck (IB) principle, this approach enables adaptive learning of high-order correlations and both short- and long-range dependencies within a unified framework for brain network analysis, achieving high-precision brain disease diagnosis. IBAHGT consists of three key components: an information bottleneck-guided adaptive hypergraph convolution, which introduces a novel hypergraph information bottleneck (HIB) principle to adaptively learn hypergraph message-passing weights between nodes and hyperedges, optimizes information flow and captures high-order information in brain networks that is maximally informative and minimally redundant (MIMR). The Transformer encoder captures global information within brain networks through the attention mechanism, specifically modeling short- and long-range dependencies. An information bottleneck-guided node-level adaptive fusion employs the IB principle to learn independent weights for each node, facilitating the fine-grained integration of high-order information and global information to obtain an efficient representation for downstream tasks. Extensive experiments demonstrate that the proposed method outperforms current state-of-the-art methods and can identify biomarkers for clinical applications.

cs.AI↗

Temporal Forcing: 4D Representation Alignment for Vision-Language-Action Models

Long-horizon robotic manipulation requires vision-language-action (VLA) models to track scene states and their evolution beyond the current observation. However, simply conditioning policies on observation history does not guarantee that the history is effectively utilized: action supervision constrains what the policy should do, but only indirectly constrains what its history representations should retain. To resolve this, we present Temporal Forcing, a 4D representation alignment framework that explicitly supervises latent temporal states and their transitions. Specifically, we first introduce a history pathway that compresses past observations into compact latent tokens. We then align these tokens and current-frame features with geometric targets from a pretrained 4D foundation model, providing direct supervision at both the state and transition levels. The 4D foundation model and alignment heads are used only for training-time supervision. Temporal Forcing improves average success from 96.6% to 98.8% on LIBERO, with the largest gain on LIBERO-Long (93.8% to 97.2%), and from 53.5% to 62.8% across twelve RoboTwin 2.0 tasks. Furthermore, Temporal Forcing increases full-task success from 20.0% to 43.3% on a physical multi-stage hidden-placement task. Controlled experiments show that 4D representation alignment is crucial for making observation history beneficial to the model. Code will be publicly available.

cs.RO↗

SymbolicArena: A Unified Infrastructure for Benchmark Distillation and Dynamic Evaluation in Symbolic Regression

Symbolic regression (SR) seeks concise and interpretable mathematical expressions from data for scientific equation discovery. Existing SR benchmarks face a tradeoff between evaluation cost and benchmark validity. Repeated evaluation of large task pools is expensive, and compact benchmarks lack systematic evidence of preserved task diversity and algorithm discriminability. SymbolicArena provides a unified infrastructure for benchmark distillation and dynamic evaluation. The framework standardizes 664 heterogeneous tasks with executable ground truth expressions and distills the Full Task Set into Core50, a validated benchmark of 50 tasks. The distillation process preserves task coverage and algorithm discrimination under explicit balance constraints. SymbolicArena applies a unified execution protocol to heterogeneous SR algorithms and produces comparable outputs and search trajectories. Multi Axis Evaluation characterizes numerical quality, symbolic quality, and search behavior. Core50 reduces evaluation workload by 92.5% and maintains agreement with Full Task Set evaluations. Experiments show that SymbolicArena achieves 72.6% to 86.7% lower approximation error than alternative selectors, further supporting its fidelity to the Full Task Set. Evaluation reveals a substantial gap between numerical fitting and symbolic recovery across current SR methods, suggesting that reliable equation recovery remains an open challenge.

cs.LG↗

Borrowing from anything: A generalizable framework for reference-guided instance editing

Reference-guided instance editing is fundamentally limited by semantic entanglement, where a reference's intrinsic appearance is intertwined with its extrinsic attributes. The key challenge lies in disentangling what information should be borrowed from the reference, and determining how to apply it appropriately to the target. To tackle this challenge, we propose GENIE, a Generalizable Instance Editing framework capable of achieving explicit disentanglement. GENIE first corrects spatial misalignments with a Spatial Alignment Module (SAM). Then, an Adaptive Residual Scaling Module (ARSM) learns what to borrow by amplifying salient intrinsic cues while suppressing extrinsic attributes, while a Progressive Attention Fusion (PAF) mechanism learns how to render this appearance onto the target, preserving its structure. Extensive experiments on the challenging AnyInsertion dataset demonstrate that GENIE achieves state-of-the-art fidelity and robustness, setting a new standard for disentanglement-based instance editing.

cs.CV↗

Not Every Term Adds New Structure: Sobolev Novelty for Symbolic Regression

Symbolic regression (SR) aims to discover compact and meaningful mathematical equations from data, but searching the vast combinatorial space of symbolic structures remains challenging. Existing methods typically guide this process using expression-level objectives, such as fitting error, which assess a candidate equation as a whole but provide little information about whether an individual term contributes genuinely new structure or is largely redundant with the rest of the expression. We introduce \textbf{Sobolev Novelty}, a term-level measure of structural independence for symbolic equations. For each term, we construct an empirical Sobolev signature from its function values and exact derivatives over the observed inputs, and quantify how much of this behavior cannot be reconstructed by the remaining terms. We further derive a theory-calibrated threshold, yielding a principled and tuning-free criterion for identifying structurally novel terms. Using this threshold, 92.6\% of terms in benchmark ground-truth equations exhibit sufficient structural novelty, compared with only 38.3\% on average for expressions produced by 15 SR methods, revealing a substantial gap between scientific equations and current SR solutions. As a lightweight plug-in, Sobolev Novelty can be incorporated into diverse SR paradigms to support term pruning, search guidance, LLM feedback, and data selection, yielding consistent performance gains and demonstrating broad applicability.

cs.LG↗

Refreshing Less, Selecting Better: Reusing Stale Gradient Features for Efficient Influence-Based Data Selection

Gradient-based data selection methods such as LESS score each candidate by the alignment between its gradient and a target validation gradient, and recomputing per-example gradient features at every new checkpoint dominates their cost. Across three selection seeds, two model families, two candidate pools, and two target tasks, features cached at a post-warmup checkpoint and paired with fresh validation gradients preserve the ranking 40 optimizer steps later with Spearman correlation from 0.952 to 0.991, while the top-10% subset they induce misses 10 to 22% of the examples that full recomputation selects. We therefore propose Cached Diverse Influence Selection (CDIS), which recomputes gradient features for the top-ranked fraction $p$ of candidates under the stale scores, fits an affine calibration on the recomputed examples, and selects the final subset under source and length quotas. A refresh fraction at or above the selection fraction recovers the exact top-$k$ subset whenever the calibrated stale scores have bounded error, and the budget curves follow this rule: at $p=0.3$ the recovered top-$k$ subset coincides with full recomputation in every setting, allocating the same budget per stratum recovers the stratified subset at 0.92 to 1.00, and gradient-stage wall-clock drops 3.5 to 3.6 times. Iterating the cache over four checkpoints keeps top-$k$ overlap at 0.98 or higher at 1.9 gradient features per example against 4 for full recomputation, and stale-to-recomputed agreement on the refreshed examples provides a free check for unsafe reuse. Downstream, unconstrained top-$k$ selection collapses to a single data source and scores 13 points below random selection on GSM8K. CDIS scores 12 points above random selection with paired confidence intervals that exclude zero and trails full recomputation by 4.3 points, one training-run standard deviation, at 3.4 times lower selection cost.

cs.LG↗

Deep Delta Learning

Transformer residual streams are updated by addition. A sufficiently expressive residual block can represent content replacement, but the residual update itself has no operation that reads, compares, and replaces content. We introduce Deep Delta Learning (DDL), which applies the delta rule over network depth. Each layer reads the residual state along a learned direction, compares the readout with a learned target, and writes a gated rank-1 correction back along the same direction. A closed gate gives the identity map, and a unit gate overwrites the selected readout with the target. DDL works with the usual vector state or with an expanded state that stores several value channels, while attention and MLP blocks keep the original model width. We pretrain decoder-only models with approximately GPT-2 small and medium sizes on the FineWeb-Edu dataset. At both scales, every DDL variant has lower validation loss and higher average one-shot accuracy than the additive baseline, and the best expanded variants raise that average by 0.91 and 1.18 points.

cs.LG↗

FlashSampling: Fast and Memory-Efficient Exact Sampling

Sampling from a categorical distribution is mathematically simple, but in large-vocabulary decoding, it often triggers extra memory traffic and extra kernels after the LM head. We present FlashSampling, an exact sampling primitive that fuses sampling into the LM-head matmul and never materializes the logits tensor in HBM. The method is simple: compute logits tile-by-tile on chip, add Gumbel noise, keep only one maximizer per row and per vocabulary tile, and finish with a small reduction over tiles. In tensor-parallel decoding, FlashSampling replaces the all-gather of logits with streaming peer-to-peer writes: This overlaps GPU-to-GPU communication with computation and HBM loads across up to 8 GPUs, with near-ideal scaling at large batch sizes. Our kernel is exact because $\text{argmax}$ decomposes over partitions; grouped variants for online and tensor-parallel settings are exact by hierarchical factorization of the categorical distribution. FlashSampling demonstrates kernel-level speedups on decode workloads across 4 different datacenter GPUs (H100, H200, B200, B300), and in end-to-end vLLM experiments, it reduces time per output token by up to $10%$ on the models we test. These results show that exact sampling, with no approximation, can be integrated into the matmul itself, consolidating the bandwidth-bound sampling step in an efficient epilogue.

cs.LG↗

SPO: Discovering Adaptive Large Neighborhood Search Operators via Stackelberg Program Optimization

Large neighborhood search (LNS) relies critically on destroy and repair operators, whose effectiveness depends on both adaptation to the evolving LNS state and interaction between the two roles. We introduce Stackelberg Program Optimization (SPO), an LLM-based framework for discovering adaptive executable destroy-repair programs. SPO conditions operator decisions on a compact LNS state, allowing state-dependent behavior to emerge through program discovery, and organizes destroy-repair discovery as a Stackelberg interaction over program space that reflects their asymmetric dependency. Role-specific credits evaluate destroy programs as leaders and repair programs as conditional follower responses, guiding a coupled optimization process that combines LLM generator learning with population-based evolutionary search over programs. Experiments on the traveling salesperson problem and capacitated vehicle routing problem show that SPO outperforms strong baselines across a broad range of settings and generalizes beyond the discovery scale to larger instances and benchmark sets. Behavioral analyses further demonstrate state-dependent operator behavior and coupled destroy-repair improvement during discovery.

cs.AI↗

More Sensors Only One Field: Rethinking Continual Spatio-Temporal Forecasting

Continual spatio-temporal forecasting supports traffic management and environmental monitoring under evolving dynamics and expanding sensor networks. However, conventional graph-based continual learning methods tie forecasting representations to the current sensor layout, so sensor expansion can alter the representation of learned spatial relationships. Our key insight is that sensor expansion changes the evidence available about a process without necessarily changing the dynamics to be learned. We propose STFO (Spatio-Temporal Field Operator), which parameterizes forecasting knowledge as a shared field-evolution operator and handles changing sensor layouts through observation and query interfaces. Normalized coordinate-based aggregation lifts irregular sensor histories onto a fixed latent grid, enabling reuse of learned spatial maps across observation sets without sensor-specific parameters. To accommodate process drift, a spectral descriptor summarizes variation across spatial scales and conditions Fourier propagation and attention to adapt operator responses to the current spatial regime. Coordinate-based decoding queries the evolved field at sensor locations and combines spatial corrections with local-history predictions. Experiments on PEMS-Stream, CA-Stream, and AIR-Stream demonstrate state-of-the-art average forecasting performance. STFO-Large reduces average MAE over DOL by 8.4% on PEMS-Stream and 4.7% on CA-Stream. Our code is available at https://github.com/Xielewei/Spatio-Temporal-Field-Operator.

cs.LG↗

Depth-Based Local Recentering of Maxmin Landmarks for Lazy Witness Persistence

We study a local post-processing rule for maxmin (farthest-point) landmark selection in lazy witness persistence. Maxmin landmarks induce nearest-landmark cells. Within each cell, the landmark is moved toward a data point of maximum empirical halfspace depth, with smaller moves in sparsely populated cells, and is then projected back to a data point in the same cell. The resulting support-weighted rule preserves one landmark per original maxmin cell. We prove a convex-core guarantee for the depth target and explicit worst-case cover bounds for the recentered landmarks. Experiments on planar synthetic loops and 120 MPEG-7 (Moving Picture Experts Group 7) silhouettes separate average landmark fit from extremal coverage. On the synthetic benchmark, recentering reduces mean nearest-landmark distance in all 900 matched trials; after aggregation over landmark budgets, the mean change is $-0.0138$ across 300 dataset/noise/seed blocks, while maximum cover increases by $0.0067$ on average and a thresholded first homology ($H_1$) count is unchanged. On MPEG-7, the image-level mean distance decreases for all 120 silhouettes, while maximum cover increases for 118. Thus the correction consistently improves average landmark representativeness but does not improve worst-case coverage; on the controlled synthetic benchmark, this trade-off occurs without a detectable change in the coarse $H_1$ summary.

cs.CG↗

Intrinsic {Right} $q$-Radial Vector Derivatives and Localized Fischer Decompositions on Radial Algebras

We define intrinsic right \(q\)-radial vector derivatives on radial algebras of abstract vector variables. For a finite parameter set \(Y\), a scalar Jackson calculus on \(x^2\) and the mixed anticommutators \(\{x,y_i\}\) is combined with the exterior decomposition relative to \(x\). Relabelling covariance and compatibility under inclusions of parameter sets give a direct-limit operator on arbitrary radial algebras. {Under the dimension specialization \(Q=q^M\), its classical limit agrees in every \(M\)-dimensional Clifford realization with the standard right Clifford derivative; for an exterior blade one obtains \([x\wedge y_I]\partial_x=(-1)^{|I|}(M-|I|)y_I\).} Two Fischer-type constructions are considered. The anticommutator with exterior creation is triangular and admits an explicit Green inverse after localization at its diagonal factors. {For right \(q\)-monogenic elements, the derivative is paired with right multiplication \(R_xF=Fx\). The homogeneous operators \(\partial^{Y,\mathrm R}_{x,q}R_x\) have generically nonzero determinants, which yields determinant-localized Fischer decompositions and explicit projectors.} The one- and two-vector determinants are computed explicitly. {After \(Q=q^M\), the two-vector determinant is nonzero for every \(0<q<1\) and every positive integer \(M\). For arbitrary finite support, a support filtration factors the determinant into exact-support terms; in degree zero, support rank \(p\) contributes the factor \([m-p]_q+p\).}

math.CV↗

Lieb-Thirring bounds for Melik-Adamyan canonical Hamiltonians

We study a class of positive matrix Hamiltonians arising from the canonical differential expressions of Melik--Adamyan and appearing in the appendix of Alpay--Gohberg. Let $J$ and $B$ be self-adjoint involutions on $\mathbb C^{2n}$ satisfying $JB=-BJ$, and let $H>0$ satisfy $HJH=J$. For $m>0$ we consider $$ \mathcal A_{m,H}=H^{-1}\left(-iJ\frac{d}{dt}+mB\right) $$ in the weighted space $L^2_H$. A locally absolutely continuous $J$-unitary gauge $Θ$ representing $H$ reduces this expression to the free massive Dirac operator plus the Hermitian coefficient $$ P_{m,Θ}=-iΘ^*JΘ'+m(Θ^*BΘ-B). $$ Whenever this coefficient belongs to $L^2$, the corresponding self-adjoint realization, including its operator domain, is independent of the chosen representing gauge. Minimizing $\int\mathrm{Tr}|P_{m,Θ}|^2$ over the gauge fibre defines an intrinsic energy. A two-sided Birman--Schwinger decoupling, combined with a truncated pseudo-relativistic estimate proved here, gives a $3/2$-moment bound for all eigenvalues in the gap $(-m,m)$ in terms of this energy. The Dirac estimate applies to arbitrary Hermitian matrix coefficients in $L^2$ and requires no sign condition. On the half-line we treat every self-adjoint Lagrangian boundary condition. Two reflection-compatible conditions require no endpoint correction, while an arbitrary condition contributes at most $2nm^{3/2}$. At zero mass, the optimal-gauge energy is computed explicitly in terms of $H^{-1/2}H'H^{-1/2}$. For a scalar hyperbolic-rotation family the massive gauge minimization reduces exactly to a one-dimensional phase functional. We prove existence of a minimizer in the principal phase sector and give an explicit trial phase that strictly and quantitatively improves the positive lift whenever the corresponding first variation is nonzero.

math.SP↗

Exceptional supersphere integration and logarithmic Pizzetti kernels

We study orthosymplectically invariant supersphere integration at the exceptional superdimensions $M=-2u$, where the harmonic Fischer structure becomes nonsemisimple and the Pizzetti pairing degenerates. For the meromorphically continued homogeneous inverse kernels we obtain the generating function $$ \mathscr G_μ(ρ;x,y) =\frac{Γ(μ/2)}{2π^{μ/2}} \bigl(1+ρ\{x,y\}+ρ^2x^2y^2\bigr)^{-μ/2}. $$ At $μ=-2u$, its Laurent expansion has a polynomial residue and a logarithmic finite part. We prove that these coefficients recover the complete degreewise duality structure on a fixed superspace with nonzero bosonic dimension. In degrees $k\le u$, the residue inverts a canonical renormalized pairing on $\mathcal P_k$. In the collision range $u<k\le2u$, the ordinary pairing has radical $(x^2)^{k-u}\mathcal P_{2u-k}$; the finite part reproduces the quotient, while the residue reproduces the radical after transport from the reflected degree. For $k\ge2u+1$, the finite part is the ordinary inverse kernel. We also establish the nondegenerate head--socle pairing on the generalized harmonic modules. As an application, we derive covariant right--left radial $q$-monogenic zonal symbols and identify precise degree-one obstructions to transferring scalar Pizzetti reproduction through a one-sided $q$-Fischer projection.

math.CV↗

Stable $q$-Hermitian coordinate calculus: Capelli--PBW transport, mixed polarization algebra, and localization obstructions

We extend a finite-support $q$-Hermitian radial calculus to Clifford-valued coordinate polynomials. For $N$ bosonic Hermitian vector labels and finite fermionic support, the stable range $m\ge 2N$ admits a canonical Gram--harmonic normal form by Howe separation. A label--Capelli inverse normalizes the Clifford contractions, while a finite Wick--Chevalley conjugation lifts the divided-power scalar gauge to the full Clifford PBW module. Coupling the normalized contractions to contractible fermionic seed complexes gives two conjugate polynomial-preserving $q$-Hermitian coordinate families. They are square-zero, anticommute within each polarization, restrict exactly to the radial PBW calculus, have scalar boundary trace $[2m-2n]_q$, and recover the classical Hermitian super Dirac pair as $q\to1$. For the mixed polarizations we introduce a relative triangular transport. The Grassmann relations for the normalized Capelli contractions hold on the full coordinate module and yield a labelwise factorization. Hence all higher-filtration mixed terms are finite subset products of explicit local defects, and the mixed polarization algebra closes for arbitrary finite label sets and finite fermionic support. The classical complex structure is common to both polarizations, whereas the two full transported Clifford--Weyl products are distinct for $0<q<1$. We also show that the fermionic Cartan denominator is forced in the natural polynomial first-order Berezin--Weyl class and determine the minimal factorwise Ore localization needed for the conjugate all-charge homotopies. The $q$-dependent Cartan orbit is nonresonant for $m\ge\max\{2N,n\}$. Finally, fixed finite-order differential and finite nonzero-shift realizations on the undeformed coordinate algebra are ruled out.

math.CV↗

A Chain- and Diagram-Level Semantics for Morphological Calculus Refinement, monodromy, and bivector orbit decompositions

Morphological calculus represents decompositions of geometric objects by polynomial-like expressions in a symbol for the real line, but scalar operations suppress the incidence and attachment maps needed to reconstruct the space. We formulate a finite semantics using script chain complexes. The cell-count polynomial satisfies $$ \mathcal M_S(t)=\mathcal P_{S,\mathbb K}(t)+(1+t)\mathcal B_{S,\mathbb K}(t), $$ where $\mathcal P$ is the Poincar'e polynomial and $\mathcal B$ records boundary ranks. Over $\mathbb Z$, Smith labels separate unit pairs, representing refinement overhead, from non-unit pairs carrying torsion. We distinguish Cartesian products from bundles, derive the monodromy defect for mapping tori, and replace scalar gluing by a finite bar construction. Mapping cones, joins, and double mapping cylinders arise as reduced models. We apply the construction to bivector discrepancies in Sommen's calculations. In dimension four, Hodge decomposition identifies the unit bivector sphere with $S^2*S^2$; the angular excess is a contractible relative complex from inserting the rank-two midpoint. In dimension five, the $SO(5)$-action on $S(Λ^2\mathbb R^5)=S^9$ has principal orbit $SO(5)/T^2$ and singular orbits $\widetilde G_2(\mathbb R^5)$ and $\mathbb{CP}^3$. For standard Bruhat cell structures, the reduced double-mapping-cylinder inventory differs from sphere homology by seven unit-labelled pairs. We also treat Borel--Moore realizations of selected noncompact symbols, define division as an action-certified partial operation, and describe the orbit-type face diagram for unit bivectors in dimension six. There the correction polynomial has nonnegative coefficients, while compatibility of the face attachments remains open. These examples separate subdivision and attachment data from quotient actions and support conditions suppressed by scalar notation.

math.AG↗

Parabolic Homotopy Colimits and Coxeter Descents

Let $G$ be a compact, connected, simply connected semisimple Lie group with Weyl group $W$ and simple reflections $S$. For a simplicial complex $\mathcal K$ on $S$, form the homotopy colimit $X_{\mathcal K}(G)=\operatorname*{hocolim}_{I\in\mathcal K}G/G_I$ of standard partial flag manifolds. We compute its integral homology. If $\operatorname{Des}_R(w)$ is the right descent set of $w\in W$ and $\ell(w)$ its Coxeter length, then $$ H_n(X_{\mathcal K}(G);\mathbb Z)\cong \bigoplus_{w\in W}\widetilde H_{n-2\ell(w)-1}(\mathcal K_{\operatorname{Des}_R(w)};\mathbb Z). $$ Thus the induced subcomplexes of $\mathcal K$ supply the topological data, while the Weyl group determines which subcomplex occurs and the Schubert-degree shift. The proof gives a chain-level splitting and an integral Morse reduction. We derive homotopy detection, duality and rigidity results, and recover polyhedral products, matroid--Tutte formulas, and the adjoint sphere as special cases.

math.CO↗

Optimal location of small favourable regions for Robin eigenvalues with indefinite weights

We consider the positive principal eigenvalue of an elliptic problem with a Robin boundary condition and bang--bang indefinite weight $κ\mathbf 1_D-\mathbf 1_{Ω\setminus D}$, and ask where a favourable region $D$ of prescribed small volume $|D|=δ$ should be located. Put $\varepsilon=δ^{1/N}$ and $τ_δ=α_δ\varepsilon$. We prove that there is a finite threshold $τ_*=τ_*(N,κ)$, independent of the ambient domain, such that $δ^{2/N}Λ_δ(α_δ)\toΛ_{\mathbb H}(τ)$ whenever $τ_δ\toτ<\infty$. If $τ<τ_*$, optimal small regions concentrate at the boundary. If $τ>τ_*$, their concentration centres move to distances much larger than $\varepsilon$ from the boundary, and after recentring and rescaling the favourable sets converge in measure to the whole-space optimal ball. At $τ=τ_*$, the half-space problem admits a compact boundary optimiser as well as minimising sequences escaping to infinity. In the finer regime $τ_δ=τ_*+σ\varepsilon+o(\varepsilon)$, we determine the first-order competition between the boundary and interior configurations. Tangential symmetry of compact threshold optimisers reduces the geometric correction to mean curvature. In particular, every fixed finite Robin coefficient is asymptotically in the boundary regime. Numerical experiments illustrate the boundary--interior transition, the three cases in the first-order selection law, and the curvature-dependent boundary location; for $N=2$ and $κ=1$ they suggest a transition near $τ_*\approx3.2$.

math.AP↗