arXiv subjects

Zongben Xu

Publications and source records attributed to Zongben Xu.

At least 19 recordsLinked to original sources

arXiv2026

Rotation Equivariant Mamba for Vision Tasks

Rotation equivariance is an important structural prior for a broad range of vision tasks, particularly in domains such as remote sensing and medical imaging where objects have no canonical orientation, yet it remains notably absent from current Mamba-based vision architectures. Despite the success of Mamba in natural language processing and its growing adoption in computer vision, existing visual Mamba models fail to account for rotational symmetry in their design. This omission renders them sensitive to image rotations, thereby constraining their robustness and cross-task generalization. To address this limitation, we incorporate rotation symmetry, an important geometric prior in many visual domains, into Mamba-based architectures. Specifically, we introduce EQ-VMamba, the first rotation equivariant visual Mamba architecture for vision tasks. The core components of EQ-VMamba include a carefully designed rotation equivariant cross-scan strategy and group Mamba blocks. Moreover, we provide a rigorous theoretical analysis of the intrinsic equivariance error, demonstrating that the proposed architecture enforces end-to-end rotation equivariance under the p4 rotation group. Extensive experiments across multiple benchmarks---including high-level image classification, mid-level semantic segmentation, and low-level image super-resolution---demonstrate that EQ-VMamba consistently improves rotation robustness and achieves superior or competitive performance compared to non-equivariant baselines on most benchmarks, while requiring 40-70% fewer parameters. These results indicate that embedding rotation equivariance not only effectively bolsters the robustness of visual Mamba models against rotation transformations, but also improves accuracy on data exhibiting rotational symmetry, with substantially improved parameter efficiency. Code is available at https://github.com/zhongchenzhao/EQ-VMamba.

cs.CV↗

arXiv2026

Superfast Spectral Compressed Sensing with Quadratic Convergence

In this paper, we study the spectral compressed sensing problem of recovering a spectrally sparse signal from linear compressive measurements. Exploiting the low-rank Hankel structure associated with the signal, we formulate a nonconvex fixed-rank optimization problem with a Hankel regularization. We propose a Superfast Iterative Hard Thresholding (SIHT) algorithm, where each iteration consists of a tangent-space least-squares update followed by a fixed-rank hard thresholding projection. SIHT is the first nonconvex algorithm with provable quadratic convergence for spectral compressed sensing. For random Gaussian measurements, it achieves exact recovery in the noiseless case and stable recovery in the noisy case with near-optimal sample complexity. To efficiently implement SIHT, we develop a parameterized conjugate gradient method for solving the least-squares subproblem, endowing SIHT with state-of-the-art computational and memory efficiency. Numerical experiments are provided to validate our results.

cs.IT↗

arXiv2026

Lifted Restricted Isometry Property and Fast Algorithm for Spectral Compressed Sensing With Near-Optimal Sample Complexity

This paper studies the spectral compressed sensing problem, which aims to recover an $r$-spectrally-sparse signal of length $N$ from linear compressive measurements. We reformulate the problem as the recovery of a low-rank Hankel matrix. Motivated by this formulation, we propose a Lifted Restricted Isometry Property (LRIP) for the measurement matrix and show that Gaussian measurement matrices satisfy LRIP under certain conditions. Unlike classical RIP, LRIP imposes a rank constraint in the lifted matrix domain while taking measurements in the signal domain through the adjoint Hankel operator. To solve the resulting nonconvex problem efficiently, we introduce a Fast Iterative Hard Thresholding (FIHT) algorithm. Based on LRIP, we show that FIHT converges linearly to the true signal with high probability using $\mathcal{O}(r \ln r \ln^2 N)$ scaled Gaussian measurements, which is near-optimal up to log factors and improves the state-of-the-art order of $r^2$ for nonconvex Hankel methods. Extensive numerical results demonstrate the superiority of FIHT as compared to state-of-the-art convex methods in terms of phase transitions, computational time, and robustness to noise.

math.OC↗

arXiv2026

Where to Adapt Matters: Layer-Selective Fine-Tuning for Capability Retention

Parameter-efficient fine-tuning (PEFT) enables large language models (LLMs) to adapt to specialized tasks, but often at the cost of degrading general capabilities acquired during pretraining. Existing approaches primarily mitigate this trade-off through data replay or regularization, relying on additional data or explicit optimization constraints. We instead focus on a different question: where should adaptation be applied? We find that fine-tuning different Transformer layers produces different target-task gains and degrees of capability degradation, suggesting that not all layers are equally suitable for adaptation. To characterize this difference, we use layer-wise empirical Fisher information to measure target-task sensitivity. However, computing Fisher scores requires backward computation and becomes increasingly expensive for large models. We therefore introduce input--output cosine similarity as a lightweight, forward-only proxy for ranking layer sensitivity. Across models and tasks, layers with lower input--output similarity consistently exhibit higher empirical Fisher scores. Building on this observation, we propose Layer-Selective LoRA (LS-LoRA), which places trainable LoRA adapters only in layers with low input--output similarity. Experiments on mathematical reasoning and code generation show that LS-LoRA improves average target-task performance while retaining substantially more commonsense reasoning capability than standard all-layer LoRA, demonstrating that carefully choosing where to adapt can provide a simple and effective way to balance target-task adaptation and general capability retention.

cs.AI↗

arXiv2026

Sharp perturbation bounds on the Frobenius norm of subunitary and positive polar factor

Leveraging tools from convex analysis and incorporating additional singular value information of matrices, we completely resolve the problem of establishing perturbation bounds for the Frobenius norm of subunitary and positive polar factors. We derive corresponding sharp upper and lower bounds. As corollaries, we refine the results of Li and Sun [SIAM J. Matrix Anal. Appl., 23 (2002), pp. 1183--1193] and strengthen the classical Araki-Yamagami inequality [Comm. Math. Phys., 81 (1981), no. 1, pp. 89--96]. The versatility of our method also allows us to strengthen Lee's conjecture, providing a sharper version along with a matching sharp lower bound. Furthermore, we generalize the classical matrix arithmetic-geometric mean inequality and Cauchy-Schwarz inequality into tighter and more robust forms. Finally, we establish a sharp lower bound for a result by Kittaneh [Comm. Math. Phys., 104 (1986), no. 2, pp. 307--310].

math.FA↗

arXiv2026

Flash EQ-Linear: Accelerating Equivariant Linear Layers via Group-wise Discrete Fourier Transform

Equivariant networks embed geometric symmetries as structural priors through weight sharing, achieving remarkable parameter efficiency across vision tasks. However, this parameter efficiency does not translate into compute efficiency: most existing implementations unroll the structured weights into dense matrices and dispatch them to generic dense kernels, so an equivariant layer costs no fewer MACs than its non-equivariant counterpart. In this paper, we observe that the equivariant linear (EQ-Linear) layer---the most fundamental and frequently used module in modern equivariant architectures---is essentially a circular convolution along the group dimension composed with a linear transform along the channel dimension. Building on this observation, we propose Flash EQ-Linear, an exact acceleration algorithm that reduces the cost to $2(T-1)/T^2$ of the original dense formulation ($T$ is the equivariant group size) by combining the Fourier convolution theorem along the group dimension with the conjugate symmetry of the real DFT. To translate these computational savings into wall-clock speedups, we further develop dedicated CUDA kernels for the $\mathrm{p}4$ group. At the operator level, Flash EQ-Linear achieves up to $2.1\times$ forward speedup over PyTorch's highly optimized F.linear; at the network level, Flash EQ-ViT achieves up to ${1.7\times}$ end-to-end speedup over both equivariant and non-equivariant baselines. As an operator-level acceleration algorithm, Flash EQ-Linear provides plug-and-play acceleration for diverse pretrained equivariant models, including EQ-ViT, EQ-Swin, EQ-VMamba, and EQ-INR, without retraining or architectural changes. Code is available at https://github.com/zhongchenzhao/FlashEQLinear.

cs.CV↗

arXiv2026

The solution to Kadison's problem on orthonormal bases of unitaries for type $\mathrm{II}_1$ factors

In 1967, Kadison asked whether every type $\mathrm{II}_1$ factor admits an orthonormal basis, with respect to its trace, consisting of unitaries. We resolve this problem in full generality and, more broadly, characterize the diffuse finite von Neumann algebras admitting such bases consisting of symmetries. Let $M$ be a diffuse finite von Neumann algebra with a faithful normal tracial state $τ$, let $κ$ be the density character of $L^2(M,τ)$, and identify $M$ with its canonical image in $L^2(M,τ)$. We prove that there exists a family $B\subset {s\in M:s=s^*=s^{-1},\ τ(s)=0}$ such that ${1}\cup B$ is an orthonormal basis of $L^2(M,τ)$ if and only if the density character of $L^2(zM,τ(z)^{-1}τ|_{zM})$ equals $κ$ for every nonzero central projection $z\in Z(M)$. In particular, every type $\mathrm{II}_1$ factor admits an orthonormal basis consisting of unitaries, thereby answering Kadison's question affirmatively. We also provide a Lean 4 formalization of the main results.

math.OA↗

arXiv2026

The modified Cartan conjecture

In 1928 H. Cartan stated a conjecture about holomorphic curves in $\mathbb{P}^n$ parametrized by the unit disc, omitting $n+2$ hyperplanes in general position. He proved it for $n=2$. In 1996 the first-named author constructed counterexamples for all $n\geq 3$, and proposed a modified form of Cartan's conjecture which he proved for $n=3$. In this paper we prove this modified conjecture in all dimensions. As a byproduct we prove a quantitative version of the classical theorem that analytic functions are linearly dependent if and only if their Wronskian determinant is zero. We interpret our results in terms of the Kobayashi--Royden pseudometric on the complement of $n+2$ hyperplanes, and on smooth algebraic varieties in the algebraic torus.

math.CV↗

arXiv2026

Coupled Optimal Transport with Landmark Constraints

Existing optimal transport (OT) models primarily seek an OT map or plan between distributions by minimizing a prescribed transport cost or distortion. However, minimizing transport cost or distortion alone may fail to identify a geometrically meaningful transformation between the two distributions. To address this limitation, this paper proposes a novel coupled OT framework that leverages a small number of annotated landmarks to guide the recovery of an underlying deformation governing the distribution transformation. The coupled OT framework integrates the optimization of the transport plan and the deformation field into a unified model, where the landmark-guided deformation field and the cost-driven transport plan are coupled through a mutual-consistency constraint. As a result, the deformation is jointly determined by the annotated landmarks and cost-driven distribution matching. The proposed framework provides a principled connection between landmark-based registration and transport-based distribution matching, enabling the recovery of transport maps from sparse geometric supervision. We establish the well-definedness of the proposed model in a general variational setting and develop a finite-element-based numerical algorithm for computation whose convergence properties are systematically analyzed. The practical effectiveness of the proposed approach is verified in shape matching.

cs.CV↗

arXiv2026

Harnessing the Potential of Optimizing Data Mixtures via Bayesian Domain Reweighting

The performance of Large Language Models (LLMs) is fundamentally influenced by the distributional composition of multi-domain pre-training data. While manual heuristics were prevalent in early models, they increasingly fail to capture the intricate synergies between domains as data complexity grows. To overcome the issue, a dominant approach seeks to fit a proxy function mapping between domain weights and their corresponding validation losses, and then find the optimal domain weights to minimize validation losses. These methods rely on strong structural assumptions, such as rank invariance or scaling laws, which are often violated, resulting in non-negligible estimation bias. A promising approach is to directly optimize the weighting scheme from data. However, it suffers from unstable optimization trajectory and prohibitive computational overhead, limiting its potential to search better domain weights configurations. This paper presents a Bayesian domain weighting method to infer the weights from a Dirichlet distribution via introducing Gamma prior information learned from observations. Experimental results demonstrate that proposed method could achieve stable and efficient domain weights learning, and identifies optimal mixtures while consuming substantially less data than search-based function-fitting methods, revitalizing optimization-based domain weighting for large-scale applications.

cs.LG↗

arXiv2026

Keypoint-Guided Optimal Transport: Models, Algorithms, and Applications

Existing Optimal Transport (OT) methods mainly derive the optimal transport plan/matching under the criterion of transport cost/distance minimization, which may cause incorrect matching in some cases. In real applications, annotating a few matched keypoints across domains is reasonable or even efortless in annotation burden. It is valuable to investigate how to leverage the annotated keypoints to guide the correct matching in OT. In this paper, we propose a novel KeyPoint-Guided model by ReLation preservation (KPG-RL)that searches for the optimal matching (i.e., transport plan) guided by the keypoints in OT.KPG-RL exploits a mask-based constraint of the transport plan to preserve the matching of keypoint pairs in transport, and guides the matching by relation of each data point to the keypoints. The KPG-RL is developed in both balanced and unbalanced/partial transport settings in Kantorovich and Gromov-Wasserstein formulations. Moreover, we deduce the dual formulation of $χ^2$-regularized KPG-RL model, from which we learn the transport based on deep learning techniques, scaling better to larger numbers of data. With the learned transport plan, two novel neural transport strategies, named manifold barycentric projection and manifold sampling, are developed to transport source data to the target domain data manifold. As applications, we apply the proposed approach to the heterogeneous domain adaptation, multi-omic single-cell alignment, and image-to-image translation. Experiments verifed the efectiveness of our approach.

cs.CV↗

arXiv2026

Sharp tangent inequalities in noncommutative $L_p$-spaces

Let $\mathcal{M}$ be a von Neumann algebra equipped with a faithful normal semifinite weight, and let $L_p(\mathcal{M})$ denote the associated Haagerup noncommutative $L_p$-space. For $1<p<\infty$, let $q=p/(p-1)$. For $z\in L_q(\mathcal{M})$ and $y\in L_p(\mathcal{M})$, denote by $\langle z,y\rangle=\operatorname{Re}\operatorname{Tr}(z^*y)$ the canonical real duality pairing between $L_q(\mathcal{M})$ and $L_p(\mathcal{M})$. Define the normalized duality map by $J_p(x)=\|x\|_p^{\,2-p}u|x|^{p-1}$ for $x=u|x|\neq0$, and set $J_p(0)=0$. We establish the sharp tangent inequality $$\|x+y\|_p^2\ge\|x\|_p^2+2\langle J_p(x),y\rangle+(p-1)\|y\|_p^2,\qquad x,y\in L_p(\mathcal{M}),\quad 1<p\le2.$$ The reverse inequality holds for $2\le p<\infty$, and the constant $p-1$ is optimal. Our inequality extends Xu's tangent inequality \cite{Xu89} from classical $L_p$-spaces to general noncommutative $L_p$-spaces and provides the sharp tangent formulation of the Ricard--Xu convexity inequality \cite{RX16}. When specialized to Schatten $p$-classes, it also yields the corresponding tangent formulation of the Ball--Carlen--Lieb convexity inequality \cite{BCL94}. Under a suitable positivity assumption, we further establish a sharp complement to Xu's tangent inequality for Schatten $p$-classes in the range $0<p<1$.

math.OA↗

arXiv2026

BaRA: Bayesian Adaptive Rank Allocation for Parameter-Efficient Fine-Tuning

While Low-rank adaptation (LoRA) enables highly efficient fine-tuning by constraining task-specific updates to fixed low-rank subspaces, this rigid design limits representational flexibility and often results in overconfident predictions and miscalibrated uncertainty, especially in low-data regimes. Recent Bayesian LoRA variants improve uncertainty estimation by modeling posterior distributions over adaptation parameters. However, these approaches typically rely on fixed or heuristically determined ranks, overlooking the inherently context-dependent nature of adaptation capacity. In this paper, we propose BaRA, a Bayesian Adaptive Rank Allocation framework for parameter-efficient fine-tuning. Drawing inspiration from probabilistic topic models, BaRA dynamically allocates adaptation capacity by activating a sparse, context-dependent subset of disentangled latent factors, enabling instance-wise variation in effective rank. This Bayesian formulation provides principled, data-driven capacity control, mitigating over-parameterization while preserving expressiveness. Beyond the modeling contribution, we provide a complexity-theoretic generalization analysis showing that the generalization gap of BaRA depends on the learned joint effective rank $\bar{s}_{Φ,θ}$ induced by the global-local gate, rather than the maximum rank $r$. This result explains why sparse adaptive rank allocation can reduce the effective hypothesis complexity while preserving input-dependent expressiveness. Extensive experiments on diverse natural language benchmarks demonstrate that BaRA consistently improves predictive performance, robustness, and uncertainty calibration compared to standard LoRA and existing Bayesian LoRA variants.

cs.LG↗

arXiv2026

A Limit Theory of Foundation Models: A Mathematical Approach to Understanding Emergent Intelligence and Scaling Laws

Emergent intelligence have played a major role in the modern AI development. While existing studies primarily rely on empirical observations to characterize this phenomenon, a rigorous theoretical framework remains underexplored. This study attempts to develop a mathematical approach to formalize emergent intelligence from the perspective of limit theory. Specifically, we introduce a performance function E(N, P, K), dependent on data size N, model size P and training steps K, to quantify intelligence behavior. We posit that intelligence emerges as a transition from finite to effectively infinite knowledge, and thus recast emergent intelligence as existence of the limit $\lim_{N,P,K \to \infty} \mathcal{E}(N,P,K)$, with emergent abilities corresponding to the limiting behavior. This limit theory helps reveal that emergent intelligence originates from the existence of a parameter-limit architecture (referred to as the limit architecture), and that emergent intelligence rationally corresponds to the learning behavior of this limit system. By introducing tools from nonlinear Lipschitz operator theory, we prove that the necessary and sufficient conditions for existence of the limit architecture. Furthermore, we derive the scaling law of foundation models by leveraging tools of Lipschitz operator and covering number. Theoretical results show that: 1) emergent intelligence is governed by three key factors-training steps, data size and the model architecture, where the properties of basic blocks play a crucial role in constructing foundation models; 2) the critical condition Lip(T)=1 for emergent intelligence provides theoretical support for existing findings. 3) emergent intelligence is determined by an infinite-dimensional system, yet can be effectively realized in practice through a finite-dimensional architecture. Our empirical results corroborate these theoretical findings.

cs.LG↗

arXiv2026

Aligning Network Equivariance with Data Symmetry: A Theoretical Framework and Adaptive Approach for Image Restoration

Image restoration is an inherently ill posed inverse problem. Equivariant networks that embed geometric symmetry priors can mitigate this ill posedness and improve performance. However, current understanding of the relationship between network equivariance and data symmetry remains largely heuristic. Particularly for real world data with imperfect symmetry, existing research lacks a systematic theoretical framework to quantify symmetry, select transformation groups, or evaluate model data alignment. To bridge this gap, we conduct an analysis from an optimization perspective and formalize the intrinsic relationship among data symmetry priors, model equivariance, and generalization capability. Specifically, we propose for the first time a quantifiable definition of non strict symmetry at the dataset level (rather than sample level) and use it as a constraint to formulate the restoration inverse problem. We then show that the equivariance for restoration models can be naturally derived from this inverse problems incorporated the proposed symmetry constraints, and that the equivariance error of the optimal restoration operator is strictly bounded by the data symmetry error and the discretization mesh size. Furthermore, by analyzing the network's empirical risk, we demonstrate that aligning equivariance with data symmetry optimizes the bias variance trade off, minimizing the total expected risk. Guided by these insights, we propose a Sample Adaptive Equivariant Network that uses a hypernetwork and transformation learnable equivariant convolutions to dynamically align with each sample's inherent symmetry. Extensive experiments on super resolution, denoising, and deraining validate our theoretical findings and show significant superiority over standard baselines and traditional equivariant models. Our code and supplementary material are available at https://github.com/tanfy929/SA-Conv.

cs.CV↗

arXiv2026

Unsupervised Posterior Sampling for Seismic Data Recovery via Score-Based Generative Priors

Seismic data restoration is a fundamental task in seismic exploration, yet remains challenging under complex and unknown degradations. Traditional model-driven or task-specific learning methods often require retraining for each degradation type and fail to generalize effectively to unseen field data. In this work, we introduce an unsupervised Posterior Sampling Framework (PSF) built upon Score-based Generative Models (SGMs) for unified seismic data restoration. PSF leverages the pre-trained unconditional SGMs as a seismic-aware generative prior and derives a generalized conditional score function associated with the forward operator of each inverse problem. This enables posterior sampling across different seismic restoration tasks without retraining or supervision. Additionally, an adaptive noise-level estimation mechanism is incorporated to dynamically regulate the noise suppression strength during sampling, enhancing flexibility under varying signal-to-noise ratios and degradation conditions.Extensive experiments on seismic denoising, interpolation, compressed sensing, and deconvolution demonstrate that PSF delivers high-quality samples and exhibits robust generalization to out-of-distribution data. These results highlight the potential of SGMs as a universal prior for seismic inverse problems and establish PSF as a flexible framework for unsupervised posterior inference across diverse degradation scenarios.

physics.geo-ph↗

arXiv2026

KoopGen: Koopman Generator Networks for Representing and Predicting Dynamical Systems with Continuous Spectra

Representing and predicting high-dimensional and spatiotemporally chaotic dynamical systems remains a fundamental challenge in dynamical systems and machine learning. Although data-driven models can achieve accurate short-term forecasts, they often lack stability, interpretability, and scalability in regimes dominated by broadband or continuous spectra. Koopman-based approaches provide a principled linear perspective on nonlinear dynamics, but existing methods rely on restrictive finite-dimensional assumptions or explicit spectral parameterizations that degrade in high-dimensional settings. Against these issues, we introduce KoopGen, a generator-based neural Koopman framework that models dynamics through a structured, state-dependent representation of Koopman generators. By exploiting the intrinsic Cartesian decomposition into skew-adjoint and self-adjoint components, KoopGen separates conservative transport from irreversible dissipation while enforcing exact operator-theoretic constraints during learning. Across systems ranging from nonlinear oscillators to high-dimensional chaotic and spatiotemporal dynamics, KoopGen improves prediction accuracy and stability, while clarifying which components of continuous-spectrum dynamics admit interpretable and learnable representations.

cs.LG↗

arXiv2026

Vanilla Group Equivariant Vision Transformer: Simple and Effective

Incorporating symmetry priors as inductive biases to design equivariant Vision Transformers (ViTs) has emerged as a promising avenue for enhancing their performance. However, existing equivariant ViTs often struggle to balance performance with equivariance, primarily due to the challenge of achieving holistic equivariant modifications across the diverse modules in ViTs-particularly in harmonizing the Self-Attention mechanism with Patch Embedding. To address this, we propose a straightforward framework that systematically renders key ViT components, including patch embedding, self-attention, positional encodings, and Down/Up-Sampling, equivariant, thereby constructing ViTs with guaranteed equivariance. The resulting architecture serves as a plug-and-play replacement that is both theoretically grounded and practically versatile, scaling seamlessly even to Swin Transformers. Extensive experiments demonstrate that our equivariant ViTs consistently improve performance and data efficiency across a wide spectrum of vision tasks.

cs.CV↗