arXiv subjects

Weiye Gan

Publications and source records attributed to Weiye Gan.

8 recordsLinked to original sources

arXiv2026

Weighted Laplacian Flow: A Deterministic Particle Flow with Provable Convergence

Sampling from a target probability density is a fundamental task in statistics, machine learning, and scientific computing. We introduce weighted Laplacian flow, a deterministic particle-flow method that transports samples from a tractable initial density to a target density known up to normalization. The method evolves the logarithmic density ratio between the target and the transported distribution and constructs the particle velocity by solving a weighted Poisson equation associated with the target density. This design avoids the need to choose a kernel and enables direct control of particle weights along the flow. We establish the global well-posedness of the proposed PDE system and prove that the transported density converges to the target density in both $L^\infty$ distance and Kullback-Leibler divergence. Under a sublinear forcing condition, the method achieves exact convergence in finite time. Numerical experiments on multimodal, heavy-tailed, and ten-dimensional targets demonstrate that weighted Laplacian flow can perform long-range mass transport, overcome energy barriers.

math.NA↗

arXiv2025

An Efficient Conditional Score-based Filter for High Dimensional Nonlinear Filtering Problems

In many engineering and applied science domains, high-dimensional nonlinear filtering is still a challenging problem. Recent advances in score-based diffusion models offer a promising alternative for posterior sampling but require repeated retraining to track evolving priors, which is impractical in high dimensions. In this work, we propose the Conditional Score-based Filter (CSF), a novel algorithm that leverages a set-transformer encoder and a conditional diffusion model to achieve efficient and accurate posterior sampling without retraining. By decoupling prior modeling and posterior sampling into offline and online stages, CSF enables scalable score-based filtering across diverse nonlinear systems. Extensive experiments on benchmark problems show that CSF achieves superior accuracy, robustness, and efficiency across diverse nonlinear filtering scenarios.

cs.LG↗

arXiv2025

Kernel Variational Inference Flow for Nonlinear Filtering Problem

We present a novel particle flow for sampling called kernel variational inference flow (KVIF). KVIF do not require the explicit formula of the target distribution which is usually unknown in filtering problem. Therefore, it can be applied to construct filters with higher accuracy in the update stage. Such an improvement has theoretical assurance. Some numerical experiments for comparison with other classical filters are also demonstrated.

math.OC↗

arXiv2025

A Nonlocal Biharmonic Model with $\Gamma$-Convergence to Local Model and an Efficient Numerical Method

Nonlocal models and their associated theories have been extensively investigated in recent years. Among these, nonlocal versions of the classical Laplace operator have attracted the most attention, while higher-order nonlocal operators have been studied far less. In this work, we focus on the nonlocal counterpart of the classical biharmonic operator together with the clamped boundary condition ($u$ and $\frac{\partial u}{\partial n}$ are given on the boundary). We develop the variational formulation of a nonlocal biharmonic model, establish the existence and uniqueness of its solution, and analyze its convergence as the nonlocal horizon approaches zero. In addition, we propose an efficient finite element method to solve the nonlocal model and the numerical results verify the analytical properties of the nonlocal model and its solution.

math.AP↗

arXiv2025

Neural Tangent Kernel of Neural Networks with Loss Informed by Differential Operators

Spectral bias is a significant phenomenon in neural network training and can be explained by neural tangent kernel (NTK) theory. In this work, we develop the NTK theory for deep neural networks with physics-informed loss, providing insights into the convergence of NTK during initialization and training, and revealing its explicit structure. We find that, in most cases, the differential operators in the loss function do not induce a faster eigenvalue decay rate and stronger spectral bias. Some experimental results are also presented to verify the theory.

cs.LG↗

arXiv2024

Generalization Error Curves for Analytic Spectral Algorithms under Power-law Decay

The generalization error curve of certain kernel regression method aims at determining the exact order of generalization error with various source condition, noise level and choice of the regularization parameter rather than the minimax rate. In this work, under mild assumptions, we rigorously provide a full characterization of the generalization error curves of the kernel gradient descent method (and a large class of analytic spectral algorithms) in kernel regression. Consequently, we could sharpen the near inconsistency of kernel interpolation and clarify the saturation effects of kernel regression algorithms with higher qualification, etc. Thanks to the neural tangent kernel theory, these results greatly improve our understanding of the generalization behavior of training the wide neural networks. A novel technical contribution, the analytic functional argument, might be of independent interest.

cs.LG↗

arXiv2023

$\Gamma$-convergence of Nonlocal Dirichlet Energies With Penalty Formulations of Dirichlet Boundary Data

We study nonlocal Dirichlet energies associated with a class of nonlocal diffusion models on a bounded domain subject to the conventional local Dirichlet boundary condition. The goal of this paper is to give a general framework to correctly impose Dirichlet boundary condition in nonlocal diffusion model. To achieve this, we formulate the Dirichlet boundary condition as a penalty term and use theory of $\varGamma$-convergence to study the correct form of the penalty term. Based on the analysis of $\varGamma$-convergence, we prove that the Dirichlet boundary condition can be correctly imposed in nonlocal diffusion model in the sense of $\varGamma$-convergence as long as the penalty term satisfies a few mild conditions. This work provides a theoretical foundation for approximate Dirichlet boundary condition in nonlocal diffusion model.

math.AP↗

arXiv2022

A non-local gradient based approach of infinity Laplacian with $\Gamma$-convergence

We propose an infinity Laplacian method to address the problem of interpolation on an unstructured point cloud. In doing so, we find the labeling function with the smallest infinity norm of its gradient. By introducing the non-local gradient, the continuous functional is approximated with a discrete form. The discrete problem is convex and can be solved efficiently with the split Bregman method. Experimental results indicate that our approach provides consistent interpolations and the labeling functions obtained are globally smooth, even in the case of extreme low sampling rate. More importantly, convergence of the discrete minimizer to the optimal continuous labeling function is proved using $\Gamma$-convergence and compactness, which guarantees the reliability of the infinity Laplacian method in various potential applications.

math.NA↗