arXiv subjects

Ming-Jun Lai

Publications and source records attributed to Ming-Jun Lai.

At least 19 recordsLinked to original sources

arXiv2026

A Bivariate Spline Construction of Orthonormal Polynomials over Polygonal Domains and Its Applications to Quadrature

We present computational methods for constructing orthogonal/orthonormal polynomials over arbitrary polygonal domains in $\mathbb{R}^2$ using bivariate spline functions. Leveraging a mature MATLAB implementation which generates spline spaces of any degree, any smoothness over any triangulation, we have exact polynomial representation over the polygonal domain of interest. Two algorithms are developed: one constructs orthonormal polynomials of degree $d>0$ over a polygonal domain, and the other constructs orthonormal polynomials of degree $d+1$ in the orthogonal complement of $\mathbb{P}_d$. Numerical examples for degrees $d=1--5$ illustrate the structure and zero curves of these polynomials, providing evidence against the existence of Gauss quadrature on centrally symmetric domains. In addition, we introduce polynomial reduction strategies based on odd- and even-degree orthogonal polynomials, reducing the integration to the integration of its residual quadratic or linear polynomials. These reductions motivate new quadrature schemes, which we further extend through polynomial interpolation to obtain efficient, high-precision quadrature rules for various polygonal domains.

math.NA↗

arXiv2025

Cellular flow control design for mixing based on the least action principle

We consider a novel approach for the enhancement of fluid mixing via pure stirring strategies building upon the Least Action Principle (LAP) for incompressible flows. The LAP is formally analogous to the Benamou--Brenier formulation of optimal transport, but imposes an incompressibility constraint. Our objective is to find a velocity field, generated by Hamiltonian flows, that minimizes the kinetic energy while ensuring that the initial scalar distribution reaches a prescribed degree of mixedness by a finite time. This formulation leads to a ``point to set" type of optimization problem which relaxes the requirement on controllability of the system compared to the classic LAP framework. In particular, we assume that the velocity field is induced by a finite set of cellular flows that can be controlled in time. We justify the feasibility of this constraint set and leverage Benamou--Brenier's results to establish the existence of a global optimal solution. Finally, we derive the corresponding optimality conditions for solving the optimal time control and conduct numerical experiments demonstrating the effectiveness of our control design.

math.OC↗

arXiv2024

Local Clustering for Lung Cancer Image Classification via Sparse Solution Technique

In this work, we propose to use a local clustering approach based on the sparse solution technique to study the medical image, especially the lung cancer image classification task. We view images as the vertices in a weighted graph and the similarity between a pair of images as the edges in the graph. The vertices within the same cluster can be assumed to share similar features and properties, thus making the applications of graph clustering techniques very useful for image classification. Recently, the approach based on the sparse solutions of linear systems for graph clustering has been found to identify clusters more efficiently than traditional clustering methods such as spectral clustering. We propose to use the two newly developed local clustering methods based on sparse solution of linear system for image classification. In addition, we employ a box spline-based tight-wavelet-framelet method to clean these images and help build a better adjacency matrix before clustering. The performance of our methods is shown to be very effective in classifying images. Our approach is significantly more efficient and either favorable or equally effective compared with other state-of-the-art approaches. Finally, we shall make a remark by pointing out two image deformation methods to build up more artificial image data to increase the number of labeled images.

cs.CV↗

arXiv2024

A Construction of Interpolating Space Curves with Any Degree of Geometric Continuity

This paper outlines a methodology for constructing a geometrically smooth interpolatory curve in $\mathbb{R}^d$ applicable to oriented and flattenable points with $d\ge 2$. The construction involves four essential components: local functions, blending functions, redistributing functions, and gluing functions. The resulting curve possesses favorable attributes, including $G^2$ geometric smoothness, locality, the absence of cusps, and no self-intersection. Moreover, the algorithm is adaptable to various scenarios, such as preserving convexity, interpolating sharp corners, and ensuring sphere preservation. The paper substantiates the efficacy of the proposed method through the presentation of numerous numerical examples, offering a practical demonstration of its capabilities.

math.NA↗

arXiv2024

Tree-based Ensemble Learning for Out-of-distribution Detection

Being able to successfully determine whether the testing samples has similar distribution as the training samples is a fundamental question to address before we can safely deploy most of the machine learning models into practice. In this paper, we propose TOOD detection, a simple yet effective tree-based out-of-distribution (TOOD) detection mechanism to determine if a set of unseen samples will have similar distribution as of the training samples. The TOOD detection mechanism is based on computing pairwise hamming distance of testing samples' tree embeddings, which are obtained by fitting a tree-based ensemble model through in-distribution training samples. Our approach is interpretable and robust for its tree-based nature. Furthermore, our approach is efficient, flexible to various machine learning tasks, and can be easily generalized to unsupervised setting. Extensive experiments are conducted to show the proposed method outperforms other state-of-the-art out-of-distribution detection methods in distinguishing the in-distribution from out-of-distribution on various tabular, image, and text data.

cs.LG↗

arXiv2024

TSSS: A Novel Triangulated Spherical Spline Smoothing for Surface-based Data

Surface-based data is commonly observed in diverse practical applications spanning various fields. In this paper, we introduce a novel nonparametric method to discover the underlying signals from data distributed on complex surface-based domains. Our approach involves a penalized spline estimator defined on a triangulation of surface patches, which enables effective signal extraction and recovery. The proposed method offers several advantages over existing methods, including superior handling of "leakage" or "boundary effects" over complex domains, enhanced computational efficiency, and potential applications in analyzing sparse and irregularly distributed data on complex objects. We provide rigorous theoretical guarantees for the proposed method, including convergence rates of the estimator in both the $L_2$ and supremum norms, as well as the asymptotic normality of the estimator. We also demonstrate that the convergence rates achieved by our estimation method are optimal within the framework of nonparametric estimation. Furthermore, we introduce a bootstrap method to quantify the uncertainty associated with the proposed estimators accurately. The superior performance of the proposed method is demonstrated through simulation experiments and data applications on cortical surface functional magnetic resonance imaging data and oceanic near-surface atmospheric data.

stat.ME↗

arXiv2024

Multivariate Splines and Their Applications

This paper begins by reviewing numerous theoretical advancements in the field of multivariate splines, primarily contributed by Professor Larry L. Schumaker. These foundational results have paved the way for a wide range of applications and computational techniques. The paper then proceeds to highlight various practical applications of multivariate splines. These include scattered data fitting and interpolation, the construction of smooth curves and surfaces, and the numerical solutions of various partial differential equations, encompassing both linear and nonlinear PDEs. Beyond these conventional and well-established uses, the paper introduces a novel application of multivariate splines in function value denoising. This innovative approach facilitates the creation of LKB splines, which are instrumental in approximating high-dimensional functions and effectively circumventing the curse of dimensionality.

math.NA↗

arXiv2024

The Optimal Linear B-splines Approximation via Kolmogorov Superposition Theorem and its Application

We propose a new approach for approximating functions in $C([0,1]^d)$ via Kolmogorov superposition theorem (KST) based on the linear spline interpolation of the outer function in the Kolmogorov representation. We improve the results in \cite{LaiShenKST21} by showing that the optimal rate of approximation based on our proposed approach is $O(\frac{1}{n^2})$, where $n$ denotes the number of knots over $[0,1]$. Furthermore, the approximation constant scales linearly with the dimension $d$. We show that there exists a dense subclass in $C([0,1]^d)$ whose approximation can achieve such optimal rate, and the number of parameters needed in such approximation is at most $O(nd)$. Thus, there is no curse of dimensionality when approximating functions in this subclass. Moreover, for $d\geq 4$, we apply tensor product spline denoising technique to denoise KB-splines and get the smooth LKB-splines. We use LKB-splines as basis to approximate functions for the cases when $d=4$ and $d=6$, which extends the results in \cite{LaiShenKST21}. In addition, we validate via numerical experiments that fewer than $O(nd)$ function values are needed to achieve the rate $O(\frac{1}{n^\beta})$ for some $\beta>0$ based on the smoothness of the outer function. Finally, we demonstrate that our approach can be applied to numerically solving partial differential equation such as the Poisson equation with accurate results.

math.NA↗

arXiv2023

A Bivariate Spline based Collocation Method for Numerical Solution to Optimal Transport Problem

In this paper, we study a spline collocation method for a numerical solution to the optimal transport problem We mainly solve the \MAE with the second boundary condition numerically by proposing a center matching algorithm. We prove a pointwise convergence of our iterative algorithm under the assumption the boundedness of spline iterates. We use the \MAE with Dirichlet boundary condition and some known solutions to the \MAE with second boundary condition to demonstrate the effectiveness of our algorithm. Then we use our method to solve some real-life problems. One application problem is to use the optimal transportation for the conversion of fisheye view images into standard rectangular images.

math.NA↗

arXiv2023

Maximal Volume Matrix Cross Approximation for Image Compression and Least Squares Solution

We study the classic matrix cross approximation based on the maximal volume submatrices. Our main results consist of an improvement of the classic estimate for matrix cross approximation and a greedy approach for finding the maximal volume submatrices. More precisely, we present a new proof of the classic estimate of the inequality with an improved constant. Also, we present a family of greedy maximal volume algorithms to improve the computational efficiency of matrix cross approximation. The proposed algorithms are shown to have theoretical guarantees of convergence. Finally, we present two applications: image compression and the least squares approximation of continuous functions. Our numerical results at the end of the paper demonstrate the effective performance of our approach.

math.NA↗

arXiv2022

Graph-based Semi-supervised Local Clustering with Few Labeled Nodes

Local clustering aims at extracting a local structure inside a graph without the necessity of knowing the entire graph structure. As the local structure is usually small in size compared to the entire graph, one can think of it as a compressive sensing problem where the indices of target cluster can be thought as a sparse solution to a linear system. In this paper, we apply this idea based on two pioneering works under the same framework and propose a new semi-supervised local clustering approach using only few labeled nodes. Our approach improves the existing works by making the initial cut to be the entire graph and hence overcomes a major limitation of the existing works, which is the low quality of initial cut. Extensive experimental results on various datasets demonstrate the effectiveness of our approach.

cs.LG↗

arXiv2022

On Locality of Harmonic Generalized Barycentric Coordinates and Their Application to Solution of the Poisson Equation

We first extend the construction of generalized barycentric coordinates (GBC) based on the vertices on the boundary of a polygon $\Omega$ to a new kind of GBCs based on vertices inside the $\Omega$ of interest. For clarity, the standard GBCs are called boundary GBCs while the new GBCs are called interior GBCs. Then we present an analysis on these two kinds of harmonic GBCs to show that each GBC function whose value is $1$ at a vertex (boundary or interior vertex of $\Omega$) decays to zero away from its supporting vertex exponentially fast except for a trivial example. Based on the exponential decay property, we explain how to approximate the harmonic GBC functions locally. That is, due to the locality of these two kinds of GBCs, one can approximate each of these GBC functions by its local versions which is supported over a sub-domain of $\Omega$. The local version of these GBC function will help reduce the computational time for shape deformation in graphical design. Next, with these two kinds of GBC functions at hand, we can use them to approximate the solution of the Dirichlet problem of the Poisson equation. This may provide a more efficient way to solve the Poisson equation by using a computer which has graphical processing unit(GPU) with thousands or more processes than the standard methods using a computer with one or few CPU kernels.

math.NA↗

arXiv2022

Trivariate Spline Collocation Methods for Numerical Solution to 3D Monge-Amp\`ere Equation

We use trivariate spline functions for the numerical solution of the Dirichlet problem of the 3D elliptic Monge-Amp\'ere equation. Mainly we use the spline collocation method introduced in [SIAM J. Numerical Analysis, 2405-2434,2022] to numerically solve iterative Poisson equations and use an averaged algorithm to ensure the convergence of the iterations. We shall also establish the rate of convergence under a sufficient condition and provide some numerical evidence to show the numerical rates. Then we present many computational results to demonstrate that this approach works very well. In particular, we tested many known convex solutions as well as nonconvex solutions over convex and nonconvex domains and compared them with several existing numerical methods to show the efficiency and effectiveness of our approach.

math.NA↗

arXiv2022

The Harmonic GBC Function Map is a Bijection if the Target Domain is Convex

Harmonic generalized barycentric coordinates (GBC) functions have been used for cartoon animation since an early work in 2006\cite{JMDGS06}. A computational procedure was further developed in \cite{SH15} for deformation between any two polygons. The bijectivity of the map based on harmonic GBC functions is still murky in the literature. In this paper, we present an elementary proof of the bijection of the harmonic GBC map transforming from one arbitrary polygonal domain $V$ to a convex polygonal domain $W$. This result is further extended to a more general harmonic map from one simply connected domain $V$ to a convex domain $W$ if the harmonic map preserves the orientation of the boundary of the domain $V$. In addition, we shall point out that the harmonic GBC map is also a diffeomorphism over the interior of $V$ to the interior of $W$. Finally, we remark on how to construct a harmonic GBC map from $V$ to $W$ when the number of vertices of $V$ is different from the number of vertices of $W$ and how to construct harmonic GBC functions over a polygonal domain with a hole or holes. We also point out that it is possible to use the harmonic GBC map to deform a nonconvex polygon $V$ to another nonconvex polygon $W$ by a good arrangement of the boundary map between $\partial V$ and $\partial W$. Several numerical deformations based on images are presented to show the effectiveness of the map based on bivariate spline approximation of the harmonic GBC functions.

math.NA↗

arXiv2022

A Compressed Sensing Based Least Squares Approach to Semi-supervised Local Cluster Extraction

A least squares semi-supervised local clustering algorithm based on the idea of compressed sensing is proposed to extract clusters from a graph with known adjacency matrix. The algorithm is based on a two-stage approach similar to the one in \cite{LaiMckenzie2020}. However, under a weaker assumption and with less computational complexity than the one in \cite{LaiMckenzie2020}, the algorithm is shown to be able to find a desired cluster with high probability. The ``one cluster at a time" feature of our method distinguishes it from other global clustering methods. Several numerical experiments are conducted on the synthetic data such as stochastic block model and real data such as MNIST, political blogs network, AT\&T and YaleB human faces data sets to demonstrate the effectiveness and efficiency of our algorithm.

cs.LG↗

arXiv2021

The Kolmogorov Superposition Theorem can Break the Curse of Dimensionality When Approximating High Dimensional Functions

We explain how to use Kolmogorov Superposition Theorem (KST) to break the curse of dimensionality when approximating a dense class of multivariate continuous functions. We first show that there is a class of functions called Kolmogorov-Lipschitz (KL) continuous in $C([0,1]^d)$ which can be approximated by a special ReLU neural network of two hidden layers with a dimension independent approximation rate $O(1/n)$ with approximation constant increasing quadratically in $d$. The number of parameters used in such neural network approximation equals to $(6d+2)n$. Next we introduce KB-splines by using linear B-splines to replace the outer function and smooth the KB-splines to have the so-called LKB-splines as the basis for approximation. Our numerical evidence shows that the curse of dimensionality is broken in the following sense: When using the standard discrete least squares (DLS) method to approximate a continuous function, there exists a pivotal set of points in $[0,1]^d$ with size at most $O(nd)$ such that the rooted mean squares error (RMSE) from the DLS based on the pivotal set is similar to the RMSE of the DLS based on the original set with size $O(n^d)$. The pivotal point set is chosen by using matrix cross approximation technique and the number of LKB-splines used for approximation is the same as the size of the pivotal data set. Therefore, we do not need too many basis functions nor too many function values to approximate a high dimensional continuous function $f$. Hence, the study in this paper provides an approach for dimension reduction problems.

math.NA↗

arXiv2021

A Multivariate Spline based Collocation Method for Numerical Solution of Partial Differential Equations

We propose a collocation method based on multivariate polynomial splines over triangulation or tetrahedralization for the numerical solution of partial differential equations. We start with a detailed explanation of the method for the Poisson equation and then extend the study to the second-order elliptic PDE in non-divergence form. We shall show that the numerical solution can approximate the exact PDE solution very well. Then we present a large amount of numerical experimental results to demonstrate the performance of the method over the 2D and 3D settings. In addition, we present a comparison with the existing multivariate spline methods in \cite{ALW06} and \cite{LW17} to show that the new method produces a similar and sometimes more accurate approximation in a more efficient fashion.

math.NA↗

arXiv2021

Nonparametric Regression for 3D Point Cloud Learning

Over the past two decades, we have seen an exponentially increased amount of point clouds collected with irregular shapes in various areas. Motivated by the importance of solid modeling for point clouds, we develop a novel and efficient smoothing tool based on multivariate splines over the tetrahedral partitions to extract the underlying signal and build up a 3D solid model from the point cloud. The proposed smoothing method can denoise or deblur the point cloud effectively and provide a multi-resolution reconstruction of the actual signal. In addition, it can handle sparse and irregularly distributed point clouds and recover the underlying trajectory. The proposed smoothing and interpolation method also provides a natural way of numerosity data reduction. Furthermore, we establish the theoretical guarantees of the proposed method. Specifically, we derive the convergence rate and asymptotic normality of the proposed estimator and illustrate that the convergence rate achieves the optimal nonparametric convergence rate. Through extensive simulation studies and a real data example, we demonstrate the superiority of the proposed method over traditional smoothing methods in terms of estimation accuracy and efficiency of data reduction.

stat.CO↗