arXiv subjects

Daniel Potts

Publications and source records attributed to Daniel Potts.

At least 19 recordsLinked to original sources

arXiv2026

Approximating the Fourier Transform from Non-equispaced Discrete Samples

We study the approximation of the Fourier transform of a function from finitely many samples. Departing from the equispaced setting, we sample the function at deterministic non-equispaced nodes obtained by transforming equispaced points on $[0,1]$ through the inverse cumulative distribution function of a probability density. This change of variables compactifies the real line, so that no truncation of the space domain is necessary. Combining an exact aliasing identity for the midpoint rule with stationary-phase estimates for the transformed oscillatory integrals, we derive deterministic error bounds for every frequency and in $L_p$. For functions with polynomial decay in space and frequency, an explicitly optimized density recovers the equispaced convergence rate, while an additional variance parameter substantially reduces the pre-asymptotic error constants. For (sub-)exponentially decaying functions a polynomially decaying density yields (sub-)exponential rates. Numerical experiments confirm the theory and demonstrate the reduced pre-asymptotic error compared with optimally scaled equispaced sampling.

math.NA↗

arXiv2026

Computation of the Fourier transform for a continuous integrable function via NFFT

We investigate the approximation of continuous Fourier transforms by trigonometric sampling polynomials and their efficient evaluation by the nonequispaced fast Fourier transform (NFFT). While the NFFT is traditionally used for the evaluation of trigonometric polynomials, we show that it can also serve as an effective computational tool for the approximation of Fourier transform values. Building on ideas of M.~Ehler, K.~Gr\"{o}chenig, and A.~Klotz \cite{EhGrKl24}, we derive explicit $\ell_\infty$ uniform error bounds between the Fourier transform and suitable sampling polynomials. The resulting estimates quantify the influence of the sampling width and truncation parameter and provide rigorous accuracy guarantees on entire frequency intervals. In contrast to previous analyses focusing mainly on discrete or $L_2$-type errors, our results yield uniform approximation bounds that are directly relevant for practical computations. Moreover, we prove a matching lower bound which shows that the derived rate in the truncation parameter is sharp. The derived theory leads to a simple algorithmic framework: first approximate the Fourier transform by a trigonometric sampling polynomial and then evaluate this polynomial efficiently by the NFFT. Numerical experiments confirm the theoretical convergence rates and demonstrate that accurate approximations of continuous Fourier transforms can be obtained with moderate computational effort.

math.NA↗

arXiv2026

Learning solution operators of PDEs with sparse approximation methods

We investigate the approximation of solution operators for partial differential equations (PDEs) using sparse high-dimensional techniques. Building on a dimension-incremental framework, we combine product basis expansions with sparse recovery methods, specifically orthogonal matching pursuit (OMP), to substantially reduce the required sample size compared with a previously considered cubature-based approach. We evaluate the resulting method numerically on several examples, comparing it against both cubature-based sparse approximation and Fourier neural operators in terms of accuracy, runtime, and sample size. The experiments show that our approach considerably reduces the number of required PDE solves relative to its predecessor while maintaining competitive accuracy, particularly when the solution admits a sparse representation in the chosen basis. Furthermore, the recovered sparse index sets yield interpretable insights into the relevant variables and parameter interactions.

math.NA↗

arXiv2025

Nonequispaced fast Fourier transforms for bandlimited functions

In this paper we consider the problem of approximating function evaluations $f(\boldsymbol x_j)$ at given nonequispaced points $\boldsymbol x_j$, $j=1,\dots N$, of a bandlimited function from given values $\hat{f}(\boldsymbol k)$, $\boldsymbol k\in \mathcal I_{\boldsymbol M}$, of its Fourier transform. Note that if a trigonometric polynomial is given, it is already known that this problem can be solved by means of the nonequispaced fast Fourier transform (NFFT). In other words, we introduce a new NFFT-like procedure for bandlimited functions, which is based on regularized Shannon sampling formulas.

math.NA↗

arXiv2024

Some remarks on regularized Shannon sampling formulas

The fast reconstruction of a bandlimited function from its sample data is an essential problem in signal processing. In this paper, we consider the widely used Gaussian regularized Shannon sampling formula in comparison to regularized Shannon sampling formulas employing alternative window functions, such as the sinh-type window function and the continuous Kaiser-Bessel window function. It is shown that the approximation errors of these regularized Shannon sampling formulas possess an exponential decay with respect to the truncation parameter. The main focus of this work is to address minor gaps in preceding papers and rigorously prove assumptions that were previously based solely on numerical tests. In doing so, we demonstrate that the sinh-type regularized Shannon sampling formula has the same exponential decay as the continuous Kaiser-Bessel regularized Shannon sampling formula, but both have twice the exponential decay of the Gaussian regularized Shannon sampling formula. Additionally, numerical experiments illustrate the theoretical results.

math.NA↗

arXiv2024

An approach to discrete operator learning based on sparse high-dimensional approximation

We present a dimension-incremental method for function approximation in bounded orthonormal product bases to learn the solutions of various differential equations. Therefore, we decompose the source function of the differential equation into parameters like Fourier or Spline coefficients and treat the solution of the differential equation as a high-dimensional function w.r.t. the spatial variables, these parameters and also further possible parameters from the differential equation itself. Finally, we learn this function in the sense of sparse approximation in a suitable function space by detecting coefficients of the basis expansion with the largest absolute values. Investigating the corresponding indices of the basis coefficients yields further insights on the structure of the solution as well as its dependency on the parameters and their interactions and allows for a reasonable generalization to even higher dimensions and therefore better resolutions of the decomposed source function.

math.NA↗

arXiv2024

ANOVA-boosting for Random Fourier Features

We propose two algorithms for boosting random Fourier feature models for approximating high-dimensional functions. These methods utilize the classical and generalized analysis of variance (ANOVA) decomposition to learn low-order functions, where there are few interactions between the variables. Our algorithms are able to find an index set of important input variables and variable interactions reliably. Furthermore, we generalize already existing random Fourier feature models to an ANOVA setting, where terms of different order can be used. Our algorithms have the advantage of interpretability, meaning that the influence of every input variable is known in the learned model, even for dependent input variables. We give theoretical as well as numerical results that our algorithms perform well for sensitivity analysis. The ANOVA-boosting step reduces the approximation error of existing methods significantly.

cs.LG↗

arXiv2024

Fast and interpretable Support Vector Classification based on the truncated ANOVA decomposition

Support Vector Machines (SVMs) are an important tool for performing classification on scattered data, where one usually has to deal with many data points in high-dimensional spaces. We propose solving SVMs in primal form using feature maps based on trigonometric functions or wavelets. In small dimensional settings the Fast Fourier Transform (FFT) and related methods are a powerful tool in order to deal with the considered basis functions. For growing dimensions the classical FFT-based methods become inefficient due to the curse of dimensionality. Therefore, we restrict ourselves to multivariate basis functions, each of which only depends on a small number of dimensions. This is motivated by the well-known sparsity of effects and recent results regarding the reconstruction of functions from scattered data in terms of truncated analysis of variance (ANOVA) decompositions, which makes the resulting model even interpretable in terms of importance of the features as well as their couplings. The usage of small superposition dimensions has the consequence that the computational effort no longer grows exponentially but only polynomially with respect to the dimension. In order to enforce sparsity regarding the basis coefficients, we use the frequently applied $\ell_2$-norm and, in addition, $\ell_1$-norm regularization. The found classifying function, which is the linear combination of basis functions, and its variance can then be analyzed in terms of the classical ANOVA decomposition of functions. Based on numerical examples we show that we are able to recover the signum of a function that perfectly fits our model assumptions. Furthermore, we perform classification on different artificial and real-world data sets. We obtain better results with $\ell_1$-norm regularization, both in terms of accuracy and clarity of interpretability.

cs.LG↗

arXiv2023

On numerical realizations of Shannon's sampling theorem

In this paper, we discuss some numerical realizations of Shannon's sampling theorem. First we show the poor convergence of classical Shannon sampling sums by presenting sharp upper and lower bounds of the norm of the Shannon sampling operator. In addition, it is known that in the presence of noise in the samples of a bandlimited function, the convergence of Shannon sampling series may even break down completely. To overcome these drawbacks, one can use oversampling and regularization with a convenient window function. Such a window function can be chosen either in frequency domain or in time domain. We especially put emphasis on the comparison of these two approaches in terms of error decay rates. It turns out that the best numerical results are obtained by oversampling and regularization in time domain using a sinh-type window function or a continuous Kaiser-Bessel window function, which results in an interpolating approximation with localized sampling. Several numerical experiments illustrate the theoretical results.

math.NA↗

arXiv2023

ANOVA approximation with mixed tensor product basis on scattered points

In this paper we consider an orthonormal basis, generated by a tensor product of Fourier basis functions, half period cosine basis functions, and the Chebyshev basis functions. We deal with the approximation problem in high dimensions related to this basis and design a fast algorithm to multiply with the underlying matrix, consisting of rows of the non-equidistant Fourier matrix, the non-equidistant cosine matrix and the non-equidistant Chebyshev matrix, and its transposed. This leads us to an ANOVA (analysis of variance) decomposition for functions with partially periodic boundary conditions through using the Fourier basis in some dimensions and the half period cosine basis or the Chebyshev basis in others. We consider sensitivity analysis in this setting, in order to find an adapted basis for the underlying approximation problem. More precisely, we find the underlying index set of the multidimensional series expansion. Additionally, we test this ANOVA approximation with mixed basis at numerical experiments, and refer to the advantage of interpretable results.

math.NA↗

arXiv2023

Optimal density compensation factors for the reconstruction of the Fourier transform of bandlimited functions

An inverse nonequispaced fast Fourier transform (iNFFT) is a fast algorithm to compute the Fourier coefficients of a trigonometric polynomial from nonequispaced sampling data. However, various applications such as magnetic resonance imaging (MRI) are concerned with the analogous problem for bandlimited functions, i.e., the reconstruction of point evaluations of the Fourier transform from given measurements of the bandlimited function. In this paper, we review an approach yielding exact reconstruction for trigonometric polynomials up to a certain degree, and extend this technique to the setting of bandlimited functions. Here we especially focus on methods computing a diagonal matrix of weights needed for sampling density compensation.

math.NA↗

arXiv2023

Fast and direct inversion methods for the multivariate nonequispaced fast Fourier transform

The well-known discrete Fourier transform (DFT) can easily be generalized to arbitrary nodes in the spatial domain. The fast procedure for this generalization is referred to as nonequispaced fast Fourier transform (NFFT). Various applications such as MRI, solution of PDEs, etc., are interested in the inverse problem, i.e., computing Fourier coefficients from given nonequispaced data. In this paper we survey different kinds of approaches to tackle this problem. In contrast to iterative procedures, where multiple iteration steps are needed for computing a solution, we focus especially on so-called direct inversion methods. We review density compensation techniques and introduce a new scheme that leads to an exact reconstruction for trigonometric polynomials. In addition, we consider a matrix optimization approach using Frobenius norm minimization to obtain an inverse NFFT.

math.NA↗

arXiv2022

Nonlinear approximation in bounded orthonormal product bases

We present a dimension-incremental algorithm for the nonlinear approximation of high-dimensional functions in an arbitrary bounded orthonormal product basis. Our goal is to detect a suitable truncation of the basis expansion of the function, where the corresponding basis support is assumed to be unknown. Our method is based on point evaluations of the considered function and adaptively builds an index set of a suitable basis support such that the approximately largest basis coefficients are still included. For this purpose, the algorithm only needs a suitable search space that contains the desired index set. Throughout the work, there are various minor modifications of the algorithm discussed as well, which may yield additional benefits in several situations. For the first time, we provide a proof of a detection guarantee for such an index set in the function approximation case under certain assumptions on the sub-methods used within our algorithm, which can be used as a foundation for similar statements in various other situations as well. Some numerical examples in different settings underline the effectiveness and accuracy of our method.

math.NA↗

arXiv2022

On the reconstruction of functions from values at subsampled quadrature points

This paper is concerned with function reconstruction from samples. The sampling points used in several approaches are (1) structured points connected with fast algorithms or (2) unstructured points coming from, e.g., an initial random draw to achieve an improved information complexity. We connect both approaches and propose a subsampling of structured points in an offline step. In particular, we start with structured quadrature points (QMC), which provide stable $L_2$ reconstruction properties. The subsampling procedure consists of a computationally inexpensive random step followed by a deterministic procedure to further reduce the number of points while keeping its information. In these points functions (belonging to a RKHS of bounded functions) will be sampled and reconstructed from whilst achieving state of the art error decay. Our method is dimension-independent and is applicable as soon as we know some initial quadrature points. We apply our general findings on the $d$-dimensional torus to subsample rank-1 lattices, where it is known that full rank-1 lattices lose half the optimal order of convergence (expressed in terms of the size of the lattice). In contrast to that, our subsampled version regains the optimal rate since many of the lattice points are not needed. Moreover, we utilize fast and memory efficient Fourier algorithms in order to compute the approximation. Numerical experiments in several dimensions support our findings.

math.NA↗

arXiv2022

Variable Transformations in combination with Wavelets and ANOVA for high-dimensional approximation

We use hyperbolic wavelet regression for the fast reconstruction of high-dimensional functions having only low dimensional variable interactions. Compactly supported periodic Chui-Wang wavelets are used for the tensorized hyperbolic wavelet basis on the torus. With a variable transformation we are able to transform the approximation rates and fast algorithms from the torus to other domains. We perform and analyze scattered-data approximation for smooth but arbitrary density functions by using a least squares method. The corresponding system matrix is sparse due to the compact support of the wavelets, which leads to a significant acceleration of the matrix vector multiplication. For non-periodic functions we propose a new extension method. A proper choice of the extension parameter together with the piece-wise polynomial Chui-Wang wavelets extends the functions appropriately. In every case we are able to bound the approximation error with high probability. Additionally, if the function has low effective dimension (i.e. only interactions of few variables), we qualitatively determine the variable interactions and omit ANOVA terms with low variance in a second step in order to decrease the approximation error. This allows us to suggest an adapted model for the approximation. Numerical results show the efficiency of the proposed method.

math.NA↗

arXiv2022

On regularized Shannon sampling formulas with localized sampling

In this paper we present new regularized Shannon sampling formulas which use localized sampling with special window functions, namely Gaussian, B-spline, and sinh-type window functions. In contrast to the classical Shannon sampling series, the regularized Shannon sampling formulas possess an exponential decay and are numerically robust in the presence of noise. Several numerical experiments illustrate the theoretical results.

math.NA↗

arXiv2022

Nonequispaced Fast Fourier Transform Boost for the Sinkhorn Algorithm

This contribution features an accelerated computation of the Sinkhorn's algorithm, which approximates the Wasserstein transportation distance, by employing nonequispaced fast Fourier transforms (NFFT). The algorithm proposed allows approximations of the Wasserstein distance by involving not more than $\mathcal O(n\log n)$ operations for probability measures supported by~$n$ points. Furthermore, the proposed method avoids expensive allocations of the characterizing matrices. With this numerical acceleration, the transportation distance is accessible to probability measures out of reach so far. Numerical experiments using synthetic and real data affirm the computational advantage and superiority.

math.OC↗

arXiv2021

Interpretable transformed ANOVA approximation on the example of the prevention of forest fires

The distribution of data points is a key component in machine learning. In most cases, one uses min-max normalization to obtain nodes in $[0,1]$ or Z-score normalization for standard normal distributed data. In this paper, we apply transformation ideas in order to design a complete orthonormal system in the $\mathrm{L}_2$ space of functions with the standard normal distribution as integration weight. Subsequently, we are able to apply the explainable ANOVA approximation for this basis and use Z-score transformed data in the method. We demonstrate the applicability of this procedure on the well-known forest fires data set from the UCI machine learning repository. The attribute ranking obtained from the ANOVA approximation provides us with crucial information about which variables in the data set are the most important for the detection of fires.

stat.ML↗