arXiv subjects

Daniel Gerth

Publications and source records attributed to Daniel Gerth.

15 recordsLinked to original sources

arXiv2025

Hybrid CG-Tikhonov is a filtration of the CG Lanczos vectors

We consider iterative methods for solving linear ill-posed problems with compact operator and right-hand side only available via noise-polluted measurements. Conjugate gradients (CG) applied to the normal equations with an appropriate stopping rule and CG applied to the system solving for a Tikhonov-regularized solution (CGT) $(A^\ast A + c I_{\mathcal{X}}) x^{(\delta,c)} = A^\ast y^\delta$ are closely related regularization methods that build iterates from the same Krylov subspaces. In this work, we show that the CGT iterate can be expressed as $ x^{(\delta,c)}_m = \sum_{i=1}^{m} \gamma^{(m)}_i(c) z_i^{(m)}v_i, $ where $\left\lbrace\gamma_i^{(m)}(c)\right\rbrace_{i=1}^m$ are functions of the Tikhonov parameter $c$ and $x^{(\delta)}_m = \sum_{i=1}^{m} z_i^{(m)}v_i$ is the $m$-th CG iterate. We call these functions Lanczos filters, and they can be shown to have decay properties as $c\rightarrow\infty$ with the speed of decay increasing with $i$. This has the effect of filtering out the contribution of the later terms of the CG iterate. The filters can be constructed using quantities defined via recursions at each iteration. We demonstrate with numerical experiments that good parameter choices correspond to appropriate damping of the Lanczos vectors. The filtration approach also provides a platform for further development of parameter choice rules, and similar representations may hold for other hybrid iterative schemes.

math.NA↗

arXiv2022

Open questions asked to analysis and numerics concerning the Hausdorff moment problem

We address facts and open questions concerning the degree of ill-posedness of the composite Hausdorff moment problem aimed at the recovery of a function $x \in L^2(0,1)$ from elements of the infinite dimensional sequence space $\ell^2$ that characterize moments applied to the antiderivative of $x$. This degree, unknown by now, results from the decay rate of the singular values of the associated compact forward operator $A$, which is the composition of the compact simple integration operator mapping in $L^2(0,1)$ and the non-compact Hausdorff moment operator $B^{(H)}$ mapping from $L^2(0,1)$ to $\ell^2$. There is a seeming contradiction between (a) numerical computations, which show (even for large $n$) an exponential decay of the singular values for $n$-dimensional matrices obtained by discretizing the operator $A$, and \linebreak (b) a strongly limited smoothness of the well-known kernel $k$ of the Hilbert-Schmidt operator $A^*A$. Fact (a) suggests severe ill-posedness of the infinite dimensional Hausdorff moment problem, whereas fact (b) lets us expect the opposite, because exponential ill-posedness occurs in common just for $C^\infty$-kernels $k$. We recall arguments for the possible occurrence of a polynomial decay of the singular values of $A$, even if the numerics seems to be against it, and discuss some issues in the numerical approximation of non-compact operators.

math.NA↗

arXiv2022

A note on numerical singular values of compositions with non-compact operators

Linear non-compact operators are difficult to study because they do not exist in the finite dimensional world. Recently, Math\'{e} and Hofmann studied the singular values of the compact composition of the non-compact Hausdorff moment operator and the compact integral operator and found credible arguments, but no strict proof, that those singular values fall only slightly faster than those of the integral operator alone. However, the fact that numerically the singular values of the combined operator fall exponentially fast was not mentioned. In this note, we provide the missing numerical results and provide an explanation why the two seemingly contradicting results may both be true.

math.NA↗

arXiv2021

The Hausdorff Moment Problem in the light of ill-posedness of type I

The Hausdorf moment problem (HMP) over the unit interval in an $L^2$-setting is a classical example of an ill-posed inverse problem. Since various applications can be rewritten in terms of the HMP, it has gathered significant attention in the literature. From the point of view of regularization it is of special interest because of the occurrence of a non-compact forward operator with non-closed range. Consequently, HMP constitutes one of few examples of a linear ill-posed problem of type~I in the sense of Nashed. In this paper we highlight this property and its consequences, for example, the existence of a infinite-dimensional subspace of stability. On the other hand, we show conditional stability estimates for the HMP in Sobolev spaces that indicate severe ill-posedness for the full recovery of a function from its moments, because H\"{o}lder-type stability can be excluded. However, the associated recovery %of the linear functional that characterizes of the function value at the rightmost point of the unit interval is stable of H\"{o}lder-type in an $H^1$-setting. We moreover discuss stability estimates for the truncated HMP, where the forward operator becomes compact. Some numerical case studies illustrate the theoretical results and complete the paper.

math.NA↗

arXiv2021

A new interpretation of (Tikhonov) regularization

Tikhonov regularization with square-norm penalty for linear forward operators has been studied extensively in the literature. However, the results on convergence theory are based on technical proofs and difficult to interpret. It is also often not clear how those results translate into the discrete, numerical setting. In this paper we present a new strategy to study the properties of a regularization method on the example of Tikhonov regularization. The technique is based on the observation that Tikhonov regularization approximates the unknown exact solution in the range of the adjoint of the forward operator. This is closely related to the concept of approximate source conditions, which we generalize to describe not only the approximation of the unknown solution, but also noise-free and noisy data; all from the same source space. Combining these three approximation results we derive the well-known convergence results in a concise way and improve the understanding by tightening the relation between concepts such as convergence rates, parameter choice, and saturation. The new technique is not limited to Tikhonov regularization, it can be applied also to iterative regularization, which we demonstrate by relating Tikhonov regularization and Landweber iteration. Because the Tikhonov functional is no longer the centrepiece of the analysis, we can show that Tikhonov regularization can be used for oversmoothing regularization. All results are accompanied by numerical examples.

math.NA↗

arXiv2020

Estimating solution smoothness and data noise with Tikhonov regularization

A main drawback of classical Tikhonov regularization is that often the parameters required to apply theoretical results, e.g., the smoothness of the sought-after solution and the noise level, are unknown in practice. In this paper we investigate in new detail the residuals in Tikhonov regularization viewed as functions of the regularization parameter. We show that the residual carries, with some restrictions, the information on both the unknown solution and the noise level. By calculating approximate solutions for a large range of regularization parameters, we can extract both parameters from the residual given only one set of noisy data and the forward operator. The smoothness in the residual allows to revisit parameter choice rules and relate a-priori, a-posteriori, and heuristic rules in a novel way that blurs the lines between the classical division of the parameter choice rules. All results are accompanied by numerical experiments.

math.NA↗

arXiv2020

Regularization for the inversion of Fibre Bragg Grating spectra

Fibre Bragg Gratings have become widespread measurement devices in engineering and other fields of application. In all but a few cases, the relation between cause and effect is simplified to a proportional model. However, at its mathematical core lies a nonlinear inverse problem which appears not to have received much attention in the literature. In this paper, we present this core problem to the mathematical community and provide a first report on opportunities and limitations of a regularization approach. In particular, we show that difficulties arise from non-uniqueness and the absence of established parameter selection rules for nonlinear inverse problems with multiple regularization parameters. Nevertheless, the paper takes a first step toward extracting more information from a single FBG measurement.

physics.optics↗

arXiv2019

Case studies and a pitfall for nonlinear variational regularization under conditional stability

Conditional stability estimates are a popular tool for the regularization of ill-posed problems. A drawback in particular under nonlinear operators is that additional regularization is needed for obtaining stable approximate solutions if the validity area of such estimates is not completely known. In this paper we consider Tikhonov regularization under conditional stability estimates for nonlinear ill-posed operator equations in Hilbert scales. We summarize assertions on convergence and convergence rate in three cases describing the relative smoothness of the penalty in the Tikhonov functional and of the exact solution. For oversmoothing penalties, for which the rue solution no longer attains a finite value, we present a result with modified assumptions for a priori choices of the regularization parameter yielding convergence rates of optimal order for noisy data. We strongly highlight the local character of the conditional stability estimate and demonstrate that pitfalls may occur through incorrect stability estimates. Then convergence can completely fail and the stabilizing effect of conditional stability may be lost. Comprehensive numerical case studies for some nonlinear examples illustrate such effects.

math.NA↗

arXiv2019

The Kurdyka-\L{}ojasiewicz inequality as regularity condition

We show that a Kurdyka-\L{}ojasiewicz (KL) inequality can be used as regularity condition for Tikhonov regularization with linear operators in Banach spaces. In fact, we prove the equivalence of a KL inequality and various known regularity conditions (variational inequality, rate conditions, and others) that are utilized for postulating smoothness conditions to obtain convergence rates. Case examples of rate estimates for Tikhonov regularization with source conditions or with conditional stability estimate illustrate the theoretical result.

math.FA↗

arXiv2017

Using Landweber method to quantify source conditions - a numerical study

Source conditions of the type $x^\dag \in\mathcal{R}((A^\ast A)^\mu)$ are an important tool in the theory of inverse problems to show convergence rates of regularized solutions as the noise in the data goes to zero. Unfortunately, it is rarely possible to verify these conditions in practice, rendering data-independent parameter choice rules unfeasible. In this paper we show that such a source condition implies a Kurdyka-\L{}ojasiewicz inequality with certain parameters depending on $\mu$. While the converse implication is unclear from a theoretical point of view, we demonstrate how the Landweber method in combination with the Kurdyka-\L{}ojasiewicz inequality can be used to approximate $\mu$ and conduct several numerical experiments. We also show that the source condition implies a lower bound on the convergence rate which is of optimal order and observable without the knowledge of $\mu$.

math.NA↗

arXiv2017

On $\ell^1$-regularization under continuity of the forward operator in weaker topologies

Our focus is on the stable approximate solution of linear operator equations based on noisy data by using $\ell^1$-regularization as a sparsity-enforcing version of Tikhonov regularization. We summarize recent results on situations where the sparsity of the solution slightly fails. In particular, we show how the recently established theory for weak*-to-weak continuous linear forward operators can be extended to the case of weak*-to-weak* continuity. This might be of interest when the image space is non-reflexive. We discuss existence, stability and convergence of regularized solutions. For injective operators, we will formulate convergence rates by exploiting variational source conditions. The typical rate function obtained under an ill-posed operator is strictly concave and the degree of failure of the solution sparsity has an impact on its behavior. Linear convergence rates just occur in the two borderline cases of proper sparsity, where the solutions belong to $\ell^0$, and of well-posedness. For an exemplary operator, we demonstrate that the technical properties used in our theory can be verified in practice. In the last section, we briefly mention the difficult case of oversmoothing regularization where $x^\dag$ does not belong to $\ell^1$.

math.FA↗

arXiv2017

Injectivity and weak*-to-weak continuity suffice for convergence rates in $\ell^1$-regularization

We show that the convergence rate of $\ell^1$-regularization for linear ill-posed equations is always $O(\delta)$ if the exact solution is sparse and if the considered operator is injective and weak*-to-weak continuous. Under the same assumptions convergence rates in case of non-sparse solutions are proven. The results base on the fact that certain source-type conditions used in the literature for proving convergence rates are automatically satisfied.

math.FA↗

arXiv2016

On the lifting of deterministic convergence rates for inverse problems with stochastic noise

Both for the theoretical and practical treatment of Inverse Problems, the modeling of the noise is a crucial part. One either models the measurement via a deterministic worst-case error assumption or assumes a certain stochastic behavior of the noise. Although some connections between both models are known, the communities develop rather independently. In this paper we seek to bridge the gap between the deterministic and the stochastic approach and show convergence and convergence rates for Inverse Problems with stochastic noise by lifting the theory established in the deterministic setting into the stochastic one. This opens the wide field of deterministic regularization methods for stochastic problems without having to do an individual stochastic analysis for each problem.

math.PR↗

arXiv2014

Phase retrieval via regularization in self-diffraction based spectral interferometry

A novel variant of spectral phase interferometry for direct electric-field reconstruction (SPIDER) is introduced and experimentally demonstrated. Other than most previously demonstrated variants of SPIDER, our method is based on a third-order nonlinear optical effect, namely self-diffraction, rather than the second-order effect of sum-frequency generation. On one hand, self-diffraction (SD) substantially simplifies phase-matching capabilities for multi-octave spectra that cannot be hosted by second-order processes, given manufacturing limitations of crystal lengths in the few-micrometer range. On the other hand, however, SD SPIDER imposes an additional constraint as it effectively measures the spectral phase of a self-convolved spectrum rather than immediately measuring the fundamental phase. Reconstruction of the latter from the measured phase and the spectral amplitude of the fundamental turns out to be an ill-posed problem, which we address by a regularization approach. We discuss the numerical implementation in detail and apply it to measured data from a Ti:sapphire amplifier system. Our experimental demonstration used 40-fs pulses and a 500 $\mu$m thick BaF${}_2$ crystal to show that the SD SPIDER signal is sufficiently strong to be separable from stray light. Extrapolating these measurements to the thinnest conceivable nonlinear media, we predict that bandwidths well above two optical octaves can be measured by a suitably adapted SD SPIDER apparatus, enabling the direct characterization of pulses down to single-femtosecond pulse durations. Such characteristics appear out of range for any currently established pulse measurement technique.

physics.optics↗

arXiv2013

Regularization of an autoconvolution problem in ultrashort laser pulse characterization

An ill-posed inverse problem of autoconvolution type is investigated. This inverse problem occurs in nonlinear optics in the context of ultrashort laser pulse characterization. The novelty of the mathematical model consists in a physically required extension of the deautoconvolution problem beyond the classical case usually discussed in literature: (i) For measurements of ultrashort laser pulses with the self-diffraction SPIDER method, a stable approximate solution of an autocovolution equation with a complex-valued kernel function is needed. (ii) The considered scenario requires complex functions both, in the solution and the rhs of the integral equation. Since, however, noisy data are available not only for amplitude and phase functions of the rhs, but also for the amplitude of the solution, the stable approximate reconstruction of the associated smooth phase function represents the main goal of the paper. An iterative regularization approach is described that is specifically adapted to the physical situation in pulse characterization, using a non-standard stopping rule for the iteration process of computing regularized solutions. Our approach is illustrated by several case studies for synthetic noisy data and physically realistic complex-valued kernel functions. Based on an example with focus on amplitude perturbations, we show that the autoconvolution equation is locally ill-posed everywhere. To date, the analytical treatment of the impact of noisy data on phase perturbations remains an open question. However, we show its influence with the help of numerical experiments. Moreover, we formulate assertions on the non-uniqueness of the complex-valued autoconvolution problem, at least for the simplified case of a constant kernel. The presented results and figures associated with case studies illustrate the ill-posedness phenomena also for the case of non-trivial complex kernel functions.

math-ph↗