arXiv subjects

Tapio Helin

Publications and source records attributed to Tapio Helin.

At least 19 recordsLinked to original sources

arXiv2026

Formalizing inverse problems in the age of AI: possibilities, pitfalls, and an invitation

Proof assistants such as Lean check mathematical proofs down to the axioms, and AI agents have recently made writing such proofs cheap. We describe AutoIP, a Lean library in which classical linear regularization theory, together with the functional analysis it rests on, has been autoformalized by AI agents. A machine-checked proof certifies only the formal statement it proves, so the remaining human task is to confirm that each formal statement says what was intended. We organize the library around this task: a reviewer compares the formal statements with their natural-language counterparts and never needs to read a proof. Our experience is that the risks lie in the statements rather than in the proofs, and that simple automated tests on the statements can expose problems even in the established literature. We illustrate this with a textbook theorem whose hypothesis is more restrictive than asserted. We invite the inverse problems community to extend and build on the library.

cs.AI↗

arXiv2026

Optimal approximation error approach in Bayesian inverse problems

In many inverse problems, evaluating the forward operator is computationally expensive, making it common practice to accelerate inference with a less costly approximate model. However, such approximations introduce unwanted bias and must be carefully accounted for to ensure the reliability of the solution. This phenomenon is particularly pronounced in Bayesian inference, where accurate posterior characterisation typically requires a large number of forward model evaluations. In this paper, we focus on the approximation error model (AEM), which compensates for the modelling error by adjusting the likelihood density. More precisely, AEM incorporates the model error into the additive Gaussian noise distribution. A central challenge in this approach is how to choose the modified noise mean and covariance in a principled way. To address this, we propose a new framework, optimal approximation error (OAE) which determines the noise model by minimising the expected information loss, measured via the Kullback-Leibler (KL) divergence between the true and approximate posterior distributions. We show that the standard enhanced error approach (EEA) is recovered as the minimiser of the expected divergence between likelihoods rather than posteriors and develop OAE as a direct alternative targeting posterior accuracy. We establish bi-convexity of the OAE objective, introduce a regularised, provably convergent proximal alternating minimisation scheme, and derive closed-form expressions in the Gaussian linear setting. We further show that OAE estimates computed from empirical training data are statistically consistent. Numerical experiments on a linear CT problem and a nonlinear Darcy-flow problem show that OAE improves posterior accuracy relative to both the uncorrected and EEA-corrected likelihoods.

math.NA↗

arXiv2026

Singular Stability Estimates for Passive Gamma Emission Tomography of Spent Nuclear Fuel

We study the joint recovery of attenuation and source coefficients from the attenuated X-ray transform, motivated by passive gamma emission tomography of spent nuclear fuel. Both coefficients are constant on known, disjoint disks of equal radius representing fuel rods. The surrounding moderator has known attenuation and zero source. We use tangential singularities of the data to give a sufficient condition on the geometry and coefficients for unique joint reconstruction from full data. For rods arranged on parallel rows separated by more than one rod diameter, with source coefficients uniformly bounded away from zero, we derive explicit reconstruction formulas and stability estimates for both coefficients. The estimates use a singular seminorm determined by two functionals per rod, computed from angular data near selected tangencies. Numerical experiments examine the approximation of these functionals from discretized data.

math.AP↗

arXiv2026

Robust Model-Based Iteration for Passive Gamma Emission Tomography

Passive Gamma Emission Tomography (PGET) is an International Atomic Energy Agency -approved technique for verifying spent nuclear fuel assemblies prior to geological disposal. Reconstructing the emission and attenuation maps from PGET measurements is a nonlinear ill-posed inverse problem, currently solved with a Levenberg-Marquardt (LM) scheme that requires 10-20 iterations to achieve sufficient accuracy. We propose an accelerated iterative solver that combines the LM algorithm with a Deep Gauss-Newton step, in which a learned operator refines the update proposed by the deterministic algorithm at each iteration. A safeguard condition based on the trust-region model ensures that the accelerated iterates perform no worse than LM and retain convergence to a critical point of the regularized objective. Within this framework we compare three architectures for the learned component: an encoder-decoder-style Convolutional Neural Network, Fourier Neural Operators, and Wavelet Neural Operators. Each is trained on a small set of coarsely simulated 9x9 assemblies. Experiments on simulated and real measurements from Finnish nuclear power plants show that the proposed scheme reaches LM-quality reconstructions in roughly one third of the iterations, while revealing architecture-dependent trade-offs in robustness against out-of-distribution inputs.

math.NA↗

arXiv2026

Approximation of differential entropy in Bayesian optimal experimental design

Bayesian optimal experimental design provides a principled framework for selecting experimental configurations that maximize obtained information. In this work, we consider settings where the likelihood entropy is independent of the design or can be evaluated explicitly, which applies, e.g. to additive noise models with design-independent or explicitly computable noise entropy. This reduces the problem to maximum entropy estimation, where the nested integral defining the expected information gain collapses into a single integral. Our study is motivated by large-scale inference problems, such as inverse problems, where the computational cost is dominated by expensive likelihood evaluations. Under additive Gaussian noise model, we propose a computational approach in which the evidence density is approximated by a Monte Carlo or quasi-Monte Carlo surrogate, while the differential entropy is evaluated using standard methods without additional likelihood evaluations. We prove that this strategy achieves convergence rates that are comparable to, or better than, state-of-the-art methods for full expected information gain estimation, particularly when the cost of entropy evaluation is negligible. Our approach relies only on mild smoothness of the forward map and avoids stronger technical assumptions required in earlier work. We also present numerical experiments, which confirm some of our theoretical findings.

stat.ML↗

arXiv2026

Score-based diffusion models for severely ill-posed problems in diffuse optical tomography

Score-based diffusion models are a recently developed framework for posterior sampling in Bayesian inverse problems, enabling high-quality reconstructions in inverse problems by leveraging expressive prior distributions learned from empirical data. Despite their strong empirical performance and growing interest within the machine learning community, their behaviour in realistic, severely ill-posed inverse problems with experimental measurement data remains under-explored. Diffuse optical tomography (DOT) is an inverse boundary value problem that uses boundary measurements of near-infrared light to recover spatially varying absorption and scattering parameters in biological tissue. The problem is highly ill-posed and particularly sensitive to both measurement noise and modelling errors. We introduce a regularization strategy by constructing a mixed score consisting of a learned component and a model-based component. We show that the resulting mixed score approximates the score of a corresponding mixture distribution locally and in the small diffusion-time regime, providing a theoretical justification for the approach. We compare four approaches for difference imaging in DOT: a classical model-based method, an approximate score-based diffusion method (DPS), an exact posterior sampling method (UCoS) and a novel, regularized version of UCoS. We show that both the model-based approach and approximate diffusion-based sampling degrade significantly in the presence of limited-view geometry and real experimental data, whereas UCoS yields more accurate reconstructions.

stat.ML↗

arXiv2026

Statistical inverse learning and $\ell^1$-regularization

We study the recovery of sparse functions from finite, noisy, and indirect observations in the framework of statistical inverse learning. The unknown is modeled as an element of $\ell^1$, and observations are generated through a possibly nonlinear forward operator $A:\ell^1\to H$, where $H$ is a vector-valued reproducing kernel Hilbert space. We propose an $\ell^1$-regularized empirical risk minimizer and develop a theoretical analysis of its statistical properties. Under mild assumptions, we establish almost-sure consistency and derive non-asymptotic high-probability convergence rates in both the prediction and $\ell^1$ reconstruction norms. The rates depend on the source smoothness parameter $r$, characterized by a variational source condition, and the effective dimension exponent $b$, describing the polynomial spectral decay of the covariance operator. We further prove matching minimax lower bounds, showing that the obtained convergence rates are optimal. To relate the theory to practical sparsity models, we consider finitely smoothing operators of the form $A=G\circ S$, where $S$ is a synthesis operator, and show that approximation-space assumptions imply the required variational source conditions. In particular, we prove that membership in the approximation space $k_t$ is equivalent to polynomial decay of the best $n$-term approximation error. Finally, we verify the assumptions for two representative inverse problems: reaction coefficient identification in elliptic PDEs and sparse computed tomography. For filtered Radon transforms, we derive explicit effective-dimension asymptotics, yielding concrete convergence rates for standard image models and sparsifying systems.

stat.ML↗

arXiv2026

A Convex Approximation Framework for Neural Likelihood-Based Bayesian Inverse Problems

Many problems in science and engineering are difficult to model accurately, either due to unknown physical mechanisms, poorly quantified measurement uncertainty, or prohibitive computational costs of high-fidelity simulations. These challenges limit the applicability of classical probabilistic inference methods such as Markov chain Monte Carlo, especially in high-dimensional Bayesian inverse problems. As data from scientific experiments become increasingly available, machine learning methods offer a flexible alternative to explicit parametric modelling. We study neural likelihood approximation, where the goal is to learn the likelihood function directly from data without explicit knowledge of the underlying data-generating process. A common approach trains likelihood surrogates by minimizing the Kullback-Leibler divergence between the true posterior and an approximate posterior, which is equivalent to minimizing the expected negative log-likelihood. This work improves the theoretical foundations of neural likelihood approximation by alleviating limitations of restrictive model classes: we show that, by working with un-normalized potentials and folding normalization into the training objective, the resulting learning problem is strictly convex. We show that empirical minimizers of the resulting data-driven objective converge to the true likelihood as the sample size grows. Numerical experiments for the neural likelihood approximation are conducted for a deblurring and a non-linear PDE based imaging problem.

stat.ML↗

arXiv2026

Bayesian optimal experimental design with Wasserstein information criteria

Bayesian optimal experimental design (OED) provides a principled framework for selecting observations or experiments. We introduce new Bayesian design criteria based on the expected Wasserstein-$p$ distance between the prior and posterior distributions, termed Wasserstein information criteria. These criteria have many parallels with the widely used expected information gain (EIG) criterion, which instead relies on the Kullback--Leibler divergence. We show that the Wasserstein-$2$ criterion admits a closed-form solution in the linear-Gaussian setting, a property which can be used for more general approximation schemes, and contrast this solution with classical notions of Bayesian alphabetic optimality. Then we develop a stability analysis of the Wasserstein-$1$ criterion, wherein we bound errors induced by perturbations of the prior or likelihood. We partially extend this analysis to the Wasserstein-$2$ criterion. In particular, these results yield error rates for empirical approximations of the prior. We then illustrate the computability of the Wasserstein-$2$ criterion and demonstrate our approximation rates through simulations.

stat.ME↗

arXiv2026

Learning sparsity-promoting regularizers for linear inverse problems

This paper introduces a novel approach to learning sparsity-promoting regularizers for solving linear inverse problems. We develop a bilevel optimization framework to select an optimal synthesis operator, denoted as $B$, which regularizes the inverse problem while promoting sparsity in the solution. The method leverages statistical properties of the underlying data and incorporates prior knowledge through the choice of $B$. We establish the well-posedness of the optimization problem, provide theoretical guarantees for the learning process, and present sample complexity bounds. The approach is demonstrated through theoretical infinite-dimensional examples, including compact perturbations of a known operator and the problem of learning the mother wavelet, and through extensive numerical simulations. This work extends previous efforts in Tikhonov regularization by addressing non-differentiable norms and proposing a data-driven approach for sparse regularization in infinite dimensions.

stat.ML↗

arXiv2026

Batch-based Bayesian Optimal Experimental Design in Linear Inverse Problems

Experimental design is central to science and engineering. A ubiquitous challenge is how to maximize the value of information obtained from expensive or constrained experimental settings. Bayesian optimal experimental design (OED) provides a principled framework for addressing such questions. In this paper, we study experimental design problems such as the optimization of sensor locations over a continuous domain in the context of linear Bayesian inverse problems. We focus in particular on batch design, that is, the simultaneous optimization of multiple design variables, which leads to a notoriously difficult non-convex optimization problem. We tackle this challenge using a promising strategy recently proposed in the frequentist setting, which relaxes A-optimal design to the space of finite positive measures. Our main contribution is the rigorous identification of the Bayesian inference problem corresponding to this relaxed A-optimal OED formulation. Moreover, building on recent work, we develop a Wasserstein gradient-flow -based optimization algorithm for the expected utility and introduce novel regularization schemes that guarantee convergence to an empirical measure. These theoretical results are supported by numerical experiments demonstrating both convergence and the effectiveness of the proposed regularization strategy.

stat.ME↗

arXiv2026

Recovering a (1+1)-dimensional wave equation from a single white noise boundary measurement

We consider the following inverse problem: Suppose a $(1+1)$-dimensional wave equation on $\mathbb{R}_+$ with zero initial conditions is excited with a Neumann boundary data modelled as a white noise process. Given also the Dirichlet data at the same point, determine the unknown first order coefficient function of the system. We first establish that direct problem is well-posed. The inverse problem is then solved by showing that correlations of the boundary data determine the Neumann-to-Dirichlet operator in the sense of distributions, which is known to uniquely identify the coefficient. This approach has applications in acoustic measurements of internal cross-sections of fluid pipes such as pressurised water supply pipes and vocal tract shape determination.

math.AP↗

arXiv2025

An Unconditional Representation of the Conditional Score in Infinite-Dimensional Linear Inverse Problems

Score-based diffusion models (SDMs) have emerged as a powerful tool for sampling from the posterior distribution in Bayesian inverse problems. However, existing methods often require multiple evaluations of the forward mapping to generate a single sample, resulting in significant computational costs for large-scale inverse problems. To address this, we propose an unconditional representation of the conditional score function (UCoS) tailored to linear inverse problems, which avoids forward model evaluations during sampling by shifting computational effort to an offline training phase. In this phase, a \emph{task-dependent} score function is learned based on the linear forward operator. Crucially, we show that the conditional score can be derived \emph{exactly} from a trained (unconditional) score using affine transformations, eliminating the need for conditional score approximations. Our approach is formulated in infinite-dimensional function spaces, making it inherently discretization-invariant. We support this formulation with a rigorous convergence analysis that justifies UCoS beyond any specific discretization. Finally we validate UCoS through high-dimensional computed tomography (CT) and image deblurring experiments, demonstrating both scalability and accuracy.

stat.ML↗

arXiv2024

Gradient-Based Non-Linear Inverse Learning

We study statistical inverse learning in the context of nonlinear inverse problems under random design. Specifically, we address a class of nonlinear problems by employing gradient descent (GD) and stochastic gradient descent (SGD) with mini-batching, both using constant step sizes. Our analysis derives convergence rates for both algorithms under classical a priori assumptions on the smoothness of the target function. These assumptions are expressed in terms of the integral operator associated with the tangent kernel, as well as through a bound on the effective dimension. Additionally, we establish stopping times that yield minimax-optimal convergence rates within the classical reproducing kernel Hilbert space (RKHS) framework. These results demonstrate the efficacy of GD and SGD in achieving optimal rates for nonlinear inverse problems in random design.

stat.ML↗

arXiv2024

The GPU-based High-order adaptive OpticS Testbench

The GPU-based High-order adaptive OpticS Testbench (GHOST) at the European Southern Observatory (ESO) is a new 2-stage extreme adaptive optics (XAO) testbench at ESO. The GHOST is designed to investigate and evaluate new control methods (machine learning, predictive control) for XAO which will be required for instruments such as the Planetary Camera and Spectrograph of ESOs Extremely Large Telescope. The first stage corrections are performed in simulation, with the residual wavefront error at each iteration saved. The residual wavefront errors from the first stage are then injected into the GHOST using a spatial light modulator. The second stage correction is made with a Boston Michromachines Corporation 492 actuator deformable mirror and a pyramid wavefront sensor. The flexibility of the bench also opens it up to other applications, one such application is investigating the flip-flop modulation method for the pyramid wavefront sensor.

astro-ph.IM↗

arXiv2024

Surrogate model for Bayesian optimal experimental design in chromatography

We applied Bayesian Optimal Experimental Design (OED) in the estimation of parameters involved in the Equilibrium Dispersive Model for chromatography with two components with the Langmuir adsorption isotherm. The coefficients estimated were Henry's coefficients, the total absorption capacity and the number of theoretical plates, while the design variables were the injection time and the initial concentration. The Bayesian OED algorithm is based on nested Monte Carlo estimation, which becomes computationally challenging due to the simulation time of the PDE involved in the dispersive model. This complication was relaxed by introducing a surrogate model based on Piecewise Sparse Linear Interpolation. Using the surrogate model instead the original reduces significantly the simulation time and it approximates the solution of the PDE with high degree of accuracy. The estimation of the parameters over strategical design points provided by OED reduces the uncertainty in the estimation of parameters. Additionally, the Bayesian OED methodology indicates no improvements when increasing the number of measurements in temporal nodes above a threshold value.

stat.AP↗

arXiv2024

The MICADO first light imager for the ELT: off-axis performance of PSF reconstruction

The highest scientific return, for adaptive optics (AO) observations, is achieved with a reliable reconstruction of the PSF. This is especially true for MICADO@ELT. In this presentation, we will focus on extending the MICADO PSF reconstruction (PSF-R) method to the off-axis case. Specifically, a novel approach based on temporal-based tomography of AO telemetry data has been recently implemented. Results from the PSF-R of both simulated and real data show that, at half isoplanatic angle distances, a precision of about 10-15% is achievable in both Strehl ratio and full-width at half maximum, paving the way to extend the MICADO PSF-R tool also to the multi-conjugated AO case.

astro-ph.IM↗

arXiv2024

The power of prediction: spatiotemporal Gaussian process modeling for predictive control in slope-based wavefront sensing

Time-delay error is a significant error source in adaptive optics (AO) systems. It arises from the latency between sensing the wavefront and applying the correction. Predictive control algorithms reduce the time-delay error, providing significant performance gains, especially for high-contrast imaging. However, the predictive controller's performance depends on factors such as the WFS type, the measurement noise, the AO system's geometry, and the atmospheric conditions. This work studies the limits of prediction under different imaging conditions through spatiotemporal Gaussian process models. The method provides a predictive reconstructor that is optimal in the least-squares sense, conditioned on the fixed times series of WFS data and our knowledge of the atmosphere. We demonstrate that knowledge is power in predictive AO control. With an SHS-based extreme AO instrument, perfect knowledge of Frozen Flow evolution (wind and Cn2 profile) leads to a reduction of the residual wavefront phase variance up to a factor of 3.5 compared to a non-predictive approach. If there is uncertainty in the profile or evolution models, the gain is more modest. Still, assuming that only effective wind speed is available (without direction) led to reductions in variance by a factor of 2.3. We also study the value of data for predictive filters by computing the experimental utility for different scenarios to answer questions such as: How many past data frames should the prediction filter consider, and is it always most advantageous to use the most recent data? We show that within the scenarios considered, more data consistently increases prediction accuracy. Further, we demonstrate that given a computational limitation on how many past frames we can use, an optimized selection of $n$ past frames leads to a 10-15% additional improvement in RMS over using the n latest consecutive frames of data.

astro-ph.IM↗