arXiv ScienceSearch

arXiv subjects

Bjørn Fredrik Nielsen

Publications and source records attributed to Bjørn Fredrik Nielsen.

17 recordsLinked to original sources

A note on the convergence of the eigenvalues in a subdomain to the continuous spectrum

The SIGEST paper Nielsen and Strako\v{s} (2024) characterized the spectrum of the preconditioned operator $\Delta^{-1}[\nabla \cdot (K\nabla u)]$ in a bounded open two-dimensional domain $\Omega$, where $\Delta$ denotes the Laplacian and $K(x,y)$ is a continuous symmetric matrix-valued function. An important part of the analysis states that for a diagonal tensor $K$ constant in an open subdomain $S \subset \Omega$, the closed interval defined by its diagonal elements belongs to the spectrum of the preconditioned operator. This result is correct, but the proof in Nielsen and Strako\v{s} (2024) must be refined. This paper presents a refined proof and extends the previous work. As shown in the cited papers, for any point $\lambda$ in the open interval defined by the elements of the diagonal tensor constant in $S$ and any point $(x_0,y_0)\in S$, a rectangular subdomain $\Sigma_l\subset S$ can be constructed such that the generalized eigenvalue problem associated with the preconditioned operator restricted to $\Sigma_l$, of arbitrarily small size, has the eigenvalue $\lambda$ and infinitely many eigenfunctions. These are given by solutions of a locally defined wave equation. However, such solutions of the locally restricted generalized eigenvalue problem cannot be extended to the whole domain $\Omega$. Using instead rectangular subdomains whose size shrinks to zero, the present paper constructs a Weyl singular sequence of \emph{approximate} eigenfunctions associated with $\lambda$, proving that $\lambda$ belongs to the spectrum of the preconditioned operator. Since self-adjoint operators in a separable Hilbert space can have at most a countable set of eigenvalues, this shows that the eigenvalues of the locally defined operator converge to points of the continuous spectrum of the preconditioned operator on the entire domain.

math.AP

Directionally Weighted Total Variation for Inverse Problems

We study weighted total variation (TV) regularization for inverse problems in which the forward operator has a large null space, a setting in which standard (unweighted) TV is known to produce systematic reconstruction artifacts such as spatial bias. To address this issue, we consider spatially varying weights derived from a sensitivity analysis of the forward operator expression via an associated Green's function. These weights rebalance the TV penalty and thereby compensate for the inhomogeneous sensitivity of the forward operator. We introduce and analyze two related models: an isotropic weighted TV functional, where the weight reflects worst-case directional sensitivity, and a directionally weighted refinement in which the weighting depends on the actual jump direction of the solution. In addition to the standard Tikhonov formulation, we also study corresponding basis-pursuit problems. We derive optimality conditions and prove exact recovery results under suitable structural assumptions. Furthermore, we investigate how recoverability depends on the geometry of the solution and its distance to the observation boundary. Numerical experiments for inverse source problems and related applications demonstrate that the proposed weighted formulations significantly reduce artifacts present in unweighted TV reconstructions, yielding improved localization and size recovery. These results highlight the crucial role of spatial weighting in TV regularization for inverse problems with large null spaces.

math.NA

Weighted Group Lasso for a static EEG problem

We investigate the weighted Group Lasso formulation for the static inverse electroencephalography (EEG) problem, aiming at reconstructing the unknown underlying neuronal sources from voltage measurements on the scalp. By modelling the three orthogonal dipole components at each location as a single coherent group, we demonstrate that depth bias and orientation bias can be effectively mitigated through the proposed regularization framework. On the theoretical front, we provide concise recovery guarantees for both single and multiple group sources. Our numerical experiments highlight that while theoretical bounds hold for a broad range of weight definitions, the practical reconstruction quality, for cases not covered by the theory, depends significantly on the specific weighting strategy employed. Specifically, employing a truncated Moore-Penrose pseudoinverse for the involved weighting matrix gives a small Dipole Localization Error (DLE). The proposed method offers a robust approach for inverse EEG problems, enabling improved spatial accuracy and a more physiologically realistic reconstruction of neural activity.

math.NA

Weighted total variation regularization for inverse problems with significant null spaces

We consider inverse problems with large null spaces, which arise in important applications such as in inverse ECG and EEG procedures. Standard regularization methods typically produce solutions in or near the orthogonal complement of the forward operator's null space. This often leads to inadequate results, where internal sources are mistakenly interpreted as being near the data acquisition sites -- e.g., near or at the body surface in connection with EEG and ECG recordings. To mitigate this, we previously proposed weighting schemes for Tikhonov and sparsity regularization. Here, we extend this approach to total variation (TV) regularization, which is particularly suited for identifying spatially extended regions with approximately constant values. We introduce a weighted TV-regularization method, provide supporting analysis, and demonstrate its performance through numerical experiments. Unlike standard TV regularization, the weighted version successfully recovers the location and size of large, piecewise constant sources away from the boundary, though not their exact shape. Additionally, we explore a hybrid weighted-sparsity and TV regularization approach, which better captures both small and large sources, albeit with somewhat more blurred reconstructions than the weighted TV method alone.

math.NA

Weighting operators for sparsity regularization

Standard regularization methods typically favor solutions which are in, or close to, the orthogonal complement of the null space of the forward operator/matrix $\mathsf{A}$. This particular biasedness might not be desirable in applications and can lead to severe challenges when $\mathsf{A}$ is non-injective. We have therefore, in a series of papers, investigated how to "remedy" this fact, relative to a chosen basis and in a certain mathematical sense: Based on a weighting procedure, it turns out that it is possible to modify both Tikhonov and sparsity regularization such that each member of the chosen basis can be almost perfectly recovered from their image under $\mathsf{A}$. In particular, we have studied this problem for the task of using boundary data to identify the source term in an elliptic PDE. However, this weighting procedure involves $\mathsf{A}^\dagger \mathsf{A}$, where $\mathsf{A}^\dagger$ denotes the pseudo inverse of $\mathsf{A}$, and can thus be CPU-demanding and lead to undesirable error amplification. We therefore, in this paper, study alternative weighting approaches and prove that some of the recovery results established for the methodology involving $\mathsf{A}$ hold for a broader class of weighting schemes. In fact, it turns out that "any" linear operator $\mathsf{B}$ has an associated proper weighting defined in terms of images under $\mathsf{B}\mathsf{A}$. We also present a series of numerical experiments, employing different choices of $\mathsf{B}$.

math.NA

Estimating neural connection strengths from firing intervals

We propose and analyse a procedure for using a standard activity-based neuron network model and firing data to compute the effective connection strengths between neurons in a network. We assume a Heaviside response function, that the external inputs are given and that the initial state of the neural activity is known. The associated forward operator for this problem, which maps given connection strengths to the time intervals of firing, is highly nonlinear. Nevertheless, it turns out that the inverse problem of determining the connection strengths can be solved in a rather transparent manner, only employing standard mathematical tools. In fact, it is sufficient to solve a system of decoupled ODEs, which yields a linear system of algebraic equations for determining the connection strengths. The nature of the inverse problem is investigated by studying some mathematical properties of the aforementioned linear system and by a series of numerical experiments. Finally, under an assumption preventing the effective contribution of the network to each neuron from staying at zero, we prove that the involved forward operator is continuous. Sufficient criteria on the external input ensuring that the needed assumption holds are also provided.

math.DS

Fictitious null spaces for improving the solution of injective inverse problems

For linear ill-posed problems with nontrivial null spaces, Tikhonov regularization and truncated singular value decomposition (TSVD) typically yield solutions that are close to the minimum norm solution. Such a bias is not always desirable, and we have therefore in a series of papers developed a weighting procedure which produces solutions with a different and controlled bias. This methodology can also conveniently be invoked when sparsity regularization is employed. The purpose of the present work is to study the potential use of this weighting applied to injective operators. The image under a compact operator of the singular vectors/functions associated with very small singular values will be almost zero. Consequently, one may regard these singular vectors/functions to constitute a basis for a fictitious null space that allows us to mimic the previous weighting procedure. It turns out that this regularization by weighting can improve the solution of injective inverse problems compared with more traditional approaches. We present some analysis of this methodology and exemplify it numerically, using sparsity regularization, for three PDE-driven inverse problems: the inverse heat conduction problem, the Cauchy problem for Laplace's equation, and the (linearized) Electrical Impedance Tomography problem with experimental data.

math.NA

Identifying the source term in the potential equation with weighted sparsity regularization

We explore the possibility for using boundary measurements to recover a sparse source term f(x) in the potential equation. Employing weighted sparsity regularization and standard results for subgradients, we derive simple-to-check criteria which assure that a number of sinks (f(x) < 0) and sources (f(x) > 0) can be identified. Furthermore, we present two cases for which these criteria always are fulfilled: a) well-separated sources and sinks, and b) many sources or sinks located at the boundary plus one interior source/sink. Our approach is such that the linearity of the associated forward operator is preserved in the discrete formulation. The theory is therefore conveniently developed in terms of Euclidean spaces, and it can be applied to a wide range of problems. In particular, it can be applied to both isotropic and anisotropic cases. We present a series of numerical experiments. This work is motivated by the observation that standard methods typically suggest that internal sinks and sources are located close to the boundary.

math.OC

Box constraints and weighted sparsity regularization for identifying sources in elliptic PDEs

We explore the possibility for using boundary data to identify sources in elliptic PDEs. Even though the associated forward operator has a large null space, it turns out that box constraints, combined with weighted sparsity regularization, can enable rather accurate recovery of sources with constant magnitude/strength. In addition, for sources with varying strength, the support of the inverse solution will be a subset of the support of the true source. We present both an analysis of the problem and a series of numerical experiments. Our work only addresses discretized problems. The reason for introducing the weighting procedure is that standard (unweighted) sparsity regularization fails to provide adequate results for the source identification task considered in this paper. This investigation is also motivated by applications, e.g., recovering mass distributions from measurements of gravitational fields and inverse scattering. We develop the methodology and the analysis in terms of Euclidean spaces, and our results can therefore be applied to many problems. For example, the results are equally applicable to models involving the screened Poisson equation as to models using the Helmholtz equation, with both large and small wave numbers.

math.NA

Numerical approximation of the spectrum of self-adjoint continuously invertible operators

This paper deals with the generalized spectrum of continuously invertible linear operators defined on infinite dimensional Hilbert spaces. More precisely, we consider two bounded, coercive, and self-adjoint operators $\bc{A, B}: V\mapsto V^{\#}$, where $V^{\#}$ denotes the dual of $V$, and investigate the conditions under which the whole spectrum of $\bc{B}^{-1}\bc{A}:V\mapsto V$ can be approximated to an arbitrary accuracy by the eigenvalues of the finite dimensional discretization $\bc{B}_n^{-1}\bc{A}_n$. Since $\bc{B}^{-1}\bc{A}$ is continuously invertible, such an investigation cannot use the concept of uniform (normwise) convergence, and it relies instead on the pointwise (strong) convergence of $\bc{B}_n^{-1}\bc{A}_n$ to $\bc{B}^{-1}\bc{A}$. The paper is motivated by operator preconditioning which is employed in the numerical solution of boundary value problems. In this context, $\bc{A}, \bc{B}: H_0^1(\Omega) \mapsto H^{-1}(\Omega)$ are the standard integral/functional representations of the differential operators $ -\nabla \cdot (k(x)\nabla u)$ and $-\nabla \cdot (g(x)\nabla u)$, respectively, and $k(x)$ and $g(x)$ are scalar coefficient functions. The investigated question differs from the eigenvalue problem studied in the numerical PDE literature which is based on the approximation of the eigenvalues within the framework of compact operators. This work follows the path started by the two recent papers published in [SIAM J. Numer. Anal., 57 (2019), pp.~1369-1394 and 58 (2020), pp.~2193-2211] and addresses one of the open questions formulated at the end of the second paper.

math.NA

Weighted sparsity regularization for source identification for elliptic PDEs

This investigation is motivated by PDE-constrained optimization problems arising in connection with electrocardiograms (ECGs) and electroencephalography (EEG). Standard sparsity regularization does not necessarily produce adequate results for these applications because only boundary data/observations are available for the identification of the unknown source, which may be interior. We therefore study a weighted $\ell^1$-regularization technique for solving inverse problems when the forward operator has a significant null space. In particular, we prove that a sparse source, regardless of whether it is interior or located at the boundary, can be exactly recovered with this weighting procedure as the regularization parameter $\alpha$ tends to zero. Our analysis is supported by numerical experiments for cases with one and several local sources. The theory is developed in terms of Euclidean spaces, and our results can therefore be applied to many problems.

math.NA

Modified Tikhonov regularization for identifying several sources

We study whether a modified version of Tikhonov regularization can be used to identify several local sources from Dirichlet boundary data for a prototypical elliptic PDE. This paper extends the results presented in [5]. It turns out that the possibility of distinguishing between two, or more, sources depends on the smoothing properties of a second or fourth order PDE. Consequently, the geometry of the involved domain, as well as the position of the sources relative to the boundary of this domain, determines the identifiability. We also present a uniqueness result for the identification of a single local source. This result is derived in terms of an abstract operator framework and is therefore not only applicable to the model problem studied in this paper. Our schemes yield quadratic optimization problems and can thus be solved with standard software tools. In addition to a theoretical investigation, this paper also contains several numerical experiments.

math.OC

A regularization operator for source identification for elliptic PDEs

We study a source identification problem for a prototypical elliptic PDE from Dirichlet boundary data. This problem is ill-posed, and the involved forward operator has a significant nullspace. Standard Tikhonov regularization yields solutions which approach the minimum $L^2$-norm least-squares solution as the regularization parameter tends to zero. We show that this approach 'always' suggests that the unknown local source is very close to the boundary of the domain of the PDE, regardless of the position of the true local source. We propose an alternative regularization procedure, realized in terms of a novel regularization operator, which is better suited for identifying local sources positioned anywhere in the domain of the PDE. Our approach is motivated by the classical theory for Tikhonov regularization and yields a standard quadratic optimization problem. Since the new methodology is derived for an abstract operator equation, it can be applied to many other source identification problems. This paper contains several numerical experiments and an analysis of the new methodology.

math.OC

Generalized spectrum of second order differential operators

We analyze the spectrum of the operator $\Delta^{-1} [\nabla \cdot (K\nabla u)]$, where $\Delta$ denotes the Laplacian and $K=K(x,y)$ is a symmetric tensor. Our main result shows that this spectrum can be derived from the spectral decomposition $K=Q \Lambda Q^T$, where $Q=Q(x,y)$ is an orthogonal matrix and $\Lambda=\Lambda(x,y)$ is a diagonal matrix. More precisely, provided that $K$ is continuous, the spectrum equals the convex hull of the ranges of the diagonal function entries of $\Lambda$. The involved domain is assumed to be bounded and Lipschitz, and both homogeneous Dirichlet and homogeneous Neumann boundary conditions are considered. We study operators defined on infinite dimensional Sobolev spaces. Our theoretical investigations are illuminated by numerical experiments, using discretized problems. The results presented in this paper extend previous analyses which have addressed elliptic differential operators with scalar coefficient functions. Our investigation is motivated by both preconditioning issues (efficient numerical computations) and the need to further develop the spectral theory of second order PDEs (core analysis).

math.AP

Laplacian preconditioning of elliptic PDEs: Localization of the eigenvalues of the discretized operator

In the paper \textit{Preconditioning by inverting the {L}aplacian; an analysis of the eigenvalues. IMA Journal of Numerical Analysis 29, 1 (2009), 24--42}, Nielsen, Hackbusch and Tveito study the operator generated by using the inverse of the Laplacian as preconditioner for second order elliptic PDEs $\nabla \cdot (k(x) \nabla u) = f$. They prove that the range of $k(x)$ is contained in the spectrum of the preconditioned operator, provided that $k$ is continuous. Their rigorous analysis only addresses mappings defined on infinite dimensional spaces, but the numerical experiments in the paper suggest that a similar property holds in the discrete case. % Motivated by this investigation, we analyze the eigenvalues of the matrix $\bf{L}^{-1}\bf{A}$, where $\bf{L}$ and ${\bf{A}}$ are the stiffness matrices associated with the Laplace operator and general second order elliptic operators, respectively. Without any assumption about the continuity of $k(x)$, we prove the existence of a one-to-one pairing between the eigenvalues of $\bf{L}^{-1}\bf{A}$ and the intervals determined by the images under $k(x)$ of the supports of the FE nodal basis functions. As a consequence, we can show that the nodal values of $k(x)$ yield accurate approximations of the eigenvalues of $\bf{L}^{-1}\bf{A}$. Our theoretical results are illuminated by several numerical experiments.

math.NA

Regularization of ill-posed point neuron models

Point neuron models with a Heaviside firing rate function can be ill-posed. That is, the initial-condition-to-solution map might become discontinuous in finite time. If a Lipschitz continuous, but steep, firing rate function is employed, then standard ODE theory implies that such models are well-posed and can thus, approximately, be solved with finite precision arithmetic. We investigate whether the solution of this well-posed model converges to a solution of the ill-posed limit problem as the steepness parameter, of the firing rate function, tends to infinity. Our argument employs the Arzel\`{a}-Ascoli theorem and also yields the existence of a solution of the limit problem. However, we only obtain convergence of a subsequence of the regularized solutions. This is consistent with the fact that we show that models with a Heaviside firing rate function can have several solutions. Our analysis assumes that the Lebesgue measure of the time the limit function, provided by the Arzel\`{a}-Ascoli theorem, equals the threshold value for firing, is zero. If this assumption does not hold, we argue that the regularized solutions may not converge to a solution of the limit problem with a Heaviside firing function.

math.CA

Robust preconditioners for PDE-constrained optimization with limited observations

Regularization robust preconditioners for PDE-constrained optimization problems have been successfully developed. These methods, however, typically assume that observation data is available throughout the entire domain of the state equation. For many inverse problems, this is an unrealistic assumption. In this paper we propose and analyze preconditioners for PDE-constrained optimization problems with limited observation data, e.g. observations are only available at the boundary of the solution domain. Our methods are robust with respect to both the regularization parameter and the mesh size. That is, the condition number of the preconditioned optimality system is uniformly bounded, independently of the size of these two parameters. We first consider a prototypical elliptic control problem and thereafter more general PDE-constrained optimization problems. Our theoretical findings are illuminated by several numerical results.

math.OC