arXiv subjects

Jonatan Vallin

Publications and source records attributed to Jonatan Vallin.

4 recordsLinked to original sources

arXiv2026

Latent Inversion of Material Coefficients from Boundary Data via Finite Tests and Neural Surrogates

We reconstruct a spatially varying material coefficient in a scalar elliptic equation from finitely many boundary excitations, each producing a full Dirichlet trace. To mitigate the ill-posedness and the cost of repeated PDE solves, we restrict the coefficient to a low-dimensional family, specified analytically or learned from samples, and solve the inverse problem in its latent coordinates. We consider a $C^1$ parametrization with $m$ latent coordinates and full-rank derivative at a reference point. If the continuous linearized Neumann-to-Dirichlet map is injective on the corresponding tangent space, at most $m$ excitations suffice for local injectivity and Lipschitz stability. Convergence of the coefficient sensitivities then transfers this stability to conforming finite element discretizations. For sufficiently fine meshes, the stability constant and neighborhood can be chosen independently of the mesh size. Under a local residual-comparison condition, uniform accuracy of the surrogate forward map yields coefficient-error bounds separating representation error, data noise, finite element error, and surrogate error. Derivative accuracy additionally preserves the surrogate's own local stability. All stability statements are local to a reference coefficient. Two-dimensional numerical experiments combine analytic and learned representations of inclusions and crack-like coefficients with neural forward surrogates. They illustrate latent-space reconstruction, reduced online cost, and further improvement from optional FEM-based refinement.

math.NA↗

arXiv2026

Solving Inverse Parametrized Problems via Finite Elements and Extreme Learning Networks

We develop an interpolation-based modeling framework for parameter-dependent partial differential equations arising in control, inverse problems, and uncertainty quantification. The solution is discretized in the physical domain using finite element methods, while the dependence on a finite-dimensional parameter is approximated separately. We establish existence, uniqueness, and regularity of the parametric solution and derive rigorous error estimates that explicitly quantify the interplay between spatial discretization and parameter approximation. In low-dimensional parameter spaces, classical interpolation schemes yield algebraic convergence rates based on Sobolev regularity in the parameter variable. In higher-dimensional parameter spaces, we replace classical interpolation by extreme learning machine (ELM) surrogates and obtain error bounds under explicit approximation and stability assumptions. The proposed framework is applied to inverse problems in quantitative photoacoustic tomography, where we derive potential and parameter reconstruction error estimates and demonstrate substantial computational savings compared to standard approaches, without sacrificing accuracy.

math.NA↗

arXiv2024

Implicit Hypersurface Approximation Capacity in Deep ReLU Networks

We develop a geometric approximation theory for deep feed-forward neural networks with ReLU activations. Given a $d$-dimensional hypersurface in $\mathbb{R}^{d+1}$ represented as the graph of a $C^2$-function $ϕ$, we show that a deep fully-connected ReLU network of width $d+1$ can implicitly construct an approximation as its zero contour with a precision bound depending on the number of layers. This result is directly applicable to the binary classification setting where the sign of the network is trained as a classifier, with the network's zero contour as a decision boundary. Our proof is constructive and relies on the geometrical structure of ReLU layers provided in [doi:10.48550/arXiv.2310.03482]. Inspired by this geometrical description, we define a new equivalent network architecture that is easier to interpret geometrically, where the action of each hidden layer is a projection onto a polyhedral cone derived from the layer's parameters. By repeatedly adding such layers, with parameters chosen such that we project small parts of the graph of $ϕ$ from the outside in, we, in a controlled way, construct a network that implicitly approximates the graph over a ball of radius $R$. The accuracy of this construction is controlled by a discretization parameter $δ$ and we show that the tolerance in the resulting error bound scales as $(d-1)R^{3/2}δ^{1/2}$ and the required number of layers is of order $d\big(\frac{32R}δ\big)^{\frac{d+1}{2}}$.

cs.LG↗

arXiv2023

The Geometric Structure of Fully-Connected ReLU Layers

We formalize and interpret the geometric structure of $d$-dimensional fully connected ReLU layers in neural networks. The parameters of a ReLU layer induce a natural partition of the input domain, such that the ReLU layer can be significantly simplified in each sector of the partition. This leads to a geometric interpretation of a ReLU layer as a projection onto a polyhedral cone followed by an affine transformation, in line with the description in [doi:10.48550/arXiv.1905.08922] for convolutional networks with ReLU activations. Further, this structure facilitates simplified expressions for preimages of the intersection between partition sectors and hyperplanes, which is useful when describing decision boundaries in a classification setting. We investigate this in detail for a feed-forward network with one hidden ReLU-layer, where we provide results on the geometric complexity of the decision boundary generated by such networks, as well as proving that modulo an affine transformation, such a network can only generate $d$ different decision boundaries. Finally, the effect of adding more layers to the network is discussed.

cs.LG↗