arXiv subjects

Minam Moon

Publications and source records attributed to Minam Moon.

3 recordsLinked to original sources

arXiv2026

Hybrid Least Squares/Gradient Descent Methods for MIONets

In this paper, we propose an efficient hybrid least squares/gradient descent (LSGD) method for MIONets to accelerate training. This method generalizes the LSGD method for DeepONets. Since MIONet is the sum of the entrywise product of multiple branch networks and a trunk network, it can be viewed as a multilinear function with respect to the last layer parameters of each branch network. These sets of parameters can be optimized using the alternating least squares method, where we solve the LS system for a single branch network in turn. To handle the large-sized system matrix, we introduce Kronecker and Khatri-Rao products and tensor permutation matrices to factor the large matrix into small ones. Our method is compatible with a general type of $L^2$ loss with regularization terms for the last layer parameters of each branch, where linear operators can be applied to the MIONet output in each loss term.

cs.LG↗

arXiv2025

Hybrid Least Squares/Gradient Descent Methods for DeepONets

We propose an efficient hybrid least squares/gradient descent method to accelerate DeepONet training. Since the output of DeepONet can be viewed as linear with respect to the last layer parameters of the branch network, these parameters can be optimized using a least squares (LS) solve, and the remaining hidden layer parameters are updated by means of gradient descent form. However, building the LS system for all possible combinations of branch and trunk inputs yields a prohibitively large linear problem that is infeasible to solve directly. To address this issue, our method decomposes the large LS system into two smaller, more manageable subproblems $\unicode{x2014}$ one for the branch network and one for the trunk network $\unicode{x2014}$ and solves them separately. This method is generalized to a broader type of $L^2$ loss with a regularization term for the last layer parameters, including the case of unsupervised learning with physics-informed loss.

cs.LG↗

arXiv2022

Singular value decomposition of the wave forward operator with radial variable coefficients

Photoacoustic tomography (PAT) is a novel and promising technology in hybrid medical imaging that involves generating acoustic waves in the object of interest by stimulating electromagnetic energy. The acoustic wave is measured outside the object. One of the key mathematical problems in PAT is the reconstruction of the initial function that contains diagnostic information from the solution of the wave equation on the surface of the acoustic transducers. Herein, we propose a wave forward operator that assigns an initial function to obtain the solution of the wave equation on a unit sphere. Under the assumption of the radial variable speed of ultrasound, we obtain the singular value decomposition of this wave forward operator by determining the orthonormal basis of a certain Hilbert space comprising eigenfunctions. In addition, numerical simulation results obtained using the continuous Galerkin method are utilized to validate the inversion resulting from the singular value decomposition.

math.NA↗