arXiv Science⌕ Search

arXiv subjects

Nianyu Yi

Publications and source records attributed to Nianyu Yi.

At least 19 recordsLinked to original sources

Long-time turbulence prediction at fine time steps using multi-stride neural operators

Long-time turbulence prediction at fine time steps is costly and prone to error accumulation, while accurate short-term fields do not ensure accurate long-time statistics. We propose a multi-stride neural operator for three-dimensional turbulence, combining implicit factorized Transformer (IFF) predictors with a factorized-attention cross-stride fusion (FA-CSF) module. All predictors take the same current velocity field as input. FA-CSF reuses their outputs and latent features to generate intermediate velocity fields through interpolation and learned correction. The corrected largest-stride field drives the next autoregressive step, decoupling the autoregressive step from the output time step. Stride-conditioned IFF (SC-IFF) predictors are first trained at power-of-two strides using three conditioning strategies, then frozen while FA-CSF is trained on long rollouts with field-data and statistical losses. Tests on turbulent channel flow and forced homogeneous isotropic turbulence (HIT) show improved long-time predictions and statistics. At a sampling interval of 10 direct numerical simulation (DNS) time steps, fixed-stride IFF yields relative L2 errors above 100% in channel-flow root-mean-square (RMS) velocity fluctuation profiles and the Reynolds shear stress profile, and in the temporal evolution of velocity and vorticity RMS values and the time-averaged energy spectrum in HIT. SC-IFF with independent stride-specific predictors and FA-CSF keeps statistics close to filtered DNS data over the tested prediction times. Relative to fixed-stride IFF, it reduces errors in the channel-flow profiles by more than 98% and in the HIT spectrum by more than 99%. Multi-stride prediction with FA-CSF generates trajectories at fine time steps 3.69 times faster than fixed-stride IFF autoregression and 2.41 times faster than hierarchical multi-stride prediction.

physics.flu-dyn↗

A Biophysically Detailed C. elegans Circuit as a Task-Agnostic Dynamical Core for Visually Robust Robot Manipulation

Robot policies are usually trained for one task, one body and one visual environment, and generalize poorly beyond these conditions. Whether a nervous system can instead supply the sensorimotor computation through its evolved wiring and biophysics remains unresolved. Here we embed a biophysically detailed Caenorhabditis elegans sensorimotor circuit - 136 multicompartment neurons with realistic morphologies and electrophysiological characteristics - as the dynamical core of a visuomotor policy. Only thin task-specific adapters are trained; the core's synaptic weights stay fixed while its membrane voltages evolve freely. Across different MetaWorld tasks the core matches or exceeds diffusion-policy, action-chunking-transformer and neural-circuit-policy baselines, and degrades less under visual perturbations. Replacing the core with generic network models such as MLP, LSTM, transformer or reservoir networks removes the advantage. Furthermore, on a real robotic arm the core withstands diverse visual perturbations that collapse the baselines. Our results suggest that visual robustness can be inherited from biophysically detailed circuit dynamics rather than learned by task-specific controllers.

cs.RO↗

Sparsely connected rank-inspired neural network

We propose a Sparsely Connected Rank-Inspired Neural Network (SCRINN) for function approximation and the numerical solution of partial differential equations (PDEs). By introducing a structured sparse connectivity architecture and an orthogonality- and normalization-guided loss function, SCRINN constructs an approximately orthonormal neural basis while promoting progressive rank growth of its evaluation matrix and reducing the number of trainable parameters. A two-stage framework is developed, in which an approximately orthonormal neural basis is first constructed, and the output weights are subsequently determined using least-squares methods. Numerical experiments on function approximation and a variety of steady-state, time-dependent, and nonlinear PDEs demonstrate that SCRINN consistently achieves high approximation accuracy with substantially lower training costs. The code is publicly available on GitHub.

math.NA↗

Sparsely connected neural network representation of Lagrange finite element function

We construct a mesh-induced sparsely connected neural network framework that exactly reproduces arbitrary-order Lagrange finite element spaces over simplicial meshes. Unlike conventional black-box neural surrogates, the proposed network architecture is fully dictated by finite element discretization rules: local computations stem from simplex geometry and barycentric coordinate transformations, while global consistency is enforced through shared degrees of freedom. For linear Lagrange elements, local basis functions are directly implemented via affine barycentric layers, and high-order polynomial bases are explicitly decomposed into barycentric product compositions realized by specially designed $\mathrm{ReLU}^p$ modules. Equipped with element indicator branches and multiplication units, these modular local components are globally assembled into a sparsely connected neural network whose function space coincides exactly with the target finite element space, thereby inheriting the complete classical finite element approximation theory. By prescribing customized backward differentiation rules for piecewise activations, function values and their spatial gradients can be simultaneously extracted via automatic differentiation within a unified computational graph, eliminating the separate gradient calculation subroutines required in standard finite element implementations. Numerical experiments verify the accuracy of the neural network representation of Lagrange finite elements. Furthermore, by virtue of the intrinsic mesh-free nature of this neural network representation, finite element functions can be interpolated between non-matching meshes, and the proposed scheme can be applied to adaptive finite element methods for solving parabolic partial differential equations. An open-source code implementation of the proposed architecture is made publicly available.

math.NA↗

A linear, fully decoupled, and unconditionally energy-stable SAV-FEM for the Cahn--Hilliard--Navier--Stokes model

In this paper, we develop a linear, fully decoupled, and unconditionally energy-stable fully discrete finite element scheme for the Cahn--Hilliard--Navier--Stokes (CHNS) system by employing the scalar auxiliary variable (SAV) approach. Unlike existing SAV-based formulations that typically introduce multiple auxiliary variables or additional techniques to handle different nonlinearities, we introduce only one scalar auxiliary variable together with a novel update of the auxiliary variable to reformulate all nonlinear terms arising from the Cahn--Hilliard and Navier--Stokes equations, yielding an equivalent reformulation of the original CHNS system. An implicit--explicit (IMEX) Euler scheme is applied for temporal discretization, where the linear terms are treated implicitly and the nonlinear terms explicitly, while a finite element method is adopted for spatial discretization. The resulting fully discrete scheme can be efficiently decomposed into two linear subproblems and one scalar quadratic algebraic equation, which significantly simplifies the implementation. Furthermore, we prove that the proposed scheme satisfies an unconditional discrete energy dissipation law and establish its stability with respect to several relevant norms. Optimal-order $L^2$ error estimates are also derived for the fully discrete finite element approximation. Finally, a series of numerical experiments are presented to verify the theoretical results and demonstrate the efficiency of the proposed method.

math.NA↗

Neural network-enhanced $hr$-adaptive finite element algorithm for parabolic equations

In this paper, we propose a novel $hr$-adaptive finite element method, enhanced by neural networks, for parabolic equations. The main challenge of the conventional $h$-adaptive finite element method is interpolating the finite element solution from the previous step in the updated mesh. The interpolation dependent on the new mesh must be recomputed at each adaptive iteration, resulting in high computational costs. The new approach addresses this challenge by introducing a neural network to construct a mesh-free surrogate of the previous step finite element solution. Since the neural network is mesh-free, it only requires training once per time step, with its parameters initialized using the minimizer of the previous time step. This approach effectively overcomes the interpolation challenges associated with non-nested meshes in computation, making node insertion and movement more convenient and efficient. The new algorithm also emphasizes SIZE and GENERATE, allowing each refinement to roughly double the number of mesh nodes of the previous iteration and then redistribute them to form a new mesh that effectively captures the singularities. It significantly reduces the time required for repeated refinement of the conventional methods and achieves the desired accuracy in no more than seven space-adaptive iterations per time step. Numerical experiments confirm the efficiency of the proposed algorithm in capturing dynamic changes of singularities. The code is made publicly available on GitHub.

math.NA↗

DataTransfer: Neural network based interpolation across non-nested meshes

In mesh-based numerical simulations, the interpolation of mesh-defined functions across different meshes is a critical task, and achieving high-precision interpolation is of great significance for improving the computational efficiency and numerical stability of algorithms. This paper proposes neural network based function mapping model across meshes, wherein the interpolation process is reformulated as a data-driven regression problem over scattered function data. Conventional interpolation and projection-based approaches are highly dependent on mesh connectivity and corresponding geometric properties, which renders such methods computationally costly and sensitive to mismatches between source and target meshes. The proposed method constructs a neural network approximator using nodal function values on the source mesh to obtain a global representation of the function, which can then be interpolated onto any other meshes. To investigate the network architectural impacts on model performance, three representative feedforward network structures are numerically compared in this work: multi-layer perceptrons, extreme learning machines, and network incorporating radial basis function hidden units. The results reveal distinct trade-offs among accuracy, computational efficiency and model robustness, among which the radial basis function-based network achieves the most desirable overall performance balance, enabling fast and precise function calculation. Numerical experiments conducted on non-nested meshes validate the efficacy of the proposed model in both function interpolation and cross-mesh data transmission tasks.

math.NA↗

Towards $C^0$ finite element methods for fourth-order elliptic equation. Part I: general boundary conditions

This paper is part of a series developing $C^0$ finite element methods for fourth-order elliptic equations on polygonal domains. Here, we investigate how boundary conditions influence the design of effective $C^0$ schemes, specifically focusing on equations without lower-order terms, namely the biharmonic equation. We propose a modified mixed formulation that decomposes the problem into a system of Poisson equations, where the number of equations depends on both the largest interior angle and the boundary conditions on its two adjacent sides. In contrast to the naive mixed formulation, which involves only two Poisson problems, the proposed approach guarantees convergence to the true solution for arbitrary polygonal domains and general boundary conditions, including Navier, Neumann, and mixed boundary conditions. $C^0$ finite element algorithms are developed, rigorous error estimates are established, and numerical experiments are presented to demonstrate the well-posedness and effectiveness of the proposed method.

math.NA↗

Data-integrated neural networks for solving partial differential equations

In this work, we propose data-integrated neural networks (DataInNet) for solving partial differential equations (PDEs), offering a novel approach to leveraging data (e.g., source terms, initial conditions, and boundary conditions). The core of this work lies in the integration of data into a unified network framework. DataInNet comprises two subnetworks: a data integration neural network responsible for accommodating and fusing various types of data, and a fully connected neural network dedicated to learning the residual physical information not captured by the data integration neural network. This network architecture inherently excludes function classes that violate known physical constraints, thereby substantially narrowing the solution search space. Numerical experiments demonstrate that the proposed DataInNet delivers superior performance on challenging problems, such as the Helmholtz equation (relative \(L^2\) error: O(\(10^{-6}\))) and PDEs with high frequency solutions (relative \(L^2\) error: O(\(10^{-5}\))).

math.NA↗

The role of particle feedback on particle acceleration in magnetic reconnection

Magnetic reconnection is a ubiquitous process in astrophysical plasmas and an efficient mechanism for particle acceleration. Using 2.5D magnetohydrodynamic (MHD) simulations with a co-evolving fluid-particle framework, we investigate how particle feedback affects reconnection and acceleration. Our simulations demonstrate that particle feedback to the fluid amplifies shear flows within magnetic islands, which strengthens the convective electric field and thereby boosts particle acceleration. This mechanism results in a higher maximum particle energy and a harder non-thermal energy spectrum. The guide field suppresses both the increase in gas internal energy and particle acceleration. These findings highlight the complex interplay between feedback, guide fields, and reconnection dynamics.

physics.plasm-ph↗

IG-PINNs: Interface-gated physics-informed neural networks for solving elliptic interface problems

In this work, we develop interface-gated physics-informed neural networks (IG-PINNs) to solve elliptic interface equations. In IG-PINNs, we use a fully connected neural network to capture the smooth behavior across the entire domain. In each subdomain separated by the interface, an interface-gated network is utilized to provide corrections at the interface. In the architectural design of the interface-gated network, we introduce a gating mechanism and a level-set function derived from the interface. This design enables the interface-gated network to effectively handle discontinuous jumps across the interface. Some numerical experiments have confirmed the effectiveness of the IG-PINNs, demonstrating higher accuracy compared with PINNs, interface PINNs (I-PINNs) and multi-domain PINNs (M-PINNs).

math.NA↗

A linear, unconditionally stable, second order decoupled method for the Ericksen-Leslie model with SAV approach

In this paper, we present a second order, linear, fully decoupled, and unconditionally energy stable scheme for solving the Erickson-Leslie model. This approach integrates the pressure correction method with a scalar auxiliary variable technique. We rigorously demonstrate the unconditional energy stability of the proposed scheme. Furthermore, we present several numerical experiments to validate its convergence order, stability, and computational efficiency.

math.AP↗

Transcending Sparse Measurement Limits: Operator-Learning-Driven Data Super-Resolution for Inverse Source Problem

Inverse source localization from Helmholtz boundary data collected over a narrow aperture is highly ill-posed and severely undersampled, undermining classical solvers (e.g., the Direct Sampling Method). We present a modular framework that significantly improves multi-source localization from extremely sparse single-frequency measurements. First, we extend a uniqueness theorem for the inverse source problem, proving that a unique solution is guaranteed under limited viewing apertures. Second, we employ a Deep Operator Network (DeepONet) with a branch-trunk architecture to interpolate the sparse measurements, lifting six to ten samples within the narrow aperture to a sufficiently dense synthetic aperture. Third, the super-resolved field is fed into the Direct Sampling Method (DSM). For a single source, we derive an error estimate showing that sparse data alone can achieve grid-level precision. In two- and three-source trials, localization from raw sparse measurements is unreliable, whereas DeepONet-reconstructed data reduce localization error by about an order of magnitude and remain effective with apertures as small as $π/4$. By decoupling interpolation from inversion, the framework allows the interpolation and inversion modules to be swapped with neural operators and classical algorithms, respectively, providing a practical and flexible design that improves localization accuracy compared with standard baselines.

math.NA↗

Weights initialization of neural networks for function approximation

Neural network-based function approximation plays a pivotal role in the advancement of scientific computing and machine learning. Yet, training such models faces several challenges: (i) each target function often requires training a new model from scratch; (ii) performance is highly sensitive to architectural and hyperparameter choices; and (iii) models frequently generalize poorly beyond the training domain. To overcome these challenges, we propose a reusable initialization framework based on basis function pretraining. In this approach, basis neural networks are first trained to approximate families of polynomials on a reference domain. Their learned parameters are then used to initialize networks for more complex target functions. To enhance adaptability across arbitrary domains, we further introduce a domain mapping mechanism that transforms inputs into the reference domain, thereby preserving structural correspondence with the pretrained models. Extensive numerical experiments in one- and two-dimensional settings demonstrate substantial improvements in training efficiency, generalization, and model transferability, highlighting the promise of initialization-based strategies for scalable and modular neural function approximation. The full code is made publicly available on Gitee.

cs.LG↗

A structure-preserving relaxation Crank-Nicolson finite element method for the Schrödinger-Poisson equation

In this paper, we propose a mass- and modified energy-conservative relaxation Crank-Nicolson finite element method for the Schrödinger-Poisson equation. Utilizing only a single auxiliary variable, we simultaneously reformulate the distinct nonlinear terms present in both the Schrödinger equation and the Poisson equation into their equivalent expressions, constructing a system equivalent to the original Schrödinger-Poisson equation. Our proposed scheme, derived from this equivalent system, is implemented linearly, avoiding the need for iterative techniques to solve the nonlinear equation. Additionally, it is executed sequentially, eliminating the need to solve a coupled large linear system. We in turn rigorously derive the optimal error estimates for the proposed scheme, demonstrating second order accuracy in time and $(k+1)$th order accuracy in space when employing polynomials of degree up to $k$. Numerical experiments validate the accuracy and effectiveness of our method and emphasize its conservation properties over long-time simulations.

math.NA↗

Robust PDE discovery under sparse and highly noisy conditions via attention neural networks

The discovery of partial differential equations (PDEs) from experimental data holds great promise for uncovering predictive models of complex physical systems. In this study, we introduce an efficient automatic model discovery framework, ANN-PYSR, which integrates attention neural networks with the state-of-the-art PySR symbolic regression library. Our approach successfully identifies the governing PDE in six benchmark examples. Compared to the DLGA framework, numerical experiments demonstrate ANN-PYSR can extract the underlying dynamic model more efficiently and robustly from sparse, highly noisy data (noise level up to 200%, 5000 sampling points). It indicates an extensive variety of practical applications of ANN-PYSR, particularly in conditions with sparse sensor networks and high noise levels, where traditional methods frequently fail.

math.NA↗

Rank Inspired Neural Network for solving linear partial differential equations

This paper proposes a rank inspired neural network (RINN) to tackle the initialization sensitivity issue of physics informed extreme learning machines (PIELM) when numerically solving partial differential equations (PDEs). Unlike PIELM which randomly initializes the parameters of its hidden layers, RINN incorporates a preconditioning stage. In this stage, covariance-driven regularization is employed to optimize the orthogonality of the basis functions generated by the last hidden layer. The key innovation lies in minimizing the off-diagonal elements of the covariance matrix derived from the hidden-layer output. By doing so, pairwise orthogonality constraints across collocation points are enforced which effectively enhances both the numerical stability and the approximation ability of the optimized function space.The RINN algorithm unfolds in two sequential stages. First, it conducts a non-linear optimization process to orthogonalize the basis functions. Subsequently, it solves the PDE constraints using linear least-squares method. Extensive numerical experiments demonstrate that RINN significantly reduces performance variability due to parameter initialization compared to PIELM. Incorporating an early stopping mechanism based on PDE loss further improves stability, ensuring consistently high accuracy across diverse initialization settings.

math.NA↗

Enhanced gradient recovery-based a posteriori error estimator and adaptive finite element method for elliptic equations

Recovery type a posteriori error estimators are popular, particularly in the engineering community, for their computationally inexpensive, easy to implement, and generally asymptotically exactness. Unlike the residual type error estimators, one can not establish upper and lower a posteriori error bounds for the classical recovery type error estimators without the saturation assumption. In this paper, we first present three examples to show the unsatisfactory performance in the practice of standard residual or recovery-type error estimators, then, an improved gradient recovery-based a posteriori error estimator is constructed. The proposed error estimator contains two parts, one is the difference between the direct and post-processed gradient approximations, and the other is the residual of the recovered gradient. The reliability and efficiency of the enhanced estimator are derived. Based on the improved recovery-based error estimator and the newest-vertex bisection refinement method with a tailored mark strategy, an adaptive finite element algorithm is designed. We then prove the convergence of the adaptive method by establishing the contraction of gradient error plus oscillation. Numerical experiments are provided to illustrate the asymptotic exactness of the new recovery-based a posteriori error estimator and the high efficiency of the corresponding adaptive algorithm.

math.NA↗