arXiv subjects

George Em Karniadakis

Publications and source records attributed to George Em Karniadakis.

At least 19 recordsLinked to original sources

arXiv2026

Pareto-Optimal Hypersonic Vehicle Design with Canonical-Coordinate Neural Operator Surrogates Under Ablation-Driven Shape Change and Incidence Variation

High-fidelity CFD is essential for coupled hypersonic aerodynamic and aerothermal phenomena, but its cost precludes multi-objective design optimization. We develop three DeepONet surrogates for two hypersonic configurations, unified by one device: the trunk receives coordinates in which the varying feature is held fixed. The first is a prescribed family of 37 spherically blunted tangent ogives, varied through ogive radius of curvature to span nose-tip ablation forebody change; no ablation is computed. A body-fitted canonical transformation maps every domain onto a common (s, eta) space, retaining physical coordinates for forces and heat transfer. A branch network predicts reduced coefficients and a Transolver trunk with Physics-Attention learns the spatial basis; a two-step strategy optimizes both jointly, orthonormalizes the basis by QR factorization, and trains a second-stage branch for unseen geometries. Surrogates cover density, pressure, velocity, temperatures, conductivities and species mass fractions. In leave-one-out tests, drag, mean and peak wall heat flux are recovered to 1.16%, 1.62% and 5.29%; a sweep of 1001 geometries gives a 200-design Pareto front trading 6.68% in drag for 4.42% in peak heating (a diagnostic, not an objective). The second is the 3D AEDC waverider at 29 angles of attack: static mesh, moving leading-edge shock. For surface quantities, the same construction predicts integrated heat load within 0.22% and force coefficients to errors below 2.6x10^-5; Pareto fronts identify angles of attack trading drag, lift and heating. For the volume field, a Cartesian trunk smears the shock; a frozen ShockNet supplies a shock-aligned coordinate and a hotspot-aware mixture of experts corrects the residual, recovering density to 12.28% relative L2 error at a held-out incidence (5.08x10^7 nodes). The 1001-design sweep takes about three minutes on a single CPU.

math-ph↗

arXiv2026

Safeguarded Neurally-Accelerated Preconditioning (SNAP) framework for Nonlinear Optimization

We introduce the Safeguarded Neurally-Accelerated Preconditioning (SNAP) framework for hybridizing nonlinear optimization methods with pre-trained neural operators (NOs). SNAP targets parametric optimization problems arising from variational formulations of nonlinear partial differential equations (PDEs), where many parameter instances require repeated solves. Inspired by multilevel line-search methods, SNAP operates in cycles, combining classical optimization steps with a search direction generated by a pre-trained NO. Since NO-generated search directions carry no a priori descent guarantee, SNAP employs an a posteriori safeguard by accepting only corrections that satisfy prescribed descent and acceptance conditions. We prove global convergence of the SNAP algorithm and show that it preserves the convergence rate of the underlying optimization method independently of the employed NO architecture. Moreover, we also show that when the NO corrections are sufficiently accurate, SNAP converges faster, with the improvement directly related to the NO training error. To demonstrate SNAP's efficiency in practice, we run numerical experiments on a diverse set of nonlinear parametric optimization problems, including parametric minimal surface, Allen--Cahn, and nonlinear Helmholtz problems. The efficiency of SNAP is demonstrated by comparing two NO architectures, Fourier neural operator (FNO) and Transolver, and by using SNAP as a standalone solver and as a nonlinear preconditioner. Our numerical results show a substantial reduction in the number of required iterations, while demonstrating robustness and generalization across a wide range of problem parameters and mesh resolutions.

math.OC↗

arXiv2026

Agents' Last Exam

Recent AI systems have achieved strong results on a wide range of benchmarks, yet these gains have not translated into economically meaningful deployment across many professional domains. We argue that this gap is largely an evaluation problem: widely used benchmarks lack sustained performance measurement on real and economically valuable workflows. This paper introduces Agents' Last Exam (ALE), a benchmark designed to evaluate AI agents on long horizon, economically valuable, real world tasks with verifiable outcomes. Developed in collaboration with 250+ industry experts, ALE covers non-physical industries defined with reference to O*NET / SOC 2018 (the U.S. federal occupational taxonomy). It is organized around a task taxonomy with 55 sub fields grouped into 13 industry clusters covering 1K+ tasks. Current results show that the hardest tier remains far from saturated: across mainstream harness and backbone configurations, the average full pass rate is below 1%. ALE is designed as a living benchmark: its task pool grows continuously as new workflows and industries are onboarded. More broadly, ALE is intended not merely as another leaderboard, but as an instrument for closing the gap between benchmark success and GDP relevant impact.

cs.AI↗

arXiv2026

Tractable Inference with Kolmogorov-Arnold Networks

Machine-learning surrogates in computational science often require not only accurate predictions but also expectations, variances, conserved integrals, and normalization constants. Conventional neural networks, including Kolmogorov--Arnold networks (KANs), generally evaluate these quantities through Monte Carlo sampling or multidimensional quadrature, making repeated inference costly, particularly in high dimensions. We introduce KANs with Tractable Operators for Uncertainty and Constraints (TOUCKANs), whose finite-degree polynomial outer functions yield a decomposable sum--product representation. Under factorizing input measures, expectations and higher moments then reduce algebraically to deterministic recursions over one-dimensional leaf integrals. Independent and shared inner-block variants form a parameter-efficiency hierarchy, and a universal-approximation proof for its most restricted member extends to the complete class. The same deterministic operators allow conserved integrals and normalization to be imposed throughout training. Across uniform and Gaussian benchmarks through 50 dimensions, deterministic mean and variance errors remained below the median fixed-budget Monte Carlo errors in every case. TOUCKANs also conserved Cahn--Hilliard mass to machine precision and imposed normalization and orthogonality through deterministic moments, enabling joint computation of the lowest four Schrödinger eigenpairs in two, three, and five dimensions. TOUCKANs therefore connect KAN approximation with tractable probabilistic circuits, making statistical operators and integral constraints directly available within an expressive neural surrogate.

physics.comp-ph↗

arXiv2026

Quantifying reticulocyte biomechanics in health and disease

Red blood cell (RBC) populations are mechanically and morphologically heterogeneous, yet how this heterogeneity governs transport, splenic retention and blood rheology in confinement remains unclear. We combine microchannel experiments with dissipative particle dynamics (DPD) simulations to determine how the morphology, deformability and hydrodynamic interaction of immature RBCs (reticulocytes) shape microconfined flow in acute and chronic mountain sickness. Reticulocyte-rich samples present the three shapes that the maturation literature assigns to successive reticulocyte stages -- multilobular, cup-shaped and near-discocytic -- which we model as R1-R3, each with a membrane shear modulus within the range reported for reticulocytes. A 5-um microchannel resolves these models only weakly, R1 taking at most ~18% longer than control discocytes to cross it, whereas a 1.5-um splenic slit, driven at its own loading, delays R1 by ~30%; both geometries order the models by shear modulus. In cell pairs, a leading cell never lets a follower pass below its own single-cell threshold, ruling out the order-of-magnitude reduction that a wake-"unjamming" picture would suggest; instead the follower queues behind the leader, and a stiffer leader, which clears the slit more slowly, delays it more. The controlling variable is the single-cell critical pressure gradient Delta P_c, which rises monotonically from control discocytes through the reticulocyte subtypes to sickled cells. Set against published rheograms, an analytical estimate attributes chronic-mountain-sickness hyperviscosity mainly to hematocrit-driven crowding rather than single-cell rheology. These results place benign acclimatization, chronic-mountain-sickness hyperviscosity and sickle-cell-trait splenic syndrome on a single mechanical axis defined by Delta P_c.

cond-mat.soft↗

arXiv2026

The typical red cell makes too little vacuole material for coalescence to build the large vacuoles of pocked cells

Red blood cells carrying intracellular vacuoles, called pocked cells, are a sensitive marker of splenic function: about 0.5% of cells in healthy people, 20 to 70% after splenectomy. Vacuoles too small to see are common, and visible ones are thought to grow when small ones merge. We tested that idea with a particle model that resolves the cell's membrane, its contents and every vacuole, and with an inventory of the vacuole volume a cell can make. In tube, shear and vascular flows, a cell's vacuoles met within a second, and, allowed to fuse, ten merged into one to five. Meeting is not what limits growth; material is. At the rate measured after splenectomy, all the vacuoles an average cell makes in its 120-day life fuse into one body 0.6 $μ$m across, the size healthy cells carry, but 16 times smaller in volume than the 1.5-$μ$m bodies of patients without a spleen. Taking vacuole size as set at formation, a population model in which vacuoles are made mainly in young cells, and far faster in a small minority that alone makes material for a large one, accounts for the published counts, sizes and age profiles and, on first-hand measurements, favours a splenic clearance that rises several-fold as cells age; letting that minority's vacuoles fuse fits nearly as well. At a model splenic slit, the cell's spare surface decided passage, and a vacuole mattered only when it led. A slit experiment would test whether brief encounters fuse vacuoles.

physics.bio-ph↗

arXiv2026

GRAFT-ATHENA: Self-Improving Agentic Teams for Autonomous Discovery and Evolutionary Numerical Algorithms

Language-model agents plan, execute, and evaluate scientific workflows. However, the problem--method relationships guiding their choices remain implicit, so plausible outputs can violate the assumptions of the scientific problem. We introduce Graph Reduction to Adaptive Factored Trees (GRAFT), which makes this problem-to-method map explicit as an expandable probabilistic structure of admissible problems, methods, and dependencies. Because this structure follows scientific semantics, knowledge from documentation, papers, and domain experts can be encoded, while factorization keeps the structure tractable. Semantic fingerprints of encoded problems measure their similarity, so expertise and experience guide related problems. GRAFT-guided workflows exceeded published expert baselines in physics-informed learning, recovered blood-rheology trends, predicted Apollo Command Module hypersonic loading within 1.8\% of experiment, and established machine-checked error bounds for regularized brain-flow reconstruction and a spectral physics-informed architecture. The representation retains evaluated outcomes and incorporates new methods, allowing scientific knowledge and experience to accumulate.

cs.LG↗

arXiv2026

Generalizable turbulence closures across bluff-body shapes by PINN-based solver-agnostic training

Data-driven turbulence closures are commonly calibrated by embedding a CFD solver within an inverse procedure that requires a converged flow solution at every optimization iteration, which is fragile and costly. We instead formulate closure identification as a PDE-constrained, data-driven inverse problem within a physics-informed neural network (PINN), and subsequently stabilize the inferred closure for deployment in a numerical solver. This separation eliminates the training cost of repeated CFD solves and associated adjoint or ensemble evaluations, providing substantial flexibility to investigate alternative closure forms. Using this flexibility, we develop four closures: three model the Reynolds stress on a realizable tensor basis---a local map, a non-local model transporting the turbulent kinetic energy and recovering the out-of-plane normal stress, and the same with a learned length scale $\ell$---and a fourth models the Reynolds force $\mathbf{F}=-\nabla\cdot\boldsymbolτ$ directly, free of the realizability constraint. All four are trained across six two-dimensional bluff-body wakes at $Re=10^4$ and deployed frozen in a standard finite-element solver, stabilized primarily by input-gradient smoothing. Under a strict leave-one-shape-out (LOSO) protocol, all four reduce the field errors of a steady SST $k$-$ω$ baseline, most strongly on the mean velocity. The learned-length-scale closure is most accurate on the stress fields, while the force model generalizes best on the mean velocity and drag (LOSO drag error $\sim 7\%$). The closures also train efficiently on Particle Image Velocimetry data, enabling geometries intractable for DNS.

physics.flu-dyn↗

arXiv2026

Well-posedness of neural turbulence closures and tangent dissipation

A neural turbulence closure defines a new boundary-value problem, $R(U)=N(U)+F(U)=0$, with a coupled Jacobian $J(U)=N'(U)+F'(U)$, where $N$ is the original mean-flow operator and $F$ the learned closure. We establish two consequences of global tangent dissipation. For a monotone original operator, a positive uniform margin supplied by the original operator and closure together guarantees existence, uniqueness and a global inverse-sensitivity bound relating a posteriori solution error to the a priori residual. For a general original operator, a dissipative closure cannot worsen tangent dissipation, but this alone does not guarantee uniqueness. Tangent dissipation depends on both diffusion and reaction. We study two complementary ways to promote it: (1) an exact-integral construction enforcing non-negative tangent diffusion while leaving reaction unconstrained, and (2) a penalty on tangent-reaction violations at sampled states. Tangent diffusion enters the Jacobian, and non-negative secant eddy viscosity alone does not control its coercivity. We conduct tests with channel flow at $Re_τ=180$--$5200$, which provides a strongly monotone baseline. Both constrained closures reach accurate solutions in all 50 training-seed/Reynolds-number cases. At $Re_τ=1000$, we conduct tests with 10,000 starts for one fixed network per closure and we find one root for each constrained closure and multiple roots for the other closures. Although this does not prove uniqueness, it provides strong empirical evidence for uniqueness of the tested constrained closures. At $Re_τ=5200$, the construction and penalty reduce the reported inverse sensitivity relative to the original operator by approximately $372\times$ and $11\times$, respectively.

physics.flu-dyn↗

arXiv2026

Quantifying the Biophysical Properties of Red Blood Cells in Gaucher Disease

Gaucher disease (GD), the most common lysosomal storage disorder, alters red blood cell (RBC) mechanics and circulation, contributing to vascular occlusions, bone infarcts, and splenomegaly. However, the individual roles of GD-RBC biophysical properties in these processes remain unclear. Here, we present a combined computational-experimental investigation to quantitatively characterize GD-RBC biophysical properties and determine how specific mechanical parameters drive abnormal RBC behavior. Informed by experimental data, we independently quantify key RBC properties, including shear modulus (mu), surface-to-volume ratio (S/V), and bending modulus (k_c). Based on these parameters, we construct three GD-RBC subtypes (GD-RBC1-3) to systematically isolate their individual contributions. At the single-cell level, optical tweezers simulations show up to ~27% reduction in axial diameter and ~42% reduction in transverse compression. Tank-treading dynamics exhibit non-monotonic behavior, with rotation frequencies increasing by up to ~70% or decreasing under elevated bending rigidity. In confined flow, traversal times through microchannel constrictions increase by more than a factor of two, while splenic slit passage times rise from ~250 ms (control) to >1200 ms for the severe GD-RBC subtype, approaching a functional no-passage threshold. At the population level, viscosity simulations demonstrate that these alterations collectively elevate blood viscosity, with small fractions (~4.0%) of highly rigid cells disproportionately increasing flow resistance. Overall, this study provides a quantitative and mechanistic framework that disentangles the contributions of key RBC parameters to abnormal behavior in GD, linking cellular-scale biophysics to hematologic dysfunction and microvascular occlusion.

physics.bio-ph↗

arXiv2026

Residual-based attention in physics-informed neural networks

Driven by the need for more efficient and seamless integration of physical models and data, physics-informed neural networks (PINNs) have seen a surge of interest in recent years. However, ensuring the reliability of their convergence and accuracy remains a challenge. In this work, we propose an efficient, gradient-less weighting scheme for PINNs that accelerates the convergence of dynamic or static systems. This simple yet effective attention mechanism is a bounded function of the evolving cumulative residuals and aims to make the optimizer aware of problematic regions at no extra computational cost or adversarial learning. We illustrate that this general method consistently achieves one order of magnitude faster convergence than vanilla PINNs and a minimum relative $L^{2}$ error of $\mathcal{O}(10^{-5})$, on typical benchmarks of the literature. The method is further tested on the inverse solution of the Navier-Stokes within the brain perivascular spaces, where it considerably improves the prediction accuracy. Furthermore, an ablation study is performed for each case to identify the contribution of the components that enhance the vanilla PINN formulation. Evident from the convergence trajectories is the ability of the optimizer to effectively escape from poor local minima or saddle points while focusing on the challenging domain regions, which consistently have a high residual score. We believe that alongside exact boundary conditions and other model reparameterizations, this type of attention mask could be an essential element for fast training of both PINNs and neural operators.

cs.LG↗

arXiv2026

Learning in PINNs: Phase transition, diffusion equilibrium, and generalization

We investigate the learning dynamics of fully-connected neural networks through the lens of the neural gradient signal-to-noise ratio (SNR), examining the behavior of first-order optimizers in non-convex objectives. Interpreting the drift/diffusion phases as proposed in the information bottleneck theory, we identify a third phase termed "diffusion equilibrium" (DE), a stable training phase characterized by highly-ordered neural gradients across the sample space. This phase is marked by an abrupt transition, where sample-wise gradients align (SNR increases), and stable optimizer convergence. Moreover, we find that when homogeneous residuals are also met across the sample space during the DE phase, this leads to better generalization, as the optimization steps are equally sensitive to each sample. Based on this observation, we propose a sample-wise re-weighting scheme, which considerably improves the residual homogeneity and generalization in quadratic loss functions, by targeting the problematic samples with large residuals and vanishing gradients. Finally, we explore the information compression phenomenon, pinpointing a significant saturation-induced compression of activations at the DE phase transition, driven by the sample-wise gradient directional alignment. Interestingly, it is during the saturation of activations that the model converges, with deeper layers experiencing negligible information loss. Supported by experimental examples on physics-informed neural networks (PINNs), which highlight the critical role of gradient agreement due to their inherent PDE-based interdependence of samples, our findings suggest that when both sample-wise gradients and residuals are ordered, this leads to faster convergence and better generalization. Identifying phase transitions could improve deep learning optimization strategies, enhancing physics-informed methods and machine learning performance.

cs.LG↗

arXiv2026

Adjoint Method versus Physics-Informed Neural Networks in PDE-Constrained Inverse Problems

Inverse problems governed by partial differential equations (PDEs) are central to computational mechanics and are commonly solved by adjoint-based optimization, while physics-informed neural networks (PINNs) have emerged as a flexible alternative. Their relative performance remains difficult to assess because the two approaches are often compared under different formulations, parameterizations, optimizers, and regularization choices. We present a controlled comparison of adjoint optimization and PINNs for PDE-constrained inverse problems. From a common abstract formulation, we instantiate both methods on identical domains, governing equations, observation models, and regularization terms, while matching the optimizer, unknown parameterization, and arithmetic precision wherever applicable. The benchmarks include unsteady Burgers, noisy Darcy permeability inversion, three-dimensional Allen-Cahn reaction identification, and unsteady Navier-Stokes viscosity identification. The results show that the representation of the unknown largely determines the preferred method: grid-based fields favor the discrete adjoint, whereas neural representations are native to PINNs and relevant for closure and constitutive modeling. For time-dependent problems, adjoint inversion can be dominated by trajectory storage and differentiation, while PINNs provide satisfactory reconstructions at lower cost. A PINN-warm-started adjoint strategy then recovers adjoint-level accuracy at about half the cost.

math.NA↗

arXiv2026

Spectrally Safe Neural Operator Warm-Starts for Large-Scale Newton Solvers

Neural operators are increasingly used to warm-start Newton solvers for nonlinear PDEs, on the premise that a low test error places the initial guess inside the basin of attraction. We show that this premise is unreliable. An operator trained to the relative $L^2$ error $O(10^{-3})$ can still produce an initial state in which the discrete Jacobian is indefinite, because the mean-squared training controls error on average while leaving localized pointwise violations of the underlying physics. For a nearly incompressible hyperelasticity problem, we trace this to the predicted volume change: the operator disperses $\mathrm{det} F$ well away from one, and the resulting Jacobian acquires negative eigenvalues even when the predicted field is visually indistinguishable from the reference. At a small scale, this is a nuisance; at a multi-million degree-of-freedom scale, it is disqualifying, since the conjugate gradient and other Krylov solvers needed for memory-feasible Newton steps assume a definite spectrum. We then show that a short, label-free fine-tuning phase -- penalizing the operator against the discrete energy, with no additional solution data -- shifts the Jacobian spectrum back to positive definite. Combined with an inexact outer loop, this gives a warm-started Newton method that converges across the full loading range where the unregularized operator fails, reaching up to 5.4$\times$ wall-clock speedup over incremental continuation on a 3D problem with 6.4 million degrees of freedom.

math.NA↗

arXiv2026

Physics-Informed Laplace Neural Operator for Solving Partial Differential Equations

Neural operators have emerged as fast surrogate solvers for parametric partial differential equations (PDEs). However, purely data-driven models often require extensive training data and can generalize poorly, especially in small-data regimes and under unseen (out-of-distribution) input functions that are not represented in the training data. To address these limitations, we propose the Physics-Informed Laplace Neural Operator (PILNO), which enhances the Laplace Neural Operator (LNO) by embedding governing physics into training through PDE, boundary condition, and initial condition residuals. To improve expressivity, we first introduce an Advanced LNO (ALNO) backbone that retains a pole-residue transient representation while replacing the steady-state branch with an FNO-style Fourier multiplier. To make physics-informed training both data-efficient and robust, PILNO further leverages (i) virtual inputs: an unlabeled ensemble of input functions spanning a broad spectral range that provides abundant physics-only supervision and explicitly targets out-of-distribution (OOD) regimes; and (ii) temporal-causality weighting: a time-decaying reweighting of the physics residual that prioritizes early-time dynamics and stabilizes optimization for time-dependent PDEs. Across four representative benchmarks -- Burgers' equation, Darcy flow, a reaction-diffusion system, and a forced KdV equation -- PILNO consistently improves accuracy in small-data settings (e.g., N_train <= 27), reduces run-to-run variability across random seeds, and achieves stronger OOD generalization with respect to input function statistics than purely data-driven baselines.

cs.LG↗

arXiv2026

Fixed and Adaptive Topological DeepONets: Functional Measurements on Hausdorff Locally Convex Spaces

Deep Operator Networks (DeepONets; arXiv:1910.03193) typically encode an input function through point values on a fixed discretization. Building on the Topological DeepONet framework of Ismailov (arXiv:2603.11972), we replace point samples by continuous linear functionals drawn from the continuous dual of a Hausdorff locally convex space $({V},\{p_α\}_{α\in A})$, whose topology is generated by a point-separating family of seminorms rather than a single norm, and develop fixed and adaptive functional measurement systems. Measurements are combined with the coefficient-space Two-Step procedure of Lee and Shin (arXiv:2309.01020), while a training-only decoder and regularization stabilize the adaptive coordinates. We derive a discrete error decomposition separating measurement, output-basis, and neural-approximation errors, together with a Barron-rate refinement. The framework is evaluated on the antiderivative operator, a non-normable locally convex input space, heterogeneous Darcy flow, a controlled operator, and fixed-time and time-evolving Navier-Stokes vorticity operators. In the heterogeneous Darcy problem, the functional models retain nearly resolution-independent errors of 5.5-5.6% on unseen grids, while in the controlled problem adaptive measurements reduce the mean error below 1.2%. For the fixed-time Navier-Stokes problem, the Adaptive Topological DeepONet is the most accurate DeepONet-based model, attaining a mean relative $L^2$ error of 1.685% +/- 0.017% using 128 functional coordinates. A comparably sized Fourier neural operator (FNO; arXiv:2010.08895) achieves the lower error 0.832% +/- 0.172%, but requires the full 64x64 input field, twice the training time, and 10.7x greater peak GPU memory. The formulation provides compact, interpretable, and discretization-portable coordinates in the continuous dual $V'$, including for non-normable input spaces.

cs.LG↗

arXiv2026

Physics-informed Kolmogorov-Arnold networks (PIKANs) for noise-robust reconstruction of boiling heat flux from infrared measurements

Recovering a noise-amplified inverse quantity from corrupted boundary data is a recurring problem in physics-informed learning for real-world applications. Specifically, small perturbations in the measured field are magnified through the spatial derivatives needed to reconstruct the target, and hence conventional discretization solvers turn them into large unphysical oscillations. We study this problem through the reconstruction of local time-resolved nucleate-boiling heat flux, which cannot be measured directly and must be inferred from infrared surface temperatures by solving an unsteady three-dimensional heat-conduction problem with sharp and rapidly evolving liquid-vapor interface gradients. We show that neither network architecture nor optimizer alone overcomes the spectral bias that smooths away these interface-scale features, and that the two must be addressed jointly. Our approach combines a Chebyshev physics-informed Kolmogorov-Arnold network (PIKAN) backbone, a quasi-second-order (SOAP) optimizer, and a temperature-annealed residual-based resampling scheme that concentrates collocation points at high-residual interface regions. Trained directly on experimental infrared measurements imposed as a boundary condition, the network resolves high-frequency bubble signatures and the high-flux distribution tail much better than a Fourier-feature PINN of equal size and training budget. In particular, it selectively filters measurement noise while preserving the physically meaningful high-frequency features, suppressing the spurious oscillations that contaminate finite-volume reconstructions and yielding more physically consistent heat-flux estimates from noisy experimental data.

physics.comp-ph↗

arXiv2026

ATHENA: Agentic Team for Hierarchical Evolutionary Numerical Algorithms

Progress in computational science depends on complex numerical workflows that must faithfully encode physical laws, yet translating conceptual insight into reliable code remains a major bottleneck. Although large language models can generate isolated code fragments, they lack the structured reasoning required to design, verify, and iteratively refine complete scientific pipelines. Here we introduce ATHENA, an agentic framework explicitly designed to emulate scientific research modeled as a knowledge-driven contextual bandit process. Its core loop separates conceptual policy from numerical realization through expert-derived conceptual scaffolding, enabling principled diagnosis, reformulation, and repair of computational strategies. Across scientific computing and scientific machine learning tasks, ATHENA autonomously derives and correctly applies exact analytical solutions, constructs stable numerical solvers, diagnoses ill-posed formulations, and orchestrates hybrid symbolic-numeric workflows. Quantitatively, ATHENA matches and frequently surpasses the accuracy of expert-authored reference solutions reported in the literature on canonical benchmarks. By reframing computation as an object of agentic reasoning, our framework enables autonomous orchestration of heterogeneous algorithms across scientific domains.

cs.LG↗