arXiv subjects

Daniel Livescu

Publications and source records attributed to Daniel Livescu.

At least 19 recordsLinked to original sources

arXiv2026

A priori Assessment of Tensor-Network Encoding for Isotropic Turbulent Flows

Tensor networks (TNs), originally developed for simulating many-body quantum systems, provide a systematic framework for approximating high-dimensional fields. This is achieved by factorizing the field into interconnected tensors with small bond dimensions, thereby restricting the correlations captured across field bipartitions. Belonging to the family of TNs, the matrix product state (MPS) ansatz is utilized here as a reduced-order modeling framework to construct truncated representations of isotropic turbulent flow data. Two direct numerical simulation (DNS) datasets are considered: the hydrodynamic field of an incompressible three-dimensional flow, and a conserved Fickian scalar in a similar flow. Each field is encoded as an MPS through a sequence of singular value decompositions (SVDs) in which small singular values are discarded. The truncated representation is contracted back to the full grid, and the resulting reconstructed field is compared against DNS. An interleaved ordering of the spatial tensor indices of the transport variables is applied prior to decomposition in order to localize the dominant inter-tensor correlations. Velocity reconstructions achieve $99.8\%$ fidelity using only $5\%$ of the original DNS memory, while the scalar field reaches the same fidelity at $15\%$ memory usage. A wide range of lower- and higher-order statistics, including velocity gradients, dissipation, and structure functions, are systematically examined. At these compression levels, the total kinetic energy and the scalar energy are both recovered within $0.2\%$ relative error, while the mean dissipation and mean scalar dissipation remain within approximately $10\%$ of the DNS generated values. These findings support the suitability of MPS for scalable reduced-order analysis of complex turbulent datasets and motivate further exploration of TN-based methods in computational turbulence.

physics.flu-dyn↗

arXiv2026

Learning turbulent transport via Mori--Zwanzig graph neural networks

We introduce a Mori--Zwanzig graph neural network (MZ--GNN) framework for learning reduced-order Lagrangian dynamics of tracer particles in homogeneous isotropic turbulence. The model represents particle acceleration as a finite-memory expansion over present and delayed particle-neighborhood graphs, with each memory contribution parameterized by an equivariant message-passing graph neural network. By construction, the architecture respects the relevant physical symmetries of the problem, including permutation equivariance, Galilean invariance, and equivariance under rotations and reflections. Trained on direct numerical simulation data, the model is rolled out autoregressively and evaluated on observables that are not imposed during training. We show that memory is essential for recovering the intermittent, heavy-tailed acceleration statistics, and that the learned dynamics accurately reproduce single-particle dispersion, pair-dispersion statistics, and four-particle tetrad geometry. Our results establish a physically structured, scalable route to data-driven multi-particle simulation of turbulent transport, and a template for learning reduced dynamics of correlated, symmetry-rich particle systems.

physics.flu-dyn↗

arXiv2026

Trajectory-Optimized Time Reparameterization for Learning-Compatible Reduced-Order Modeling of Stiff Dynamical Systems

Stiff dynamical systems present a challenge for machine-learning reduced-order models (ML-ROMs), as explicit time integration becomes unstable in stiff regimes while implicit integration within learning loops is computationally expensive and often degrades training efficiency. Time reparameterization (TR) offers an alternative by transforming the independent variable so that rapid physical-time transients are spread over a stretched-time coordinate, enabling stable explicit integration on uniformly sampled grids. Although several TR strategies have been proposed, their effect on learnability in ML-ROMs remains incompletely understood. This work investigates time reparameterization as a stiffness-mitigation mechanism for neural ODE reduced-order modeling and introduces a trajectory-optimized TR (TOTR) formulation. The proposed approach casts time reparameterization as an optimization problem in arc-length coordinates, in which a traversal-speed profile is selected to penalize acceleration in stretched time. By targeting the smoothness of the training dynamics, this formulation produces reparameterized trajectories that are better conditioned and easier to learn than existing TR methods. TOTR is evaluated on three stiff problems: a parameterized stiff linear system, the van der Pol oscillator, and the HIRES chemical kinetics model. Across all cases, the proposed approach yields smoother reparameterizations and improved physical-time predictions under identical training regimens than other TR approaches. Quantitative results demonstrate loss reductions of one to two orders of magnitude compared to benchmark algorithms. These results highlight that effective stiffness mitigation in ML-ROMs depends critically on the regularity and learnability of the time map itself, and that optimization-based TR provides a robust framework for explicit reduced-order modeling of multiscale dynamical systems.

cs.LG↗

arXiv2025

Flow-driven hysteresis in the transition boiling regime

Transition boiling is an intermediate regime occurring between nucleate boiling, where bubbles at the surface efficiently carry heat away, and film boiling, where a layer of vapor formed over the surface insulates the system reducing heat transfer. This regime is inherently unstable and typically occurs near the boiling crisis, where the system approaches the maximum heat flux. Transition boiling hysteresis remains a central open problem in phase-change heat transfer, with critical implications for industrial cooling systems and nuclear reactor safety, since entering this regime sharply reduces heat removal potentially leading to overheating or component damage. We investigate the mechanisms driving hysteresis in the transition boiling regime through large-scale three-dimensional numerical simulations, providing clearcut evidence that hysteresis occurs even under idealized conditions of pool boiling on flat surfaces at constant temperature. This demonstrates that hysteresis arises purely from the flow dynamics of the liquid-vapor system, rather than from surface properties or defects. Moreover, we disclose strong asymmetries in the transition dynamics between nucleate and film boiling. During heating, the transition is abrupt and memory-less, whereas, upon decreasing the surface temperature, it is more complex, with the emergence of metastable coexisting states that can delay the transition.

physics.flu-dyn↗

arXiv2025

Data-driven Mori-Zwanzig modeling of Lagrangian particle dynamics in turbulent flows

The dynamics of Lagrangian particles in turbulence play a crucial role in mixing, transport, and dispersion in complex flows. Their trajectories exhibit highly non-trivial statistical behavior, motivating the development of surrogate models that can reproduce these trajectories without incurring the high computational cost of direct numerical simulations of the full Eulerian field. This task is particularly challenging because reduced-order models typically lack access to the full set of interactions with the underlying turbulent field. Novel data-driven machine learning techniques can be powerful in capturing and reproducing complex statistics of the reduced-order/surrogate dynamics. In this work, we show how one can learn a surrogate dynamical system that is able to evolve a turbulent Lagrangian trajectory in a way that is point-wise accurate for short-time predictions (with respect to Kolmogorov time) and stable and statistically accurate at long times. This approach is based on the Mori-Zwanzig formalism, which prescribes a mathematical decomposition of the full dynamical system into resolved dynamics that depend on the current state and the past history of a reduced set of observables, and the unresolved orthogonal dynamics due to unresolved degrees of freedom of the initial state. We show how by training this reduced order model on a point-wise error metric on short time-prediction, we are able to correctly learn the dynamics of Lagrangian turbulence, such that also the long-time statistical behavior is stably recovered at test time. This opens up a range of new applications, for example, for the control of active Lagrangian agents in turbulence.

physics.flu-dyn↗

arXiv2025

Skeletal Reaction Models for Gasoline Surrogate Combustion

Skeletal reaction models are derived for a four-component gasoline surrogate model via an instantaneous local sensitivity analysis technique. The sensitivities of the species mass fractions and the temperature with respect to the reaction rates are estimated by a reduced-order modeling (ROM) methodology. Termed "implicit time-dependent basis CUR (implicit TDB-CUR)," this methodology is based on the CUR matrix decomposition and incorporates implicit time integration for evolving the bases. The estimated sensitivities are subsequently analyzed to develop skeletal reaction models with a fully automated procedure. The 1389-species gasoline surrogate model developed at Lawrence Livermore National Laboratory (LLNL) is selected as the detailed kinetics model. The skeletal reduction procedure is applied to this model in a zero-dimensional constant-pressure reactor over a wide range of initial conditions. The performances of the resulting skeletal models are appraised by comparison against the results via the LLNL detailed model, and also predictions via other skeletal models. Two new skeletal models are developed consisting of 679 and 494 species, respectively. The first is an alternative to an existing model with the same number of species. The predictions with this model reproduces the detailed models vital flame results with less than 1% errors. The errors via the second model are less than 10%.

cs.CE↗

arXiv2025

Lagrangian Attention Tensor Networks for Velocity Gradient Statistical Modeling

Direct numerical simulation of turbulence at realistic Reynolds numbers is still beyond current computational capability, necessitating models that reduce the number of resolved spatial scales. Motivated by phenomenology and recent data-driven works based on universality of the smallest scales in fully developed turbulence, the statistical dynamics of the velocity gradient tensor (VGT) at the Kolmogorov scale become of critical importance in advancing turbulence models. Physics-informed machine learning has found considerable success in exploiting large datasets taken from direct numerical simulation of Navier-Stokes to improve models for the evolution of the VGT. In this work, we follow the long line of blending physical insight with data analysis to simultaneously advance both the modeling and understanding of the phenomenology of the VGT. Using the intimate connection between VGT evolution and fluid deformation, we develop the Lagrangian attention tensor network approach that significantly improves over current physics-informed machine learning methods. We demonstrate state-of-the-art performance in both a-priori and a-posteriori metrics, before interpreting the trained attention mechanisms to discover a surprising connection between the history of the strain-rate-tensor and the pressure Hessian.

physics.flu-dyn↗

arXiv2025

Multidisciplinary Science in the Multimessenger Era

Astrophysical observations of the cosmos allow us to probe extreme physics and answer foundational questions on our universe. Modern astronomy is increasingly operating under a holistic approach, probing the same question with multiple diagnostics including how sources vary over time, how they appear across the electromagnetic spectrum, and through their other signatures, including gravitational waves, neutrinos, cosmic rays, and dust on Earth. Astrophysical observations are now reaching the point where approximate physics models are insufficient. Key sources of interest are explosive transients, whose understanding requires multidisciplinary studies at the intersection of astrophysics, gravity, nuclear science, plasma physics, fluid dynamics and turbulence, computation, particle physics, atomic, molecular, and optical science, condensed matter and materials science, radiation transport, and high energy density physics. This white paper provides an overview of the major scientific advances that lay at the intersection of physics and astronomy and are best probed through time-domain and multimessenger astrophysics, an exploration of how multidisciplinary science can be fostered, and introductory descriptions of the relevant scientific disciplines and key astrophysical sources of interest.

astro-ph.HE↗

arXiv2024

Physics-constrained coupled neural differential equations for one dimensional blood flow modeling

Computational cardiovascular flow modeling plays a crucial role in understanding blood flow dynamics. While 3D models provide acute details, they are computationally expensive, especially with fluid-structure interaction (FSI) simulations. 1D models offer a computationally efficient alternative, by simplifying the 3D Navier-Stokes equations through axisymmetric flow assumption and cross-sectional averaging. However, traditional 1D models based on finite element methods (FEM) often lack accuracy compared to 3D averaged solutions. This study introduces a novel physics-constrained machine learning technique that enhances the accuracy of 1D blood flow models while maintaining computational efficiency. Our approach, utilizing a physics-constrained coupled neural differential equation (PCNDE) framework, demonstrates superior performance compared to conventional FEM-based 1D models across a wide range of inlet boundary condition waveforms and stenosis blockage ratios. A key innovation lies in the spatial formulation of the momentum conservation equation, departing from the traditional temporal approach and capitalizing on the inherent temporal periodicity of blood flow. This spatial neural differential equation formulation switches space and time and overcomes issues related to coupling stability and smoothness, while simplifying boundary condition implementation. The model accurately captures flow rate, area, and pressure variations for unseen waveforms and geometries. We evaluate the model's robustness to input noise and explore the loss landscapes associated with the inclusion of different physics terms. This advanced 1D modeling technique offers promising potential for rapid cardiovascular simulations, achieving computational efficiency and accuracy. By combining the strengths of physics-based and data-driven modeling, this approach enables fast and accurate cardiovascular simulations.

physics.flu-dyn↗

arXiv2024

Probabilistic Flux Limiters

The stable numerical integration of shocks in compressible flow simulations relies on the reduction or elimination of Gibbs phenomena (unstable, spurious oscillations). A popular method to virtually eliminate Gibbs oscillations caused by numerical discretization in under-resolved simulations is to use a flux limiter. A wide range of flux limiters has been studied in the literature, with recent interest in their optimization via machine learning methods trained on high-resolution datasets. The common use of flux limiters in numerical codes as plug-and-play blackbox components makes them key targets for design improvement. Moreover, while aleatoric (inherent randomness) and epistemic (lack of knowledge) uncertainty is commonplace in fluid dynamical systems, these effects are generally ignored in the design of flux limiters. Even for deterministic dynamical models, numerical uncertainty is introduced via coarse-graining required by insufficient computational power to solve all scales of motion. Here, we introduce a conceptually distinct type of flux limiter that is designed to handle the effects of randomness in the model and uncertainty in model parameters. This new, {\it probabilistic flux limiter}, learned with high-resolution data, consists of a set of flux limiting functions with associated probabilities, which define the frequencies of selection for their use. Using the example of Burgers' equation, we show that a machine learned, probabilistic flux limiter may be used in a shock capturing code to more accurately capture shock profiles. In particular, we show that our probabilistic flux limiter outperforms standard limiters, and can be successively improved upon (up to a point) by expanding the set of probabilistically chosen flux limiting functions.

physics.flu-dyn↗

arXiv2024

On a spectral method for $\beta$-particle bound excitation collisions in kilonovae

The interaction of $\beta$-particles with the weakly ionized plasma background is an important mechanism for powering the kilonova transient signal from neutron star mergers. For this purpose, we present an implementation of the approximate fast-particle collision kernel, described by Inokuti (1971) following the seminal formulation of Bethe (1930), in a spectral solver of the Vlasov-Maxwell-Boltzmann equations. In particular, we expand the fast-particle plane-wave atomic excitation kernel into coefficients of the Hermite basis, and derive the relevant discrete spectral system. In this fast-particle limit, the approach permits the direct use of atomic data, including optical oscillator strengths, normally applied to photon-matter interaction. The resulting spectral matrix is implemented in the MASS-APP spectral solver framework, in a way that avoids full matrix storage per spatial zone. We numerically verify aspects of the matrix construction, and present a proof-of-principle 3D simulation of a 2D axisymmetric kilonova ejecta snapshot. Our preliminary numerical results indicate that a reasonable choice of Hermite basis parameters for $\beta$-particles in the kilonova are a bulk velocity parameter $\vec{u}=0$, a thermal velocity parameter $\vec{\alpha}=0.5c$, and a 9x9x9 mode velocity basis set (Hermite orders 0 to 8 in each dimension). For ejecta-interior sample zones, we estimate the ratio of thermalization from large-angle ($\gtrsim2.5^{\circ}$) bound excitation scattering to total thermalization is $\sim$0.002-0.003.

astro-ph.HE↗

arXiv2023

Mori-Zwanzig mode decomposition: Comparison with time-delay embeddings

We introduce the Mori-Zwanzig Mode Decomposition (MZMD), a novel data-driven technique for efficient modal analysis of and reduced-order modeling of large-scale spatio-temporal dynamical systems. MZMD represents an extension of Dynamic Mode Decomposition (DMD) by providing an approximate closure term with MZ memory kernels accounting for how the unresolved modes of DMD interact with the resolved modes, thus addressing limitations when the state-space observables do not form a Koopman-invariant subspace. Leveraging the Mori-Zwanzig (MZ) formalism, MZMD identifies the modes and spectrum of the discrete-time Generalized Langevin Equation (GLE); an integro-differential equation that governs the dynamics of selected observables and their memory-dependent coupling with the unresolved degrees of freedom. This feature fundamentally distinguishes MZMD from time-delay embedding methods, such as Higher-Order DMD (HODMD). In this work, we derive and analyze MZMD and compare it with DMD and HODMD, using two exemplary Direct Numerical Simulation (DNS) datasets: a 2D flow over a cylinder (as validation) and laminar-turbulent boundary-layer transition over a flared cone at Mach 6. We demonstrate that MZMD, via the addition of MZ memory terms, improves the resolution of spatio-temporal structures within the transitional/turbulent regime by the introduction of transient and periodic modes (not captured by DMD), which contain features that arise due to nonlinear mechanisms, such as the generation of the so-called hot streaks on the surface of the flared cone. Our results demonstrate that MZMD serves as an efficient generalization of DMD (reducing to DMD in the absence of memory), improves stability, and exhibits greater robustness and resistance to overfitting compared to HODMD.

physics.flu-dyn↗

arXiv2023

Data-Driven Mori-Zwanzig: Reduced Order Modeling of Sparse Sensors Measurements for Boundary Layer Transition

Understanding, predicting and controlling laminar-turbulent boundary-layer transition is crucial for the next generation aircraft design. However, in real flight experiments, or wind tunnel tests, often only sparse sensor measurements can be collected at fixed locations. Thus, in developing reduced models for predicting and controlling the flow at the sensor locations, the main challenge is in accounting for how the surrounding field of unobserved variables interacts with the observed variables at the fixed sensor locations. This makes the Mori-Zwanzig (MZ) formalism a natural choice, as it results in the Generalized Langevin Equations which provides a framework for constructing non-Markovian reduced-order models that includes the effects the unresolved variables have on the resolved variables. These effects are captured in the so called memory kernel and orthogonal dynamics. In this work, we explore the data-driven MZ formulations to two boundary layer flows obtained from DNS data; a low speed incompressible flow; and a high speed compressible flow over a flared cone at Mach 6. An array of "sensors" are placed near the surface of the solid boundary, and the MZ operators are learned and the predictions are compared to the Extended Dynamic Mode Decomposition (EDMD), both using delay embedded coordinates. Further comparisons are made with Long Short-Term Memory (LSTM) and a regression based projection framework using neural networks for the MZ operators. First we compare the effects of including delay embedded coordinates with EDMD and Mori based MZ and provide evidence that using both memory and delay embedded coordinates minimizes generalization errors on the relevant time scales. Next, we provide numerical evidence that the data-driven regression based projection MZ model performs best with respect to the prediction accuracy (minimum generalization error) on the relevant time scales.

physics.flu-dyn↗

arXiv2023

Full trajectory optimizing operator inference for reduced-order modeling using differentiable programming

Accurate and inexpensive Reduced Order Models (ROMs) for forecasting turbulent flows can facilitate rapid design iterations and thus prove critical for predictive control in engineering problems. Galerkin projection based Reduced Order Models (GP-ROMs), derived by projecting the Navier-Stokes equations on a truncated Proper Orthogonal Decomposition (POD) basis, are popular because of their low computational costs and theoretical foundations. However, the accuracy of traditional GP-ROMs degrades over long time prediction horizons. To address this issue, we extend the recently proposed Neural Galerkin Projection (NeuralGP) data driven framework to compressibility-dominated transonic flow, considering a prototypical problem of a buffeting NACA0012 airfoil governed by the full Navier-Stokes equations. The algorithm maintains the form of the ROM-ODE obtained from the Galerkin projection; however coefficients are learned directly from the data using gradient descent facilitated by differentiable programming. This blends the strengths of the physics driven GP-ROM and purely data driven neural network-based techniques, resulting in a computationally cheaper model that is easier to interpret. We show that the NeuralGP method minimizes a more rigorous full trajectory error norm compared to a linearized error definition optimized by the calibration procedure. We also find that while both procedures stabilize the ROM by displacing the eigenvalues of the linear dynamics matrix of the ROM-ODE to the complex left half-plane, the NeuralGP algorithm adds more dissipation to the trailing POD modes resulting in its better long-term performance. The results presented highlight the superior accuracy of the NeuralGP technique compared to the traditional calibrated GP-ROM method.

physics.flu-dyn↗

arXiv2023

Data-Driven Mori-Zwanzig: Approaching a Reduced Order Model for Hypersonic Boundary Layer Transition

In this work, we apply, for the first time to spatially inhomogeneous flows, a recently developed data-driven learning algorithm of Mori-Zwanzig (MZ) operators, which is based on a generalized Koopman's description of dynamical systems. The MZ formalism provides a mathematically exact procedure for constructing non-Markovian reduced-order models of resolved variables from high-dimensional dynamical systems, where the effects due to the unresolved dynamics are captured in the memory kernel and orthogonal dynamics. The algorithm developed in this work applies Mori's linear projection operator and an SVD based compression to the selection of the resolved variables (equivalently, a low rank approximation of the two time covariance matrices). We show that this MZ decomposition not only identifies the same spatio-temporal structures found by DMD, but it can also be used to extract spatio-temporal structures of the hysteresis effects present in the memory kernels. We perform an analysis of these structures in the context of a laminar-turbulent boundary-layer transition flow over a flared cone at Mach 6, and show the dynamical relevance of the memory kernels. Additionally, by including these memory terms learned in our data-driven MZ approach, we show improvement in prediction accuracy over DMD at the same level of truncation and at a similar computational cost. Furthermore, an analysis of the spatio-temporal structures of the MZ operators shows identifiable structures associated with the nonlinear generation of the so-called "hot" streaks on the surface of the flared code, which have previously been observed in experiments and direct numerical simulations.

physics.flu-dyn↗

arXiv2022

Towards learning Lattice Boltzmann collision operators

In this work we explore the possibility of learning from data collision operators for the Lattice Boltzmann Method using a deep learning approach. We compare a hierarchy of designs of the neural network (NN) collision operator and evaluate the performance of the resulting LBM method in reproducing time dynamics of several canonical flows. In the current study, as a first attempt to address the learning problem, the data was generated by a single relaxation time BGK operator. We demonstrate that vanilla NN architecture has very limited accuracy. On the other hand, by embedding physical properties, such as conservation laws and symmetries, it is possible to dramatically increase the accuracy by several orders of magnitude and correctly reproduce the short and long time dynamics of standard fluid flows.

physics.comp-ph↗

arXiv2022

Physics-Constrained Generative Adversarial Networks for 3D Turbulence

Generative Adversarial Networks (GANs) have received wide acclaim among the machine learning (ML) community for their ability to generate realistic 2D images. ML is being applied more often to complex problems beyond those of computer vision. However, current frameworks often serve as black boxes and lack physics embeddings, leading to poor ability in enforcing constraints and unreliable models. In this work, we develop physics embeddings that can be stringently imposed, referred to as hard constraints, in the neural network architecture. We demonstrate their capability for 3D turbulence by embedding them in GANs, particularly to enforce the mass conservation constraint in incompressible fluid turbulence. In doing so, we also explore and contrast the effects of other methods of imposing physics constraints within the GANs framework, especially penalty-based physics constraints popular in literature. By using physics-informed diagnostics and statistics, we evaluate the strengths and weaknesses of our approach and demonstrate its feasibility.

physics.comp-ph↗

arXiv2022

An adaptive wavelet method for nonlinear partial differential equations with applications to dynamic damage modeling

Multiscale and multiphysics problems need novel numerical methods in order for them to be solved correctly and predictively. To that end, we develop a wavelet based technique to solve a coupled system of nonlinear partial differential equations (PDEs) while resolving features on a wide range of spatial and temporal scales. The algorithm exploits the multiresolution nature of wavelet basis functions to solve initial-boundary value problems on finite domains with a sparse multiresolution spatial discretization. By leveraging wavelet theory and embedding a predictor-corrector procedure within the time advancement loop, we dynamically adapt the computational grid and maintain accuracy of the solutions of the PDEs as they evolve. Consequently, our method provides high fidelity simulations with significant data compression. We present verification of the algorithm and demonstrate its capabilities by modeling high-strain rate damage nucleation and propagation in nonlinear solids using a novel Eulerian-Lagrangian continuum framework.

math.NA↗