arXiv subjects

Daniel Livescu

Publications and source records attributed to Daniel Livescu.

At least 37 records · Page 2Linked to original sources

arXiv2022

Towards learning Lattice Boltzmann collision operators

In this work we explore the possibility of learning from data collision operators for the Lattice Boltzmann Method using a deep learning approach. We compare a hierarchy of designs of the neural network (NN) collision operator and evaluate the performance of the resulting LBM method in reproducing time dynamics of several canonical flows. In the current study, as a first attempt to address the learning problem, the data was generated by a single relaxation time BGK operator. We demonstrate that vanilla NN architecture has very limited accuracy. On the other hand, by embedding physical properties, such as conservation laws and symmetries, it is possible to dramatically increase the accuracy by several orders of magnitude and correctly reproduce the short and long time dynamics of standard fluid flows.

physics.comp-ph↗

arXiv2022

Physics-Constrained Generative Adversarial Networks for 3D Turbulence

Generative Adversarial Networks (GANs) have received wide acclaim among the machine learning (ML) community for their ability to generate realistic 2D images. ML is being applied more often to complex problems beyond those of computer vision. However, current frameworks often serve as black boxes and lack physics embeddings, leading to poor ability in enforcing constraints and unreliable models. In this work, we develop physics embeddings that can be stringently imposed, referred to as hard constraints, in the neural network architecture. We demonstrate their capability for 3D turbulence by embedding them in GANs, particularly to enforce the mass conservation constraint in incompressible fluid turbulence. In doing so, we also explore and contrast the effects of other methods of imposing physics constraints within the GANs framework, especially penalty-based physics constraints popular in literature. By using physics-informed diagnostics and statistics, we evaluate the strengths and weaknesses of our approach and demonstrate its feasibility.

physics.comp-ph↗

arXiv2022

An adaptive wavelet method for nonlinear partial differential equations with applications to dynamic damage modeling

Multiscale and multiphysics problems need novel numerical methods in order for them to be solved correctly and predictively. To that end, we develop a wavelet based technique to solve a coupled system of nonlinear partial differential equations (PDEs) while resolving features on a wide range of spatial and temporal scales. The algorithm exploits the multiresolution nature of wavelet basis functions to solve initial-boundary value problems on finite domains with a sparse multiresolution spatial discretization. By leveraging wavelet theory and embedding a predictor-corrector procedure within the time advancement loop, we dynamically adapt the computational grid and maintain accuracy of the solutions of the PDEs as they evolve. Consequently, our method provides high fidelity simulations with significant data compression. We present verification of the algorithm and demonstrate its capabilities by modeling high-strain rate damage nucleation and propagation in nonlinear solids using a novel Eulerian-Lagrangian continuum framework.

math.NA↗

arXiv2022

Predictive Scale-Bridging Simulations through Active Learning

Throughout computational science, there is a growing need to utilize the continual improvements in raw computational horsepower to achieve greater physical fidelity through scale-bridging over brute-force increases in the number of mesh elements. For instance, quantitative predictions of transport in nanoporous media, critical to hydrocarbon extraction from tight shale formations, are impossible without accounting for molecular-level interactions. Similarly, inertial confinement fusion simulations rely on numerical diffusion to simulate molecular effects such as non-local transport and mixing without truly accounting for molecular interactions. With these two disparate applications in mind, we develop a novel capability which uses an active learning approach to optimize the use of local fine-scale simulations for informing coarse-scale hydrodynamics. Our approach addresses three challenges: forecasting continuum coarse-scale trajectory to speculatively execute new fine-scale molecular dynamics calculations, dynamically updating coarse-scale from fine-scale calculations, and quantifying uncertainty in neural network models.

cs.LG↗

arXiv2022

Lagrangian Large Eddy Simulations via Physics Informed Machine Learning

High Reynolds Homogeneous Isotropic Turbulence is fully described within the Navier-Stokes (NS) equations, which are notoriously difficult to solve numerically. Engineers, interested primarily in describing turbulence at a reduced range of resolved scales, have designed heuristics, known as Large Eddy Simulation (LES). LES is described in terms of the temporally evolving Eulerian velocity field defined over a spatial grid with the mean-spacing correspondent to the resolved scale. This classic Eulerian LES depends on assumptions about effects of sub-grid scales on the resolved scales. Here, we take an alternative approach and design novel LES heuristics stated in terms of Lagrangian particles moving with the flow. Our Lagrangian LES, thus L-LES, is described by equations generalizing the weakly compressible Smoothed Particle Hydrodynamics formulation with extended parametric and functional freedom, which is then resolved via Machine Learning training on Lagrangian data from Direct Numerical Simulations of the NS equations. The L-LES model includes physics-informed parameterization and functional form, by combining physics-based parameters and physics-inspired Neural Networks to describe the evolution of turbulence within the resolved range of scales. The sub-grid scale contributions are modeled separately with physical constraints to account for the effects from un-resolved scales. We build the resulting model under the Differentiable Programming framework to facilitate efficient training. We experiment with loss functions of different types, including physics-informed ones accounting for statistics of Lagrangian particles. We show that our Lagrangian LES model is capable of reproducing Eulerian and unique Lagrangian turbulence structures and statistics over a range of turbulent Mach numbers.

physics.flu-dyn↗

arXiv2022

Analysis of second-moments and their budgets for Richtmyer-Meshkov instability and variable-density turbulence induced by re-shock

Nonlinear Richtmyer--Meshkov instability and mixing transition induced by a Mach 1.45 shock and subsequent re-shock at an interface between two ideal gases (sulfur hexafluoride and air) with high Atwood number are studied with second-moment analysis using data from high-resolution compressible Navier--Stokes simulations. The analysis first addresses the importance of two second-order moments: turbulent mass flux and density-specific-volume covariance, together with their transport equations. These quantities play an essential role in the development of Favre-averaged Reynolds stress and turbulent kinetic energy in this variable-density flow. Then, grid sensitivities and the time evolution of the turbulent quantities which include the second-moments are investigated, followed by a detailed study of the transport equations for the second-moments including the Reynolds stress and the turbulent kinetic energy with well-resolved data before re-shock. After re-shock, budgets of the same but large-scale turbulent quantities are studied with the effects of the subfilter-scale stress taken into account. The budgets of these large-scale quantities are shown to have an insignificant influence from the numerical regularization. Finally, the effects of the subfilter-scale stress on the budgets of the large-scale turbulent quantities with different degrees of filtering are also examined.

physics.flu-dyn↗

arXiv2021

Data Driven Learning of Mori-Zwanzig Operators for Isotropic Turbulence

Developing reduced-order models for turbulent flows, which contain dynamics over a wide range of scales, is an extremely challenging problem. In statistical mechanics, the Mori-Zwanzig (MZ) formalism provides a mathematically formal procedure for constructing reduced-order representations of high-dimensional dynamical systems, where the effect due to the unresolved dynamics are captured in the memory kernel and orthogonal dynamics. Turbulence models based on MZ formalism have been scarce due to the limited knowledge of the MZ operators, which originates from the difficulty in deriving MZ kernels for complex nonlinear dynamical systems. In this work, we apply a recently developed data-driven learning algorithm, which is based on Koopman's description of dynamical systems and Mori's linear projection operator, on a set of fully-resolved isotropic turbulence datasets to extract the Mori-Zwanzig operators. With data augmentation using known turbulence symmetries, the extracted Markov term, memory kernel, and orthogonal dynamics are statistically converged and the Generalized Fluctuation-Dissipation Relation can be verified. The properties of the memory kernel and orthogonal dynamics, and their dependence on the choices of observables are investigated to address the modeling assumptions that are commonly used in MZ-based models. A series of numerical experiments are then constructed using the extracted kernels to evaluate the memory effects on predictions. Results show that the prediction errors are strongly affected by the choice of observables and can be further reduced by including the past history of the observables in the memory kernel.

physics.flu-dyn↗

arXiv2021

Physics-Informed Machine Learning of the Lagrangian Dynamics of Velocity Gradient Tensor

Reduced models describing the Lagrangian dynamics of the Velocity Gradient Tensor (VGT) in Homogeneous Isotropic Turbulence (HIT) are developed under the Physics-Informed Machine Learning (PIML) framework. We consider VGT at both Kolmogorov scale and coarse-grained scale within the inertial range of HIT. Building reduced models requires resolving the pressure Hessian and sub-filter contributions, which is accomplished by constructing them using the integrity bases and invariants of VGT. The developed models can be expressed using the extended Tensor Basis Neural Network (TBNN). Physical constraints, such as Galilean invariance, rotational invariance, and incompressibility condition, are thus embedded in the models explicitly. Our PIML models are trained on the Lagrangian data from a high-Reynolds number Direct Numerical Simulation (DNS). To validate the results, we perform a comprehensive out-of-sample test. We observe that the PIML model provides an improved representation for the magnitude and orientation of the small-scale pressure Hessian contributions. Statistics of the flow, as indicated by the joint PDF of second and third invariants of the VGT, show good agreement with the "ground-truth" DNS data. A number of other important features describing the structure of HIT are reproduced by the model successfully. We have also identified challenges in modeling inertial range dynamics, which indicates that a richer modeling strategy is required. This helps us identify important directions for future research, in particular towards including inertial range geometry into TBNN.

physics.flu-dyn↗

arXiv2021

Data-driven learning for the Mori-Zwanzig formalism: a generalization of the Koopman learning framework

A theoretical framework which unifies the conventional Mori-Zwanzig formalism and the approximate Koopman learning is presented. In this framework, the Mori-Zwanzig formalism, developed in statistical mechanics to tackle the hard problem of construction of reduced-order dynamics for high-dimensional dynamical systems, can be considered as a natural generalization of the Koopman description of the dynamical system. We next show that similar to the approximate Koopman learning methods, data-driven methods can be developed for the Mori-Zwanzig formalism with Mori's linear projection operator. We developed two algorithms to extract the key operators, the Markov and the memory kernel, using time series of a reduced set of observables in a dynamical system. We adopted the Lorenz `96 system as a test problem and solved for the operators, which exhibit complex behaviors which are unlikely to be captured by traditional modeling approaches, in Mori-Zwanzig analysis. The nontrivial Generalized Fluctuation Dissipation relationship, which relates the memory kernel with the two-time correlation statistics of the orthogonal dynamics, was numerically verified as a validation of the solved operators. We present numerical evidence that the Generalized Langevin Equation, a key construct in the Mori-Zwanzig formalism, is more advantageous in predicting the evolution of the reduced set of observables than the conventional approximate Koopman operators.

cond-mat.stat-mech↗

arXiv2021

Learning Stable Galerkin Models of Turbulence with Differentiable Programming

Turbulent flow control has numerous applications and building reduced-order models (ROMs) of the flow and the associated feedback control laws is extremely challenging. Despite the complexity of building data-driven ROMs for turbulence, the superior representational capacity of deep neural networks has demonstrated considerable success in learning ROMs. Nevertheless, these strategies are typically devoid of physical foundations and often lack interpretability. Conversely, the Proper Orthogonal Decomposition (POD) based Galerkin projection (GP) approach for ROM has been popular in many problems owing to its theoretically consistent and explainable physical foundations. However, a key limitation is that the ordinary differential equations (ODEs) arising from GP ROMs are highly susceptible to instabilities due to truncation of POD modes and lead to deterioration in temporal predictions. In this work, we propose a \textit{differentiable programming} approach that blends the strengths of both these strategies, by embedding neural networks explicitly into the GP ODE structure, termed Neural Galerkin projection. We demonstrate this approach on the isentropic Navier-Stokes equations for compressible flow over a cavity at a moderate Mach number. When provided the structure of the projected equations, we show that the Neural Galerkin approach implicitly learns stable ODE coefficients from POD coefficients and demonstrates significantly longer and accurate time horizon predictions, when compared to the classical POD-GP assisted by calibration. We observe that the key benefits of this differentiable programming-based approach include increased flexibility in physics-based learning, very low computational costs, and a significant increase in interpretability, when compared to purely data-driven neural networks.

physics.flu-dyn↗

arXiv2021

Objective discovery of dominant dynamical processes with intelligible machine learning

The advent of big data has vast potential for discovery in natural phenomena ranging from climate science to medicine, but overwhelming complexity stymies insight. Existing theory is often not able to succinctly describe salient phenomena, and progress has largely relied on ad hoc definitions of dynamical regimes to guide and focus exploration. We present a formal definition in which the identification of dynamical regimes is formulated as an optimization problem, and we propose an intelligible objective function. Furthermore, we propose an unsupervised learning framework which eliminates the need for a priori knowledge and ad hoc definitions; instead, the user need only choose appropriate clustering and dimensionality reduction algorithms, and this choice can be guided using our proposed objective function. We illustrate its applicability with example problems drawn from ocean dynamics, tumor angiogenesis, and turbulent boundary layers. Our method is a step towards unbiased data exploration that allows serendipitous discovery within dynamical systems, with the potential to propel the physical sciences forward.

cs.LG↗

arXiv2021

A multiresolution adaptive wavelet method for nonlinear partial differential equations

The multiscale complexity of modern problems in computational science and engineering can prohibit the use of traditional numerical methods in multi-dimensional simulations. Therefore, novel algorithms are required in these situations to solve partial differential equations (PDEs) with features evolving on a wide range of spatial and temporal scales. To meet these challenges, we present a multiresolution wavelet algorithm to solve PDEs with significant data compression and explicit error control. We discretize in space by projecting fields and spatial derivative operators onto wavelet basis functions. We provide error estimates for the wavelet representation of fields and their derivatives. Then, our estimates are used to construct a sparse multiresolution discretization which guarantees the prescribed accuracy. Additionally, we embed a predictor-corrector procedure within the temporal integration to dynamically adapt the computational grid and maintain the accuracy of the solution of the PDE as it evolves. We present examples to highlight the accuracy and adaptivity of our approach.

math.NA↗

arXiv2020

Interpreting neural network models of residual scalar flux

We show that in addition to providing effective and competitive closures, when analysed in terms of dynamics and physically-relevant diagnostics, artificial neural networks (ANNs) can be both interpretable and provide useful insights in the on-going task of developing and improving turbulence closures. In the context of large-eddy simulations (LES) of a passive scalar in homogeneous isotropic turbulence, exact subfilter fluxes obtained by filtering direct numerical simulations (DNS) are used both to train deep ANN models as a function of filtered variables, and to optimise the coefficients of a turbulent Prandtl number LES closure. \textit{A-priori} analysis of the subfilter scalar variance transfer rate demonstrates that learnt ANN models out-perform optimised turbulent Prandtl number closures and Clark-type gradient models. Next, \textit{a-posteriori} solutions are obtained with each model over several integral timescales. These experiments reveal, with single- and multi-point diagnostics, that ANN models temporally track exact resolved scalar variance with greater accuracy compared to other subfilter flux models for a given filter length scale. Finally, we interpret the artificial neural networks statistically with differential sensitivity analysis to show that the ANN models feature dynamics reminiscent of so-called "mixed models", where mixed models are understood as comprising both a structural and functional component. Besides enabling enhanced-accuracy LES of passive scalars henceforth, we anticipate this work to contribute to utilising neural network models as a tool in interpretability, robustness and model discovery.

physics.comp-ph↗

arXiv2020

Variable-density effects in incompressible non-buoyant shear-driven turbulent mixing layers

The asymmetries that arise when a mixing layer involves two miscible fluids of differing densities are investigated using incompressible (low-speed) direct numerical simulations. The simulations are performed in the temporal configuration with very large domain sizes, to allow the mixing layers to reach prolonged states of fully-turbulent self-similar growth. Imposing a mean density variation breaks the mean symmetry relative to the classical single-fluid temporal mixing layer problem. Unlike prior variable-density mixing layer simulations in which the streams are composed of the same fluids with dissimilar thermodynamic properties, the density variations are presently due to compositional differences between the fluid streams, leading to different mixing dynamics. Variable-density (non-Boussinesq) effects introduce strong asymmetries in the flow statistics that can be explained by the strongest turbulence increasingly migrating to the lighter fluid side as free stream density difference increases. Interface thickness growth rates also reduce, with some thickness definitions particularly sensitive to the corresponding changes in alignment between density and streamwise velocity profiles. Additional asymmetries in the sense of statistical distributions of densities at a given position within the mixing layer reveal that fine scales of turbulence are preferentially sustained in lighter fluid, which also is where fastest mixing occurs. These effects influence statistics involving density fluctuations, which have important implications for mixing and more complicated phenomena that are sensitive to the mixing dynamics, such as combustion.

physics.flu-dyn↗

arXiv2020

Variable-density buoyancy-driven turbulence with asymmetric initial density distribution

The effects of different initial density distributions on the evolution of buoyancy-driven homogeneous variable-density turbulence (HVDT) at low (0.05) and high (0.75) Atwood numbers are studied by using high-resolution direct numerical simulations. HVDT aims to mimic the acceleration-driven Rayleigh-Taylor and shock-driven Richtmyer-Meshkov instabilities and reveals new physics that arise from variable-density effects on the turbulent mixing. Here, the initial amounts of pure light and pure heavy flows are altered primarily to mimic the variable-density turbulence at the different locations of the Rayleigh-Taylor and Richtmyer-Meshkov instabilities' mixing layers where the amounts of the mixing fluids are not equal. It is found that for the low Atwood number cases, the asymmetric initial density distribution has limited effects on both global and local flow evolution for HVDT. However, at high Atwood number, both global flow evolution and the local flow structures are strongly affected by the initial composition ratio. The flow composed of more light fluid reaches higher turbulent levels and the local statistics reach their fully-developed behavior earlier in the time evolution. During the late time decay, where most of the flow is well-mixed, all parameters become independent of the initial composition ratio for both low and high Atwood number cases.

physics.flu-dyn↗

arXiv2020

Atwood and Reynolds numbers effects on the evolution of buoyancy-driven homogeneous variable-density turbulence

The evolution of buoyancy-driven homogeneous variable-density turbulence (HVDT) at Atwood numbers up to 0.75 and large Reynolds numbers is studied by using high-resolution Direct Numerical Simulations. To help understand the highly non-equilibrium nature of buoyancy-driven HVDT, the flow evolution is divided into four different regimes based on the behavior of turbulent kinetic energy derivatives. The results show that each regime has a unique type of dependency on both Atwood and Reynolds numbers. It is found that the local statistics of the flow based on the flow composition are more sensitive to Atwood and Reynolds numbers compared to those based on the entire flow. It is also observed that at higher Atwood numbers, different flow features reach their asymptotic Reynolds number behavior at different times. The energy spectrum defined based on the Favre fluctuations momentum has less large scale contamination from viscous effects for variable density flows with constant properties, compared to other forms used previously. The evolution of the energy spectrum highlights distinct dynamical features of the four flow regimes. Thus, the slope of the energy spectrum at intermediate to large scales evolves from -7/3 to -1, as a function of the production to dissipation ratio. The classical Kolmogorov spectrum emerges at intermediate to high scales at the highest Reynolds numbers examined, after the turbulence starts to decay. Finally, the similarities and differences between buoyancy-driven HVDT and the more conventional stationary turbulence are discussed and new strategies and tools for analysis are proposed.

physics.flu-dyn↗

arXiv2020

Embedding Hard Physical Constraints in Neural Network Coarse-Graining of 3D Turbulence

In the recent years, deep learning approaches have shown much promise in modeling complex systems in the physical sciences. A major challenge in deep learning of PDEs is enforcing physical constraints and boundary conditions. In this work, we propose a general framework to directly embed the notion of an incompressible fluid into Convolutional Neural Networks, and apply this to coarse-graining of turbulent flow. These physics-embedded neural networks leverage interpretable strategies from numerical methods and computational fluid dynamics to enforce physical laws and boundary conditions by taking advantage the mathematical properties of the underlying equations. We demonstrate results on three-dimensional fully-developed turbulence, showing that this technique drastically improves local conservation of mass, without sacrificing performance according to several other metrics characterizing the fluid flow.

physics.comp-ph↗

arXiv2019

Revisiting the Late-Time Growth of Single-mode Rayleigh-Taylor Instability and the Role of Vorticity

Growth of the single-fluid single-mode Rayleigh-Taylor instability (RTI) is revisited in 2D and 3D using fully compressible high-resolution simulations. We conduct a systematic analysis of the effects of perturbation Reynolds number ($Re_p$) and Atwood number ($A$) on RTI's late-time growth. Contrary to the common belief that single-mode RTI reaches a terminal bubble velocity, we show that the bubble re-accelerates when $Re_p$ is sufficiently large, consistent with [Ramaparabhu et al. 2006, Wei and Livescu 2012]. However, unlike in [Ramaparabhu et al. 2006], we find that for a sufficiently high $Re_p$, the bubble's late-time acceleration is persistent and does not vanish. Analysis of vorticity dynamics shows a clear correlation between vortices inside the bubble and re-acceleration. Due to symmetry around the bubble and spike (vertical) axes, the self-propagation velocity of vortices points in the vertical direction. If viscosity is sufficiently small, the vortices persist long enough to enter the bubble tip and accelerate the bubble [Wei and Livescu 2012]. A similar effect has also been observed in ablative RTI [Betti and Sanz 2006]. As the spike growth increases relative to that of the bubble at higher $A$, vorticity production shifts downward, away from the centerline and toward the spike tip. We modify the Betti-Sanz model for bubble velocity by introducing a vorticity efficiency factor $η=0.45$ to accurately account for re-acceleration caused by vorticity in the bubble tip. It had been previously suggested that vorticity generation and the associated bubble re-acceleration are suppressed at high $A$. However, we present evidence that if the large $Re_p$ limit is taken first, bubble re-acceleration is still possible. Our results also show that re-acceleration is much easier to occur in 3D than 2D, requiring smaller $Re_p$ thresholds.

physics.flu-dyn↗