arXiv subjects

Sili Deng

Publications and source records attributed to Sili Deng.

23 records · Page 2Linked to original sources

arXiv2021

Arrhenius.jl: A Differentiable Combustion SimulationPackage

Combustion kinetic modeling is an integral part of combustion simulation, and extensive studies have been devoted to developing both high fidelity and computationally affordable models. Despite these efforts, modeling combustion kinetics is still challenging due to the demand for expert knowledge and optimization against experiments, as well as the lack of understanding of the associated uncertainties. Therefore, data-driven approaches that enable efficient discovery and calibration of kinetic models have received much attention in recent years, the core of which is the optimization based on big data. Differentiable programming is a promising approach for learning kinetic models from data by efficiently computing the gradient of objective functions to model parameters. However, it is often challenging to implement differentiable programming in practice. Therefore, it is still not available in widely utilized combustion simulation packages such as CHEMKIN and Cantera. Here, we present a differentiable combustion simulation package leveraging the eco-system in Julia, including DifferentialEquations.jl for solving differential equations, ForwardDiff.jl for auto-differentiation, and Flux.jl for incorporating neural network models into combustion simulations and optimizing neural network models using the state-of-the-art deep learning optimizers. We demonstrate the benefits of differentiable programming in efficient and accurate gradient computations, with applications in uncertainty quantification, kinetic model reduction, data assimilation, and model discovery.

physics.chem-ph↗

arXiv2021

Machine Learning Approaches to Learn HyChem Models

The HyChem approach has recently been proposed for modeling high-temperature combustion of real, multi-component fuels. The approach combines lumped reaction steps for fuel thermal and oxidative pyrolysis with detailed chemistry for the oxidation of the resulting pyrolysis products. However, the approach usually shows substantial discrepancies with experimental data within the Negative Temperature Coefficient (NTC) regime, as the low-temperature chemistry is more fuel-specific than high-temperature chemistry. This paper proposes a machine learning approach to learn the HyChem models that can cover both high-temperature and low-temperature regimes. Specifically, we develop a HyChem model using the experimental datasets of ignition delay times covering a wide range of temperatures and equivalence ratios. The chemical kinetic model is treated as a neural network model, and we then employ stochastic gradient descent (SGD), a technique that was developed for deep learning, for the training. We demonstrate the approach in learning the HyChem model for F-24, which is a Jet-A derived fuel, and compare the results with previous work employing genetic algorithms. The results show that the SGD approach can achieve comparable model performance with genetic algorithms but the computational cost is reduced by 1000 times. In addition, with regularization in SGD, the SGD approach changes the kinetic parameters from their original values much less than genetic algorithm and is thus more likely to retrain mechanistic meanings. Finally, our approach is built upon open-source packages and can be applied to the development and optimization of chemical kinetic models for internal combustion engine simulations.

physics.chem-ph↗

arXiv2021

Inference of cell dynamics on perturbation data using adjoint sensitivity

Data-driven dynamic models of cell biology can be used to predict cell response to unseen perturbations. Recent work (CellBox) had demonstrated the derivation of interpretable models with explicit interaction terms, in which the parameters were optimized using machine learning techniques. While the previous work was tested only in a single biological setting, this work aims to extend the range of applicability of this model inference approach to a diversity of biological systems. Here we adapted CellBox in Julia differential programming and augmented the method with adjoint algorithms, which has recently been used in the context of neural ODEs. We trained the models using simulated data from both abstract and biology-inspired networks, which afford the ability to evaluate the recovery of the ground truth network structure. The resulting accuracy of prediction by these models is high both in terms of low error against data and excellent agreement with the network structure used for the simulated training data. While there is no analogous ground truth for real life biological systems, this work demonstrates the ability to construct and parameterize a considerable diversity of network models with high predictive ability. The expectation is that this kind of procedure can be used on real perturbation-response data to derive models applicable to diverse biological systems.

q-bio.MN↗

arXiv2021

Autonomous Discovery of Unknown Reaction Pathways from Data by Chemical Reaction Neural Network

Chemical reactions occur in energy, environmental, biological, and many other natural systems, and the inference of the reaction networks is essential to understand and design the chemical processes in engineering and life sciences. Yet, revealing the reaction pathways for complex systems and processes is still challenging due to the lack of knowledge of the involved species and reactions. Here, we present a neural network approach that autonomously discovers reaction pathways from the time-resolved species concentration data. The proposed Chemical Reaction Neural Network (CRNN), by design, satisfies the fundamental physics laws, including the Law of Mass Action and the Arrhenius Law. Consequently, the CRNN is physically interpretable such that the reaction pathways can be interpreted, and the kinetic parameters can be quantified simultaneously from the weights of the neural network. The inference of the chemical pathways is accomplished by training the CRNN with species concentration data via stochastic gradient descent. We demonstrate the successful implementations and the robustness of the approach in elucidating the chemical reaction pathways of several chemical engineering and biochemical systems. The autonomous inference by the CRNN approach precludes the need for expert knowledge in proposing candidate networks and addresses the curse of dimensionality in complex systems. The physical interpretability also makes the CRNN capable of not only fitting the data for a given system but also developing knowledge of unknown pathways that could be generalized to similar chemical systems.

q-bio.MN↗

arXiv2020

Kinetic Similarity between Extinction Strain Rate and Laminar Flame Speed

Extinction strain rate (ESR) and laminar flame speed (LFS) are fundamental properties of a fuel/air mixture that are often utilized as scaling parameters in turbulent combustion. While LFS at atmospheric and elevated pressures are extensively investigated, experimental measurements of ESR with counterflow premixed flames are very limited for flame instability often occurs near extinction, especially at high pressures. Due to the scarcity of ESR measurements, most combustion kinetic models are mainly validated and optimized against LFS. However, it is questionable whether the controlling reactions are the same for ESR and LFS such that those models are also valid for predicting ESR. This work quantifies the kinetic similarities between ESR and LFS by analyzing their kinetic sensitivity directions. The direction is represented by a unit vector composed of the normalized sensitivity of ESR or LFS to the rate constant for each elemental reaction. Consequently, the similarity between the two directions is measured by the inner product of the corresponding unit vectors. The sensitivity directions of ESR and LFS are found parallel for various fuels, equivalence ratios, and pressures. Furthermore, sensitivity directions at various strain rates are also similar for the maximum temperature, local temperature at various locations in the flame coordinate, and ESR in counterflow premixed flames. These findings suggest that LFS and ESR are similarly effective as the target for constraining and optimizing rate constants in kinetic models. In addition, the independence of the sensitivity directions on the strain rate also enables us to perform uncertainty quantification for turbulent flames with a wide range of strain rates based on the kinetic sensitivity of ESR and LFS.

physics.flu-dyn↗