arXiv ScienceSearch

arXiv subjects

Alex Alberts

Publications and source records attributed to Alex Alberts.

6 recordsLinked to original sources

Modeling diesel output particulate matter as the Ornstein-Uhlenbeck process

Diesel engine particulate matter (PM) is one of the most challenging emission constituents to predict. As engines become cleaner and emissions levels drop, manufacturers need reliable methods to quantify the PM generated by production engines. Due to the inaccuracy of commercial-grade sensors, they turn to predictive models to accurately estimate PM. In practice, this requires a computationally inexpensive model that provides PM estimates with calibrated uncertainty. Complex, multiscale physics make mechanistic models intractable and traditional data-driven methods struggle in transient drive cycles due to the stochastic nature of PM generation. Leveraging recent innovations in PM measurement technology, we introduce a novel PM model based on the Ornstein-Uhlenbeck (OU) process. The OU process is a mean-reverting stochastic process commonly used in financial modeling, now being explored for engineering applications, and can be described as a stochastic differential equation (SDE). We modify the OU process by parameterizing the terms of the SDE as functions of the engine state, which are then fit with a maximum likelihood estimate. In a synthetic example, we verify the ability of our model to learn a time-varying, parametrized OU process. We then train the model using real experimental data designed to dynamically cover the engine operating space and test the trained model on EPA-regulated drive cycles. For most drive cycles, we find the method accurately predicts cumulative output of PM across time.

stat.AP

Bayesian identification of fibrous insulation thermal conductivity towards design of spacecraft thermal protection systems

The design of spacecraft thermal protection systems (TPS) requires accurate knowledge of thermal transport properties across wide ranges of temperature and pressure. For fibrous insulation, conventional measurement techniques in laboratory settings are typically limited to temperatures much lower than what is reached in atmosphere entry scenarios. Moreover, it is often the case that only temperature measurements are available, meaning that the thermal conductivity of the insulation must be indirectly inferred as an inverse problem. We propose a Bayesian framework using information field theory (IFT) to reconstruct the thermal conductivity of high-temperature fibrous insulation from sparse experimental data. Under IFT, the conductivity is represented as a Gaussian process, and the physics is enforced via a physics-informed prior over the temperature derived from the heat equation. Bayes's rule produces an infinite-dimensional posterior distribution that quantifies uncertainty about the conductivity which can be evaluated in extrapolation regimes. We apply the method to Opacified Fibrous Insulation with both synthetic and experimental data to reconstruct the thermal conductivity beyond the experimental regime. The inferred conductivities are validated against reference data and then propagated into high-fidelity digital twins of flexible TPS performance under Mars and Earth entry trajectories. The results show that IFT yields accurate predictions with quantified uncertainty, enabling robust TPS sizing in regimes inaccessible to direct measurement.

physics.comp-ph

Bayesian neural networks with interpretable priors from Mercer kernels

Quantifying the uncertainty in the output of a neural network is essential for deployment in scientific or engineering applications where decisions must be made under limited or noisy data. Bayesian neural networks (BNNs) provide a framework for this purpose by constructing a Bayesian posterior distribution over the network parameters. However, the prior, which is of key importance in any Bayesian setting, is rarely meaningful for BNNs. This is because the complexity of the input-to-output map of a BNN makes it difficult to understand how certain distributions enforce any interpretable constraint on the output space of the network. Gaussian processes (GPs), on the other hand, are often preferred in uncertainty quantification tasks due to their interpretability. The drawback is that GPs are limited to small datasets without advanced techniques, which often rely on the covariance kernel having a specific structure. To address these challenges, we introduce a new class of priors for BNNs, called Mercer priors, such that the resulting BNN has samples which approximate that of a specified GP. The method works by defining a prior directly over the network parameters from the Mercer representation of the covariance kernel, and does not rely on the network having a specific structure. In doing so, we can exploit the scalability of BNNs in a meaningful Bayesian way.

stat.ML

An interpretation of the Brownian bridge as a physics-informed prior for the Poisson equation

Many inverse problems require reconstructing physical fields from limited and noisy data while incorporating known governing equations. A growing body of work within probabilistic numerics formalizes such tasks via Bayesian inference in function spaces by assigning a physically meaningful prior to the latent field. In this work, we demonstrate that Brownian bridge Gaussian processes can be viewed as a softly-enforced physics-constrained prior for the Poisson equation. We first show equivalence between the variational problem associated with the Poisson equation and a kernel ridge regression objective. Then, through the connection between Gaussian process regression and kernel methods, we identify a Gaussian process for which the posterior mean function and the minimizer to the variational problem agree, thereby placing this PDE-based regularization within a fully Bayesian framework. This connection allows us to probe different theoretical questions, such as convergence and behavior of inverse problems. We then develop a finite-dimensional representation in function space and prove convergence of the projected prior and resulting posterior in Wasserstein distance. Finally, we connect the method to the important problem of identifying model-form error in applications, providing a diagnostic for model misspecification.

stat.ML

Uniqueness of MAP estimates for inverse problems under information field theory

Information field theory (IFT) is an emerging technique for posing infinite-dimensional inverse problems using the mathematics found in quantum field theory. Under IFT, the field inference task is formulated in a Bayesian setting where the probability measures are defined by path integrals. We derive conditions under which IFT inverse problems have unique maximum a posterioi estimates, placing a special focus on the problem of identifying model-form error. We define physics-informed priors over fields, where a parameter, called the model trust, measures our belief in the physical model. Smaller values of trust cause the prior to diffuse, representing a larger degree of uncertainty about the physics. To detect model-form error, we learn the trust as part of the inverse problem and study the limiting behavior. We provide an example where the physics are assumed to be the Poisson equation and study the effect of model-form error on the model trust. We find that a correct model leads to infinite trust, and under model-form error, physics that are closer to the ground truth lead to larger values of the trust.

math-ph

Physics-informed Information Field Theory for Modeling Physical Systems with Uncertainty Quantification

Data-driven approaches coupled with physical knowledge are powerful techniques to model systems. The goal of such models is to efficiently solve for the underlying field by combining measurements with known physical laws. As many systems contain unknown elements, such as missing parameters, noisy data, or incomplete physical laws, this is widely approached as an uncertainty quantification problem. The common techniques to handle all the variables typically depend on the numerical scheme used to approximate the posterior, and it is desirable to have a method which is independent of any such discretization. Information field theory (IFT) provides the tools necessary to perform statistics over fields that are not necessarily Gaussian. We extend IFT to physics-informed IFT (PIFT) by encoding the functional priors with information about the physical laws which describe the field. The posteriors derived from this PIFT remain independent of any numerical scheme and can capture multiple modes, allowing for the solution of problems which are ill-posed. We demonstrate our approach through an analytical example involving the Klein-Gordon equation. We then develop a variant of stochastic gradient Langevin dynamics to draw samples from the joint posterior over the field and model parameters. We apply our method to numerical examples with various degrees of model-form error and to inverse problems involving nonlinear differential equations. As an addendum, the method is equipped with a metric which allows the posterior to automatically quantify model-form uncertainty. Because of this, our numerical experiments show that the method remains robust to even an incorrect representation of the physics given sufficient data. We numerically demonstrate that the method correctly identifies when the physics cannot be trusted, in which case it automatically treats learning the field as a regression problem.

stat.ML