arXiv subjects

Ilias Bilionis

Publications and source records attributed to Ilias Bilionis.

At least 19 recordsLinked to original sources

arXiv2026

Bayesian thermal digital twin for a space habitat subjected to an impact event

Space habitats may experience disruptive events, such as micro-meteorite impacts, that can induce structural damage and thermal anomalies in the interior environment, requiring resilient Environmental Control and Life Support Systems (ECLSS). Digital twins offer a promising paradigm for supporting resilience, onboard decision making, and uncertainty-aware autonomy. However, limited work has developed digital twins for the thermal aspects of ECLSS. This work develops a Bayesian thermal digital twin for a habitat cyber-physical testbed experiencing impact-induced thermal anomalies. We construct a coupled thermal resistance-capacitance network model representing the physical and cyber thermal subsystems and embed physics-based activation functions to automate model selection, enable adaptation, and facilitate health-state estimation. Offline Bayesian calibration is performed for the physical subsystem using experimental temperature data. For the cyber subsystem, reduction in structural protective layer thickness is identified as the impact-sensitive parameter. After fixing the physical parameters and insensitive parameters, Bayesian inference is performed continuously to estimate impact-relevant cyber parameters, enabling detection of impact location, timing, and severity. Synthetic studies examine hyperparameter selection, observability, and noise effects, and the final framework is validated using experimental testbed data. Results show that the proposed digital twin can detect impact-induced thermal anomalies, infer impact-relevant parameters with quantified uncertainty, generate informative temperature forecasts, and support time-to-critical estimation for autonomous habitat operation.

eess.SY↗

arXiv2026

Coding-agents can replicate scientific machine learning papers

Scientific machine learning papers typically make computational claims, e.g., that the relative mean square error is less than 5% or that the 95% predictive credible interval covers the test data. A coding agent can be prompted to replicate those claims from paper materials alone, but the prompt does not by itself reliably preserve progress or check whether generated evidence supports the paper's claims. We introduce Paper-replication, a workflow that makes each selected paper claim a target with recorded evidence, and implement it as a coding-agent skill. The workflow makes the agent record those targets, reconstruct the paper's method, run computational experiments, link generated outputs to provenance and comparisons with the paper's claims, record where matched evidence appears in the replication report, and pass validation checks before completion. We evaluate Paper-replication on twelve independent runs across four scientific machine learning papers. All twelve workspaces pass the completion gate, and all 158 recorded targets are matched with report coverage. Even in this completed workspace state, repeated runs differ in how papers are divided into targets, in numerical fidelity to the source papers, in elapsed replication time, in the number of intermediate executions replaced before final evidence is accepted, and in the rules used to accept evidence. Paper-replication makes completion depend on workspace evidence and validation checks rather than on the agent's final message.

cs.AI↗

arXiv2026

Bayesian Aneurysm Growth Detection via Surface Displacement Modeling

Clinical decisions for unruptured intracranial aneurysms depend on detecting growth on follow-up magnetic resonance angiography (MRA). Growth is typically judged from manual 2D diameters on few slices, which vary across clinicians and frequently miss subtle 3D change. Even with 3D segmentations, apparent differences can reflect resolution, segmentation, surface processing, or registration mismatch rather than true growth; most criteria remain heuristic and binary. We show that a Bayesian displacement-based model using the surrounding vessel as an internal reference achieves strong discrimination of aneurysm growth (AUC 0.86-0.87) and improves agreement with expert labels (Cohen's kappa up to 0.66 vs. 0.35 for volumetric criteria), while providing calibrated posterior probabilities with uncertainty bounds. The method registers baseline and follow-up surfaces, computes normal-directed displacements, and summarizes change as the difference between mean aneurysm displacement and mean displacement on the surrounding non-aneurysmal vessel segment. The vessel segment serves as an internal control for imaging and processing variability, assuming negligible structural change over the surveillance interval. We evaluate two cohorts spanning time-of-flight and contrast-enhanced longitudinal MRA studies: a public dataset labeled from neuroradiologist-provided measurements and an institutional dataset labeled by senior and junior raters. Performance is preserved when training on lower-expertise labels, indicating robustness to label variability. Calibrated probabilities may aid clinical decision-making in borderline cases, where high uncertainty can motivate repeat imaging. This framework provides interpretable probabilistic growth assessment from longitudinal MRA, reduces dependence on clinician expertise, and supports cross-center surveillance across scanners and angiography sequences.

physics.med-ph↗

arXiv2026

Bayesian Calibration of Engine-out NOx Models for Engine-to-Engine Transferability

Accurate prediction of engine-out NOx is essential for meeting stringent emissions regulations and optimizing engine performance. Traditional approaches rely on models trained on data from a small number of engines, which can be insufficient in generalizing across an entire population of engines due to sensor biases and variations in input conditions. In real world applications, these models require tuning or calibration to maintain acceptable error tolerance when applied to other engines. This highlights the need for models that can adapt with minimal adjustments to accommodate engine-to-engine variability and sensor discrepancies. While previous studies have explored machine learning methods for predicting engine-out NOx, these approaches often fail to generalize reliably across different engines and operating environments. To address these issues, we propose a Bayesian calibration framework that combines Gaussian processes (GP) with approximate Bayesian computation to infer and correct sensor biases. Starting with a pre-trained model developed using nominal engine data, our method identifies engine specific sensor biases and recalibrates predictions accordingly. By incorporating these inferred biases, our approach generates posterior predictive distributions for engine-out NOx on unseen test data, achieving high accuracy without retraining the model. Our results demonstrate that this transferable modeling approach significantly improves the accuracy of predictions compared to conventional non-adaptive GP models, effectively addressing engine-to-engine variability and improving model generalizability.

cs.LG↗

arXiv2026

Modeling diesel output particulate matter as the Ornstein-Uhlenbeck process

Diesel engine particulate matter (PM) is one of the most challenging emission constituents to predict. As engines become cleaner and emissions levels drop, manufacturers need reliable methods to quantify the PM generated by production engines. Due to the inaccuracy of commercial-grade sensors, they turn to predictive models to accurately estimate PM. In practice, this requires a computationally inexpensive model that provides PM estimates with calibrated uncertainty. Complex, multiscale physics make mechanistic models intractable and traditional data-driven methods struggle in transient drive cycles due to the stochastic nature of PM generation. Leveraging recent innovations in PM measurement technology, we introduce a novel PM model based on the Ornstein-Uhlenbeck (OU) process. The OU process is a mean-reverting stochastic process commonly used in financial modeling, now being explored for engineering applications, and can be described as a stochastic differential equation (SDE). We modify the OU process by parameterizing the terms of the SDE as functions of the engine state, which are then fit with a maximum likelihood estimate. In a synthetic example, we verify the ability of our model to learn a time-varying, parametrized OU process. We then train the model using real experimental data designed to dynamically cover the engine operating space and test the trained model on EPA-regulated drive cycles. For most drive cycles, we find the method accurately predicts cumulative output of PM across time.

stat.AP↗

arXiv2026

Bayesian neural networks with interpretable priors from Mercer kernels

Quantifying the uncertainty in the output of a neural network is essential for deployment in scientific or engineering applications where decisions must be made under limited or noisy data. Bayesian neural networks (BNNs) provide a framework for this purpose by constructing a Bayesian posterior distribution over the network parameters. However, the prior, which is of key importance in any Bayesian setting, is rarely meaningful for BNNs. This is because the complexity of the input-to-output map of a BNN makes it difficult to understand how certain distributions enforce any interpretable constraint on the output space of the network. Gaussian processes (GPs), on the other hand, are often preferred in uncertainty quantification tasks due to their interpretability. The drawback is that GPs are limited to small datasets without advanced techniques, which often rely on the covariance kernel having a specific structure. To address these challenges, we introduce a new class of priors for BNNs, called Mercer priors, such that the resulting BNN has samples which approximate that of a specified GP. The method works by defining a prior directly over the network parameters from the Mercer representation of the covariance kernel, and does not rely on the network having a specific structure. In doing so, we can exploit the scalability of BNNs in a meaningful Bayesian way.

stat.ML↗

arXiv2026

A Causal Graph-Enhanced Gaussian Process Regression for Modeling Engine-out NOx

The stringent regulatory requirements on nitrogen oxides (NOx) emissions from diesel compression ignition engines require accurate and reliable models for real time monitoring and diagnostics. Although traditional methods such as physical sensors and virtual engine control module (ECM) sensors provide essential data, they are only used for estimation. Ubiquitous literature primarily focuses on deterministic models with little emphasis on capturing the various uncertainties. The lack of probabilistic frameworks restricts the applicability of these models for robust diagnostics. The objective of this paper is to develop and validate a probabilistic model to predict engine-out NOx emissions using Gaussian process regression. Our approach is as follows. We employ three variants of Gaussian process models: the first with a standard radial basis function kernel with input window, the second incorporating a deep kernel using convolutional neural networks to capture temporal dependencies, and the third enriching the deep kernel with a causal graph derived via graph convolutional networks. The causal graph embeds physics knowledge into the learning process. All models are compared against a virtual ECM sensor using both quantitative and qualitative metrics. We conclude that our model provides an improvement in predictive performance when using an input window and a deep kernel structure. Even more compelling is the further enhancement achieved by the incorporation of a causal graph into the deep kernel. These findings are corroborated across different verification and validation datasets.

cs.LG↗

arXiv2026

SMURF: Scalable method for unsupervised reconstruction of flow in 4D flow MRI

We introduce SMURF, a scalable and unsupervised machine learning method for simultaneously segmenting vascular geometries and reconstructing velocity fields from 4D flow MRI data. SMURF models geometry and velocity fields using multilayer perceptron-based functions incorporating Fourier feature embeddings and random weight factorization to accelerate convergence. A measurement model connects these fields to the observed image magnitude and phase data. Maximum likelihood estimation and subsampling enable SMURF to process high-dimensional datasets efficiently. Evaluations on synthetic, in vitro, and in vivo datasets demonstrate SMURF's performance. On synthetic internal carotid artery aneurysm data derived from CFD, SMURF achieves a quarter-voxel segmentation accuracy across noise levels of up to 50%, outperforming the state-of-the-art segmentation method by up to double the accuracy. In an in vitro experiment on Poiseuille flow, SMURF reduces velocity reconstruction RMSE by approximately 34% compared to raw measurements. In in vivo internal carotid artery aneurysm data, SMURF attains nearly half-voxel segmentation accuracy relative to expert annotations and decreases median velocity divergence residuals by about 31%, with a 27% reduction in the interquartile range. These results indicate that SMURF is robust to noise, preserves flow structure, and identifies patient-specific morphological features. SMURF advances 4D flow MRI accuracy, potentially enhancing the diagnostic utility of 4D flow MRI in clinical applications.

physics.med-ph↗

arXiv2026

Bayesian identification of fibrous insulation thermal conductivity towards design of spacecraft thermal protection systems

The design of spacecraft thermal protection systems (TPS) requires accurate knowledge of thermal transport properties across wide ranges of temperature and pressure. For fibrous insulation, conventional measurement techniques in laboratory settings are typically limited to temperatures much lower than what is reached in atmosphere entry scenarios. Moreover, it is often the case that only temperature measurements are available, meaning that the thermal conductivity of the insulation must be indirectly inferred as an inverse problem. We propose a Bayesian framework using information field theory (IFT) to reconstruct the thermal conductivity of high-temperature fibrous insulation from sparse experimental data. Under IFT, the conductivity is represented as a Gaussian process, and the physics is enforced via a physics-informed prior over the temperature derived from the heat equation. Bayes's rule produces an infinite-dimensional posterior distribution that quantifies uncertainty about the conductivity which can be evaluated in extrapolation regimes. We apply the method to Opacified Fibrous Insulation with both synthetic and experimental data to reconstruct the thermal conductivity beyond the experimental regime. The inferred conductivities are validated against reference data and then propagated into high-fidelity digital twins of flexible TPS performance under Mars and Earth entry trajectories. The results show that IFT yields accurate predictions with quantified uncertainty, enabling robust TPS sizing in regimes inaccessible to direct measurement.

physics.comp-ph↗

arXiv2025

An interpretation of the Brownian bridge as a physics-informed prior for the Poisson equation

Many inverse problems require reconstructing physical fields from limited and noisy data while incorporating known governing equations. A growing body of work within probabilistic numerics formalizes such tasks via Bayesian inference in function spaces by assigning a physically meaningful prior to the latent field. In this work, we demonstrate that Brownian bridge Gaussian processes can be viewed as a softly-enforced physics-constrained prior for the Poisson equation. We first show equivalence between the variational problem associated with the Poisson equation and a kernel ridge regression objective. Then, through the connection between Gaussian process regression and kernel methods, we identify a Gaussian process for which the posterior mean function and the minimizer to the variational problem agree, thereby placing this PDE-based regularization within a fully Bayesian framework. This connection allows us to probe different theoretical questions, such as convergence and behavior of inverse problems. We then develop a finite-dimensional representation in function space and prove convergence of the projected prior and resulting posterior in Wasserstein distance. Finally, we connect the method to the important problem of identifying model-form error in applications, providing a diagnostic for model misspecification.

stat.ML↗

arXiv2025

Active Learning Discovery of High Temperature Oxidation Resistant Refractory Complex Concentrated Alloys

Refractory complex concentrated alloys (RCCAs) are of significant interest for advanced high-temperature applications, owing to their broad compositional range and potential for attractive mechanical properties and oxidation resistance. However, their compositional complexity poses significant challenges to conventional alloy discovery methodologies. In this study, an active learning framework is introduced that integrates Gaussian process regression with Bayesian global optimization to accelerate identification of oxidation-resistant RCCAs. Focusing on aluminum-containing quaternary systems, alloy and oxide descriptors were used to predict oxidation performance at 1000$^\circ$C. Beginning with a dataset of 81 experimentally validated RCCAs, this framework was used to iteratively select alloy batches (five alloys per batch) with optimization based on a balance between exploration and exploitation to minimize associated experimental costs. After six iterations, two alloys were identified (nominal Al$_{30}$Mo$_5$Ti$_{15}$Cr$_{50}$ and Al$_{40}$Mo$_5$Ti$_{30}$Cr$_{25}$) that exhibited specific mass gains less than 1 mg/cm$^2$ at 1000$^\circ$C in air. Both of these alloys formed adherent external $α$-Al$_2$O$_3$ scales and exhibited parabolic oxidation kinetics consistent with diffusion-limited scale growth. Furthermore, our multiobjective analysis demonstrates that these alloys simultaneously achieve high specific hardness ($>0.12$ HV$_{0.5}$m$^3$/kg) and thermal expansion compatibility with thermal barrier coating systems, positioning them as promising bond coat candidates. This work underscores the efficacy of active learning in traversing complex compositional landscapes, and offers a scalable strategy for the development of advanced materials suitable for extreme environments.

cond-mat.mtrl-sci↗

arXiv2025

Uniqueness of MAP estimates for inverse problems under information field theory

Information field theory (IFT) is an emerging technique for posing infinite-dimensional inverse problems using the mathematics found in quantum field theory. Under IFT, the field inference task is formulated in a Bayesian setting where the probability measures are defined by path integrals. We derive conditions under which IFT inverse problems have unique maximum a posterioi estimates, placing a special focus on the problem of identifying model-form error. We define physics-informed priors over fields, where a parameter, called the model trust, measures our belief in the physical model. Smaller values of trust cause the prior to diffuse, representing a larger degree of uncertainty about the physics. To detect model-form error, we learn the trust as part of the inverse problem and study the limiting behavior. We provide an example where the physics are assumed to be the Poisson equation and study the effect of model-form error on the model trust. We find that a correct model leads to infinite trust, and under model-form error, physics that are closer to the ground truth lead to larger values of the trust.

math-ph↗

arXiv2024

Neural information field filter

We introduce neural information field filter, a Bayesian state and parameter estimation method for high-dimensional nonlinear dynamical systems given large measurement datasets. Solving such a problem using traditional methods, such as Kalman and particle filters, is computationally expensive. Information field theory is a Bayesian approach that can efficiently reconstruct dynamical model state paths and calibrate model parameters from noisy measurement data. To apply the method, we parameterize the time evolution state path using the span of a finite linear basis. The existing method has to reparameterize the state path by initial states to satisfy the initial condition. Designing an expressive yet simple linear basis before knowing the true state path is crucial for inference accuracy but challenging. Moreover, reparameterizing the state path using the initial state is easy to perform for a linear basis, but is nontrivial for more complex and expressive function parameterizations, such as neural networks. The objective of this paper is to simplify and enrich the class of state path parameterizations using neural networks for the information field theory approach. To this end, we propose a generalized physics-informed conditional prior using an auxiliary initial state. We show the existing reparameterization is a special case. We parameterize the state path using a residual neural network that consists of a linear basis function and a Fourier encoding fully connected neural network residual function. The residual function aims to correct the error of the linear basis function. To sample from the intractable posterior distribution, we develop an optimization algorithm, nested stochastic variational inference, and a sampling algorithm, nested preconditioned stochastic gradient Langevin dynamics. A series of numerical and experimental examples verify and validate the proposed method.

stat.ML↗

arXiv2024

An information field theory approach to Bayesian state and parameter estimation in dynamical systems

Dynamical system state estimation and parameter calibration problems are ubiquitous across science and engineering. Bayesian approaches to the problem are the gold standard as they allow for the quantification of uncertainties and enable the seamless fusion of different experimental modalities. When the dynamics are discrete and stochastic, one may employ powerful techniques such as Kalman, particle, or variational filters. Practitioners commonly apply these methods to continuous-time, deterministic dynamical systems after discretizing the dynamics and introducing fictitious transition probabilities. However, approaches based on time-discretization suffer from the curse of dimensionality since the number of random variables grows linearly with the number of time-steps. Furthermore, the introduction of fictitious transition probabilities is an unsatisfactory solution because it increases the number of model parameters and may lead to inference bias. To address these drawbacks, the objective of this paper is to develop a scalable Bayesian approach to state and parameter estimation suitable for continuous-time, deterministic dynamical systems. Our methodology builds upon information field theory. Specifically, we construct a physics-informed prior probability measure on the function space of system responses so that functions that satisfy the physics are more likely. This prior allows us to quantify model form errors. We connect the system's response to observations through a probabilistic model of the measurement process. The joint posterior over the system responses and all parameters is given by Bayes' rule. To approximate the intractable posterior, we develop a stochastic variational inference algorithm. In summary, the developed methodology offers a powerful framework for Bayesian estimation in dynamical systems.

physics.data-an↗

arXiv2024

Physics-informed Information Field Theory for Modeling Physical Systems with Uncertainty Quantification

Data-driven approaches coupled with physical knowledge are powerful techniques to model systems. The goal of such models is to efficiently solve for the underlying field by combining measurements with known physical laws. As many systems contain unknown elements, such as missing parameters, noisy data, or incomplete physical laws, this is widely approached as an uncertainty quantification problem. The common techniques to handle all the variables typically depend on the numerical scheme used to approximate the posterior, and it is desirable to have a method which is independent of any such discretization. Information field theory (IFT) provides the tools necessary to perform statistics over fields that are not necessarily Gaussian. We extend IFT to physics-informed IFT (PIFT) by encoding the functional priors with information about the physical laws which describe the field. The posteriors derived from this PIFT remain independent of any numerical scheme and can capture multiple modes, allowing for the solution of problems which are ill-posed. We demonstrate our approach through an analytical example involving the Klein-Gordon equation. We then develop a variant of stochastic gradient Langevin dynamics to draw samples from the joint posterior over the field and model parameters. We apply our method to numerical examples with various degrees of model-form error and to inverse problems involving nonlinear differential equations. As an addendum, the method is equipped with a metric which allows the posterior to automatically quantify model-form uncertainty. Because of this, our numerical experiments show that the method remains robust to even an incorrect representation of the physics given sufficient data. We numerically demonstrate that the method correctly identifies when the physics cannot be trusted, in which case it automatically treats learning the field as a regression problem.

stat.ML↗

arXiv2024

Unbalanced optimal transport for stochastic particle tracking

Non-invasive flow measurement techniques, such as particle tracking velocimetry, resolve 3D velocity fields by pairing tracer particle positions in successive time steps. These trajectories are crucial for evaluating physical quantities like vorticity, shear stress, pressure, and coherent structures. Traditional approaches deterministically reconstruct particle positions and extract particle tracks using tracking algorithms. However, reliable track estimation is challenging due to measurement noise caused by high particle density, particle image overlap, and falsely reconstructed 3D particle positions. To overcome this challenge, probabilistic approaches quantify the epistemic uncertainty in particle positions, typically using a Gaussian probability distribution. However, the standard deterministic tracking algorithms relying on nearest-neighbor search do not directly extend to the probabilistic setting. Moreover, such algorithms do not necessarily find globally consistent solutions robust to reconstruction errors. This paper aims to develop a globally consistent nearest-neighborhood algorithm that robustly extracts stochastic particle tracks from the reconstructed Gaussian particle distributions in all frames. Our tracking algorithm relies on the unbalanced optimal transport theory in the metric space of Gaussian measures. Specifically, we optimize a binary transport plan for efficiently moving the Gaussian distributions of reconstructed particle positions between time frames. We achieve this by computing the partial Wasserstein distance in the metric space of Gaussian measures. Our tracking algorithm is robust to position reconstruction errors since it automatically detects the number of particles that should be matched through hyperparameter optimization. Finally, we validate our method using an in vitro flow experiment using a 3D-printed cerebral aneurysm.

physics.data-an↗

arXiv2024

Learning to solve Bayesian inverse problems: An amortized variational inference approach using Gaussian and Flow guides

Inverse problems, i.e., estimating parameters of physical models from experimental data, are ubiquitous in science and engineering. The Bayesian formulation is the gold standard because it alleviates ill-posedness issues and quantifies epistemic uncertainty. Since analytical posteriors are not typically available, one resorts to Markov chain Monte Carlo sampling or approximate variational inference. However, inference needs to be rerun from scratch for each new set of data. This drawback limits the applicability of the Bayesian formulation to real-time settings, e.g., health monitoring of engineered systems, and medical diagnosis. The objective of this paper is to develop a methodology that enables real-time inference by learning the Bayesian inverse map, i.e., the map from data to posteriors. Our approach is as follows. We parameterize the posterior distribution as a function of data. This work outlines two distinct approaches to do this. The first method involves parameterizing the posterior using an amortized full-rank Gaussian guide, implemented through neural networks. The second method utilizes a Conditional Normalizing Flow guide, employing conditional invertible neural networks for cases where the target posterior is arbitrarily complex. In both approaches, we learn the network parameters by amortized variational inference which involves maximizing the expectation of evidence lower bound over all possible datasets compatible with the model. We demonstrate our approach by solving a set of benchmark problems from science and engineering. Our results show that the posterior estimates of our approach are in agreement with the corresponding ground truth obtained by Markov chain Monte Carlo. Once trained, our approach provides the posterior distribution for a given observation just at the cost of a forward pass of the neural network.

stat.ML↗

arXiv2023

Mass uptake during oxidation of metallic alloys: literature data collection, analysis, and FAIR sharing

The area-normalized change of mass ($Δ$m/A) with time during the oxidation of metallic alloys is commonly used to assess oxidation resistance. Analyses of such data can also aid in evaluating underlying oxidation mechanisms. We performed an exhaustive literature search and digitized normalized mass change vs. time data for 407 alloys. To maximize the impact of these and future mass uptake data, we developed and published an open, online, computational workflow that fits the data to various models of oxidation kinetics, uses Bayesian statistics for model selection, and makes the raw data and model parameters available via a queryable database. The tool, Refractory Oxidation Database (https://nanohub.org/tools/refoxdb/), uses nanoHUB's Sim2Ls to make the workflow and data (including metadata) findable, accessible, interoperable, and reusable (FAIR). We find that the models selected by the original authors do not match the most likely one according to the Bayesian information criterion (BIC) in 71% of the cases. Further, in 56% of the cases, the published model was not even in the top 3 models according to the BIC. These numbers were obtained assuming an experimental noise of 2.5% of the mass gain range, a smaller noise leads to more discrepancies. The RefOxDB tool is open access and researchers can add their own raw data (those to be included in future publications, as well as negative results) for analysis and to share their work with the community. Such consistent and systematic analysis of open, community generated data can significantly accelerate the development of machine-learning models for oxidation behavior and assist in the understanding and improvement of oxidation resistance.

cond-mat.mtrl-sci↗