arXiv ScienceSearch

arXiv subjects

Jan Mandel

Publications and source records attributed to Jan Mandel.

At least 19 recordsLinked to original sources

Transfer Learning for Dead Fuel Moisture Prediction Using Time-Warping Recurrent Neural Networks

This paper proposes a time-warping transfer learning method, a technique for temporally rescaling the learned dynamics of a recurrent neural network (RNN) with a Long Short-Term Memory (LSTM) layer to enable task transfer across fuel moisture classes. Fuel moisture content (FMC) is divided into idealized classes based on characteristic lag time. Large quantities of real-time data are available for 10h fuels from sensors on weather stations, but observations of other fuel classes are sparse in space and time. We use transfer learning to adapt an RNN pretrained on 10h FMC to predict FMC for 1h, 100h, and 1000h fuels. We validate this method using data from a landmark field study conducted in Oklahoma that was used to calibrate the state-of-the-art Nelson fuel moisture model.

stat.AP

Optimal Planning and Machine Learning for Responsive Tracking and Enhanced Forecasting of Wildfires using a Spacecraft Constellation

We propose a novel concept of operations using optimal planning methods and machine learning (ML) to collect spaceborne data that is unprecedented for monitoring wildfires, process it to create new or enhanced products in the context of wildfire danger or spread monitoring, and assimilate them to improve existing, wildfire decision support tools delivered to firefighters within latency appropriate for time-critical applications. The concept is studied with respect to NASA's CYGNSS Mission, a constellation of passive microwave receivers that measure specular GNSS-R reflections despite clouds and smoke. Our planner uses a Mixed Integer Program formulation to schedule joint observation data collection and downlink for all satellites. Optimal solutions are found quickly that collect 98-100% of available observation opportunities. ML-based fire predictions that drive the planner objective are greater than 40% more correlated with ground truth than existing state-of-art. The presented case study on the TX Smokehouse Creek fire in 2024 and LA fires in 2025 represents the first high-resolution data collected by CYGNSS of active fires. Creation of Burnt Area Maps (BAM) using ML on data from active fires and BAM assimilation into NASA's Weather Research and Forecasting Model using neural nets to broadcast fire spread are novel outcomes. BAM and CYGNSS obtained soil moisture are integrated for the first time into USGS fire danger maps. Inclusion of CYGNSS data in ML-based burn predictions boosts accuracy by 13%, and inclusion of high-resolution data boosts ML recall by another 15%. The proposed workflow has an expected latency of 6-30h, improving on the current delivery time of multiple days. All components in the proposed concept are shown to be computationally scalable and globally generalizable, with sustainability considerations such as edge efficiency and low latency on small devices.

cs.RO

Generative Algorithms for Wildfire Progression Reconstruction from Multi-Modal Satellite Active Fire Measurements and Terrain Height

Increasing wildfire occurrence has spurred growing interest in wildfire spread prediction. However, even the most complex wildfire models diverge from observed progression during multi-day simulations, motivating need for data assimilation. A useful approach to assimilating measurement data into complex coupled atmosphere-wildfire models is to estimate wildfire progression from measurements and use this progression to develop a matching atmospheric state. In this study, an approach is developed for estimating fire progression from VIIRS active fire measurements, GOES-derived ignition times, and terrain height data. A conditional Generative Adversarial Network is trained with simulations of historic wildfires from the atmosphere-wildfire model WRF-SFIRE, thus allowing incorporation of WRF-SFIRE physics into estimates. Fire progression is succinctly represented by fire arrival time, and measurements for training are obtained by applying an approximate observation operator to WRF-SFIRE solutions, eliminating need for satellite data during training. The model is trained on tuples of fire arrival times, measurements, and terrain, and once trained leverages measurements of real fires and corresponding terrain data to generate samples of fire arrival times. The approach is validated on five Pacific US wildfires, with results compared against high-resolution perimeters measured via aircraft, finding an average Sorensen-Dice coefficient of 0.81. The influence of terrain height on the arrival time inference is also evaluated and it is observed that terrain has minimal influence when the inference is conditioned on satellite measurements.

cs.LG

Introduction to Infinite Dimensional Statistics and Applications

These notes started to educate ourselves and to collect some background for our future work, with the hope that perhaps they will be useful to others also. Many if not all results are more or less elementary or available in the literature, but we need to fill some holes (which are undoubtely statements so trivial that the authors we use do not consider them holes at all) or make straightforward extensions, and then we do the proofs in sufficient detail for reference. Topics include random fields and stochastic processes as random elements in Hilbert spaces, Karhunen-Lo\`{e}ve explansion and random orthonormal series, laws of large numbers, white noise, convergence of the Ensemble Kalman Filter (EnKF), and the ensemble Kalman Transform Filter (ETKF).

math.FA

Generative Algorithms for Fusion of Physics-Based Wildfire Spread Models with Satellite Data for Initializing Wildfire Forecasts

Increases in wildfire activity and the resulting impacts have prompted the development of high-resolution wildfire behavior models for forecasting fire spread. Recent progress in using satellites to detect fire locations further provides the opportunity to use measurements to improve fire spread forecasts from numerical models through data assimilation. This work develops a method for inferring the history of a wildfire from satellite measurements, providing the necessary information to initialize coupled atmosphere-wildfire models from a measured wildfire state in a physics-informed approach. The fire arrival time, which is the time the fire reaches a given spatial location, acts as a succinct representation of the history of a wildfire. In this work, a conditional Wasserstein Generative Adversarial Network (cWGAN), trained with WRF-SFIRE simulations, is used to infer the fire arrival time from satellite active fire data. The cWGAN is used to produce samples of likely fire arrival times from the conditional distribution of arrival times given satellite active fire detections. Samples produced by the cWGAN are further used to assess the uncertainty of predictions. The cWGAN is tested on four California wildfires occurring between 2020 and 2022, and predictions for fire extent are compared against high resolution airborne infrared measurements. Further, the predicted ignition times are compared with reported ignition times. An average Sorensen's coefficient of 0.81 for the fire perimeters and an average ignition time error of 32 minutes suggest that the method is highly accurate.

cs.LG

Data Likelihood of Active Fires Satellite Detection and Applications to Ignition Estimation and Data Assimilation

Data likelihood of fire detection is the probability of the observed detection outcome given the state of the fire spread model. We derive fire detection likelihood of satellite data as a function of the fire arrival time on the model grid. The data likelihood is constructed by a combination of the burn model, the logistic regression of the active fires detections, and the Gaussian distribution of the geolocation error. The use of the data likelihood is then demonstrated by an estimation of the ignition point of a wildland fire by the maximization of the likelihood of MODIS and VIIRS data over multiple possible ignition points.

stat.AP

Experimental Design of a Prescribed Burn Instrumentation

Observational data collected during experiments, such as the planned Fire and Smoke Model Evaluation Experiment (FASMEE), are critical for progressing and transitioning coupled fire-atmosphere models like WRF-SFIRE and WRF-SFIRE-CHEM into operational use. Historical meteorological data, representing typical weather conditions for the anticipated burn locations and times, have been processed to initialize and run a set of simulations representing the planned experimental burns. Based on an analysis of these numerical simulations, this paper provides recommendations on the experimental setup that include the ignition procedures, size and duration of the burns, and optimal sensor placement. New techniques are developed to initialize coupled fire-atmosphere simulations with weather conditions typical of the planned burn locations and time of the year. Analysis of variation and sensitivity analysis of simulation design to model parameters by repeated Latin Hypercube Sampling are used to assess the locations of the sensors. The simulations provide the locations of the measurements that maximize the expected variation of the sensor outputs with the model parameters.

physics.ao-ph

Assimilation of fire perimeters and satellite detections by minimization of the residual in a fire spread model

Assimilation of data into a fire-spread model is formulated as an optimization problem. The level set equation, which relates the fire arrival time and the rate of spread, is allowed to be satisfied only approximately, and we minimize a norm of the residual. Previous methods based on modification of the fire arrival time either used an additive correction to the fire arrival time, or made a position correction. Unlike additive fire arrival time corrections, the new method respects the dependence of the fire rate of spread on diurnal changes of fuel moisture and on weather changes, and, unlike position corrections, it respects the dependence of the fire spread on fuels and terrain as well. The method is used to interpolate the fire arrival time between two perimeters by imposing the fire arrival time at the perimeters as constraints.

cs.CE

On well-posedness of Bayesian data assimilation and inverse problems in Hilbert space

Bayesian inverse problem on an infinite dimensional separable Hilbert space with the whole state observed is well posed when the prior state distribution is a Gaussian probability measure and the data error covariance is a cylindric Gaussian measure whose covariance has positive lower bound. If the state distribution and the data distribution are equivalent Gaussian probability measures, then the Bayesian posterior measure is not well defined. If the state covariance and the data error covariance commute, then the Bayesian posterior measure is well defined for all data vectors if and only if the data error covariance has positive lower bound, and the set of data vectors for which the Bayesian posterior measure is not well defined is dense if the data error covariance does not have positive lower bound.

math.PR

Multilevel maximum likelihood estimation with application to covariance matrices

The asymptotic variance of the maximum likelihood estimate is proved to decrease when the maximization is restricted to a subspace that contains the true parameter value. Maximum likelihood estimation allows a systematic fitting of covariance models to the sample, which is important in data assimilation. The hierarchical maximum likelihood approach is applied to the spectral diagonal covariance model with different parameterizations of eigenvalue decay, and to the sparse inverse covariance model with specified parameter values on different sets of nonzero entries. It is shown computationally that using smaller sets of parameters can decrease the sampling noise in high dimension substantially.

math.ST

Spectral diagonal ensemble Kalman filters

A new type of ensemble Kalman filter is developed, which is based on replacing the sample covariance in the analysis step by its diagonal in a spectral basis. It is proved that this technique improves the aproximation of the covariance when the covariance itself is diagonal in the spectral basis, as is the case, e.g., for a second-order stationary random field and the Fourier basis. The method is extended by wavelets to the case when the state variables are random fields, which are not spatially homogeneous. Efficient implementations by the fast Fourier transform (FFT) and discrete wavelet transform (DWT) are presented for several types of observations, including high-dimensional data given on a part of the domain, such as radar and satellite images. Computational experiments confirm that the method performs well on the Lorenz 96 problem and the shallow water equations with very small ensembles and over multiple analysis cycles.

stat.ME

On the Convergence of a Non-linear Ensemble Kalman Smoother

Ensemble methods, such as the ensemble Kalman filter (EnKF), the local ensemble transform Kalman filter (LETKF), and the ensemble Kalman smoother (EnKS) are widely used in sequential data assimilation, where state vectors are of huge dimension. Little is known, however, about the asymptotic behavior of ensemble methods. In this paper, we prove convergence in L^p of ensemble Kalman smoother to the Kalman smoother in the large-ensemble limit, as well as the convergence of EnKS-4DVAR, which is a Levenberg-Marquardt-like algorithm with EnKS as the linear solver, to the classical Levenberg-Marquardt algorithm in which the linearized problem is solved exactly.

math.PR

Data Assimilation of Satellite Fire Detection in Coupled Atmosphere-Fire Simulation by WRF-SFIRE

Currently available satellite active fire detection products from the VIIRS and MODIS instruments on polar-orbiting satellites produce detection squares in arbitrary locations. There is no global fire/no fire map, no detection under cloud cover, false negatives are common, and the detection squares are much coarser than the resolution of a fire behavior model. Consequently, current active fire satellite detection products should be used to improve fire modeling in a statistical sense only, rather than as a direct input. We describe a new data assimilation method for active fire detection, based on a modification of the fire arrival time to simultaneously minimize the difference from the forecast fire arrival time and maximize the likelihood of the fire detection data. This method is inspired by contour detection methods used in computer vision, and it can be cast as a Bayesian inverse problem technique, or a generalized Tikhonov regularization. After the new fire arrival time on the whole simulation domain is found, the model can be re-run from a time in the past using the new fire arrival time to generate the heat fluxes and to spin up the atmospheric model until the satellite overpass time, when the coupled simulation continues from the modified state.

physics.data-an

Data assimilation of dead fuel moisture observations from remote automated weather stations

Fuel moisture has a major influence on the behavior of wildland fires and is an important underlying factor in fire risk assessment. We propose a method to assimilate dead fuel moisture content observations from remote automated weather stations (RAWS) into a time-lag fuel moisture model. RAWS are spatially sparse and a mechanism is needed to estimate fuel moisture content at locations potentially distant from observational stations. This is arranged using a trend surface model (TSM), which allows us to account for the effects of topography and atmospheric state on the spatial variability of fuel moisture content. At each location of interest, the TSM provides a pseudo-observation, which is assimilated via Kalman filtering. The method is tested with the time-lag fuel moisture model in the coupled weather-fire code WRF-SFIRE on 10-hr fuel moisture content observations from Colorado RAWS in 2013. We show using leave-one-out testing that the TSM compares favorably with inverse squared distance interpolation as used in the Wildland Fire Assessment System. Finally, we demonstrate that the data assimilation method is able to improve fuel moisture content estimates in unobserved fuel classes.

physics.ao-ph

Toward an integrated system for fire, smoke, and air quality simulations

In this study, we describe how WRF-Sfire is coupled with WRF-Chem to construct WRFSC, an integrated forecast system for wildfire and smoke prediction. The integrated forecast system has the advantage of not requiring a simple plume-rise model and assumptions about the size and heat release from the fire in order to determine fire emissions into the atmosphere. With WRF-Sfire, wildfire spread, plume and plume-top heights are predicted directly, at every WRF timestep, providing comprehensive meteorology and fire emissions to the chemical transport model WRF-Chem. Evaluation of WRFSC was based on comparisons between available observations to the results of two WRFSC simulations. The study found overall good agreement between forecasted and observed fire spread and smoke transport for the Witch-Guejito fire. Also the simulated PM2.5 (fine particulate matter) peak concentrations matched the observations. However, the NO and ozone levels were underestimated in the simulations and the peak concentrations were mistimed. Determining the terminal or plume-top height is one of the most important aspects of simulating wildfire plume transport, and the study found overall good agreement between simulated and observed plume-top heights, with some (10% or less) underestimation by the simulations. One of the most promising results of the study was the agreement between passive-tracer modeled plume-top heights for the Barker Canyon fire simulation and observations. This simulation took only 13h, with the first 24h forecast ready in almost 3h, making it a possible operational tool for providing emission profiles for external chemical transport models.

physics.ao-ph

Convergence of the Square Root Ensemble Kalman Filter in the Large Ensemble Limit

Ensemble filters implement sequential Bayesian estimation by representing the probability distribution by an ensemble mean and covariance. Unbiased square root ensemble filters use deterministic algorithms to produce an analysis (posterior) ensemble with prescribed mean and covariance, consistent with the Kalman update. This includes several filters used in practice, such as the Ensemble Transform Kalman Filter (ETKF), the Ensemble Adjustment Kalman Filter (EAKF), and a filter by Whitaker and Hamill. We show that at every time index, as the number of ensemble members increases to infinity, the mean and covariance of an unbiased ensemble square root filter converge to those of the Kalman filter, in the case a linear model and an initial distribution of which all moments exist. The convergence is in $L^{p}$ and the convergence rate does not depend on the model dimension. The result holds in the infinitely dimensional Hilbert space as well.

math.ST

Data assimilation of fuel moisture in WRF-SFIRE

Fuel moisture is a major influence on the behavior of wildland fires and an important underlying factor in fire risk. We present a method to assimilate spatially sparse fuel moisture observations from remote automatic weather stations (RAWS) into the moisture model in WRF-SFIRE. WRF-SFIRE is a coupled atmospheric and fire behavior model which simulates the evolution of fuel moisture in idealized fuel species based on atmospheric state. The proposed method uses a modified trend surface model to estimate the fuel moisture field and its uncertainty based on currently available observations. At each grid point of WRF-SFIRE, this information is combined with the model forecast using a nonlinear Kalman filter, leading to an updated estimate of fuel moisture. We demonstrate the effectiveness of the method with tests in two real-world situations: a region in Southern California, where two large Santa Ana fires occurred recently, and on a domain enclosing Colorado.

physics.ao-ph

Air pollution forecasting by coupled atmosphere-fire model WRF and SFIRE with WRF-Chem

Atmospheric pollution regulations have emerged as a dominant obstacle to prescribed burns. Thus, forecasting the pollution caused by wildland fires has acquired high importance. WRF and SFIRE model wildland fire spread in a two-way interaction with the atmosphere. The surface heat flux from the fire causes strong updrafts, which in turn change the winds and affect the fire spread. Fire emissions, estimated from the burning organic matter, are inserted in every time step into WRF-Chem tracers at the lowest atmospheric layer. The buoyancy caused by the fire then naturally simulates plume dynamics, and the chemical transport in WRF-Chem provides a forecast of the pollution spread. We discuss the choice of wood burning models and compatible chemical transport models in WRF-Chem, and demonstrate the results on case studies.

physics.ao-ph