arXiv ScienceSearch

arXiv subjects

Adam Andersson

Publications and source records attributed to Adam Andersson.

18 recordsLinked to original sources

Convergence of fictitious play for fully coupled FBSDEs in finite-player stochastic differential games

In this article we investigate the theoretical convergence properties of the fictitious-play approximation procedure applied to coupled FBSDE systems for finite-player non-zero-sum stochastic differential games. Under one set of assumptions, the convergence is shown to be geometric. Under an additional structural assumption, the geometric convergence rate further improves to a super-exponential rate in a special class of games. To the best of our knowledge, this provides the first convergence analysis of fictitious play for fully coupled FBSDEs. A numerical experiment with a linear-quadratic interbank borrowing and lending problem confirms the geometric convergence.

math.OC

Dynamic one-time delivery of critical data by small and sparse UAV swarms: a model problem for MARL scaling studies

This work studies the application of Multi-Agent Reinforcement Learning (MARL) to decentralized control of unmanned aerial vehicles to relay a critical data package to a known position. For this purpose, a family of deterministic games is introduced, designed for MARL scaling studies. A robust baseline policy is proposed which restricts agent motion and applies Dijkstra's shortest path algorithm. Computational experiment results show that two off-the-shelf MARL algorithms perform competitively with the baseline for a small number of agents, but face scalability issues as the number of agents increases. Source code and animations are available online at https://github.com/mikapersson/Information-Relaying.

eess.SY

Nonlinear filtering based on density approximation and deep BSDE prediction

A novel approximate Bayesian filter based on backward stochastic differential equations is introduced. It uses a nonlinear Feynman--Kac representation of the filtering problem and the approximation of an unnormalized filtering density using the well-known deep BSDE method and neural networks. The method is trained offline, which means that it can be applied online with new observations. A hybrid a priori-a posteriori error bound is proved under a parabolic H\"ormander condition. The theoretical convergence rate is confirmed in two numerical examples.

math.NA

The deep multi-FBSDE method: a robust deep learning method for coupled FBSDEs

We introduce the deep multi-FBSDE method for robust approximation of coupled forward-backward stochastic differential equations (FBSDEs), focusing on cases where the deep BSDE method of Han, Jentzen, and E (2018) fails to converge. To overcome the convergence issues, we consider a family of FBSDEs that are equivalent to the original problem in the sense that they satisfy the same associated partial differential equation (PDE). Our algorithm proceeds in two phases: first, we approximate the initial condition for the FBSDE family, and second, we approximate the original FBSDE using the initial condition approximated in the first phase. Numerical experiments show that our method converges even when the standard deep BSDE method does not.

math.NA

A convergent scheme for the Bayesian filtering problem based on the Fokker--Planck equation and deep splitting

A numerical scheme for approximating the nonlinear filtering density is introduced and its convergence rate is established, theoretically under a parabolic H\"{o}rmander condition, and empirically in numerical examples. In a prediction step, between the noisy and partial measurements at discrete times, the scheme approximates the Fokker--Planck equation with a deep splitting scheme, followed by an exact update through Bayes' formula. This results in a classical prediction-update filtering algorithm that operates online for new observation sequences post-training. The algorithm employs a sampling-based Feynman--Kac approach, designed to mitigate the curse of dimensionality. As a corollary we obtain the convergence rate for the approximation of the Fokker--Planck equation alone, disconnected from the filtering problem. The convergence analysis is complemented by a nonlinear $10$-dimensional numerical example demonstrating the robustness of the method.

math.NA

Evaluating the Role of Security Assurance Cases in Agile Medical Device Development

Cybersecurity issues in medical devices threaten patient safety and can cause harm if exploited. Standards and regulations therefore require vendors of such devices to provide an assessment of the cybersecurity risks as well as a description of their mitigation. Security assurance cases (SACs) capture these elements as a structured argument. Compiling an SAC requires taking domain-specific regulations and requirements as well as the way of working into account. In this case study, we evaluate CASCADE, an approach for building SAC in the context of a large medical device manufacturer with an established agile development workflow. We investigate the regulatory context as well as the adaptations needed in the development process. Our results show the suitability of SACs in the medical device industry. We identified 17 use cases in which an SAC supports internal and external needs. The connection to safety assurance can be achieved by incorporating information from the risk assessment matrix into the SAC. Integration into the development process can be achieved by introducing a new role and rules for the design review and the release to production as well as additional criteria for the definition of done. We also show that SACs built with CASCADE fulfill the requirements of relevant standards in the medical domain such as ISO 14971.

cs.CR

An energy-based deep splitting method for the nonlinear filtering problem

The purpose of this paper is to explore the use of deep learning for the solution of the nonlinear filtering problem. This is achieved by solving the Zakai equation by a deep splitting method, previously developed for approximate solution of (stochastic) partial differential equations. This is combined with an energy-based model for the approximation of functions by a deep neural network. This results in a computationally fast filter that takes observations as input and that does not require re-training when new observations are received. The method is tested on four examples, two linear in one and twenty dimensions and two nonlinear in one dimension. The method shows promising performance when benchmarked against the Kalman filter and the bootstrap particle filter.

stat.CO

Convergence of a robust deep FBSDE method for stochastic control

In this paper, we propose a deep learning based numerical scheme for strongly coupled FBSDEs, stemming from stochastic control. It is a modification of the deep BSDE method in which the initial value to the backward equation is not a free parameter, and with a new loss function being the weighted sum of the cost of the control problem, and a variance term which coincides with the mean squared error in the terminal condition. We show by a numerical example that a direct extension of the classical deep BSDE method to FBSDEs, fails for a simple linear-quadratic control problem, and motivate why the new method works. Under regularity and boundedness assumptions on the exact controls of time continuous and time discrete control problems, we provide an error analysis for our method. We show empirically that the method converges for three different problems, one being the one that failed for a direct extension of the deep BSDE method.

math.OC

Finite element approximation of Lyapunov equations related to parabolic stochastic PDEs

A numerical analysis for the fully discrete approximation of an operator Lyapunov equation related to linear SPDEs (stochastic partial differential equations) driven by multiplicative noise is considered. The discretization of the Lyapunov equation in space is given by finite elements and in time by a semiimplicit Euler scheme. The main result is the derivation of the rate of convergence in operator norm. Moreover, it is shown that the solution of the equation provides a representation of a quadratic and path dependent functional of the SPDE solution. This fact yields a deterministic numerical method to compute such functionals. As a secondary result, weak error rates are established for a fully discrete finite element approximation of the SPDE with respect to this functional. This is obtained as a consequence of the approximation analysis of the Lyapunov equation. It is the first weak convergence analysis for fully discrete finite element approximations of SPDEs driven by multiplicative noise that obtains double the strong rate of convergence, especially for path dependent functionals and smooth spatial noise. Numerical experiments illustrate the results empirically and it is demonstrated that the deterministic method has advantages over Monte Carlo sampling in a stability context.

math.NA

Malliavin regularity and weak approximation of semilinear SPDE with L\'evy noise

We investigate the weak order of convergence for space-time discrete approximations of semilinear parabolic stochastic evolution equations driven by additive square-integrable L\'evy noise. To this end, the Malliavin regularity of the solution is analyzed and recent results on refined Malliavin-Sobolev spaces from the Gaussian setting are extended to a Poissonian setting. For a class of path-dependent test functions, we obtain that the weak rate of convergence is twice the strong rate.

math.PR

Poisson Malliavin calculus in Hilbert space with an application to SPDE

In this paper we introduce a Hilbert space-valued Malliavin calculus for Poisson random measures. It is solely based on elementary principles from the theory of point processes and basic moment estimates, and thus allows for a simple treatment of the Malliavin operators. The main part of the theory is developed for general Poisson random measures, defined on a $\sigma$-finite measure space, with minimal conditions. The theory is shown to apply to a space-time setting, suitable for studying stochastic partial differential equations. As an application, we analyze the weak order of convergence of space-time approximations for a class of linear equations with $\alpha$-stable noise, $\alpha\in(1,2)$. For a suitable class of test functions, the weak order of convergence is found to be $\alpha$ times the strong order.

math.PR

Regularity properties for solutions of infinite dimensional Kolmogorov equations in Hilbert spaces

In this article we establish regularity properties for solutions of infinite dimensional Kolmogorov equations. We prove that if the nonlinear drift coefficients, the nonlinear diffusion coefficients, and the initial conditions of the considered Kolmogorov equations are $n$-times continuously Fr\'{e}chet differentiable, then so are the generalized solutions at every positive time. In addition, a key contribution of this work is to prove suitable enhanced regularity properties for the derivatives of the generalized solutions of the Kolmogorov equations in the sense that the dominating linear operator in the drift coefficient of the Kolmogorov equation regularizes the higher order derivatives of the solutions. Such enhanced regularity properties are of major importance for establishing weak convergence rates for spatial and temporal numerical approximations of stochastic partial differential equations.

math.AP

On the differentiability of solutions of stochastic evolution equations with respect to their initial values

In this article we study the differentiability of solutions of parabolic semilinear stochastic evolution equations (SEEs) with respect to their initial values. We prove that if the nonlinear drift coefficients and the nonlinear diffusion coefficients of the considered SEEs are $n$-times continuously Fr\'{e}chet differentiable, then the solutions of the considered SEEs are also $n$-times continuously Fr\'{e}chet differentiable with respect to their initial values. Moreover, a key contribution of this work is to establish suitable enhanced regularity properties of the derivative processes of the considered SEE in the sense that the dominating linear operator appearing in the SEE smoothes the higher order derivative processes.

math.PR

Existence, uniqueness, and regularity for stochastic evolution equations with irregular initial values

In this article we develop a framework for studying parabolic semilinear stochastic evolution equations (SEEs) with singularities in the initial condition and singularities at the initial time of the time-dependent coefficients of the considered SEE. We use this framework to establish existence, uniqueness, and regularity results for mild solutions of parabolic semilinear SEEs with singularities at the initial time. We also provide several counterexample SEEs that illustrate the optimality of our results.

math.PR

Mean-square convergence of the BDF2-Maruyama and backward Euler schemes for SDE satisfying a global monotonicity condition

In this paper the numerical approximation of stochastic differential equations satisfying a global monotonicity condition is studied. The strong rate of convergence with respect to the mean square norm is determined to be $\frac{1}{2}$ for the two-step BDF-Maruyama scheme and for the backward Euler-Maruyama method. In particular, this is the first paper which proves a strong convergence rate for a multi-step method applied to equations with possibly superlinearly growing drift and diffusion coefficient functions. We also present numerical experiments for the $\tfrac32$-volatility model from finance, which verify our results in practice and indicate that the BDF2-Maruyama method offers advantages over Euler-type methods if the stochastic differential equation is stiff or driven by a noise with small intensity.

math.NA

Weak error analysis for semilinear stochastic Volterra equations with additive noise

We prove a weak error estimate for the approximation in space and time of a semilinear stochastic Volterra integro-differential equation driven by additive space-time Gaussian noise. We treat this equation in an abstract framework, in which parabolic stochastic partial differential equations are also included as a special case. The approximation in space is performed by a standard finite element method and in time by an implicit Euler method combined with a convolution quadrature. The weak rate of convergence is proved to be twice the strong rate, as expected. Our convergence result concerns not only functionals of the solution at a fixed time but also more complicated functionals of the entire path and includes convergence of covariances and higher order statistics. The proof does not rely on a Kolmogorov equation. Instead it is based on a duality argument from Malliavin calculus.

math.NA

Duality in refined Sobolev-Malliavin spaces and weak approximations of SPDE

We introduce a new family of refined Sobolev-Malliavin spaces that capture the integrability in time of the Malliavin derivative. We consider duality in these spaces and derive a Burkholder type inequality in a dual norm. The theory we develop allows us to prove weak convergence with essentially optimal rate for numerical approximations in space and time of semilinear parabolic stochastic evolution equations driven by Gaussian additive noise. In particular, we combine a standard Galerkin finite element method with backward Euler timestepping. The method of proof does not rely on the use of the Kolmogorov equation or the It\={o} formula and is therefore non-Markovian in nature. Test functions satisfying polynomial growth and mild smoothness assumptions are allowed, meaning in particular that we prove convergence of arbitrary moments with essentially optimal rate.

math.PR

Weak convergence for a spatial approximation of the nonlinear stochastic heat equation

We find the weak rate of convergence of the spatially semidiscrete finite element approximation of the nonlinear stochastic heat equation. Both multiplicative and additive noise is considered under different assumptions. This extends an earlier result of Debussche in which time discretization is considered for the stochastic heat equation perturbed by white noise. It is known that this equation has a solution only in one space dimension. In order to obtain results for higher dimensions, colored noise is considered here, besides white noise in one dimension. Integration by parts in the Malliavin sense is used in the proof. The rate of weak convergence is, as expected, essentially twice the rate of strong convergence.

math.NA