arXiv ScienceSearch

arXiv subjects

Kevin Burrage

Publications and source records attributed to Kevin Burrage.

At least 19 recordsLinked to original sources

Implementation of Milstein Schemes for Stochastic Delay-Differential Equations with Arbitrary Fixed Delays

This paper develops methods for numerically solving stochastic delay-differential equations (SDDEs) with multiple fixed delays that do not align with a uniform time mesh. We focus on numerical schemes of strong convergence orders $1/2$ and $1$, such as the Euler--Maruyama and Milstein schemes, respectively. Although numerical schemes for SDDEs with delays $\tau_1,\ldots,\tau_K$ are theoretically established, their implementations require evaluations at both present times such as $t_n$, and also at delayed times such as $t_n-\tau_k$ and $t_n-\tau_l-\tau_k$. As a result, previous simulations of these schemes have been largely restricted to the case of divisible delays. We develop simulation techniques for the general case of indivisible delays where delayed times such as $t_n-\tau_k$ are not restricted to a uniform time mesh. To achieve order of convergence (OoC) $1/2$, we implement the schemes with a fixed step size while using linear interpolation to approximate delayed scheme values. To achieve OoC $1$, we construct an augmented time mesh that includes all time points required to evaluate the schemes, which necessitates using a varying step size. We also introduce a technique to simulate delayed iterated stochastic integrals on the augmented time mesh, by extending an established method from the divisible-delays setting. We then confirm that the numerical schemes achieve their theoretical convergence orders with computational examples.

math.NA

Magnus Methods for Stochastic Delay-Differential Equations

This paper introduces Magnus-based methods for solving stochastic delay-differential equations (SDDEs). We construct Magnus--Euler--Maruyama (MEM) and Magnus--Milstein (MM) schemes by combining stochastic Magnus integrators with Taylor methods for SDDEs. These schemes are applied incrementally between multiples of the delay times. We present proofs of their convergence orders and demonstrate these rates through numerical examples and error graphs. Among the examples, we apply the MEM and MM schemes to both linear and nonlinear problems. We also apply the MEM scheme to a stochastic partial delay-differential equation (SPDDE), comparing its performance with the traditional Euler--Maruyama (EM) method. Under fine spatial discretization, the MEM scheme remains numerically stable while the EM method becomes unstable, yielding a significant computational advantage.

math.NA

Learning surrogate equations for the analysis of an agent-based cancer model

In this paper, we adapt a two-species agent-based cancer model that describes the interaction between cancer cells and healthy cells on a uniform grid to include the interaction with a third species -- namely immune cells. We run six different scenarios to explore the competition between cancer and immune cells and the initial concentration of the immune cells on cancer dynamics. We then use coupled equation learning to construct a population-based reaction model for each scenario. We show how they can be unified into a single surrogate population-based reaction model, whose underlying three coupled ordinary differential equations are much easier to analyse than the original agent-based model. As an example, by finding the single steady state of the cancer concentration, we are able to find a linear relationship between this concentration and the initial concentration of the immune cells. This then enables us to estimate suitable values for the competition and initial concentration to reduce the cancer substantially without performing additional complex and expensive simulations from an agent-based stochastic model.

cs.LG

Cardiac Digital Twin Pipeline for Virtual Therapy Evaluation

Cardiac digital twins are computational tools capturing key functional and anatomical characteristics of patient hearts for investigating disease phenotypes and predicting responses to therapy. When paired with large-scale computational resources and large clinical datasets, digital twin technology can enable virtual clinical trials on virtual cohorts to fast-track therapy development. Here, we present an automated pipeline for personalising ventricular anatomy and electrophysiological function based on routinely acquired cardiac magnetic resonance (CMR) imaging data and the standard 12-lead electrocardiogram (ECG). Using CMR-based anatomical models, a sequential Monte-Carlo approximate Bayesian computational inference method is extended to infer electrical activation and repolarisation characteristics from the ECG. Fast simulations are conducted with a reaction-Eikonal model, including the Purkinje network and biophysically-detailed subcellular ionic current dynamics for repolarisation. For each patient, parameter uncertainty is represented by inferring a population of ventricular models rather than a single one, which means that parameter uncertainty can be propagated to therapy evaluation. Furthermore, we have developed techniques for translating from reaction-Eikonal to monodomain simulations, which allows more realistic simulations of cardiac electrophysiology. The pipeline is demonstrated in a healthy female subject, where our inferred reaction-Eikonal models reproduced the patient's ECG with a Pearson's correlation coefficient of 0.93, and the translated monodomain simulations have a correlation coefficient of 0.89. We then apply the effect of Dofetilide to the monodomain population of models for this subject and show dose-dependent QT and T-peak to T-end prolongations that are in keeping with large population drug response data.

cs.CE

Using a library of chemical reactions to fit systems of ordinary differential equations to agent-based models: a machine learning approach

In this paper we introduce a new method based on a library of chemical reactions for constructing a system of ordinary differential equations from stochastic simulations arising from an agent-based model. The advantage of this approach is that this library respects any coupling between systems components, whereas the SINDy algorithm (introduced by Brunton, Proctor and Kutz) treats the individual components as decoupled from one another. Another advantage of our approach is that we can use a non-negative least squares algorithm to find the non-negative rate constants in a very robust, stable and simple manner. We illustrate our ideas on an agent-based model of tumour growth on a 2D lattice.

math.DS

Digital Twinning of the Human Ventricular Activation Sequence to Clinical 12-lead ECGs and Magnetic Resonance Imaging Using Realistic Purkinje Networks for in Silico Clinical Trials

Cardiac in silico clinical trials can virtually assess the safety and efficacy of therapies using human-based modelling and simulation. These technologies can provide mechanistic explanations for clinically observed pathological behaviour. Designing virtual cohorts for in silico trials requires exploiting clinical data to capture the physiological variability in the human population. The clinical characterisation of ventricular activation and the Purkinje network is challenging, especially non-invasively. Our study aims to present a novel digital twinning pipeline that can efficiently generate and integrate Purkinje networks into human multiscale biventricular models based on subject-specific clinical 12-lead electrocardiogram and magnetic resonance recordings. Essential novel features of the pipeline are the human-based Purkinje network generation method, personalisation considering ECG R wave progression as well as QRS morphology, and translation from reduced-order Eikonal models to equivalent biophysically-detailed monodomain ones. We demonstrate ECG simulations in line with clinical data with clinical image-based multiscale models with Purkinje in four control subjects and two hypertrophic cardiomyopathy patients (simulated and clinical QRS complexes with Pearson's correlation coefficients > 0.7). Our methods also considered possible differences in the density of Purkinje myocardial junctions in the Eikonal-based inference as regional conduction velocities. These differences translated into regional coupling effects between Purkinje and myocardial models in the monodomain formulation. In summary, we demonstrate a digital twin pipeline enabling simulations yielding clinically-consistent ECGs with clinical CMR image-based biventricular multiscale models, including personalised Purkinje in healthy and cardiac disease conditions.

physics.med-ph

The Fisher Geometry and Geodesics of the Multivariate Normals, without Differential Geometry

Choosing the Fisher information as the metric tensor for a Riemannian manifold provides a powerful yet fundamental way to understand statistical distribution families. Distances along this manifold become a compelling measure of statistical distance, and paths of shorter distance improve sampling techniques that leverage a sequence of distributions in their operation. Unfortunately, even for a distribution as generally tractable as the multivariate normal distribution, this information geometry proves unwieldy enough that closed-form solutions for shortest-distance paths or their lengths remain unavailable outside of limited special cases. In this review we present for general statisticians the most practical aspects of the Fisher geometry for this fundamental distribution family. Rather than a differential geometric treatment, we use an intuitive understanding of the covariance-induced curvature of this manifold to unify the special cases with known closed-form solution and review approximate solutions for the general case. We also use the multivariate normal information geometry to better understand the paths or distances commonly used in statistics (annealing, Wasserstein). Given the unavailability of a general solution, we also discuss the methods used for numerically obtaining geodesics in the space of multivariate normals, identifying remaining challenges and suggesting methodological improvements.

math.ST

Formulae for mixed moments of Wiener processes and a stochastic area integral

This paper deals with the expectation of monomials with respect to the stochastic area integral $A_{1,2}(t,t+h)=\int_{t}^{t+h}\int_{t}^{s}{\rm d} W_{1}(r){\rm d} W_{2}(s) -\int_{t}^{t+h}\int_{t}^{s}{\rm d} W_{2}(r){\rm d} W_{1}(s)$ and the increments of two Wiener processes, $\Delta{W}_{i}(t,t+h)=W_{i}(t+h)-W_{i}(t),\ i=1,2$. In a monomial, if the exponent of one of the Wiener increments or the stochastic area integral is an odd number, then the expectation of the monomial is zero. However, if the exponent of any of them is an even number, then the expectation is nonzero and its exact value is not known in general. In the present paper, we derive formulae to give the value in general. As an application of the formulae, we will utilize the formulae for a careful stability analysis on a Magnus-type Milstein method. As another application, we will give some mixed moments of the increments of Wiener processes and stochastic double integrals.

math.PR

Stability switching in Lotka-Volterra and Ricker-type predator-prey systems with arbitrary step size

Dynamical properties of numerically approximated discrete systems may become inconsistent with those of the corresponding continuous-time system. We present a qualitative analysis of the dynamical properties of two species Lotka-Volterra and Ricker-type predator-prey systems under discrete and continuous settings. By creating an arbitrary time discretisation, we obtain stability conditions that preserve the characteristics of continuous-time models and their numerically approximated systems. Here, we show that even small changes to some of the model parameters may alter the system dynamics unless an appropriate time discretisation is chosen to return similar dynamical behaviour observed in the corresponding continuous-time system. We also found similar dynamical properties of the Ricker-type predator-prey systems under certain conditions. Our results demonstrate the need for preliminary analysis to identify which dynamical properties of approximated discretised systems agree or disagree with the corresponding continuous-time systems.

math.DS

Analysis of sloppiness in model simulations: unveiling parameter uncertainty when mathematical models are fitted to data

This work introduces a comprehensive approach to assess the sensitivity of model outputs to changes in parameter values, constrained by the combination of prior beliefs and data. This novel approach identifies stiff parameter combinations strongly affecting the quality of the model-data fit while simultaneously revealing which of these key parameter combinations are informed primarily by the data or are also substantively influenced by the priors. We focus on the very common context in complex systems where the amount and quality of data are low compared to the number of model parameters to be collectively estimated, and showcase the benefits of this technique for applications in biochemistry, ecology, and cardiac electrophysiology. We also show how stiff parameter combinations, once identified, uncover controlling mechanisms underlying the system being modeled and inform which of the model parameters need to be prioritized in future experiments for improved parameter inference from collective model-data fitting.

stat.ME

Parameter estimation and uncertainty quantification using information geometry

In this work we: (1) review likelihood-based inference for parameter estimation and the construction of confidence regions; and, (2) explore the use of techniques from information geometry, including geodesic curves and Riemann scalar curvature, to supplement typical techniques for uncertainty quantification such as Bayesian methods, profile likelihood, asymptotic analysis and bootstrapping. These techniques from information geometry provide data-independent insights into uncertainty and identifiability, and can be used to inform data collection decisions. All code used in this work to implement the inference and information geometry techniques is available on GitHub.

stat.ME

The use of a time-fractional transport model for performing computational homogenisation of 2D heterogeneous media exhibiting memory effects

In this work, a two-dimensional time-fractional subdiffusion model is developed to investigate the underlying transport phenomena evolving in a binary medium comprised of two sub-domains occupied by homogeneous material. We utilise an unstructured mesh control volume method to validate the model against a derived semi-analytical solution for a class of two-layered problems. This generalised transport model is then used to perform computational homogenisation on various two-dimensional heterogenous porous media. A key contribution of our work is to extend the classical homogenisation theory to accommodate the new framework and show that the effective diffusivity tensor can be computed once the cell problems reach steady state at the microscopic scale. We verify the theory for binary media via a series of well-known test problems and then investigate media having inclusions that exhibit a molecular relaxation (memory) effect. Finally, we apply the generalised transport model to estimate the bound water diffusivity tensor on cellular structures obtained from environmental scanning electron microscope (ESEM) images for Spruce wood and Australian hardwood. A highlight of our work is that the computed diffusivity for the heterogeneous media with molecular relaxation is quite different from the classical diffusion cases, being dominated at steady-state by the material with memory effects.

math.NA

Homogenisation for the monodomain model in the presence of microscopic fibrotic structures

Computational models in cardiac electrophysiology are notorious for long runtimes, restricting the numbers of nodes and mesh elements in the numerical discretisations used for their solution. This makes it particularly challenging to incorporate structural heterogeneities on small spatial scales, preventing a full understanding of the critical arrhythmogenic effects of conditions such as cardiac fibrosis. In this work, we explore the technique of homogenisation by volume averaging for the inclusion of non-conductive micro-structures into larger-scale cardiac meshes with minor computational overhead. Importantly, our approach is not restricted to periodic patterns, enabling homogenised models to represent, for example, the intricate patterns of collagen deposition present in different types of fibrosis. We first highlight the importance of appropriate boundary condition choice for the closure problems that define the parameters of homogenised models. Then, we demonstrate the technique's ability to correctly upscale the effects of fibrotic patterns with a spatial resolution of 10 $\mu$m into much larger numerical mesh sizes of 100-250 $\mu$m. The homogenised models using these coarser meshes correctly predict critical pro-arrhythmic effects of fibrosis, including slowed conduction, source/sink mismatch, and stabilisation of re-entrant activation patterns. As such, this approach to homogenisation represents a significant step towards whole organ simulations that unravel the effects of microscopic cardiac tissue heterogeneities.

physics.med-ph

Inference of ventricular activation properties from non-invasive electrocardiography

The realisation of precision cardiology requires novel techniques for the non-invasive characterisation of individual patients' cardiac function to inform therapeutic and diagnostic decision-making. The electrocardiogram (ECG) is the most widely used clinical tool for cardiac diagnosis. Its interpretation is, however, confounded by functional and anatomical variability in heart and torso. In this study, we develop new computational techniques to estimate key ventricular activation properties for individual subjects by exploiting the synergy between non-invasive electrocardiography and image-based torso-biventricular modelling and simulation. More precisely, we present an efficient sequential Monte Carlo approximate Bayesian computation-based inference method, integrated with Eikonal simulations and torso-biventricular models constructed based on clinical cardiac magnetic resonance (CMR) imaging. The method also includes a novel strategy to treat combined continuous (conduction speeds) and discrete (earliest activation sites) parameter spaces, and an efficient dynamic time warping-based ECG comparison algorithm. We demonstrate results from our inference method on a cohort of twenty virtual subjects with cardiac volumes ranging from 74 cm3 to 171 cm3 and considering low versus high resolution for the endocardial discretisation (which determines possible locations of the earliest activation sites). Results show that our method can successfully infer the ventricular activation properties from non-invasive data, with higher accuracy for earliest activation sites, endocardial speed, and sheet (transmural) speed in sinus rhythm, rather than the fibre or sheet-normal speeds.

q-bio.TO

The reflectionless properties of Toeplitz waves and Hankel waves: an analysis via Bessel functions

We study reflectionless properties at the boundary for the wave equation in one space dimension and time, in terms of a well-known matrix that arises from a simple discretisation of space. It is known that all matrix functions of the familiar second difference matrix representing the Laplacian in this setting are the sum of a Toeplitz matrix and a Hankel matrix. The solution to the wave equation is one such matrix function. Here, we study the behaviour of the corresponding waves that we call Toeplitz waves and Hankel waves. We show that these waves can be written as certain linear combinations of even Bessel functions of the first kind. We find exact and explicit formulae for these waves. We also show that the Toeplitz and Hankel waves are reflectionless on even, respectively odd, traversals of the domain. Our analysis naturally suggests a new method of computer simulation that allows control, so that it is possible to choose -- in advance -- the number of reflections. An attractive result that comes out of our analysis is the appearance of the well-known shift matrix, and also other matrices that might be thought of as Hankel versions of the shift matrix. By revealing the algebraic structure of the solution in terms of shift matrices, we make it clear how the Toeplitz and Hankel waves are indeed reflectionless at the boundary on even or odd traversals. Although the subject of the reflectionless boundary condition has a long history, we believe the point of view that we adopt here in terms of matrix functions is new.

math.NA

A discrete least squares collocation method for two-dimensional nonlinear time-dependent partial differential equations

In this paper, we develop regularized discrete least squares collocation and finite volume methods for solving two-dimensional nonlinear time-dependent partial differential equations on irregular domains. The solution is approximated using tensor product cubic spline basis functions defined on a background rectangular (interpolation) mesh, which leads to high spatial accuracy and straightforward implementation, and establishes a solid base for extending the computational framework to three-dimensional problems. A semi-implicit time-stepping method is employed to transform the nonlinear partial differential equation into a linear boundary value problem. A key finding of our study is that the newly proposed mesh-free finite volume method based on circular control volumes reduces to the collocation method as the radius limits to zero. Both methods produce a large constrained least-squares problem that must be solved at each time step in the advancement of the solution. We have found that regularization yields a relatively well-conditioned system that can be solved accurately using QR factorization. An extensive numerical investigation is performed to illustrate the effectiveness of the present methods, including the application of the new method to a coupled system of time-fractional partial differential equations having different fractional indices in different (irregularly shaped) regions of the solution domain.

math.NA

Efficient multistep methods for tempered fractional calculus: Algorithms and Simulations

In this work, we extend the fractional linear multistep methods in [C. Lubich, SIAM J. Math. Anal., 17 (1986), pp.704--719] to the tempered fractional integral and derivative operators in the sense that the tempered fractional derivative operator is interpreted in terms of the Hadamard finite-part integral. We develop two fast methods, Fast Method I and Fast Method II, with linear complexity to calculate the discrete convolution for the approximation of the (tempered) fractional operator. Fast Method I is based on a local approximation for the contour integral that represents the convolution weight. Fast Method II is based on a globally uniform approximation of the trapezoidal rule for the integral on the real line. Both methods are efficient, but numerical experimentation reveals that Fast Method II outperforms Fast Method I in terms of accuracy, efficiency, and coding simplicity. The memory requirement and computational cost of Fast Method II are $O(Q)$ and $O(Qn_T)$, respectively, where $n_T$ is the number of the final time steps and $Q$ is the number of quadrature points used in the trapezoidal rule. The effectiveness of the fast methods is verified through a series of numerical examples for long-time integration, including a numerical study of a fractional reaction-diffusion model.

math.NA

Computational modelling of cardiac ischaemia using a variable-order fractional Laplacian

Heart failure is one of the most common causes of death in the western world. Many heart problems are linked to disturbances in cardiac electrical activity, such as wave re-entry caused by ischaemia. In terms of mathematical modelling, the monodomain equation is widely used to model electrical activity in the heart. Recently, Bueno-Orovio et al. [J. R. Soc. Interface 11: 20140352, 2014] pioneered the use of a fractional Laplacian operator in the monodomain equation to account for the complex heterogeneous structures in heart tissue. In this work we consider how to extend this approach to apply to hearts with regions of damaged tissue. This requires the use of a fractional Laplacian operator whose fractional order varies spatially. We develop efficient numerical methods capable of solving this challenging problem on domains ranging from simple one-dimensional intervals with uniform meshes, through to full three-dimensional geometries on unstructured meshes. Results are presented for several test problems in one dimension, demonstrating the effects of different fractional orders in regions of healthy and damaged tissue. Then we showcase some new results for a three-dimensional fractional monodomain equation with a Beeler-Reuter ionic current model on a rabbit heart mesh. These simulation results are found to exhibit wave re-entry behaviour, brought about only by varying the value of the fractional order in a region representing damaged tissue.

math.NA