arXiv ScienceSearch

arXiv subjects

Chris Oates

Publications and source records attributed to Chris Oates.

8 recordsLinked to original sources

Probabilistic Inference and Learning with Stein's Method

This monograph provides a rigorous overview of theoretical and methodological aspects of probabilistic inference and learning with Stein's method. Recipes are provided for constructing Stein discrepancies from Stein operators and Stein sets, and properties of these discrepancies such as computability, separation, convergence detection, and convergence control are discussed. Further, the connection between Stein operators and Stein variational gradient descent is set out in detail. The main definitions and results are precisely stated, and references to all proofs are provided.

stat.ML

Fundamental Physics with a State-of-the-Art Optical Clock in Space

Recent advances in optical atomic clocks and optical time transfer have enabled new possibilities in precision metrology for both tests of fundamental physics and timing applications. Here we describe a space mission concept that would place a state-of-the-art optical atomic clock in an eccentric orbit around Earth. A high stability laser link would connect the relative time, range, and velocity of the orbiting spacecraft to earthbound stations. The primary goal for this mission would be to test the gravitational redshift, a classical test of general relativity, with a sensitivity 30,000 times beyond current limits. Additional science objectives include other tests of relativity, enhanced searches for dark matter and drifts in fundamental constants, and establishing a high accuracy international time/geodesic reference.

gr-qc

Optical-Clock-Based Time Scale

A time scale is a procedure for accurately and continuously marking the passage of time. It is exemplified by Coordinated Universal Time (UTC), and provides the backbone for critical navigation tools such as the Global Positioning System (GPS). Present time scales employ microwave atomic clocks, whose attributes can be combined and averaged in a manner such that the composite is more stable, accurate, and reliable than the output of any individual clock. Over the past decade, clocks operating at optical frequencies have been introduced which are orders of magnitude more stable than any microwave clock. However, in spite of their great potential, these optical clocks cannot be operated continuously, which makes their use in a time scale problematic. In this paper, we report the development of a hybrid microwave-optical time scale, which only requires the optical clock to run intermittently while relying upon the ensemble of microwave clocks to serve as the flywheel oscillator. The benefit of using clock ensemble as the flywheel oscillator, instead of a single clock, can be understood by the Dick-effect limit. This time scale demonstrates for the first time sub-nanosecond accuracy for a few months, attaining a fractional frequency uncertainty of 1.45*10-16 at 30 days and reaching the 10-17 decade at 50 days, with respect to UTC. This time scale significantly improves the accuracy in timekeeping and could change the existing time-scale architectures.

physics.app-ph

A Bayesian Conjugate Gradient Method

A fundamental task in numerical computation is the solution of large linear systems. The conjugate gradient method is an iterative method which offers rapid convergence to the solution, particularly when an effective preconditioner is employed. However, for more challenging systems a substantial error can be present even after many iterations have been performed. The estimates obtained in this case are of little value unless further information can be provided about the numerical error. In this paper we propose a novel statistical model for this numerical error set in a Bayesian framework. Our approach is a strict generalisation of the conjugate gradient method, which is recovered as the posterior mean for a particular choice of prior. The estimates obtained are analysed with Krylov subspace methods and a contraction result for the posterior is presented. The method is then analysed in a simulation study as well as being applied to a challenging problem in medical imaging.

stat.ME

On the Bayesian Solution of Differential Equations

The interpretation of numerical methods, such as finite difference methods for differential equations, as point estimators allows for formal statistical quantification of the error due to discretisation in the numerical context. Competing statistical paradigms can be considered and Bayesian probabilistic numerical methods (PNMs) are obtained when Bayesian statistical principles are deployed. Bayesian PNM are closed under composition, such that uncertainty due to different sources of discretisation can be jointly modelled and rigorously propagated. However, we argue that no strictly Bayesian PNM for the numerical solution of ordinary differential equations (ODEs) have yet been developed. To address this gap, we work at a foundational level, where a novel Bayesian PNM is proposed as a proof-of-concept. Our proposal is a synthesis of classical Lie group methods, to exploit the underlying structure of the gradient field, and non-parametric regression in a transformed solution space for the ODE. The procedure is presented in detail for first order ODEs and relies on a certain technical condition -- existence of a solvable Lie algebra -- being satisfied. Numerical illustrations are provided.

stat.ME

Probabilistic Numerical Methods for Partial Differential Equations and Bayesian Inverse Problems

This paper develops a probabilistic numerical method for solution of partial differential equations (PDEs) and studies application of that method to PDE-constrained inverse problems. This approach enables the solution of challenging inverse problems whilst accounting, in a statistically principled way, for the impact of discretisation error due to numerical solution of the PDE. In particular, the approach confers robustness to failure of the numerical PDE solver, with statistical inferences driven to be more conservative in the presence of substantial discretisation error. Going further, the problem of choosing a PDE solver is cast as a problem in the Bayesian design of experiments, where the aim is to minimise the impact of solver error on statistical inferences; here the challenge of non-linear PDEs is also considered. The method is applied to parameter inference problems in which discretisation error in non-negligible and must be accounted for in order to reach conclusions that are statistically valid.

stat.ME

Bayesian Probabilistic Numerical Methods

The emergent field of probabilistic numerics has thus far lacked clear statistical principals. This paper establishes Bayesian probabilistic numerical methods as those which can be cast as solutions to certain inverse problems within the Bayesian framework. This allows us to establish general conditions under which Bayesian probabilistic numerical methods are well-defined, encompassing both non-linear and non-Gaussian models. For general computation, a numerical approximation scheme is proposed and its asymptotic convergence established. The theoretical development is then extended to pipelines of computation, wherein probabilistic numerical methods are composed to solve more challenging numerical tasks. The contribution highlights an important research frontier at the interface of numerical analysis and uncertainty quantification, with a challenging industrial application presented.

stat.ME

Probabilistic Numerical Methods for PDE-constrained Bayesian Inverse Problems

This paper develops meshless methods for probabilistically describing discretisation error in the numerical solution of partial differential equations. This construction enables the solution of Bayesian inverse problems while accounting for the impact of the discretisation of the forward problem. In particular, this drives statistical inferences to be more conservative in the presence of significant solver error. Theoretical results are presented describing rates of convergence for the posteriors in both the forward and inverse problems. This method is tested on a challenging inverse problem with a nonlinear forward model.

stat.ME