arXiv subjects

David Ford

Publications and source records attributed to David Ford.

7 recordsLinked to original sources

arXiv2025

Assimilation of machine learning-predicted nitrate to improve the quality of phytoplankton forecasting in the shelf sea environment

We demonstrate that assimilating Neural Network (NN)-predicted surface nitrate leads to a major improvement in phytoplankton short-range (1-5 day) dynamical model forecasts for the North-West European Shelf (NWES) seas. We show that assimilation of only ocean color chlorophyll-$a$ in the current Met Office NWES operational system can lead to excess surface nitrate concentrations in the post-Spring bloom period and these are a major reason behind some known, fast-growing biases in NWES phytoplankton forecasts during late Spring and Summer. Assimilating observations of nitrate would potentially help address this, but NWES nitrate data are typically not available in sufficient abundance to be effectively assimilated. We have therefore used a recently developed and validated neural network (NN) model predicting surface nitrate concentrations from a range of observable variables and assimilated the NN-predicted nitrate within a research and development version of the Met Office's NWES operational forecasting system. As a result of nitrate assimilation the phytoplankton 5-day forecast skill improves by up to 30%. We show that although much of this improvement can be achieved by using a weekly nitrate climatology predicted by the NN model, there is a clear advantage in using flow-dependent nitrate data. We discuss the impacts of this improvement on a range of additional eutrophication indicators, such as dissolved inorganic phosphorus and sea bottom oxygen. We argue that it should be feasible to upgrade this approach to a fully hybrid machine learning - data assimilation within the near-real time NWES operational forecasting system.

q-bio.QM↗

arXiv2009

Reducing the Risk of Spreadsheet Usage - a Case Study

The frequency with which spreadsheets are used and the associated risk is well known. Many tools and techniques have been developed which help reduce risks associate with creating and maintaining spreadsheet. However, little consideration has been given to reducing the risks of routine usage by the "consumers" - for example when entering and editing data. EASA's solution, available commercially, ensures that any routine process involving spreadsheets can be executed rapidly and without errors by the end-users, often with a significant reduction in manual effort. Specifically, the technology enables the rapid creation and deployment of web-based applications, connected to one or more centralized spreadsheets; this ensures version control, easy and error free usage, and security of intellectual property contained in spreadsheets.

cs.HC↗

arXiv2008

A Note on the Equivalence of Gibbs Free Energy and Information Theoretic Capacity

The minimization of Gibbs free energy is based on the changes in work and free energy that occur in a physical or chemical system. The maximization of mutual information, the capacity, of a noisy channel is determined based on the marginal probabilities and conditional entropies associated with a communications system. As different as the procedures might first appear, through the exploration of a simple, "dual use" Ising model, it is seen that the two concepts are in fact the same. In particular, the case of a binary symmetric channel is calculated in detail.

cond-mat.stat-mech↗

arXiv2006

Surfaces of Constant Temperature in Time

The inverse relationship between energy and time is as familiar as Planck's constant. From the point of view of a system with many states, perhaps a better representation of the system is a vector of characteristic times (one per state) for example, a canonically distributed system. In the vector case the inverse relationship persists, this time as a relation between the $L_2$ norms. That relationship is derived herein. An unexpected benefit of the vectorized time viewpoint is the determination of surfaces of constant temperature in terms of the time coordinates. The results apply to all empirically accessible systems, that is situations where details of the dynamics are recorded at the microscopic level of detail. This includes all manner of simulation data of statistical mechanical systems as well as experimental data from actual systems (e.g. the internet, financial market data) where statistical physical methods have been applied.

cond-mat.stat-mech↗

arXiv2006

Surfaces of Constant Temperature for Glauber Dynamics

The wavefunction of a single spin system in a prepared initial state evolves to equilibrium with a heat bath. The average spin $$q(t) = p_{\uparrow}(t) - p_{\downarrow}(t)$$ exhibits a characteristic time for this evolution. With the proper choice of spin flip rates, a dynamical Ising model (Glauber) can be constructed with the same characteristic time for transition of the average spin to equilibrium. The Glauber dynamics are expressed as a Markoff process that possesses many of the same physical characteristics as its quantum mechanical counterpart. In addition, since the classical trajectories are those of an ergodic process (the time averages of a single trajectory are equivalent to the ensemble averages), the surfaces of constant temperature, in terms of the model parameters, may be derived for the single spin system.

cond-mat.stat-mech↗

arXiv2005

Descriptive Thermodynamics

Thermodynamics (in concert with its sister discipline, statistical physics) can be regarded as a data reduction scheme based on partitioning a total system into a subsystem and a bath that weakly interact with each other. The ubiquity and applicability of the scheme chiefly derives from that of partitioning protocols in experiments and observations. Whereas conventionally, the systems investigated require this form of data reduction in order to facilitate prediction, a different problem also occurs, in the context of communication networks, markets, etc. Such "empirically accessible" systems typically overwhelm observers with the sort of information that in the case of (say) a gas is effectively unobtainable. What is required for such complex interacting systems is not prediction (this may be impossible when humans besides the observer are responsible for the interactions) but rather,_description_ as a route to understanding. Still, the need for a thermodynamical data reduction scheme remains. In this paper, we show how an empirical temperature can be computed for finite, empirically accessible systems, and further outline how this construction allows the age-old science of thermodynamics to be fruitfully applied to them. The particular example of TCP/IP networks will be briefly discussed.

cond-mat.stat-mech↗

arXiv2004

Application of Thermodynamics to the Reduction of Data Generated by a Non-Standard System

In traditional thermodynamical and statistical-mechanical approaches one has (some) detailed knowledge of the principles governing the microdynamics of a system. However in many instances we may not have a Hamiltonian or good information about the degrees of freedom (or, in a roughly complementary sense, the redundancies in observed data), but on the other hand we have access to a preponderance of raw data. The development outlined here is an attempt to apply the principles of thermodynamics and statistical mechanics generically to such cases.

cond-mat.stat-mech↗