arXiv Science⌕ Search

arXiv subjects

Keith Smith

Publications and source records attributed to Keith Smith.

14 recordsLinked to original sources
arXiv2025

Graph Variate Neural Networks

Modelling dynamically evolving spatio-temporal signals is a prominent challenge in the Graph Neural Network (GNN) literature. Notably, GNNs assume an existing underlying graph structure. While this underlying structure may not always exist or is derived independently from the signal, a temporally evolving functional network can always be constructed from multi-channel data. Graph Variate Signal Analysis (GVSA) defines a unified framework consisting of a network tensor of instantaneous connectivity profiles against a stable support usually constructed from the signal itself. Building on GVSA and tools from graph signal processing, we introduce Graph-Variate Neural Networks (GVNNs): layers that convolve spatio-temporal signals with a signal-dependent connectivity tensor combining a stable long-term support with instantaneous, data-driven interactions. This design captures dynamic statistical interdependencies at each time step without ad hoc sliding windows and admits an efficient implementation with linear complexity in sequence length. Across forecasting benchmarks, GVNNs consistently outperform strong graph-based baselines and are competitive with widely used sequence models such as LSTMs and Transformers. On EEG motor-imagery classification, GVNNs achieve strong accuracy highlighting their potential for brain-computer interface applications.

cs.LG↗
arXiv2025

Covariance Density Neural Networks

Graph neural networks have re-defined how we model and predict on network data but there lacks a consensus on choosing the correct underlying graph structure on which to model signals. CoVariance Neural Networks (VNN) address this issue by using the sample covariance matrix as a Graph Shift Operator (GSO). Here, we improve on the performance of VNNs by constructing a Density Matrix where we consider the sample Covariance matrix as a quasi-Hamiltonian of the system in the space of random variables. Crucially, using this density matrix as the GSO allows components of the data to be extracted at different scales, allowing enhanced discriminability and performance. We show that this approach allows explicit control of the stability-discriminability trade-off of the network, provides enhanced robustness to noise compared to VNNs, and outperforms them in useful real-life applications where the underlying covariance matrix is informative. In particular, we show that our model can achieve strong performance in subject-independent Brain Computer Interface EEG motor imagery classification, outperforming EEGnet while being faster. This shows how covariance density neural networks provide a basis for the notoriously difficult task of transferability of BCIs when evaluated on unseen individuals.

cs.LG↗
arXiv2023

Multi-point Assessment of the Kinematics of Shocks (MAKOS): A Heliophysics Mission Concept Study

Collisionless shocks are fundamental processes that are ubiquitous in space plasma physics throughout the Heliosphere and most astrophysical environments. Earth's bow shock and interplanetary shocks at 1 AU offer the most readily accessible opportunities to advance our understanding of the nature of collisionless shocks via fully-instrumented, in situ observations. One major outstanding question pertains to the energy budget of collisionless shocks, particularly how exactly collisionless shocks convert incident kinetic bulk flow energy into thermalization (heating), suprathermal particle acceleration, and a variety of plasma waves, including nonlinear structures. Furthermore, it remains unknown how those energy conversion processes change for different shock orientations (e.g., quasi-parallel vs. quasi-perpendicular) and driving conditions (upstream Alfv\'enic and fast Mach numbers, plasma beta, etc.). Required to address these questions are multipoint observations enabling direct measurement of the necessary plasmas, energetic particles, and electric and magnetic fields and waves, all simultaneously from upstream, downstream, and at the shock transition layer with observatory separations at ion to magnetohydrodynamic (MHD) scales. Such a configuration of spacecraft with specifically-designed instruments has never been available, and this white paper describes a conceptual mission design -- MAKOS -- to address these outstanding questions and advance our knowledge of the nature of collisionless shocks.

astro-ph.IM↗
arXiv2023

The Persistent Mystery of Collisionless Shocks

Collisionless shock waves are one of the main forms of energy conversion in space plasmas. They can directly or indirectly drive other universal plasma processes such as magnetic reconnection, turbulence, particle acceleration and wave phenomena. Collisionless shocks employ a myriad of kinetic plasma mechanisms to convert the kinetic energy of supersonic flows in space to other forms of energy (e.g., thermal plasma, energetic particles, or Poynting flux) in order for the flow to pass an immovable obstacle. The partitioning of energy downstream of collisionless shocks is not well understood, nor are the processes which perform energy conversion. While we, as the heliophysics community, have collected an abundance of observations of the terrestrial bow shock, instrument and mission-level limitations have made it impossible to quantify this partition, to establish the physics within the shock layer responsible for it, and to understand its dependence on upstream conditions. This paper stresses the need for the first ever spacecraft mission specifically designed and dedicated to the observation of both the terrestrial bow shock as well as Interplanetary shocks in the solar wind.

astro-ph.IM↗
arXiv2022

Writes Hurt: Lessons in Cache Design for Optane NVRAM

Intel OptaneTM DC Persistent Memory resides on the memory bus and approaches DRAM in access latency. One avenue for its adoption is to employ it in place of persistent storage; another is to use it as a cheaper and denser extension of DRAM. In pursuit of the latter goal, we present the design of a volatile Optane NVRAM cache as a component in a storage engine underlying MongoDB. The primary innovation in our design is a new cache admission policy. We discover that on Optane NVRAM, known for its limited write throughput, the presence of writes disproportionately affects the throughput of reads, much more so than on DRAM. Therefore, an admission policy that indiscriminately admits new data (and thus generates writes), severely limits the rate of data retrieval and results in exceedingly poor performance for the cache overall. We design an admission policy that balances the rate of admission with the rate of lookups using dynamically observed characteristics of the workload. Our implementation outperforms OpenCAS (an off-the-shelf Optane-based block cache) in all cases, and Intel Memory Mode in cases where the database size exceeds the available NVRAM. Our cache is decoupled from the rest of the storage engine and uses generic metrics to guide its admission policy; therefore our design can be easily adopted in other systems.

cs.AR↗
arXiv2018

Hyperledger Fabric: A Distributed Operating System for Permissioned Blockchains

Fabric is a modular and extensible open-source system for deploying and operating permissioned blockchains and one of the Hyperledger projects hosted by the Linux Foundation (www.hyperledger.org). Fabric is the first truly extensible blockchain system for running distributed applications. It supports modular consensus protocols, which allows the system to be tailored to particular use cases and trust models. Fabric is also the first blockchain system that runs distributed applications written in standard, general-purpose programming languages, without systemic dependency on a native cryptocurrency. This stands in sharp contrast to existing blockchain platforms that require "smart-contracts" to be written in domain-specific languages or rely on a cryptocurrency. Fabric realizes the permissioned model using a portable notion of membership, which may be integrated with industry-standard identity management. To support such flexibility, Fabric introduces an entirely novel blockchain design and revamps the way blockchains cope with non-determinism, resource exhaustion, and performance attacks. This paper describes Fabric, its architecture, the rationale behind various design decisions, its most prominent implementation aspects, as well as its distributed application programming model. We further evaluate Fabric by implementing and benchmarking a Bitcoin-inspired digital currency. We show that Fabric achieves end-to-end throughput of more than 3500 transactions per second in certain popular deployment configurations, with sub-second latency, scaling well to over 100 peers.

cs.DC↗
arXiv2017

The ESO Diffuse Interstellar Bands Large Exploration Survey: EDIBLES I. Project description, survey sample and quality assessment

The carriers of the diffuse interstellar bands (DIBs) are largely unidentified molecules ubiquitously present in the interstellar medium (ISM). After decades of study, two strong and possibly three weak near-infrared DIBs have recently been attributed to the C60+ fullerene based on observational and laboratory measurements. There is great promise for the identification of the over 400 other known DIBs, as this result could provide chemical hints towards other possible carriers. In an effort to systematically study the properties of the DIB carriers, we have initiated a new large-scale observational survey: the ESO Diffuse Interstellar Bands Large Exploration Survey (EDIBLES). The main objective is to build on and extend existing DIB surveys to make a major step forward in characterising the physical and chemical conditions for a statistically significant sample of interstellar lines-of-sight, with the goal to reverse-engineer key molecular properties of the DIB carriers. EDIBLES is a filler Large Programme using the Ultraviolet and Visual Echelle Spectrograph at the Very Large Telescope at Paranal, Chile. It is designed to provide an observationally unbiased view of the presence and behaviour of the DIBs towards early-spectral-type stars whose lines-of-sight probe the diffuse-to-translucent ISM. Such a complete dataset will provide a deep census of the atomic and molecular content, physical conditions, chemical abundances and elemental depletion levels for each sightline. Achieving these goals requires a homogeneous set of high-quality data in terms of resolution (R ~ 70000 -- 100000), sensitivity (S/N up to 1000 per resolution element), and spectral coverage (305--1042 nm), as well as a large sample size (100+ sightlines). In this first paper the goals, objectives and methodology of the EDIBLES programme are described and an initial assessment of the data is provided.

astro-ph.GA↗
arXiv2017

Graph-Variate Signal Analysis

Incorporating graphs in the analysis of multivariate signals is becoming a standard way to understand the interdependency of activity recorded at different sites. The new research frontier in this direction includes the important problem of how to assess dynamic changes of signal activity. We address this problem in a novel way by defining the graph-variate signal alongside methods for its analysis. Essentially, graph-variate signal analysis leverages graphs of reliable connectivity information to filter instantaneous bivariate functions of the multivariate signal. This opens up a new and robust approach to analyse joint signal and network dynamics at sample resolution. Furthermore, our method can be formulated as instantaneous networks on which standard network analysis can be implemented. When graph connectivity is estimated from the multivariate signal itself, the appropriate consideration of instantaneous graph signal functions allows for a novel dynamic connectivity measure-- graphvariate dynamic (GVD) connectivity-- which is robust to spurious short-term dependencies. Particularly, we present appropriate functions for three pertinent connectivity metrics-- correlation, coherence and the phase-lag index. We show that our approach can determine signals with a single correlated couple against wholly uncorrelated data of up to 128 nodes in signal size (1 out of 8128 weighted edges). GVD connectivity is also shown to be more robust than i) other GSP approaches at detecting a randomly traveling spheroid on a 3D grid and ii) standard dynamic connectivity in determining differences in EEG restingstate and task-related activity. We also demonstrate its use in revealing hidden depth correlations from geophysical gamma ray data. We expect that the methods and framework presented will provide new approaches to data analysis in a variety of applied settings.

cs.SI↗
arXiv2016

Accounting for the Complex Hierarchical Topology of EEG Phase-Based Functional Connectivity in Network Binarisation

Research into binary network analysis of brain function faces a methodological challenge in selecting an appropriate threshold to binarise edge weights. For EEG phase-based functional connectivity, we test the hypothesis that such binarisation should take into account the complex hierarchical structure found in functional connectivity. We explore the density range suitable for such structure and provide a comparison of state-of-the-art binarisation techniques, the recently proposed Cluster-Span Threshold (CST), minimum spanning trees, efficiency-cost optimisation and union of shortest path graphs, with arbitrary proportional thresholds and weighted networks. We test these techniques on weighted complex hierarchy models by contrasting model realisations with small parametric differences. We also test the robustness of these techniques to random and targeted topological attacks.We find that the CST performs consistenty well in state-of-the-art modelling of EEG network topology, robustness to topological network attacks, and in three real datasets, agreeing with our hypothesis of hierarchical complexity. This provides interesting new evidence into the relevance of considering a large number of edges in EEG functional connectivity research to provide informational density in the topology.

q-bio.NC↗
arXiv2016

Locating Temporal Functional Dynamics of Visual Short-Term Memory Binding using Graph Modular Dirichlet Energy

Visual short-term memory binding tasks are a promising early marker for Alzheimer's disease (AD). To uncover functional deficits of AD in these tasks it is meaningful to first study unimpaired brain function. Electroencephalogram recordings were obtained from encoding and maintenance periods of tasks performed by healthy young volunteers. We probe the task's transient physiological underpinnings by contrasting shape only (Shape) and shape-colour binding (Bind) conditions, displayed in the left and right sides of the screen, separately. Particularly, we introduce and implement a novel technique named Modular Dirichlet Energy (MDE) which allows robust and flexible analysis of the functional network with unprecedented temporal precision. We find that connectivity in the Bind condition is less integrated with the global network than in the Shape condition in occipital and frontal modules during the encoding period of the right screen condition. Using MDE we are able to discern driving effects in the occipital module between 100-140ms, coinciding with the P100 visually evoked potential, followed by a driving effect in the frontal module between 140-180ms, suggesting that the differences found constitute an information processing difference between these modules. This provides temporally precise information over a heterogeneous population in promising tasks for the detection of AD.

q-bio.NC↗
arXiv2016

Comparison of Network Analysis Approaches on EEG Connectivity in Beta during Visual Short-Term Memory Binding Tasks

We analyse the electroencephalogram signals in the beta band of working memory representation recorded from young healthy volunteers performing several different Visual Short-Term Memory (VSTM) tasks which have proven useful in the assessment of clinical and preclinical Alzheimer's disease. We compare network analysis using Maximum Spanning Trees (MSTs) with network analysis obtained using 20% and 25% connection thresholds on the VSTM data. MSTs are a promising method of network analysis negating the more classical use of thresholds which are so far chosen arbitrarily. However, we find that the threshold analyses outperforms MSTs for detection of functional network differences. Particularly, MSTs fail to find any significant differences. Further, the thresholds detect significant differences between shape and shape-colour binding tasks when these are tested in the left side of the display screen, but no such differences are detected when these tasks are tested for in the right side of the display screen. This provides evidence that contralateral activity is a significant factor in sensitivity for detection of cognitive task differences.

q-bio.NC↗
arXiv2016

Cluster-Span Threshold: An unbiased threshold for binarising weighted complete networks in functional connectivity analysis

We propose a new unbiased threshold for network analysis named the Cluster-Span Threshold (CST). This is based on the clustering coefficient, C, following logic that a balance of `clustering' to `spanning' triples results in a useful topology for network analysis and that the product of complementing properties has a unique value only when perfectly balanced. We threshold networks by fixing C at this balanced value, rather than fixing connection density at an arbitrary value, as has been the trend. We compare results from an electroencephalogram data set of volunteers performing visual short term memory tasks of the CST alongside other thresholds, including maximum spanning trees. We find that the CST holds as a sensitive threshold for distinguishing differences in the functional connectivity between tasks. This provides a sensitive and objective method for setting a threshold on weighted complete networks which may prove influential on the future of functional connectivity research.

q-bio.NC↗
arXiv2016

The Complex Hierarchical Topology of EEG Functional Connectivity

Understanding the complex hierarchical topology of functional brain networks is a key aspect of functional connectivity research. Such topics are obscured by the widespread use of sparse binary network models which are fundamentally different to the complete weighted networks derived from functional connectivity. We introduce two techniques to probe the hierarchical complexity of topologies. Firstly, a new metric to measure hierarchical complexity; secondly, a Weighted Complex Hierarchy (WCH) model. To thoroughly evaluate our techniques, we generalise sparse binary network archetypes to weighted forms and explore the main topological features of brain networks- integration, regularity and modularity- using curves over density. By controlling the parameters of our model, the highest complexity is found to arise between a random topology and a strict 'class-based' topology. Further, the model has equivalent complexity to EEG phase-lag networks at peak performance. Hierarchical complexity attains greater magnitude and range of differences between different networks than the previous commonly used complexity metric and our WCH model offers a much broader range of network topology than the standard scale-free and small-world models at a full range of densities. Our metric and model provide a rigorous characterisation of hierarchical complexity. Importantly, our framework shows a scale of complexity arising between 'all nodes are equal' topologies at one extreme and 'strict class-based' topologies at the other.

q-bio.NC↗