arXiv subjects

Daniel Giles

Publications and source records attributed to Daniel Giles.

At least 19 recordsLinked to original sources

arXiv2025

A Search for Transiting Exocomets in TESS Sectors 1-26

We present a search for single photometric exocomet transits using a magnitude-limited sample of stars observed by the TESS primary mission. These events are asymmetric, with a sharp ingress and more gradual egress expected because the comet tail trails behind the coma. Our goals are to estimate the occurrence rate of exocomet transits, and given sufficient numbers comment on whether the host stars are biased towards being A/F spectral types, as suggested by a previous survey with Kepler data. We recovered the previously identified exocomet transit with TESS around $\beta$ Pic (TIC 270577175) and identified three additional main sequence systems with exocomet-like transits (TIC 280832588, TIC 73149665, and TIC 143152957). We also identified one exocomet candidate around a giant star (TIC 229790952) and one around a probable supergiant (TIC 110969638). We find a total occurrence rate of $2.64\times10^{-4}$ star$^{-1}$ year$^{-1}$, much higher than Kepler's rate of $6.7 \times 10^{-6}$ star$^{-1}$ year$^{-1}$. Some of this difference may be because our rate includes a correction for detection efficiency, where the Kepler search did not. However, with only a handful of detections in each survey, the rates are also very uncertain. In contrast to the Kepler search, we find two candidate hosts that may be G types, but the spectral types would be better supported with spectroscopic follow-up. Primarily, we conclude that exocomet-like transits are very rare at 0.1%-1% transit depth levels, and that higher precision photometry to detect and characterise shallower transits effectively is the most likely path to more detections and stronger statistical conclusions.

astro-ph.EP↗

arXiv2025

Learning Chaos In A Linear Way

Learning long-term behaviors in chaotic dynamical systems, such as turbulent flows and climate modelling, is challenging due to their inherent instability and unpredictability. These systems exhibit positive Lyapunov exponents, which significantly hinder accurate long-term forecasting. As a result, understanding long-term statistical behavior is far more valuable than focusing on short-term accuracy. While autoregressive deep sequence models have been applied to capture long-term behavior, they often lead to exponentially increasing errors in learned dynamics. To address this, we shift the focus from simple prediction errors to preserving an invariant measure in dissipative chaotic systems. These systems have attractors, where trajectories settle, and the invariant measure is the probability distribution on attractors that remains unchanged under dynamics. Existing methods generate long trajectories of dissipative chaotic systems by aligning invariant measures, but it is not always possible to obtain invariant measures for arbitrary datasets. We propose the Poincare Flow Neural Network (PFNN), a novel operator learning framework designed to capture behaviors of chaotic systems without any explicit knowledge of the invariant measure. PFNN employs an auto-encoder to map the chaotic system to a finite-dimensional feature space, effectively linearizing the chaotic evolution. It then learns the linear evolution operators to match the physical dynamics by addressing two critical properties in dissipative chaotic systems: (1) contraction, the system's convergence toward its attractors, and (2) measure invariance, trajectories on the attractors following a probability distribution invariant to the dynamics. Our experiments on a variety of chaotic systems demonstrate that PFNN has more accurate predictions and physical statistics compared to competitive baselines.

nlin.CD↗

arXiv2025

Calibrated Physics-Informed Uncertainty Quantification

Simulating complex physical systems is crucial for understanding and predicting phenomena across diverse fields, such as fluid dynamics and heat transfer, as well as plasma physics and structural mechanics. Traditional approaches rely on solving partial differential equations (PDEs) using numerical methods, which are computationally expensive and often prohibitively slow for real-time applications or large-scale simulations. Neural PDEs have emerged as efficient alternatives to these costly numerical solvers, offering significant computational speed-ups. However, their lack of robust uncertainty quantification (UQ) limits deployment in critical applications. We introduce a model-agnostic, physics-informed conformal prediction (CP) framework that provides guaranteed uncertainty estimates without requiring labelled data. By utilising a physics-based approach, we can quantify and calibrate the model's inconsistencies with the physics rather than the uncertainty arising from the data. Our approach utilises convolutional layers as finite-difference stencils and leverages physics residual errors as nonconformity scores, enabling data-free UQ with marginal and joint coverage guarantees across prediction domains for a range of complex PDEs. We further validate the efficacy of our method on neural PDE models for plasma modelling and shot design in fusion reactors.

cs.LG↗

arXiv2025

Tensor-Var: Efficient Four-Dimensional Variational Data Assimilation

Variational data assimilation estimates the dynamical system states by minimizing a cost function that fits the numerical models with the observational data. Although four-dimensional variational assimilation (4D-Var) is widely used, it faces high computational costs in complex nonlinear systems and depends on imperfect state-observation mappings. Deep learning (DL) offers more expressive approximators, while integrating DL models into 4D-Var is challenging due to their nonlinearities and lack of theoretical guarantees in assimilation results. In this paper, we propose Tensor-Var, a novel framework that integrates kernel conditional mean embedding (CME) with 4D-Var to linearize nonlinear dynamics, achieving convex optimization in a learned feature space. Moreover, our method provides a new perspective for solving 4D-Var in a linear way, offering theoretical guarantees of consistent assimilation results between the original and feature spaces. To handle large-scale problems, we propose a method to learn deep features using neural networks within the Tensor-Var framework. Experiments on chaotic systems and global weather prediction with real-time observations show that Tensor-Var outperforms conventional and DL hybrid 4D-Var baselines in accuracy while achieving a 10- to 20-fold speed improvement.

cs.LG↗

arXiv2024

Uncertainty Quantification of Surrogate Models using Conformal Prediction

Data-driven surrogate models offer quick approximations to complex numerical and experimental systems but typically lack uncertainty quantification, limiting their reliability in safety-critical applications. While Bayesian methods provide uncertainty estimates, they offer no statistical guarantees and struggle with high-dimensional spatio-temporal problems due to computational costs. We present a conformal prediction (CP) framework that provides statistically guaranteed marginal coverage for surrogate models in a model-agnostic manner with near-zero computational cost. Our approach handles high-dimensional spatio-temporal outputs by performing cell-wise calibration while preserving the tensorial structure of predictions. Through extensive empirical evaluation across diverse applications including fluid dynamics, magnetohydrodynamics, weather forecasting, and fusion diagnostics, we demonstrate that CP achieves empirical coverage with valid error bars regardless of model architecture, training regime, or output dimensionality. We evaluate three nonconformity scores (conformalised quantile regression, absolute error residual, and standard deviation) for both deterministic and probabilistic models, showing that guaranteed coverage holds even for out-of-distribution predictions where models are deployed on physics regimes different from training data. Calibration requires only seconds to minutes on standard hardware. The framework enables rigorous validation of pre-trained surrogate models for downstream applications without retraining. While CP provides marginal rather than conditional coverage and assumes exchangeability between calibration and test data, our method circumvents the curse of dimensionality inherent in traditional uncertainty quantification approaches, offering a practical tool for trustworthy deployment of machine learning in physical sciences.

cs.AI↗

arXiv2024

Valid Error Bars for Neural Weather Models using Conformal Prediction

Neural weather models have shown immense potential as inexpensive and accurate alternatives to physics-based models. However, most models trained to perform weather forecasting do not quantify the uncertainty associated with their forecasts. This limits the trust in the model and the usefulness of the forecasts. In this work we construct and formalise a conformal prediction framework as a post-processing method for estimating this uncertainty. The method is model-agnostic and gives calibrated error bounds for all variables, lead times and spatial locations. No modifications are required to the model and the computational cost is negligible compared to model training. We demonstrate the usefulness of the conformal prediction framework on a limited area neural weather model for the Nordic region. We further explore the advantages of the framework for deterministic and probabilistic models.

cs.LG↗

arXiv2024

Embedding machine-learnt sub-grid variability improves climate model biases

The under-representation of cloud formation is a long-standing bias associated with climate simulations. Parameterisation schemes are required to capture cloud processes within current climate models but have known biases. We overcome these biases by embedding a Multi-Output Gaussian Process (MOGP) trained on high resolution Unified Model simulations to represent the variability of temperature and specific humidity within a climate model. A trained MOGP model is coupled in-situ with a simplified Atmospheric General Circulation Model named SPEEDY. The temperature and specific humidity profiles of SPEEDY are perturbed at fixed intervals according to the variability predicted from the MOGP. Ten-year predictions are generated for both control and ML-hybrid models. The hybrid model reduces the global precipitation bias by 18\% and over the tropics by 22\%. To further understand the drivers of these improvements, physical quantities of interest are explored, such as the distribution of lifted index values and the alteration of the Hadley cell. The control and hybrid set-ups are also run in a plus 4K sea-surface temperature experiment to explore the effects of the approach on patterns relating to cloud cover and precipitation in a warmed climate setting.

physics.ao-ph↗

arXiv2024

Scalable Data Assimilation with Message Passing

Data assimilation is a core component of numerical weather prediction systems. The large quantity of data processed during assimilation requires the computation to be distributed across increasingly many compute nodes, yet existing approaches suffer from synchronisation overhead in this setting. In this paper, we exploit the formulation of data assimilation as a Bayesian inference problem and apply a message-passing algorithm to solve the spatial inference problem. Since message passing is inherently based on local computations, this approach lends itself to parallel and distributed computation. In combination with a GPU-accelerated implementation, we can scale the algorithm to very large grid sizes while retaining good accuracy and compute and memory requirements.

cs.LG↗

arXiv2024

Searching the SN 1987A SETI Ellipsoid with TESS

The SETI Ellipsoid is a strategy for technosignature candidate selection which assumes that extraterrestrial civilizations who have observed a galactic-scale event -- such as supernova 1987A -- may use it as a Schelling point to broadcast synchronized signals indicating their presence. Continuous wide-field surveys of the sky offer a powerful new opportunity to look for these signals, compensating for the uncertainty in their estimated time of arrival. We explore sources in the TESS continuous viewing zone, which corresponds to 5% of all TESS data, observed during the first three years of the mission. Using improved 3D locations for stars from Gaia Early Data Release 3, we identified 32 SN 1987A SETI Ellipsoid targets in the TESS continuous viewing zone with uncertainties better than 0.5 ly. We examined the TESS light curves of these stars during the Ellipsoid crossing event and found no anomalous signatures. We discuss ways to expand this methodology to other surveys, more targets, and different potential signal types.

astro-ph.IM↗

arXiv2024

Time-dependent influence metric for cascade dynamics on networks

An algorithm for efficiently calculating the expected size of single-seed cascade dynamics on networks is proposed and tested. The expected size is a time-dependent quantity and so enables the identification of nodes who are the most influential early or late in the spreading process. The measure is accurate for both critical and subcritical dynamic regimes and so generalises the nonbacktracking centrality that was previously shown to successfully identify the most influential single spreaders in a model of critical epidemics on networks.

physics.soc-ph↗

arXiv2022

Multilevel Bayesian Quadrature

Multilevel Monte Carlo is a key tool for approximating integrals involving expensive scientific models. The idea is to use approximations of the integrand to construct an estimator with improved accuracy over classical Monte Carlo. We propose to further enhance multilevel Monte Carlo through Bayesian surrogate models of the integrand, focusing on Gaussian process models and the associated Bayesian quadrature estimators. We show, using both theory and numerical experiments, that our approach can lead to significant improvements in accuracy when the integrand is expensive and smooth, and when the dimensionality is small or moderate. We conclude the paper with a case study illustrating the potential impact of our method in landslide-generated tsunami modelling, where the cost of each integrand evaluation is typically too large for operational settings.

stat.ME↗

arXiv2022

Searching the SETI Ellipsoid with Gaia

The SETI Ellipsoid is a geometric method for prioritizing technosignature observations based on the strategy of receiving signals synchronized to conspicuous astronomical events. Precise distances to nearby stars from Gaia makes constraining Ellipsoid crossing times possible. Here we explore the utility of using the Gaia Catalog of Nearby Stars to select targets on the SN 1987A SETI Ellipsoid, as well the Ellipsoids defined by 278 classical novae. Less than 8% of stars within the 100 pc sample are inside the SN 1987A SETI Ellipsoid, meaning the vast majority of nearby stars are still viable targets for monitoring over time. We find an average of 734 stars per year within the 100 pc volume will intersect the Ellipsoid from SN 1987A, with ~10% of those having distance uncertainties from Gaia better than 0.1 lyr.

astro-ph.IM↗

arXiv2020

A method for finding anomalous astronomical light curves and their analogs

Our understanding of the Universe has profited from deliberate, targeted studies of known phenomena, as well as from serendipitous, unexpected discoveries, such as the discovery of a complex variability pattern in the direction of KIC 8462852 (Boyajian's star). Upcoming surveys, such as the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), will explore the parameter space of astrophysical transients at all time scales, and offer the opportunity to discover even more extreme examples of unexpected phenomena. We investigate strategies to identify novel objects and to contextualize them within large time-series data sets in order to facilitate the discovery of new classes of objects, as well as the physical interpretation of their anomalous nature. We develop a method that combines tree-based and manifold-learning algorithms for anomaly detection in order to perform two tasks: 1) identify and rank anomalous objects in a time-domain dataset; and 2) group those anomalies according to their similarity in order to identify analogs. We achieve the latter by combining an anomaly score from a tree-based method with a dimensionality manifold-learning reduction strategy. Clustering in the reduced space allows for the successful identification of anomalies and analogs. We also assess the impact of pre-processing and feature engineering schemes and investigate the astrophysical nature of the objects that our models identify as anomalous by augmenting the Kepler data with Gaia color and luminosity information. We find that multiple models, used in combination, are a promising strategy to identify novel light curves and light curve families.

astro-ph.SR↗

arXiv2020

Modelling with Volna-OP2: Towards tsunami threat reduction

Accurate and efficient tsunami modelling is essential for providing tsunami forecasts and hazard assessments. Volna-OP2 is a finite volume solver of the nonlinear shallow water equations and its capabilities of producing both faster than real time ensembles and high resolution inundation studies are presented here. The code is massively parallelised and can utilise various high performance computing architectures. When an earthquake is detected there is always some uncertainty on the source parameters. Generating a faster than real time ensemble for maximum wave heights which captures this uncertainty would be of great benefit to tsunami warning centres. The 2003 Boumerdes earthquake (Algeria) acts as a test case for showing Volna-OP2's ability at rapidly forecasting regional maximum wave heights. Drawing on various earthquake sources proposed in the literature and scaling the magnitudes to mimic uncertainty on the source, 20 separate earthquake realisations are simulated for 4 hours real time in 97s on two Nvidia V100 GPUs. Further a reduced ensemble of the Lisbon 1755 tsunami with an emphasis on the effects to the Irish coastline is presented. Where again various earthquake sources have been drawn from the literature and simulated on a regional scale. Finally, a pilot study which builds upon the reduced ensemble results investigates the inundation of a Lisbon tsunami on key sections of the Irish coastline. The results of this pilot study highlight that the inundation is constrained to low-lying areas with maximum run-up heights of $\approx 3.4m$ being found.

physics.ao-ph↗

arXiv2020

Density Based Outlier Scoring on Kepler Data

In the present era of large scale surveys, big data presents new challenges to the discovery process for anomalous data. Such data can be indicative of systematic errors, extreme (or rare) forms of known phenomena, or most interestingly, truly novel phenomena which exhibit as-of-yet unobserved behaviors. In this work we present an outlier scoring methodology to identify and characterize the most promising unusual sources to facilitate discoveries of such anomalous data. We have developed a data mining method based on k-Nearest Neighbor distance in feature space to efficiently identify the most anomalous lightcurves. We test variations of this method including using principal components of the feature space, removing select features, the effect of the choice of k, and scoring to subset samples. We evaluate the peformance of our scoring on known object classes and find that our scoring consistently scores rare (<1000) object classes higher than common classes. We have applied scoring to all long cadence lightcurves of quarters 1 to 17 of Kepler's prime mission and present outlier scores for all 2.8 million lightcurves for the roughly 200k objects.

astro-ph.IM↗

arXiv2020

Performance analysis of Volna-OP2 -- massively parallel code for tsunami modelling

The software package Volna-OP2 is a robust and efficient code capable of simulating the complete life cycle of a tsunami whilst harnessing the latest High Performance Computing (HPC) architectures. In this paper, a comprehensive error analysis and scalability study of the GPU version of the code is presented. A novel decomposition of the numerical errors into the dispersion and dissipation components is explored. Most tsunami codes exhibit amplitude smearing and/or phase lagging/leading, so the decomposition shown here is a new approach and novel tool for explaining these occurrences. It is the first time that the errors of a tsunami code have been assessed in this manner. To date, Volna-OP2 has been widely used by the tsunami modelling community. In particular its computational efficiency has allowed various sensitivity analyses and uncertainty quantification studies. Due to the number of simulations required, there is always a trade-off between accuracy and runtime when carrying out these statistical studies. The analysis presented in this paper will guide the user towards an acceptable level of accuracy within a given runtime.

physics.comp-ph↗

arXiv2018

Systematic Serendipity: A Test of Unsupervised Machine Learning as a Method for Anomaly Detection

Advances in astronomy are often driven by serendipitous discoveries. As survey astronomy continues to grow, the size and complexity of astronomical databases will increase, and the ability of astronomers to manually scour data and make such discoveries decreases. In this work, we introduce a machine learning-based method to identify anomalies in large datasets to facilitate such discoveries, and apply this method to long cadence lightcurves from NASA's Kepler Mission. Our method clusters data based on density, identifying anomalies as data that lie outside of dense regions. This work serves as a proof-of-concept case study and we test our method on four quarters of the Kepler long cadence lightcurves. We use Kepler's most notorious anomaly, Boyajian's Star (KIC 8462852), as a rare `ground truth' for testing outlier identification to verify that objects of genuine scientific interest are included among the identified anomalies. We evaluate the method's ability to identify known anomalies by identifying unusual behavior in Boyajian's Star, we report the full list of identified anomalies for these quarters, and present a sample subset of identified outliers that includes unusual phenomena, objects that are rare in the Kepler field, and data artifacts. By identifying <4% of each quarter as outlying data, we demonstrate that this anomaly detection method can create a more targeted approach in searching for rare and novel phenomena.

astro-ph.IM↗

arXiv2015

Minimizing Differences of Convex Functions and Applications to Facility Location and Clustering

In this paper we develop algorithms to solve generalized weighted Fermat-Torricelli problems with positive and negative weights and multifacility location problems involving distances generated by Minkowski gauges. We also introduce a new model of clustering based on squared distances to convex sets. Using the Nesterov smoothing technique and an algorithm for minimizing differences of convex functions called the DCA introduced by Tao and An, we develop effective algorithms for solving these problems.

math.OC↗