arXiv subjects

Jacob Burba

Publications and source records attributed to Jacob Burba.

At least 19 recordsLinked to original sources

arXiv2026

Foreground Characterization and Mitigation in the Observations of the CD/EoR with the SKA

The Square Kilometre Array (SKA), with its unprecedented sensitivity, frequency coverage, and large collecting area, is poised to revolutionize our understanding of the Cosmic Dawn (CD) and Epoch of Reionization (EoR) epochs marking the formation of the first luminous sources and the subsequent reionization of the intergalactic medium (IGM). However, detecting the faint redshifted 21-cm signal from neutral hydrogen remains one of the foremost challenges in observational cosmology, as it is buried beneath bright foregrounds from Galactic synchrotron radiation, free-free emission, and extragalactic point sources that are 4-5 orders of magnitude stronger than the cosmological signal. In this chapter, we highlight the key components and characteristics of these foregrounds and review ongoing efforts to model, characterize, and mitigate them. We emphasize how the SKA-Low AA* configuration, through its optimized array design, wide field of view, and improved calibration accuracy, enhances our capacity to suppress foreground contamination and recover the cosmological signal. The SKA Observatory Foreground Challenge plays a pivotal role in this effort by bringing together the global EoR/CD community to develop, compare, and validate foreground removal pipelines using realistic simulated datasets. Building on the experience of existing pathfinders such as LOFAR, MWA, and HERA, these collaborative initiatives are helping refine statistical and machine learning-based approaches for signal recovery. Together, these advancements are laying the groundwork for the SKA to probe the thermal and ionization history of the early Universe with unprecedented precision.

astro-ph.CO↗

arXiv2026

Bayesian power spectrum estimation with modelling of systematic effects in delay-fringe rate space

Observing the Epoch of Reionisation using 21cm radio interferometry has proven to be a challenging task. Extraction of the extremely faint redshifted signal is complicated by the presence of bright foregrounds, radio frequency interference (RFI), and systematic artefacts. We discuss the challenge of accounting for systematic effects, particularly cable reflections, that appear in the visibility data obtained from 21cm interferometers. Cable reflections cause attenuated copies of the foreground signal to appear outside the 'foreground wedge' region in which foreground contamination is supposed to be localised. We build on the hydra-pspec Gibbs sampler to implement a model of the systematics as a multiplicative effect in delay-fringe rate space. We include this model in the inference of the joint posterior distribution, in addition to the 21cm signal, its power spectrum, and foregrounds. This allows the systematics contribution to be marginalised, rather than filtering it out and causing additional signal loss. We demonstrate the method on simulated visibility data for a single baseline, showing that the 21cm delay power spectrum can be recovered well regardless of the location of the systematics in delay-fringe rate space. Our implementation is suitable for modelling other multiplicative factors on the visibilities, e.g. residual gain errors.

astro-ph.CO↗

arXiv2025

First Results from HERA Phase II

We report the first upper limits on the power spectrum of 21-cm fluctuations during the Epoch of Reionization and Cosmic Dawn from Phase II of the Hydrogen Epoch of Reionization Array (HERA) experiment. HERA Phase II constitutes several significant improvements in the signal chain compared to Phase I, most notably resulting in expanded frequency bandwidth, from 50-250 MHz. In these first upper limits, we investigate a small two-week subset of the available Phase II observations, with a focus on identifying new systematic characteristics of the instrument, and establishing an analysis pipeline to account for them. We report 2$\sigma$ upper limits in eight spectral bands, spanning $5.6 \leq z \leq 24.4$ that are consistent with thermal noise at the $2\sigma$ level for $k \gtrsim 0.6-0.9 h{\rm Mpc}^{-1}$ (band dependent). Our tightest limit during Cosmic Dawn ($z>12$) is $1.13\times 10^6 {\rm mK}^2$ at ($k=0.55 h{\rm Mpc}^{-1}, z=16.78$), and during the EoR ($5.5<z<12$) it is $1.78\times 10^3 {\rm mK}^2$ at ($k=0.70 h{\rm Mpc}^{-1}, z=7.05$). We find that mutual coupling has become our dominant systematic, leaking foreground power that strongly contaminates the low-$k$ modes, resulting in the loss of modes from $k=0.35-0.55$ compared to Phase I data.

astro-ph.CO↗

arXiv2025

Exploring One-point Statistics in HERA Phase I Data: Effects of Foregrounds and Systematics on Measuring One-Point Statistics

Measuring one-point statistics in redshifted 21 cm intensity maps offers an opportunity to explore non-Gaussian features of the early universe. We assess the impact of instrumental effects on measurements made with the Hydrogen Epoch of Reionization Array (HERA) by forward modeling observational and simulation data. Using HERA Phase I observations over 94 nights, we examine the second (m2, variance) and third (m3) moments of images. We employ the DAYENU-filtering method for foreground removal and reduce simulated foreground residuals to 10% of the 21 cm signal residuals. In noiseless cosmological simulations, the amplitudes of one-point statistics measurements are significantly reduced by the instrument response and further reduced by wedge-filtering. Analyses with wedge-filtered observational data, along with expected noise simulations, show that systematics alter the probability distribution of the map pixels. Likelihood analysis based on the observational data shows m2 measurements disfavor the cold reionization model characterized by inefficient X-ray heating, in line with other power spectra measurements. Small signals in m3 due to the instrument response of the Phase I observation and wedge-filtering make it challenging to use these non-Gaussian statistics to explore model parameters. Forecasts with the full HERA array predict high signal-to-noise ratios for m2, m3, and S3 assuming no foregrounds, but wedge-filtering drastically reduces these ratios. This work demonstrates conclusively that a comprehensive understanding of instrumental effects on m2 and m3 is essential for their use as a cosmological probe, given their dependence on the underlying model.

astro-ph.CO↗

arXiv2025

BayesEoR: Bayesian 21-cm Power Spectrum Estimation from Interferometric Visibilities

BayesEoR is a GPU-accelerated, MPI-compatible Python package for estimating the power spectrum of redshifted 21-cm emission from interferometric observations of the Epoch of Reionization (EoR). Utilizing a Bayesian framework, BayesEoR jointly fits for the 21-cm EoR power spectrum and a "foreground" model, referring to bright, contaminating emission between us and the cosmological signal, and forward models the instrument with which these signals are observed. To perform the sampling, we use MultiNest [arXiv:1402.0004], which calculates the Bayesian evidence as part of the analysis. Thus, BayesEoR can also be used as a tool for model selection [see e.g. arXiv:1701.03384].

astro-ph.IM↗

arXiv2024

Impacts and Statistical Mitigation of Missing Data on the 21cm Power Spectrum: A Case Study with the Hydrogen Epoch of Reionization Array

The precise characterization and mitigation of systematic effects is one of the biggest roadblocks impeding the detection of the fluctuations of cosmological 21cm signals. Missing data in radio cosmological experiments, often due to radio frequency interference (RFI), poses a particular challenge to power spectrum analysis as it could lead to the ringing of bright foreground modes in Fourier space, heavily contaminating the cosmological signals. Here we show that the problem of missing data becomes even more arduous in the presence of systematic effects. Using a realistic numerical simulation, we demonstrate that partially flagged data combined with systematic effects can introduce significant foreground ringing. We show that such an effect can be mitigated through inpainting the missing data. We present a rigorous statistical framework that incorporates the process of inpainting missing data into a quadratic estimator of the 21cm power spectrum. Under this framework, the uncertainties associated with our inpainting method and its impact on power spectrum statistics can be understood. These results are applied to the latest Phase II observations taken by the Hydrogen Epoch of Reionization Array, forming a crucial component in power spectrum analyses as we move toward detecting 21cm signals in the ever more noisy RFI environment.

astro-ph.CO↗

arXiv2024

High-dimensional inference of radio interferometer beam patterns I: Parametric model of the HERA beams

Accurate modelling of the primary beam is an important but difficult task in radio astronomy. For high dynamic range problems such as 21cm intensity mapping, small modelling errors in the sidelobes and spectral structure of the beams can translate into significant systematic errors. Realistic beams exhibit complex spatial and spectral structure, presenting a major challenge for beam measurement and calibration methods. In this paper series, we present a Bayesian framework to infer per-element beam patterns from the interferometric visibilities for large arrays with complex beam structure, assuming a particular (but potentially uncertain) sky model and calibration solution. In this first paper, we develop a compact basis for the beam so that the Bayesian computation is tractable with high-dimensional sampling methods. We use the Hydrogen Epoch of Reionization Array (HERA) as an example, verifying that the basis is capable of describing its single-element E-field beam (i.e. without considering array effects like mutual coupling) with a relatively small number of coefficients. We find that 32 coefficients per feed, incident polarization, and frequency, are sufficient to give percent-level and $\sim$10\% errors in the mainlobe and sidelobes respectively for the current HERA Vivaldi feeds, improving to $\sim 0.1\%$ and $\sim 1\%$ for 128 coefficients.

astro-ph.IM↗

arXiv2024

Sensitivity of Bayesian 21 cm power spectrum estimation to foreground model errors

Power spectrum estimators are an important tool in efforts to detect the 21 cm brightness temperature fluctuations from neutral hydrogen at early times. An initial detection will likely be statistical in nature, meaning that it will not be possible to make a coherent map of the brightness temperature fluctuations; instead, only their variance will be measured against a background of noise and residual systematic effects. Optimal Quadratic Estimator (OQE)-based methods often apply an inverse covariance weighting to the data. However, inaccurate covariance modelling can lead to reduced sensitivity and, in some cases, severe signal loss. We recently proposed a Bayesian method to jointly estimate the 21 cm fluctuations, their power spectrum, and foreground emission. Instead of requiring a fixed a priori estimate of the covariance, we estimate the covariance as part of the inference. Choices of parametrization, particularly of the foregrounds, are subject to model errors and could lead to biases and other ill effects if not properly controlled. In this paper, we investigate the effects of inaccurate foreground models on 21 cm power spectrum recovery. Using simulated visibilities, we find that, even in the most extreme scenarios tested, our approach is capable of recovering 21 cm delay power spectrum estimates consistent with a known input signal for delays $\gtrsim300$ ns ($\sim$88\% of the available Fourier modes). This is true even when using foreground models derived from modified foreground catalogs containing spatial and spectral perturbations at the quoted level of uncertainty on our foreground catalogs.

astro-ph.CO↗

arXiv2024

Statistical estimation of full-sky radio maps from 21cm array visibility data using Gaussian constrained realizations

An important application of next-generation wide-field radio interferometers is making high dynamic range maps of radio emission. Traditional deconvolution methods like CLEAN can give poor recovery of diffuse structure, prompting the development of wide-field alternatives like Direct Optimal Mapping and $m$-mode analysis. In this paper, we propose an alternative Bayesian method to infer the coefficients of a full-sky spherical harmonic basis for a drift-scan telescope with potentially thousands of baselines, that can precisely encode the uncertainties and correlations between the parameters used to build the recovered image. We use Gaussian constrained realizations (GCR) to efficiently draw samples of the spherical harmonic coefficients, despite the very large parameter space and extensive sky-regions of missing data. Each GCR solution provides a complete, statistically-consistent gap-free realization of a full-sky map conditioned on the available data, even when the interferometer's field of view is small. Many realizations can be generated and used for further analysis and robust propagation of statistical uncertainties. In this paper, we present the mathematical formalism of the spherical harmonic GCR-method for radio interferometers. We focus on the recovery of diffuse emission as a use case, along with validation of the method against simulations with a known diffuse emission component.

astro-ph.IM↗

arXiv2024

A demonstration of the effect of fringe-rate filtering in the Hydrogen Epoch of Reionization Array delay power spectrum pipeline

Radio interferometers targeting the 21cm brightness temperature fluctuations at high redshift are subject to systematic effects that operate over a range of different timescales. These can be isolated by designing appropriate Fourier filters that operate in fringe-rate (FR) space, the Fourier pair of local sidereal time (LST). Applications of FR filtering include separating effects that are correlated with the rotating sky vs. those relative to the ground, down-weighting emission in the primary beam sidelobes, and suppressing noise. FR filtering causes the noise contributions to the visibility data to become correlated in time however, making interpretation of subsequent averaging and error estimation steps more subtle. In this paper, we describe fringe rate filters that are implemented using discrete prolate spheroidal sequences, and designed for two different purposes -- beam sidelobe/horizon suppression (the `mainlobe' filter), and ground-locked systematics removal (the `notch' filter). We apply these to simulated data, and study how their properties affect visibilities and power spectra generated from the simulations. Included is an introduction to fringe-rate filtering and a demonstration of fringe-rate filters applied to simple situations to aid understanding.

astro-ph.CO↗

arXiv2024

Hydrogen Epoch of Reionization Array (HERA) Phase II Deployment and Commissioning

This paper presents the design and deployment of the Hydrogen Epoch of Reionization Array (HERA) phase II system. HERA is designed as a staged experiment targeting 21 cm emission measurements of the Epoch of Reionization. First results from the phase I array are published as of early 2022, and deployment of the phase II system is nearing completion. We describe the design of the phase II system and discuss progress on commissioning and future upgrades. As HERA is a designated Square Kilometer Array (SKA) pathfinder instrument, we also show a number of "case studies" that investigate systematics seen while commissioning the phase II system, which may be of use in the design and operation of future arrays. Common pathologies are likely to manifest in similar ways across instruments, and many of these sources of contamination can be mitigated once the source is identified.

astro-ph.IM↗

arXiv2023

matvis: A matrix-based visibility simulator for fast forward modelling of many-element 21 cm arrays

Detection of the faint 21 cm line emission from the Cosmic Dawn and Epoch of Reionisation will require not only exquisite control over instrumental calibration and systematics to achieve the necessary dynamic range of observations but also validation of analysis techniques to demonstrate their statistical properties and signal loss characteristics. A key ingredient in achieving this is the ability to perform high-fidelity simulations of the kinds of data that are produced by the large, many-element, radio interferometric arrays that have been purpose-built for these studies. The large scale of these arrays presents a computational challenge, as one must simulate a detailed sky and instrumental model across many hundreds of frequency channels, thousands of time samples, and tens of thousands of baselines for arrays with hundreds of antennas. In this paper, we present a fast matrix-based method for simulating radio interferometric measurements (visibilities) at the necessary scale. We achieve this through judicious use of primary beam interpolation, fast approximations for coordinate transforms, and a vectorised outer product to expand per-antenna quantities to per-baseline visibilities, coupled with standard parallelisation techniques. We validate the results of this method, implemented in the publicly-available matvis code, against a high-precision reference simulator, and explore its computational scaling on a variety of problems.

astro-ph.IM↗

arXiv2023

Bayesian estimation of cross-coupling and reflection systematics in 21cm array visibility data

Observations with radio arrays that target the 21-cm signal originating from the early Universe suffer from a variety of systematic effects. An important class of these are reflections and spurious couplings between antennas. We apply a Hamiltonian Monte Carlo sampler to the modelling and mitigation of these systematics in simulated Hydrogen Epoch of Reionisation Array (HERA) data. This method allows us to form statistical uncertainty estimates for both our models and the recovered visibilities, which is an important ingredient in establishing robust upper limits on the Epoch of Reionisation (EoR) power spectrum. In cases where the noise is large compared to the EoR signal, this approach can constrain the systematics well enough to mitigate them down to the noise level for both systematics studied. Incoherently averaging the recovered power spectra can further reduce the noise and improve recovery. Where the noise level is lower than the EoR, our modelling can mitigate the majority of the reflections and coupling with there being only a minor level of residual systematics. Our approach performs similarly to existing filtering/fitting techniques used in the HERA pipeline, but with the added benefit of rigorously propagating uncertainties. In all cases it does not significantly attenuate the underlying signal.

astro-ph.IM↗

arXiv2023

Direct Optimal Mapping Image Power Spectrum and its Window Functions

The key to detecting neutral hydrogen during the epoch of reionization (EoR) is to separate the cosmological signal from the dominating foreground radiation. We developed direct optimal mapping (DOM) to map interferometric visibilities; it contains only linear operations, with full knowledge of point spread functions from visibilities to images. Here, we demonstrate a fast Fourier transform-based image power spectrum and its window functions computed from the DOM images. We use noiseless simulation, based on the Hydrogen Epoch of Reionization Array Phase I configuration, to study the image power spectrum properties. The window functions show $<10^{-11}$ of the integrated power leaks from the foreground-dominated region into the EoR window; the 2D and 1D power spectra also verify the separation between the foregrounds and the EoR.

astro-ph.IM↗

arXiv2023

Search for the Epoch of Reionisation with HERA: Upper Limits on the Closure Phase Delay Power Spectrum

Radio interferometers aiming to measure the power spectrum of the redshifted 21 cm line during the Epoch of Reionisation (EoR) need to achieve an unprecedented dynamic range to separate the weak signal from overwhelming foreground emissions. Calibration inaccuracies can compromise the sensitivity of these measurements to the effect that a detection of the EoR is precluded. An alternative to standard analysis techniques makes use of the closure phase, which allows one to bypass antenna-based direction-independent calibration. Similarly to standard approaches, we use a delay spectrum technique to search for the EoR signal. Using 94 nights of data observed with Phase I of the Hydrogen Epoch of Reionization Array (HERA), we place approximate constraints on the 21 cm power spectrum at $z=7.7$. We find at 95% confidence that the 21 cm EoR brightness temperature is $\le$(372)$^2$ "pseudo" mK$^2$ at 1.14 "pseudo" $h$ Mpc$^{-1}$, where the "pseudo" emphasises that these limits are to be interpreted as approximations to the actual distance scales and brightness temperatures. Using a fiducial EoR model, we demonstrate the feasibility of detecting the EoR with the full array. Compared to standard methods, the closure phase processing is relatively simple, thereby providing an important independent check on results derived using visibility intensities, or related.

astro-ph.CO↗

arXiv2023

All Sky Modelling Requirements for Bayesian 21 cm Power Spectrum Estimation with BayesEoR

We present a comprehensive simulation-based study of the BayesEoR code for 21 cm power spectrum recovery when analytically marginalizing over foreground parameters. To account for covariance between the 21 cm signal and contaminating foreground emission, BayesEoR jointly constructs models for both signals within a Bayesian framework. Due to computational constraints, the forward model is constructed using a restricted field-of-view (FoV) in the image domain. When the only EoR contaminants are noise and foregrounds, we demonstrate that BayesEoR can accurately recover the 21 cm power spectrum when the component of sky emission outside this forward-modelled region is downweighted by the beam at the level of the dynamic range between the foreground and 21 cm signals. However, when all-sky foreground emission is included along with a realistic instrument primary beam with sidelobes above this threshold extending to the horizon, the recovered power spectrum is contaminated by unmodelled sky emission outside the restricted FoV model. Expanding the combined cosmological and foreground model to cover the whole sky is computationally prohibitive. To address this, we present a modified version of BayesEoR that allows for an all-sky foreground model, while the modelled 21 cm signal remains only within the primary FoV of the telescope. With this modification, it will be feasible to run an all-sky BayesEoR analysis on a sizeable compute cluster. We also discuss several future directions for further reducing the need to model all-sky foregrounds, including wide-field foreground subtraction, an image-domain likelihood utilizing a tapering function, and instrument primary beam design.

astro-ph.IM↗

arXiv2022

Statistical recovery of 21cm visibilities and their power spectra with Gaussian constrained realisations and Gibbs sampling

Radio interferometers designed to probe the 21cm signal from Cosmic Dawn and the Epoch of Reionisation must contend with systematic effects that make it difficult to achieve sufficient dynamic range to separate the 21cm signal from foreground emission and other effects. For instance, the instrument's chromatic response modulates the otherwise spectrally smooth foregrounds, making them difficult to model, while a significant fraction of the data must be excised due to the presence of radio frequency interference (RFI), leaving gaps in the data. Errors in modelling the (modulated and gappy) foregrounds can easily generate spurious contamination of what should otherwise be 21cm signal-dominated modes. Various approaches have been developed to mitigate these issues by (e.g.) using non-parametric reconstruction of the foregrounds, in-painting the gaps, and weighting the data to reduce the level of contamination. We present a Bayesian statistical method that combines these approaches, using the coupled techniques of Gaussian constrained realisations (GCR) and Gibbs sampling. This provides a way of drawing samples from the joint posterior distribution of the 21cm signal modes and their power spectrum in the presence of gappy data and an uncertain foreground model in a computationally scalable manner. The data are weighted by an inverse covariance matrix that is estimated as part of the inference, along with a foreground model that can then be marginalised over. We demonstrate the application of this technique on a simulated HERA-like delay spectrum analysis, comparing three different approaches for accounting for the foreground components.

astro-ph.CO↗

arXiv2022

Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization

Radio Frequency Interference (RFI) is one of the systematic challenges preventing 21cm interferometric instruments from detecting the Epoch of Reionization. To mitigate the effects of RFI on data analysis pipelines, numerous inpaint techniques have been developed to restore RFI corrupted data. We examine the qualitative and quantitative errors introduced into the visibilities and power spectrum due to inpainting. We perform our analysis on simulated data as well as real data from the Hydrogen Epoch of Reionization Array (HERA) Phase 1 upper limits. We also introduce a convolutional neural network that capable of inpainting RFI corrupted data in interferometric instruments. We train our network on simulated data and show that our network is capable at inpainting real data without requiring to be retrained. We find that techniques that incorporate high wavenumbers in delay space in their modeling are best suited for inpainting over narrowband RFI. We also show that with our fiducial parameters Discrete Prolate Spheroidal Sequences (DPSS) and CLEAN provide the best performance for intermittent ``narrowband'' RFI while Gaussian Progress Regression (GPR) and Least Squares Spectral Analysis (LSSA) provide the best performance for larger RFI gaps. However we caution that these qualitative conclusions are sensitive to the chosen hyperparameters of each inpainting technique. We find these results to be consistent in both simulated and real visibilities. We show that all inpainting techniques reliably reproduce foreground dominated modes in the power spectrum. Since the inpainting techniques should not be capable of reproducing noise realizations, we find that the largest errors occur in the noise dominated delay modes. We show that in the future, as the noise level of the data comes down, CLEAN and DPSS are most capable of reproducing the fine frequency structure in the visibilities of HERA data.

astro-ph.IM↗