arXiv subjects

Michael J. Wilensky

Publications and source records attributed to Michael J. Wilensky.

18 recordsLinked to original sources

arXiv2026

Bayesian power spectrum estimation with modelling of systematic effects in delay-fringe rate space

Observing the Epoch of Reionisation using 21cm radio interferometry has proven to be a challenging task. Extraction of the extremely faint redshifted signal is complicated by the presence of bright foregrounds, radio frequency interference (RFI), and systematic artefacts. We discuss the challenge of accounting for systematic effects, particularly cable reflections, that appear in the visibility data obtained from 21cm interferometers. Cable reflections cause attenuated copies of the foreground signal to appear outside the 'foreground wedge' region in which foreground contamination is supposed to be localised. We build on the hydra-pspec Gibbs sampler to implement a model of the systematics as a multiplicative effect in delay-fringe rate space. We include this model in the inference of the joint posterior distribution, in addition to the 21cm signal, its power spectrum, and foregrounds. This allows the systematics contribution to be marginalised, rather than filtering it out and causing additional signal loss. We demonstrate the method on simulated visibility data for a single baseline, showing that the 21cm delay power spectrum can be recovered well regardless of the location of the systematics in delay-fringe rate space. Our implementation is suitable for modelling other multiplicative factors on the visibilities, e.g. residual gain errors.

astro-ph.CO↗

arXiv2025

First Results from HERA Phase II

We report the first upper limits on the power spectrum of 21-cm fluctuations during the Epoch of Reionization and Cosmic Dawn from Phase II of the Hydrogen Epoch of Reionization Array (HERA) experiment. HERA Phase II constitutes several significant improvements in the signal chain compared to Phase I, most notably resulting in expanded frequency bandwidth, from 50-250 MHz. In these first upper limits, we investigate a small two-week subset of the available Phase II observations, with a focus on identifying new systematic characteristics of the instrument, and establishing an analysis pipeline to account for them. We report 2$\sigma$ upper limits in eight spectral bands, spanning $5.6 \leq z \leq 24.4$ that are consistent with thermal noise at the $2\sigma$ level for $k \gtrsim 0.6-0.9 h{\rm Mpc}^{-1}$ (band dependent). Our tightest limit during Cosmic Dawn ($z>12$) is $1.13\times 10^6 {\rm mK}^2$ at ($k=0.55 h{\rm Mpc}^{-1}, z=16.78$), and during the EoR ($5.5<z<12$) it is $1.78\times 10^3 {\rm mK}^2$ at ($k=0.70 h{\rm Mpc}^{-1}, z=7.05$). We find that mutual coupling has become our dominant systematic, leaking foreground power that strongly contaminates the low-$k$ modes, resulting in the loss of modes from $k=0.35-0.55$ compared to Phase I data.

astro-ph.CO↗

arXiv2025

Systematic assessment of the Hubble tension via Bayesian jackknife testing

Statistically-significant differences in the value of the Hubble parameter are found depending on the measurement method that is used, a result known as the Hubble tension. A variety of ways of comparing, grouping, and excluding measurements have been used to try to explain this, either in terms of physical effects or systematic errors. We present a systematic 'Bayesian jackknife' analysis of 16 independent measurements of the Hubble parameter in an attempt to identify whether the measurements fall into meaningful clusters that would help explain the origin of the tension. After evaluating evidence ratios for the commonly-used split into early- vs late-time measurements, we then study a range of simplified alternative physical scenarios that reflect different physical origins of an apparent bias or shift in the value of $H_0$, assigning phenomenological population parameters to each subset. These include scenarios where specific subsets are biased (e.g. due to unrecognised experimental systematics in the local distance ladder or cosmic microwave background measurements), as well as more cosmologically-motivated cases involving modifications to the expansion history. Many of these scenarios have similar marginal likelihood, but the model where no measurements are biased is strongly disfavoured. Finally, we marginalise over all these scenarios to estimate the 'model agnostic' posterior distribution of $H_0$. The resulting distribution is mildly multi-modal, but modestly favours values near $H_0=68$ km/s/Mpc, with a 95\% credible region of $66.7 < H_0 < 72.7$ km/s/Mpc.

astro-ph.CO↗

arXiv2025

High Dimensional Beam Inference II: Inference of a Perturbed HERA Beam from Simulated Visibility Data

Accurate beam modeling is important in many radio astronomy applications. In this paper, we focus on beam modeling for 21-cm intensity mapping experiments using radio interferometers, though the techniques also apply to single dish experiments with small modifications. In 21-cm intensity mapping, beam models are usually determined from highly detailed electromagnetic simulations of the receiver system. However, these simulations are expensive, and therefore have limited ability to describe practical imperfections in the beam pattern. We present a fully analytic Bayesian inference framework to infer a beam pattern from the interferometric visibilities assuming a particular sky model and that the beam pattern for all elements is identical, allowing one to capture deviations from the ideal beam for relatively low computational cost. We represent the beam using a sparse Fourier-Bessel basis on a projection of the hemisphere to the unit disc, but the framework applies to any linear basis expansion of the primary beam. We test the framework on simulated visibilities from an unpolarized sky, ignoring mutual coupling of array elements. We successfully recover the simulated, perturbed power beam when the sky model is perfect. Briefly exploring sky model inaccuracies, we find that beam inferences are sensitive to them, so we suggest jointly modeling uncertainties in the sky and beam in related inference tasks.

astro-ph.IM↗

arXiv2024

Impacts and Statistical Mitigation of Missing Data on the 21cm Power Spectrum: A Case Study with the Hydrogen Epoch of Reionization Array

The precise characterization and mitigation of systematic effects is one of the biggest roadblocks impeding the detection of the fluctuations of cosmological 21cm signals. Missing data in radio cosmological experiments, often due to radio frequency interference (RFI), poses a particular challenge to power spectrum analysis as it could lead to the ringing of bright foreground modes in Fourier space, heavily contaminating the cosmological signals. Here we show that the problem of missing data becomes even more arduous in the presence of systematic effects. Using a realistic numerical simulation, we demonstrate that partially flagged data combined with systematic effects can introduce significant foreground ringing. We show that such an effect can be mitigated through inpainting the missing data. We present a rigorous statistical framework that incorporates the process of inpainting missing data into a quadratic estimator of the 21cm power spectrum. Under this framework, the uncertainties associated with our inpainting method and its impact on power spectrum statistics can be understood. These results are applied to the latest Phase II observations taken by the Hydrogen Epoch of Reionization Array, forming a crucial component in power spectrum analyses as we move toward detecting 21cm signals in the ever more noisy RFI environment.

astro-ph.CO↗

arXiv2024

A Generalized Method for Characterizing 21-cm Power Spectrum Signal Loss from Temporal Filtering of Drift-scanning Visibilities

A successful detection of the cosmological 21-cm signal from intensity mapping experiments (for example, during the Epoch of Reioinization or Cosmic Dawn) is contingent on the suppression of subtle systematic effects in the data. Some of these systematic effects, with mutual coupling a major concern in interferometric data, manifest with temporal variability distinct from that of the cosmological signal. Fringe-rate filtering -- a time-based Fourier filtering technique -- is a powerful tool for mitigating these effects; however, fringe-rate filters also attenuate the cosmological signal. Analyses that employ fringe-rate filters must therefore be supplemented by careful accounting of the signal loss incurred by the filters. In this paper, we present a generalized formalism for characterizing how the cosmological 21-cm signal is attenuated by linear time-based filters applied to interferometric visibilities from drift-scanning telescopes. Our formalism primarily relies on analytic calculations and therefore has a greatly reduced computational cost relative to traditional Monte Carlo signal loss analyses. We apply our signal loss formalism to a filtering strategy used by the Hydrogen Epoch of Reionization Array (HERA) and compare our analytic predictions against signal loss estimates obtained through a Monte Carlo analysis. We find excellent agreement between the analytic predictions and Monte Carlo estimates and therefore conclude that HERA, as well as any other drift-scanning interferometric experiment, should use our signal loss formalism when applying linear, time-based filters to the visibilities.

astro-ph.CO↗

arXiv2024

RHINO: A large horn antenna for detecting the 21cm global signal

The sky-averaged brightness temperature of the 21cm line from neutral hydrogen provides a sensitive probe of the thermal state of the intergalactic medium, particularly before and during Cosmic Dawn and the Epoch of Reionisation. This `global signal' is faint, on the order of tens to hundreds of millikelvin, and spectrally relatively smooth, making it exceedingly difficult to disentangle from foreground radio emission and instrumental artefacts. In this paper, we introduce RHINO, an experiment based around a large horn antenna operating from 60-85 MHz. Horn antennas are highly characterisable and provide excellent shielding from their immediate environment, which are potentially decisive advantages when it comes to the beam measurement and modelling problems that are particularly challenging for this kind of experiment. The system also includes a novel continuous wave calibration source to control correlated gain fluctuations, allowing continuous monitoring of the overall gain level without needing to rapidly switch between the sky and a calibration source. Here, we describe the basic RHINO concept, including the antenna design, EM simulations, and receiver electronics. We use a basic simulation and analysis pipeline to study the impact of the limited bandwidth on recovery of physical 21cm global signal model parameters, and discuss a basic calibration scheme that incorporates the continuous wave signal. Finally, we report on the current state of a scaled-down prototype system under construction at Jodrell Bank Observatory.

astro-ph.IM↗

arXiv2024

Bayesian evidence for flux scale errors in Galactic synchrotron maps

The 408 MHz Haslam map is widely used as a low-frequency anchor for the intensity and morphology of Galactic synchrotron emission. Multi-frequency, multi-experiment fits show evidence of spatial variation and curvature in the synchrotron frequency spectrum, but there are also poorly-understood multiplicative flux scale disagreements between experiments. We perform a Bayesian model comparison across a range of scenarios, using fits that include recent spectroscopic observations at $\sim 1$ GHz by MeerKAT as well as a reference map from the OVRO-LWA at 73 MHz. In the few square degrees that we analyzed, a large uncorrected flux scale factor potentially as large as 1.6 in the Haslam data is preferred, indicating a 60\% overestimation of the brightness. This partly undermines its use as a reference map. We also find that models with nonzero spectral curvature are statistically disfavored. Given the limited sky coverage here, we suggest a similar analysis across many more regions of the sky to determine the extent and variation of flux scale errors, and whether they should be treated as random or systematic errors in analyses that use the Haslam map as a template.

astro-ph.CO↗

arXiv2024

High-dimensional inference of radio interferometer beam patterns I: Parametric model of the HERA beams

Accurate modelling of the primary beam is an important but difficult task in radio astronomy. For high dynamic range problems such as 21cm intensity mapping, small modelling errors in the sidelobes and spectral structure of the beams can translate into significant systematic errors. Realistic beams exhibit complex spatial and spectral structure, presenting a major challenge for beam measurement and calibration methods. In this paper series, we present a Bayesian framework to infer per-element beam patterns from the interferometric visibilities for large arrays with complex beam structure, assuming a particular (but potentially uncertain) sky model and calibration solution. In this first paper, we develop a compact basis for the beam so that the Bayesian computation is tractable with high-dimensional sampling methods. We use the Hydrogen Epoch of Reionization Array (HERA) as an example, verifying that the basis is capable of describing its single-element E-field beam (i.e. without considering array effects like mutual coupling) with a relatively small number of coefficients. We find that 32 coefficients per feed, incident polarization, and frequency, are sufficient to give percent-level and $\sim$10\% errors in the mainlobe and sidelobes respectively for the current HERA Vivaldi feeds, improving to $\sim 0.1\%$ and $\sim 1\%$ for 128 coefficients.

astro-ph.IM↗

arXiv2024

Sensitivity of Bayesian 21 cm power spectrum estimation to foreground model errors

Power spectrum estimators are an important tool in efforts to detect the 21 cm brightness temperature fluctuations from neutral hydrogen at early times. An initial detection will likely be statistical in nature, meaning that it will not be possible to make a coherent map of the brightness temperature fluctuations; instead, only their variance will be measured against a background of noise and residual systematic effects. Optimal Quadratic Estimator (OQE)-based methods often apply an inverse covariance weighting to the data. However, inaccurate covariance modelling can lead to reduced sensitivity and, in some cases, severe signal loss. We recently proposed a Bayesian method to jointly estimate the 21 cm fluctuations, their power spectrum, and foreground emission. Instead of requiring a fixed a priori estimate of the covariance, we estimate the covariance as part of the inference. Choices of parametrization, particularly of the foregrounds, are subject to model errors and could lead to biases and other ill effects if not properly controlled. In this paper, we investigate the effects of inaccurate foreground models on 21 cm power spectrum recovery. Using simulated visibilities, we find that, even in the most extreme scenarios tested, our approach is capable of recovering 21 cm delay power spectrum estimates consistent with a known input signal for delays $\gtrsim300$ ns ($\sim$88\% of the available Fourier modes). This is true even when using foreground models derived from modified foreground catalogs containing spatial and spectral perturbations at the quoted level of uncertainty on our foreground catalogs.

astro-ph.CO↗

arXiv2024

Statistical estimation of full-sky radio maps from 21cm array visibility data using Gaussian constrained realizations

An important application of next-generation wide-field radio interferometers is making high dynamic range maps of radio emission. Traditional deconvolution methods like CLEAN can give poor recovery of diffuse structure, prompting the development of wide-field alternatives like Direct Optimal Mapping and $m$-mode analysis. In this paper, we propose an alternative Bayesian method to infer the coefficients of a full-sky spherical harmonic basis for a drift-scan telescope with potentially thousands of baselines, that can precisely encode the uncertainties and correlations between the parameters used to build the recovered image. We use Gaussian constrained realizations (GCR) to efficiently draw samples of the spherical harmonic coefficients, despite the very large parameter space and extensive sky-regions of missing data. Each GCR solution provides a complete, statistically-consistent gap-free realization of a full-sky map conditioned on the available data, even when the interferometer's field of view is small. Many realizations can be generated and used for further analysis and robust propagation of statistical uncertainties. In this paper, we present the mathematical formalism of the spherical harmonic GCR-method for radio interferometers. We focus on the recovery of diffuse emission as a use case, along with validation of the method against simulations with a known diffuse emission component.

astro-ph.IM↗

arXiv2023

Evidence of Ultra-faint Radio Frequency Interference in Deep 21~cm Epoch of Reionization Power Spectra with the Murchison Widefield Array

We present deep upper limits from the 2014 Murchison Widefield Array (MWA) Phase I observing season, with a particular emphasis on identifying the spectral fingerprints of extremely faint radio frequency interference (RFI) contamination in the 21~cm power spectra (PS). After meticulous RFI excision involving a combination of the \textsc{SSINS} RFI flagger and a series of PS-based jackknife tests, our lowest upper limit on the Epoch of Reionization (EoR) 21~cm PS signal is $\Delta^2 \leq 1.61\cdot10^4 \text{ mK}^2$ at $k=0.258\text{ h Mpc}^{-1}$ at a redshift of 6.5 using 14.7 hours of data. By leveraging our understanding of how even fainter RFI is likely to contaminate the EoR PS, we are able to identify ultra-faint RFI signals in the cylindrical PS. Surprisingly this signature is most obvious in PS formed with less than an hour of data, but is potentially subdominant to other systematics in multiple-hour integrations. Since the total RFI budget in a PS detection is quite strict, this nontrivial integration behavior suggests a need to more realistically model coherently integrated ultra-faint RFI in PS measurements so that its potential contribution to a future detection can be diagnosed.

astro-ph.CO↗

arXiv2022

Why and When to Expect Gaussian Error Distributions in Epoch of Reionization 21-cm Power Spectrum Measurements

We explore error distributions in Epoch of Reionization 21-cm power spectrum estimators using a combination of mathematical analysis and numerical simulations. We provide closed form solutions for the error distributions of individual bins in 3d-power spectra for two estimators currently in use in the field, which we designate as ``straight-square" and ``cross-multiply" estimators. We then demonstrate when the corresponding spherically binned power spectra should (and should not) have Gaussian error distributions, which requires appealing to nonstandard statements of the central limit theorem. This has important implications for how upper limits are reported, as well as how cosmological inferences are performed based on power spectrum measurements. Specifically, assuming a Gaussian error distribution can over or underestimate the upper limit depending on the type of estimator, and produces overly compact likelihood functions for the power spectrum.

astro-ph.CO↗

arXiv2022

Bayesian jackknife tests with a small number of subsets: Application to HERA 21cm power spectrum upper limits

We present a Bayesian jackknife test for assessing the probability that a data set contains biased subsets, and, if so, which of the subsets are likely to be biased. The test can be used to assess the presence and likely source of statistical tension between different measurements of the same quantities in an automated manner. Under certain broadly applicable assumptions, the test is analytically tractable. We also provide an open source code, CHIBORG, that performs both analytic and numerical computations of the test on general Gaussian-distributed data. After exploring the information theoretical aspects of the test and its performance with an array of simulations, we apply it to data from the Hydrogen Epoch of Reionization Array (HERA) to assess whether different sub-seasons of observing can justifiably be combined to produce a deeper 21cm power spectrum upper limit. We find that, with a handful of exceptions, the HERA data in question are statistically consistent and this decision is justified. We conclude by pointing out the wide applicability of this test, including to CMB experiments and the $H_0$ tension.

astro-ph.IM↗

arXiv2022

Improved Constraints on the 21 cm EoR Power Spectrum and the X-Ray Heating of the IGM with HERA Phase I Observations

We report the most sensitive upper limits to date on the 21 cm epoch of reionization power spectrum using 94 nights of observing with Phase I of the Hydrogen Epoch of Reionization Array (HERA). Using similar analysis techniques as in previously reported limits (HERA Collaboration 2022a), we find at 95% confidence that $\Delta^2(k = 0.34$ $h$ Mpc$^{-1}$) $\leq 457$ mK$^2$ at $z = 7.9$ and that $\Delta^2 (k = 0.36$ $h$ Mpc$^{-1}) \leq 3,496$ mK$^2$ at $z = 10.4$, an improvement by a factor of 2.1 and 2.6 respectively. These limits are mostly consistent with thermal noise over a wide range of $k$ after our data quality cuts, despite performing a relatively conservative analysis designed to minimize signal loss. Our results are validated with both statistical tests on the data and end-to-end pipeline simulations. We also report updated constraints on the astrophysics of reionization and the cosmic dawn. Using multiple independent modeling and inference techniques previously employed by HERA Collaboration (2022b), we find that the intergalactic medium must have been heated above the adiabatic cooling limit at least as early as $z = 10.4$, ruling out a broad set of so-called "cold reionization" scenarios. If this heating is due to high-mass X-ray binaries during the cosmic dawn, as is generally believed, our result's 99% credible interval excludes the local relationship between soft X-ray luminosity and star formation and thus requires heating driven by evolved low-metallicity stars.

astro-ph.CO↗

arXiv2021

Exploring the consequences of chromatic data excision in 21-cm Epoch of Reionization power spectrum observations

We explore how chromatic RFI flags affect 21-cm power spectrum measurements. We particularly study flags that are coarser than the analysis resolution. We find that such RFI flags produce excess power in the EoR window in much the same way as residual RFI. We use Fast Holographic Deconvolution (FHD) simulations to explain this as a result of chromatic disruptions in the interferometric sampling function of the array. We also use these simulations in conjunction with Error Propagated Power Spectrum with InterLeaved Observed Noise ($\varepsilon$ppsilon) to show that without modifying current flagging strategies or implementing extremely accurate and complete foreground subtraction, 21-cm EoR experiments will fail to make a significant detection. As a mitigation strategy, we find that circumventing the chromatic structure altogether by flagging the entire analysis band when RFI is detected is simple to implement and highly successful. This demands a detection strategy with a low false positive rate in order to prevent excessive data loss.

astro-ph.IM↗

arXiv2020

Quantifying Excess Power from Radio Frequency Interference in Epoch of Reionization Measurements

We quantify the effect of radio frequency interference (RFI) on measurements of the 21-cm power spectrum during the Epoch of Reionization (EoR). Specifically, we investigate how the frequency structure of RFI source emission generates contamination in higher-order wave modes that is much more problematic than smooth-spectrum foreground sources. Using a relatively optimistic EoR model, we find that even a single relatively dim RFI source can overwhelm the EoR power spectrum signal of $\sim10\text{ mK}^2$ for modes $0.1 \text{ }h\text{ Mpc}^{-1} < k < 2 \text{ }h\text{ Mpc}^{-1}$. If total apparent RFI flux density in the final power spectrum integration is kept below 1 mJy, an EoR signal resembling this optimistic model should be detectable for modes $k < 0.9\text{ }h\text{ Mpc}^{-1}$, given no other systematic contaminants and an error tolerance as high as 10%. More pessimistic models will be more restrictive. These results emphasize the need for highly effective RFI mitigation strategies for telescopes used to search for the EoR.

astro-ph.IM↗

arXiv2019

Absolving the SSINS of Precision Interferometric Radio Data: A New Technique for Mitigating Faint Radio Frequency Interference

We introduce a new pipeline for analyzing and mitigating radio frequency interference (RFI), which we call Sky-Subtracted Incoherent Noise Spectra (SSINS). SSINS is designed to identify and remove faint RFI below the single baseline thermal noise by employing a frequency-matched detection algorithm on baseline-averaged amplitudes of time-differenced visibilities. We demonstrate the capabilities of SSINS using the Murchison Widefield Array (MWA) in Western Australia. We successfully image aircraft flying over the array via digital television (DTV) reflection detected using SSINS and summarize an RFI occupancy survey of MWA Epoch of Reionization data. We describe how to use SSINS with new data using a documented, publicly available implementation with comprehensive usage tutorials.

astro-ph.IM↗