arXiv Science⌕ Search

arXiv subjects

D. C. Masters

Publications and source records attributed to D. C. Masters.

14 recordsLinked to original sources

Euclid Data Release 1 (DR1): Calibration strategy and observations

This paper reviews how Euclid's top-level calibration requirements were translated into a calibration plan, how this plan is implemented and maintained during the survey, and how it performs in the current DR1 release. We show that DR1 already meets or exceeds most end-of-mission spectrophotometric calibration requirements. The construction of spectroscopically complete and pure samples relies on ongoing data acquisition for the Euclid Deep Survey, while point-spread-function modelling and shear calibration are still converging to their stringent accuracy requirements. With all DR1 data reprocessed with the DR1 pipeline configuration, more subtle effects have been detected and characterised, and correction strategies have been developed for DR2. These include improved absolute flux calibration, astrometry, charge-persistence correction, shutter effects, wavelength calibration, and spectrophotometric corrections for water-ice contamination. Finally, synthetic photometric transformations between Euclid and each of Roman, the James Webb Space Telescope, and the Chinese Space-station Survey Telescope, are presented.

astro-ph.IM↗

Euclid data release 1 (DR1) - SIR spectroscopic calibration

The Euclid space mission is dedicated to probing the nature of dark energy and dark matter, through a comprehensive mapping of the Universe's large-scale structure. Central to these cosmological goals are the spectra produced by the Near-Infrared Spectrometer and Photometer (NISP) and reduced by the scientific pipelines of the SIR (Spectral near InfraRed) processing function. Due to the intrinsic complexity of slitless spectroscopic data, scientific observations cannot be self-calibrated by the science pipelines. Consequently, the development of dedicated SIR calibration pipelines, utilising specific pointing sequences and observation fields, is essential. The resulting calibration products are fundamental to ensuring that reduced spectra are characterised within requirements in both wavelength and flux. This paper provides a detailed description of the SIR calibration pipelines responsible for generating the products utilised by the science pipelines for Data Release 1 (DR1). A significant challenge in these calibration tasks arises from the requirement to model the entire focal plane as a unified entity. Such a global modelling approach is critical for maintaining astrometric and spectroscopic continuity across the entire field of view. DR1 provides more than 170 millions validated spectra in both red- and blue-grism modes. The accuracy of the reduced spectra is strictly dependent on the performance of the calibration pipelines. Comprehensive analyses of the calibration products and the resulting science spectra demonstrate that current outputs successfully meet the mission requirements. Nevertheless, specific areas for optimisation have been identified; ongoing development is focused on addressing these critical points to further enhance data quality for future data releases.

astro-ph.IM↗

Euclid Data Release 1 (DR1): Photometric-redshift pipeline overview and validation

We present the pipeline design of the photometric redshift processing function for Data Release 1 (DR1) of the $Euclid$ mission, and the validation and performance of our cosmology-related products that are released as part of DR1-Foundation. The $Euclid$ mission aims to constrain the equation-of-state parameter of dark energy, $w$, to percent-level accuracy through the measurement of large-scale structure via weak gravitational lensing and galaxy clustering. As part of DR1-Foundation we release determinations of photometric redshifts (photo-$z$), corrected photometry, and object classes that are used to form the basis of the cosmological samples. The release furthermore includes estimates of the spectral energy distributions of stars and galaxies for the careful modelling of the point-spread function for weak-lensing measurement. We estimate the performance of the photo-$z$ point estimates and probability distribution functions using overlapping spectroscopic redshifts, which are weighted to match different flux-limited target samples. We find that the current performance is somewhat below mission design requirements ($40\%$ in scatter and a factor of 2 in outlier fraction) at the nominal survey depth ($I_{\rm E}<24.5$), but closely matching requirements at slightly brighter magnitudes ($I_{\rm E}<24$), consistent with pre-launch analyses and the slightly shallower external data (up to $0.3\,\mathrm{mag}$) with respect to end-of-mission expectations. Data from Rubin-LSST will help alleviate this issue by the time of the final cosmology analyses. The other cosmology-related outputs are tested to the extent that is possible with currently available comparison data. This paper is partnered by an article describing the measurement of the physical properties of galaxies for the purpose of non-cosmological science.

astro-ph.CO↗

Euclid: Improving redshift distribution reconstruction using a deep-to-wide transfer function

The Euclid mission seeks to understand the Universe expansion history and the nature of dark energy, which requires a very accurate estimate of redshift distribution. Achieving this accuracy relies on reference samples with spectroscopic redshifts, together with a procedure to match them to survey sources for which only photometric redshifts are available. One important source of systematic uncertainty is the mismatch in photometric properties between galaxies in the Euclid survey and the reference objects. We develop a method to degrade the photometry of objects with deep photometry to match the properties of any shallower survey in the multi-band photometric space, preserving all the correlations between the fluxes and their uncertainties. We compare our transfer method with more demanding image-based methods, such as Balrog from the Dark Energy Survey Collaboration. According to metrics, our method outperforms Balrog. We implement it in the redshift distribution reconstruction, based on the self-organising map approach of arXiv:1509.03318, and test it using a realistic sample from the Euclid Flagship Simulation. We find that the key ingredient is to ensure that the reference objects are distributed in the colour space the same way as the wide-survey objects, which can be efficiently achieved with our transfer method. In our best implementation, the mean redshift biases are consistently reduced across the tomographic bins, bringing a significant fraction of them within the Euclid accuracy requirements in all tomographic bins. Equally importantly, the tests allow us to pinpoint which step in the calibration pipeline has the strongest impact on achieving the required accuracy. Our approach also reproduces the overall redshift distributions, which are crucial for applications such as angular clustering.

astro-ph.CO↗

Euclid: Photometric redshift calibration with self-organising maps

The Euclid survey aims to trace the evolution of cosmic structures up to redshift $z$ $\sim$ 3 and beyond. Its success depends critically on obtaining highly accurate mean redshifts for ensembles of galaxies $n(z)$ in all tomographic bins, essential for deriving robust cosmological constraints. However, photometric redshifts (photo-$z$s) suffer from systematic biases arising from various sources of uncertainty. To address these challenges, we utilised self-organising maps (SOMs) with mock samples resembling the Euclid Wide Survey (EWS), to validate Euclid's uncertainty requirement of $|Δ\langle z \rangle| = \langle z_{\text{est}} \rangle - \langle z \rangle \leq 0.002 (1+z)$ per tomographic bin, assuming DR3-level data. We observe that defining the redshift tomography using the mean spectroscopic redshift (spec-$z$) per SOM cell, results in none of the ten tomographic redshift bins satisfying the requirement. In contrast, the redshift tomography on the photo-$z$s of the EWS-like sample yields superior results, with eight out of ten bins [$0 < z\leq 2.5$] meeting the Euclid requirement. To enhance the realism of our study, we morph our calibration sample to mimic the C3R2 survey in incremental steps. In this context, a maximum of six out of ten bins meet the requirement, strongly advocating the adoption of a redshift tomography defined by the photo-$z$s of individual galaxies rather than the commonly used mean spec-$z$ of SOM cells. To examine the impact on the expected biases for $Ω_{\text{m}}$, $σ_{8}$, and $Δw_{0}$ measured by Euclid, we perform a Fisher forecast for cosmic shear only, based on our redshift uncertainties. Here, we find that even under an evaluation of the uncertainty where the impact of the redshift bias is substantial, most absolute biases remain below 0.1$σ$ in the idealised scenario and below 0.3$σ$ in the more realistic case.

astro-ph.CO↗

Euclid Quick Data Release (Q1): From spectrograms to spectra: the SIR spectroscopic Processing Function

The Euclid space mission aims to investigate the nature of dark energy and dark matter by mapping the large-scale structure of the Universe. A key component of Euclid's observational strategy is slitless spectroscopy, conducted using the Near Infrared Spectrometer and Photometer (NISP). This technique enables the acquisition of large-scale spectroscopic data without the need for targeted apertures, allowing precise redshift measurements for millions of galaxies. These data are essential for Euclid's core science objectives, including the study of cosmic acceleration and the evolution of galaxy clustering, as well as enabling many non-cosmological investigations. This study presents the SIR processing function (PF), which is responsible for processing slitless spectroscopic data. The objective is to generate science-grade fully-calibrated one-dimensional spectra, ensuring high-quality spectroscopic data. The processing function relies on a source catalogue generated from photometric data, effectively corrects detector effects, subtracts cross-contaminations, minimizes self-contamination, calibrates wavelength and flux, and produces reliable spectra for later scientific use. The first Quick Data Release (Q1) of Euclid's spectroscopic data provides approximately three million validated spectra for sources observed in the red-grism mode from a selected portion of the Euclid Wide Survey. We find that wavelength accuracy and measured resolving power are within requirements, thanks to the excellent optical quality of the instrument. The SIR PF represents a significant step in processing slitless spectroscopic data for the Euclid mission. As the survey progresses, continued refinements and additional features will enhance its capabilities, supporting high-precision cosmological and astrophysical measurements.

astro-ph.IM↗

Euclid: Detecting Solar System objects in Euclid images and classifying them using Kohonen self-organising maps

The ESA Euclid mission will survey more than 14,000 deg$^2$ of the sky in visible and near-infrared wavelengths, mapping the extra-galactic sky to constrain our cosmological model of the Universe. Although the survey focusses on regions further than 15 deg from the ecliptic, it should allow for the detection of more than about $10^5$ Solar System objects (SSOs). After simulating the expected signal from SSOs in Euclid images acquired with the visible camera (VIS), we describe an automated pipeline developed to detect moving objects with an apparent velocity in the range of 0.1-10 arcsec/h, typically corresponding to sources in the outer Solar System (from Centaurs to Kuiper-belt objects). In particular, the proposed detection scheme is based on Sourcextractor software and on applying a new algorithm capable of associating moving objects amongst different catalogues. After applying a suite of filters to improve the detection quality, we study the expected purity and completeness of the SSO detections. We also show how a Kohonen self-organising neural network can be successfully trained (in an unsupervised fashion) to classify stars, galaxies, and SSOs. By implementing an early-stopping method in the training scheme, we show that the network can be used in a predictive way, allowing one to assign the probability of each detected object being a member of each considered class.

astro-ph.IM↗

Euclid preparation. XXXI. The effect of the variations in photometric passbands on photometric-redshift accuracy

The technique of photometric redshifts has become essential for the exploitation of multi-band extragalactic surveys. While the requirements on photo-zs for the study of galaxy evolution mostly pertain to the precision and to the fraction of outliers, the most stringent requirement in their use in cosmology is on the accuracy, with a level of bias at the sub-percent level for the Euclid cosmology mission. A separate, and challenging, calibration process is needed to control the bias at this level of accuracy. The bias in photo-zs has several distinct origins that may not always be easily overcome. We identify here one source of bias linked to the spatial or time variability of the passbands used to determine the photometric colours of galaxies. We first quantified the effect as observed on several well-known photometric cameras, and found in particular that, due to the properties of optical filters, the redshifts of off-axis sources are usually overestimated. We show using simple simulations that the detailed and complex changes in the shape can be mostly ignored and that it is sufficient to know the mean wavelength of the passbands of each photometric observation to correct almost exactly for this bias; the key point is that this mean wavelength is independent of the spectral energy distribution of the source}. We use this property to propose a correction that can be computationally efficiently implemented in some photo-z algorithms, in particular template-fitting. We verified that our algorithm, implemented in the new photo-z code Phosphoros, can effectively reduce the bias in photo-zs on real data using the CFHTLS T007 survey, with an average measured bias Delta z over the redshift range 0.4<z<0.7 decreasing by about 0.02, specifically from Delta z~0.04 to Delta z~0.02 around z=0.5. Our algorithm is also able to produce corrected photometry for other applications.

astro-ph.CO↗

COSMOS2020: Manifold Learning to Estimate Physical Parameters in Large Galaxy Surveys

We present a novel method to estimate galaxy physical properties from spectral energy distributions (SEDs), alternate to template fitting techniques and based on self-organizing maps (SOM) to learn the high-dimensional manifold of a photometric galaxy catalog. The method has been previously tested with hydrodynamical simulations in Davidzon et al. (2019) while here is applied to real data for the first time. It is crucial for its implementation to build the SOM with a high quality, panchromatic data set, which we elect to be the "COSMOS2020" galaxy catalog. After the training and calibration steps with COSMOS2020, other galaxies can be processed through SOM to obtain an estimate of their stellar mass and star formation rate (SFR). Both quantities result to be in good agreement with independent measurements derived from more extended photometric baseline, and also their combination (i.e., the SFR vs. stellar mass diagram) shows a main sequence of star forming galaxies consistent with previous studies. We discuss the advantages of this method compared to traditional SED fitting, highlighting the impact of having, instead of the usual synthetic templates, a collection of empirical SEDs built by the SOM in a "data-driven" way. Such an approach also allows, even for extremely large data sets, an efficient visual inspection to identify photometric errors or peculiar galaxy types. Considering in addition the computational speed of this new estimator, we argue that it will play a valuable role in the analysis of oncoming large-area surveys like Euclid or the Legacy Survey of Space and Time at the Vera Cooper Rubin Telescope.

astro-ph.GA↗

Euclid preparation: XVIII. Cosmic Dawn Survey. Spitzer observations of the Euclid deep fields and calibration fields

We present a new infrared survey covering the three Euclid deep fields and four other Euclid calibration fields using Spitzer's Infrared Array Camera (IRAC). We have combined these new observations with all relevant IRAC archival data of these fields in order to produce the deepest possible mosaics of these regions. In total, these observations represent nearly 11% of the total Spitzer mission time. The resulting mosaics cover a total of approximately 71.5deg$^2$ in the 3.6 and 4.5um bands, and approximately 21.8deg$^2$ in the 5.8 and 8um bands. They reach at least 24 AB magnitude (measured to sigma, in a 2.5 arcsec aperture) in the 3.6um band and up to ~ 5 mag deeper in the deepest regions. The astrometry is tied to the Gaia astrometric reference system, and the typical astrometric uncertainty for sources with 16<[3.6]<19 is <0.15 arcsec. The photometric calibration is in excellent agreement with previous WISE measurements. We have extracted source number counts from the 3.6um band mosaics and they are in excellent agreement with previous measurements. Given that the Spitzer Space Telescope has now been decommissioned these mosaics are likely to be the definitive reduction of these IRAC data. This survey therefore represents an essential first step in assembling multi-wavelength data on the Euclid deep fields which are set to become some of the premier fields for extragalactic astronomy in the 2020s.

astro-ph.GA↗

Euclid preparation: XI. Mean redshift determination from galaxy redshift probabilities for cosmic shear tomography

The analysis of weak gravitational lensing in wide-field imaging surveys is considered to be a major cosmological probe of dark energy. Our capacity to constrain the dark energy equation of state relies on the accurate knowledge of the galaxy mean redshift $\langle z \rangle$. We investigate the possibility of measuring $\langle z \rangle$ with an accuracy better than $0.002\,(1+z)$, in ten tomographic bins spanning the redshift interval $0.2 99.8\%$. The zPDF approach could also be successful if we debias the zPDF using a spectroscopic training sample. This approach requires deep imaging data, but is weakly sensitive to spectroscopic redshift failures in the training sample. We improve the debiasing method and confirm our finding by applying it to real-world weak-lensing data sets (COSMOS and KiDS+VIKING-450).

astro-ph.CO↗

Euclid preparation: VIII. The Complete Calibration of the Colour-Redshift Relation survey: VLT/KMOS observations and data release

The Complete Calibration of the Colour-Redshift Relation survey (C3R2) is a spectroscopic effort involving ESO and Keck facilities designed to empirically calibrate the galaxy colour-redshift relation - P(z|C) to the Euclid depth (i_AB=24.5) and is intimately linked to upcoming Stage IV dark energy missions based on weak lensing cosmology. The aim is to build a spectroscopic calibration sample that is as representative as possible of the galaxies of the Euclid weak lensing sample. In order to minimise the number of spectroscopic observations to fill the gaps in current knowledge of the P(z|C), self-organising map (SOM) representations of the galaxy colour space have been constructed. Here we present the first results of an ESO@ VLT Large Programme approved in the context of C3R2, which makes use of the two VLT optical and near-infrared multi-object spectrographs, FORS2 and KMOS. This paper focuses on high-quality spectroscopic redshifts of high-z galaxies observed with the KMOS spectrograph in the H- and K-bands. A total of 424 highly-reliable z are measured in the 1.3<=z<=2.5 range, with total success rates of 60.7% in the H-band and 32.8% in the K-band. The newly determined z fill 55% of high and 35% of lower priority empty SOM grid cells. We measured Halpha fluxes in a 1."2 radius aperture from the spectra of the spectroscopically confirmed galaxies and converted them into star formation rates. In addition, we performed an SED fitting analysis on the same sample in order to derive stellar masses, E(B-V), total magnitudes, and SFRs. We combine the results obtained from the spectra with those derived via SED fitting, and we show that the spectroscopic failures come from either weakly star-forming galaxies (at z<1.7, i.e. in the H-band) or low S/N spectra (in the K-band) of z>2 galaxies.

astro-ph.GA↗

Euclid: The selection of quiescent and star-forming galaxies using observed colours

The Euclid mission will observe well over a billion galaxies out to $z\sim6$ and beyond. This will offer an unrivalled opportunity to investigate several key questions for understanding galaxy formation and evolution. The first step for many of these studies will be the selection of a sample of quiescent and star-forming galaxies, as is often done in the literature by using well known colour techniques such as the `UVJ' diagram. However, given the limited number of filters available for the Euclid telescope, the recovery of such rest-frame colours will be challenging. We therefore investigate the use of observed Euclid colours, on their own and together with ground-based u-band observations, for selecting quiescent and star-forming galaxies. The most efficient colour combination, among the ones tested in this work, consists of the (u-VIS) and (VIS-J) colours. We find that this combination allows users to select a sample of quiescent galaxies complete to above $\sim70\%$ and with less than 15$\%$ contamination at redshifts in the range $0.75 65\%$ completeness level and contamination below 20$\%$ at $1<z<2$ for finding quiescent galaxies. In comparison, the sample of quiescent galaxies selected with the traditional UVJ technique is only $\sim20\%$ complete at $z<3$, when recovering the rest-frame colours using mock Euclid observations. This shows that our new methodology is the most suitable one when only Euclid bands, along with u-band imaging, are available.

astro-ph.GA↗

Phenotypic redshifts with self-organizing maps: A novel method to characterize redshift distributions of source galaxies for weak lensing

Wide-field imaging surveys such as the Dark Energy Survey (DES) rely on coarse measurements of spectral energy distributions in a few filters to estimate the redshift distribution of source galaxies. In this regime, sample variance, shot noise, and selection effects limit the attainable accuracy of redshift calibration and thus of cosmological constraints. We present a new method to combine wide-field, few-filter measurements with catalogs from deep fields with additional filters and sufficiently low photometric noise to break degeneracies in photometric redshifts. The multi-band deep field is used as an intermediary between wide-field observations and accurate redshifts, greatly reducing sample variance, shot noise, and selection effects. Our implementation of the method uses self-organizing maps to group galaxies into phenotypes based on their observed fluxes, and is tested using a mock DES catalog created from N-body simulations. It yields a typical uncertainty on the mean redshift in each of five tomographic bins for an idealized simulation of the DES Year 3 weak-lensing tomographic analysis of $σ_{Δz} = 0.007$, which is a 60% improvement compared to the Year 1 analysis. Although the implementation of the method is tailored to DES, its formalism can be applied to other large photometric surveys with a similar observing strategy.

astro-ph.CO↗