arXiv Science⌕ Search

arXiv subjects

Laurence Perreault Levasseur

Publications and source records attributed to Laurence Perreault Levasseur.

At least 19 recordsLinked to original sources

Do Tabular Foundation Models Know Physics? Contamination, Units, and the Deterministic Limit

Tabular foundation models (TFMs) learn to fill in tables the way language models fill in text, and tables are arguably the format in which most physical measurement arrives. Did they learn any physics in the process? They are Bayesian by construction, so the question is what their prior contains. We probe it directly, evaluating four of them (TabPFN-3, TabICLv2, TabDPT and Real-TabPFN-2.5) against six baselines on datasets sampled from 316 physical equations, in and out of domain. TFMs dominate, out of the box and after tuning. But we show that their prior can represent neither a noiseless mechanism nor physical units, which is why they interpolate physics without yet being able to act as physical models.

cs.LG↗

Bridging Simulators with Conditional Optimal Transport

We propose a new field-level emulator that bridges two simulators using unpaired simulation datasets. Our method leverages a flow-based approach to learn the likelihood transport from one simulator to the other. Since multiple transport maps exist, we employ Conditional Optimal Transport Flow Matching (COT-FM) to ensure that the transformation minimally distorts the underlying structure of the data. We demonstrate the effectiveness of this approach by bridging weak lensing simulators: a Lagrangian Perturbation Theory (LPT) to a N-body Particle-Mesh (PM). We demonstrate that our emulator captures the full correction between the simulators by showing that it enables full-field inference to accurately recover the true posterior, validating its accuracy beyond traditional summary statistics.

astro-ph.CO↗

Galaxy cluster characterization with machine learning techniques

We present an analysis of the X-ray properties of the galaxy cluster population in the z=0 snapshot of the IllustrisTNG simulations, utilizing machine learning techniques to perform clustering and regression tasks. We examine five properties of the hot gas (the central cooling time, the central electron density, the central entropy excess, the concentration parameter, and the cuspiness) which are commonly used as classification metrics to identify cool core (CC), weak cool core (WCC) and non cool core (NCC) clusters of galaxies. Using mock Chandra X-ray images as inputs, we first explore an unsupervised clustering scheme to see how the resulting groups correlate with the CC/WCC/NCC classification based on the different criteria. We observe that the groups replicate almost exactly the separation of the galaxy cluster images when classifying them based on the concentration parameter. We then move on to a regression task, utilizing a ResNet model to predict the value of all five properties. The network is able to achieve a mean percentage error of 1.8% for the central cooling time, and a balanced accuracy of 0.83 on the concentration parameter, making them the best-performing metrics. Finally, we use simulation-based inference (SBI) to extract posterior distributions for the network predictions. Our neural network simultaneously predicts all five classification metrics using only mock Chandra X-ray images. This study demonstrates that machine learning is a viable approach for analyzing and classifying the large galaxy cluster datasets that will soon become available through current and upcoming X-ray surveys, such as eROSITA.

astro-ph.GA↗

Beyond Gaussian Noise: A Generalized Approach to Likelihood Analysis with non-Gaussian Noise

Likelihood analysis is typically limited to normally distributed noise due to the difficulty of determining the probability density function of complex, high-dimensional, non-Gaussian, and anisotropic noise. This is a major limitation for precision measurements in many domains of science, including astrophysics, for example, for the analysis of the Cosmic Microwave Background, gravitational waves, gravitational lensing, and exoplanets. This work presents Score-based LIkelihood Characterization (SLIC), a framework that resolves this issue by building a data-driven noise model using a set of noise realizations from observations. We show that the approach produces unbiased and precise likelihoods even in the presence of highly non-Gaussian correlated and spatially varying noise. We use diffusion generative models to estimate the gradient of the probability density of noise with respect to data elements. In combination with the Jacobian of the physical model of the signal, we use Langevin sampling to produce independent samples from the unbiased likelihood. We demonstrate the effectiveness of the method using real data from the Hubble Space Telescope and James Webb Space Telescope.

astro-ph.IM↗

Simulation-Based Inference of Strong Gravitational Lensing Parameters

In the coming years, a new generation of sky surveys, in particular, Euclid Space Telescope (2022), and the Rubin Observatory's Legacy Survey of Space and Time (LSST, 2023) will discover more than 200,000 new strong gravitational lenses, which represents an increase of more than two orders of magnitude compared to currently known sample sizes. Accurate and fast analysis of such large volumes of data under a statistical framework is therefore crucial for all sciences enabled by strong lensing. Here, we report on the application of simulation-based inference methods, in particular, density estimation techniques, to the predictions of the set of parameters of strong lensing systems from neural networks. This allows us to explicitly impose desired priors on lensing parameters, while guaranteeing convergence to the optimal posterior in the limit of perfect performance.

astro-ph.CO↗

HIGAN: Cosmic Neutral Hydrogen with Generative Adversarial Networks

One of the most promising ways to observe the Universe is by detecting the 21cm emission from cosmic neutral hydrogen (HI) through radio-telescopes. Those observations can shed light on fundamental astrophysical questions only if accurate theoretical predictions are available. In order to maximize the scientific return of these surveys, those predictions need to include different observables and be precise on non-linear scales. Currently, one of the best ways to achieve this is via cosmological hydrodynamic simulations; however, the computational cost of these simulations is high -- tens of millions of CPU hours. In this work, we use Wasserstein Generative Adversarial Networks (WGANs) to generate new high-resolution ($35~h^{-1}{\rm kpc}$) 3D realizations of cosmic HI at $z=5$. We do so by sampling from a 100-dimension manifold, learned by the generator, that characterizes the fully non-linear abundance and clustering of cosmic HI from the state-of-the-art simulation IllustrisTNG. We show that different statistical properties of the produced samples -- 1D PDF, power spectrum, bispectrum, and void size function -- match very well those of IllustrisTNG, and outperform state-of-the-art models such as Halo Occupation Distributions (HODs). Our WGAN samples reproduce the abundance of HI across 9 orders of magnitude, from the Ly$α$ forest to Damped Lyman Absorbers. WGAN can produce new samples orders of magnitude faster than hydrodynamic simulations.

astro-ph.CO↗

Overview of the DESI Legacy Imaging Surveys

The DESI Legacy Imaging Surveys are a combination of three public projects (the Dark Energy Camera Legacy Survey, the Beijing-Arizona Sky Survey, and the Mayall z-band Legacy Survey) that will jointly image approximately 14,000 deg^2 of the extragalactic sky visible from the northern hemisphere in three optical bands (g, r, and z) using telescopes at the Kitt Peak National Observatory and the Cerro Tololo Inter-American Observatory. The combined survey footprint is split into two contiguous areas by the Galactic plane. The optical imaging is conducted using a unique strategy of dynamically adjusting the exposure times and pointing selection during observing that results in a survey of nearly uniform depth. In addition to calibrated images, the project is delivering a catalog, constructed by using a probabilistic inference-based approach to estimate source shapes and brightnesses. The catalog includes photometry from the grz optical bands and from four mid-infrared bands (at 3.4, 4.6, 12 and 22 micorons) observed by the Wide-field Infrared Survey Explorer (WISE) satellite during its full operational lifetime. The project plans two public data releases each year. All the software used to generate the catalogs is also released with the data. This paper provides an overview of the Legacy Surveys project.

astro-ph.IM↗

Data-Driven Reconstruction of Gravitationally Lensed Galaxies using Recurrent Inference Machines

We present a machine learning method for the reconstruction of the undistorted images of background sources in strongly lensed systems. This method treats the source as a pixelated image and utilizes the Recurrent Inference Machine (RIM) to iteratively reconstruct the background source given a lens model. Our architecture learns to minimize the likelihood of the model parameters (source pixels) given the data using the physical forward model (ray tracing simulations) while implicitly learning the prior of the source structure from the training data. This results in better performance compared to linear inversion methods, where the prior information is limited to the 2-point covariance of the source pixels approximated with a Gaussian form, and often specified in a relatively arbitrary manner. We combine our source reconstruction network with a convolutional neural network that predicts the parameters of the mass distribution in the lensing galaxies directly from telescope images, allowing a fully automated reconstruction of the background source images and the foreground mass distribution.

astro-ph.IM↗

Analyzing interferometric observations of strong gravitational lenses with recurrent and convolutional neural networks

We use convolutional neural networks (CNNs) and recurrent neural networks (RNNs) to estimate the parameters of strong gravitational lenses from interferometric observations. We explore multiple strategies and find that the best results are obtained when the effects of the dirty beam are first removed from the images with a deconvolution performed with an RNN-based structure before estimating the parameters. For this purpose, we use the recurrent inference machine (RIM) introduced in Putzky & Welling (2017). This provides a fast and automated alternative to the traditional CLEAN algorithm. We obtain the uncertainties of the estimated parameters using variational inference with Bernoulli distributions. We test the performance of the networks with a simulated test dataset as well as with five ALMA observations of strong lenses. For the observed ALMA data we compare our estimates with values obtained from a maximum-likelihood lens modeling method which operates in the visibility space and find consistent results. We show that we can estimate the lensing parameters with high accuracy using a combination of an RNN structure performing image deconvolution and a CNN performing lensing analysis, with uncertainties less than a factor of two higher than those achieved with maximum-likelihood methods. Including the deconvolution procedure performed by RIM, a single evaluation can be done in about a second on a single GPU, providing a more than six orders of magnitude increase in analysis speed while using about eight orders of magnitude less computational resources compared to maximum-likelihood lens modeling in the uv-plane. We conclude that this is a promising method for the analysis of mm and cm interferometric data from current facilities (e.g., ALMA, JVLA) and future large interferometric observatories (e.g., SKA), where an analysis in the uv-plane could be difficult or unfeasible.

astro-ph.IM↗

Fast Automated Analysis of Strong Gravitational Lenses with Convolutional Neural Networks

Quantifying image distortions caused by strong gravitational lensing and estimating the corresponding matter distribution in lensing galaxies has been primarily performed by maximum likelihood modeling of observations. This is typically a time and resource-consuming procedure, requiring sophisticated lensing codes, several data preparation steps, and finding the maximum likelihood model parameters in a computationally expensive process with downhill optimizers. Accurate analysis of a single lens can take up to a few weeks and requires the attention of dedicated experts. Tens of thousands of new lenses are expected to be discovered with the upcoming generation of ground and space surveys, the analysis of which can be a challenging task. Here we report the use of deep convolutional neural networks to accurately estimate lensing parameters in an extremely fast and automated way, circumventing the difficulties faced by maximum likelihood methods. We also show that lens removal can be made fast and automated using Independent Component Analysis of multi-filter imaging data. Our networks can recover the parameters of the Singular Isothermal Ellipsoid density profile, commonly used to model strong lensing systems, with an accuracy comparable to the uncertainties of sophisticated models, but about ten million times faster: 100 systems in approximately 1s on a single graphics processing unit. These networks can provide a way for non-experts to obtain lensing parameter estimates for large samples of data. Our results suggest that neural networks can be a powerful and fast alternative to maximum likelihood procedures commonly used in astrophysics, radically transforming the traditional methods of data reduction and analysis.

astro-ph.IM↗

Uncertainties in Parameters Estimated with Neural Networks: Application to Strong Gravitational Lensing

In Hezaveh et al. 2017 we showed that deep learning can be used for model parameter estimation and trained convolutional neural networks to determine the parameters of strong gravitational lensing systems. Here we demonstrate a method for obtaining the uncertainties of these parameters. We review the framework of variational inference to obtain approximate posteriors of Bayesian neural networks and apply it to a network trained to estimate the parameters of the Singular Isothermal Ellipsoid plus external shear and total flux magnification. We show that the method can capture the uncertainties due to different levels of noise in the input data, as well as training and architecture-related errors made by the network. To evaluate the accuracy of the resulting uncertainties, we calculate the coverage probabilities of marginalized distributions for each lensing parameter. By tuning a single hyperparameter, the dropout rate, we obtain coverage probabilities approximately equal to the confidence levels for which they were calculated, resulting in accurate and precise uncertainty estimates. Our results suggest that neural networks can be a fast alternative to Monte Carlo Markov Chains for parameter uncertainty estimation in many practical applications, allowing more than seven orders of magnitude improvement in speed.

astro-ph.CO↗

Detection of lensing substructure using ALMA observations of the dusty galaxy SDP.81

We study the abundance of substructure in the matter density near galaxies using ALMA Science Verification observations of the strong lensing system SDP.81. We present a method to measure the abundance of subhalos around galaxies using interferometric observations of gravitational lenses. Using simulated ALMA observations, we explore the effects of various systematics, including antenna phase errors and source priors, and show how such errors may be measured or marginalized. We apply our formalism to ALMA observations of SDP.81. We find evidence for the presence of a $M=10^{8.96\pm 0.12} M_{\odot}$ subhalo near one of the images, with a significance of $6.9σ$ in a joint fit to data from bands 6 and 7; the effect of the subhalo is also detected in both bands individually. We also derive constraints on the abundance of dark matter subhalos down to $M\sim 2\times 10^7 M_{\odot}$, pushing down to the mass regime of the smallest detected satellites in the Local Group, where there are significant discrepancies between the observed population of luminous galaxies and predicted dark matter subhalos. We find hints of additional substructure, warranting further study using the full SDP.81 dataset (including, for example, the spectroscopic imaging of the lensed carbon monoxide emission). We compare the results of this search to the predictions of $Λ$CDM halos, and find that given current uncertainties in the host halo properties of SDP.81, our measurements of substructure are consistent with theoretical expectations. Observations of larger samples of gravitational lenses with ALMA should be able to improve the constraints on the abundance of galactic substructure.

astro-ph.CO↗

Backreaction and Stochastic Effects in Single Field Inflation

The formalism of stochastic inflation is a powerful tool for analyzing the backreaction of cosmological perturbations, and making precise predictions for inflationary observables. We demonstrate this with the simple $m^2ϕ^2$ model of inflation, wherein we obtain an effective field theory for IR modes of the inflaton, which remains coupled to UV modes through a classical noise. We compute slow-roll corrections to the evolution of UV modes (i.e. quantum fluctuations), and track this effect from the UV theory to the IR theory, where it manifests as a correction to the classical noise. We compute the stochastic correction to the spectral index of primordial perturbations, finding a small effect, and discuss models in which this effect can become large. We extend our analysis to tensor modes, and demonstrate that the stochastic approach allows us to recover the standard tensor tilt $n_T$, plus corrections.

hep-th↗

Measuring the power spectrum of dark matter substructure using strong gravitational lensing

In recent years, it has become possible to detect individual dark matter subhalos near images of strongly lensed extended background galaxies. Typically, only the most massive subhalos in the strong lensing region may be detected this way. In this work, we show that strong lenses may also be used to constrain the much more numerous population of lower mass subhalos that are too small to be detected individually. In particular, we show that the power spectrum of projected density fluctuations in galaxy halos can be measured using strong gravitational lensing. We develop the mathematical framework of power spectrum estimation, and test our method on mock observations. We use our results to determine the types of observations required to measure the substructure power spectrum with high significance. We predict that deep observations ($\sim10$ hours on a single target) with current facilities can measure this power spectrum at the $3σ$ level, with no apparent degeneracy with unknown clumpiness in the background source structure or fluctuations from detector noise. Upcoming ALMA measurements of strong lenses are capable of placing strong constraints on the abundance of dark matter subhalos and the underlying particle nature of dark matter.

astro-ph.CO↗

Recursive Stochastic Effects in Valley Hybrid Inflation

Hybrid Inflation is a two-field model where inflation ends by a tachyonic instability, the duration of which is determined by stochastic effects and has important observational implications. Making use of the recursive approach to the stochastic formalism presented in Ref. [1], these effects are consistently computed. Through an analysis of back-reaction, this method is shown to converge in the valley but points toward an (expected) instability in the waterfall. It is further shown that quasi-stationarity of the auxiliary field distribution breaks down in the case of a short-lived waterfall. It is found that the typical dispersion of the waterfall field at the critical point is then diminished, thus increasing the duration of the waterfall phase and jeopardizing the possibility of a short transition. Finally, it is found that stochastic effects worsen the blue tilt of the curvature perturbations by an order one factor when compared with the usual slow-roll contribution.

hep-th↗

Lagrangian Formulation of Stochastic Inflation: A Recursive Approach

We present a new, recursive approach to stochastic inflation which is self-consistent and solves multiple problems which plagued a certain number of previous studies, in particular in realistic contexts where the background spacetime is taken to be dynamical, where there is more than one field present, especially with a mass hierarchy, or where the role played by back-reaction is suspected to be important. We first review the formalism of stochastic inflation as it is usually heuristically presented, that is, deriving the Langevin equations from the field equations of motion, and summarize previous results on the subject. We demonstrate where inconsistent approximations to the Langevin equations are commonly made, and show how these can be avoided. This set up shares many similarities with quantum Brownian motion and out-of-equilibrium statistical quantum dynamics. We hence review how path integral techniques can be applied to the stochastic inflationary context. We show this formalism to be consistent with the standard approach, develop a natural perturbative expansion, and use it to calculate the one-loop corrected Langevin equations.

hep-th↗

Defrosting in an Emergent Galileon Cosmology

We study the transition from an Emergent Galileon condensate phase of the early universe to a later expanding radiation phase. This "defrosting" or "preheating" transition is a consequence of the excitation of matter fluctuations by the coherent Galileon condensate, in analogy to how preheating in inflationary cosmology occurs via the excitation of matter fluctuations through coupling of matter with the coherent inflaton condensate. We show that the "minimal" coupling of matter (modeled as a massless scalar field) to the Galileon field introduced by Creminelli, Nicolis and Trincherini in order to generate a scale-invariant spectrum of matter fluctuations is sufficient to lead to efficient defrosting, provided that the effects of the non-vanishing expansion rate of the universe are taken into account. If we neglect the effects of expansion, an additional coupling of matter to the Galileon condensate is required. We study the efficiency of the defrosting mechanism in both cases.

astro-ph.CO↗

A Matter Bounce By Means of Ghost Condensation

Assuming the existence of a scalar field which undergoes "ghost condensation" and which has a suitably chosen potential, it is possible to obtain a non-singular bouncing cosmology in the presence of regular matter and radiation. The potential for the ghost condensate field can be chosen such that the cosmological bounce is stable against the presence of anisotropic stress. Cosmological fluctuations on long wavelengths relevant to current cosmological observations pass through the bounce unaffected by the new physics which yields the bounce. Thus, this model allows for the realization of the "matter bounce" scenario, an alternative to inflationary cosmology for the generation of the observed primordial fluctuations in which the inhomogeneities originate as quantum vacuum perturbations which exit the Hubble radius in the matter-dominated phase of contraction.

hep-th↗