arXiv subjects

Yin Li

Publications and source records attributed to Yin Li.

At least 181 records · Page 10Linked to original sources

arXiv2019

Semi Supervised Phrase Localization in a Bidirectional Caption-Image Retrieval Framework

We introduce a novel deep neural network architecture that links visual regions to corresponding textual segments including phrases and words. To accomplish this task, our architecture makes use of the rich semantic information available in a joint embedding space of multi-modal data. From this joint embedding space, we extract the associative localization maps that develop naturally, without explicitly providing supervision during training for the localization task. The joint space is learned using a bidirectional ranking objective that is optimized using a $N$-Pair loss formulation. This training mechanism demonstrates the idea that localization information is learned inherently while optimizing a Bidirectional Retrieval objective. The model's retrieval and localization performance is evaluated on MSCOCO and Flickr30K Entities datasets. This architecture outperforms the state of the art results in the semi-supervised phrase localization setting.

cs.CV↗

arXiv2019

Privacy-Preserving Secret Shared Computations using MapReduce

Data outsourcing allows data owners to keep their data at \emph{untrusted} clouds that do not ensure the privacy of data and/or computations. One useful framework for fault-tolerant data processing in a distributed fashion is MapReduce, which was developed for \emph{trusted} private clouds. This paper presents algorithms for data outsourcing based on Shamir's secret-sharing scheme and for executing privacy-preserving SQL queries such as count, selection including range selection, projection, and join while using MapReduce as an underlying programming model. Our proposed algorithms prevent an adversary from knowing the database or the query while also preventing output-size and access-pattern attacks. Interestingly, our algorithms do not involve the database owner, which only creates and distributes secret-shares once, in answering any query, and hence, the database owner also cannot learn the query. Logically and experimentally, we evaluate the efficiency of the algorithms on the following parameters: (\textit{i}) the number of communication rounds (between a user and a server), (\textit{ii}) the total amount of bit flow (between a user and a server), and (\textit{iii}) the computational load at the user and the server.\B

cs.DB↗

arXiv2019

Learning to Predict the Cosmological Structure Formation

Matter evolved under influence of gravity from minuscule density fluctuations. Non-perturbative structure formed hierarchically over all scales, and developed non-Gaussian features in the Universe, known as the Cosmic Web. To fully understand the structure formation of the Universe is one of the holy grails of modern astrophysics. Astrophysicists survey large volumes of the Universe and employ a large ensemble of computer simulations to compare with the observed data in order to extract the full information of our own Universe. However, to evolve trillions of galaxies over billions of years even with the simplest physics is a daunting task. We build a deep neural network, the Deep Density Displacement Model (hereafter D$^3$M), to predict the non-linear structure formation of the Universe from simple linear perturbation theory. Our extensive analysis, demonstrates that D$^3$M outperforms the second order perturbation theory (hereafter 2LPT), the commonly used fast approximate simulation method, in point-wise comparison, 2-point correlation, and 3-point correlation. We also show that D$^3$M is able to accurately extrapolate far beyond its training data, and predict structure formation for significantly different cosmological parameters. Our study proves, for the first time, that deep learning is a practical and accurate alternative to approximate simulations of the gravitational structure formation of the Universe.

astro-ph.CO↗

arXiv2019

Koszul duality via suspending Lefschetz fibrations

Let $M$ be a Liouville 6-manifold which is the smooth fiber of a Lefschetz fibration on $\mathbb{C}^4$ constructed by suspending a Lefschetz fibration on $\mathbb{C}^3$. We prove that for many examples including stabilizations of Milnor fibers of hypersurface cusp singularities, the compact Fukaya category $\mathcal{F}(M)$ and the wrapped Fukaya category $\mathcal{W}(M)$ are related through $A_\infty$-Koszul duality, by identifying them with cyclic and Calabi-Yau completions of the same quiver algebra. This implies the split-generation of the compact Fukaya category $\mathcal{F}(M)$ by vanishing cycles. Moreover, new examples of Liouville manifolds which admit quasi-dilations in the sense of Seidel-Solomon are obtained.

math.SG↗

arXiv2019

Disconnected Covariance of 2-point Functions in Large-Scale Structure

Optimal analyses using the 2-point functions of large-scale structure probes require accurate covariance matrices. A covariance matrix of the 2-point function comprises the disconnected part and the connected part. While the connected covariance only becomes important on small scales, the disconnected covariance is dominant on large scales, where the survey window has a significant impact. In this work, we develop an analytical method to compute the disconnected covariance, accounting for the window effect. Derived under the flat-sky approximation, our formalism is applicable to wide surveys by swapping in the curved-sky window functions. Our method works for both the power spectrum and the correlation function, and applies to the covariances of various probes including the multipoles and the wedges of 3D clustering, the angular and the projected statistics of clustering and shear, as well as the cross covariances between different probes. We verify the analytic covariance against the sample covariance from the galaxy mock simulations in two test cases: (1) the power spectrum multipole covariance, and (2) the joint covariance of the projected correlation function and the correlation function multipoles. Our method achieve good agreement with the mocks, while at a negligible computational cost. Unlike mocks, our analytic covariance is free of sampling noise, which often leads to numerical problems and the need to inflate the errors. In addition, our method can use the best-fit power spectrum as input, in contrast to the standard procedure of using a fiducial model that may deviate significantly from the truth. We also show that a naive diagonal power spectrum covariance underestimates the signal-to-noise ratio compared to our analytic covariance. The code that accompanies this paper is available at https://github.com/eelregit/covdisc.

astro-ph.CO↗

arXiv2018

The multidimensional dependence of halo bias in the eye of a machine: a tale of halo structure, assembly and environment

We develop a novel approach in exploring the joint dependence of halo bias on multiple halo properties using Gaussian process regression. Using a $Λ$CDM $N$-body simulation, we carry out a comprehensive study of the joint bias dependence on halo structure, formation history and environment. We show that the bias is a multivariate function of halo properties that falls into three regimes. For massive haloes, halo mass explains the majority of bias variation. For early-forming haloes, bias depends sensitively on the recent mass accretion history. For low-mass and late-forming haloes, bias depends more on the structure of a halo such as its shape and spin. Our framework enables us to convincingly prove that $V_\mathrm{max}/V_\mathrm{vir}$ is a lossy proxy of formation time for bias modelling, whereas the mass, spin, shape and formation time variables are non-redundant with respect to each other. Combining mass and formation time largely accounts for the mass accretion history dependence of bias. Combining all the internal halo properties fully accounts for the density profile dependence inside haloes, and predicts the clustering variation of individual haloes to a $20\%$ level at $\sim 10\mathrm{Mpc}h^{-1}$. When an environmental density is measured outside $1\mathrm{Mpc}h^{-1}$ from the halo centre, it outperforms and largely accounts for the bias dependence on the internal halo structure, explaining the bias variation above a level of $30\%$.

astro-ph.CO↗

arXiv2018

Deep Crisp Boundaries: From Boundaries to Higher-level Tasks

Edge detection has made significant progress with the help of deep Convolutional Networks (ConvNet). These ConvNet based edge detectors have approached human level performance on standard benchmarks. We provide a systematical study of these detectors' outputs. We show that the detection results did not accurately localize edge pixels, which can be adversarial for tasks that require crisp edge inputs. As a remedy, we propose a novel refinement architecture to address the challenging problem of learning a crisp edge detector using ConvNet. Our method leverages a top-down backward refinement pathway, and progressively increases the resolution of feature maps to generate crisp edges. Our results achieve superior performance, surpassing human accuracy when using standard criteria on BSDS500, and largely outperforming state-of-the-art methods when using more strict criteria. More importantly, we demonstrate the benefit of crisp edge maps for several important applications in computer vision, including optical flow estimation, object proposal generation and semantic segmentation.

cs.CV↗

arXiv2018

Twin Lagrangian fibrations in mirror symmetry

A twin Lagrangian fibration, originally introduced by Yau and the first author, is roughly a geometric structure consisting of two Lagrangian fibrations whose fibers intersect with each other cleanly. In this paper, we show the existence of twin Lagrangian fibrations on certain symplectic manifolds whose mirrors are fibered by rigid analytic cycles. Using family Floer theory in the sense of Fukaya and Abouzaid, these twin Lagrangian fibrations are shown to be induced from fibrations by rigid analytic subvarieties on the mirror. As additional evidences, we discuss two simple applications of our constructions.

math.SG↗

arXiv2018

Scale-dependent bias and bispectrum in neutrino separate universe simulations

Cosmic background neutrinos have a large velocity dispersion, which causes the evolution of long-wavelength density perturbations to depend on scale. This scale-dependent growth leads to the well-known suppression in the linear theory matter power spectrum that is used to probe neutrino mass. In this paper, we study the impact of long-wavelength density perturbations on small-scale structure formation. By performing separate universe simulations where the long-wavelength mode is absorbed into the local expansion, we measure the responses of the cold dark matter (CDM) power spectrum and halo mass function, which correspond to the squeezed-limit bispectrum and halo bias. We find that the scale-dependent evolution of the long-wavelength modes causes these quantities to depend on scale and provide simple expressions to model them in terms of scale and the amount of massive neutrinos. Importantly, this scale-dependent bias reduces the suppression in the linear halo power spectrum due to massive neutrinos by 13 and 26% for objects of bias $\bar{b}=2$ and $\bar{b} \gg1$, respectively. We demonstrate with high statistical significance that the scale-dependent halo bias ${\it cannot}$ be modeled by the CDM and neutrino density transfer functions at the time when the halos are identified. This reinforces the importance of the temporal nonlocality of structure formation, especially when the growth is scale dependent.

astro-ph.CO↗

arXiv2018

Learning to Grasp Without Seeing

Can a robot grasp an unknown object without seeing it? In this paper, we present a tactile-sensing based approach to this challenging problem of grasping novel objects without prior knowledge of their location or physical properties. Our key idea is to combine touch based object localization with tactile based re-grasping. To train our learning models, we created a large-scale grasping dataset, including more than 30 RGB frames and over 2.8 million tactile samples from 7800 grasp interactions of 52 objects. To learn a representation of tactile signals, we propose an unsupervised auto-encoding scheme, which shows a significant improvement of 4-9% over prior methods on a variety of tactile perception tasks. Our system consists of two steps. First, our touch localization model sequentially 'touch-scans' the workspace and uses a particle filter to aggregate beliefs from multiple hits of the target. It outputs an estimate of the object's location, from which an initial grasp is established. Next, our re-grasping model learns to progressively improve grasps with tactile feedback based on the learned features. This network learns to estimate grasp stability and predict adjustment for the next grasp. Re-grasping thus is performed iteratively until our model identifies a stable grasp. Finally, we demonstrate extensive experimental results on grasping a large set of novel objects using tactile sensing alone. Furthermore, when applied on top of a vision-based policy, our re-grasping model significantly boosts the overall accuracy by 10.6%. We believe this is the first attempt at learning to grasp with only tactile sensing and without any prior object knowledge.

cs.RO↗

arXiv2018

Learning Two-Branch Neural Networks for Image-Text Matching Tasks

Image-language matching tasks have recently attracted a lot of attention in the computer vision field. These tasks include image-sentence matching, i.e., given an image query, retrieving relevant sentences and vice versa, and region-phrase matching or visual grounding, i.e., matching a phrase to relevant regions. This paper investigates two-branch neural networks for learning the similarity between these two data modalities. We propose two network structures that produce different output representations. The first one, referred to as an embedding network, learns an explicit shared latent embedding space with a maximum-margin ranking loss and novel neighborhood constraints. Compared to standard triplet sampling, we perform improved neighborhood sampling that takes neighborhood information into consideration while constructing mini-batches. The second network structure, referred to as a similarity network, fuses the two branches via element-wise product and is trained with regression loss to directly predict a similarity score. Extensive experiments show that our networks achieve high accuracies for phrase localization on the Flickr30K Entities dataset and for bi-directional image-sentence retrieval on Flickr30K and MSCOCO datasets.

cs.CV↗

arXiv2018

What is the temperature of an ultra-cold Rydberg plasma?

We have measured the asymptotic expansion velocities of ultra-cold plasmas (UNPs) which evolve from cold, dense, samples of Rydberg rubidium atoms using ion time-of-flight spectroscopy. From this, we have obtained values for the initial plasma electron temperature as functions of the original Rydberg atom density and binding energy. Our results show that the electron temperature is determined principally by the plasma environment when the UNP decouples from the Rydberg atoms, which occurs when the plasma electrons become too cold to ionize the remaining Rydberg population. Furthermore, the dependence of the electron temperature on Rydberg atom density gives strong indirect evidence for the existence of a bottleneck in the spectrum of Rydberg states that coexist with a cold plasma.

physics.atom-ph↗

arXiv2018

Galaxy power-spectrum responses and redshift-space super-sample effect

As a major source of cosmological information, galaxy clustering is susceptible to long-wavelength density and tidal fluctuations. These long modes modulate the growth and expansion rate of local structures, shifting them in both amplitude and scale. These effects are often named the growth and dilation effects, respectively. In particular the dilation shifts the baryon acoustic oscillation (BAO) peak and breaks the assumption of the Alcock-Paczynski (AP) test. This cannot be removed with reconstruction techniques because the effect originates from long modes outside the survey. In redshift space, the long modes generate a large-scale radial peculiar velocity that affects the redshift-space distortion (RSD) signal. We compute the redshift-space response functions of the galaxy power spectrum to long density and tidal modes at leading order in perturbation theory, including both the growth and dilation terms. We validate these response functions against measurements from simulated galaxy mock catalogs. As one application, long density and tidal modes beyond the scale of a survey correlate various observables leading to an excess error known as the super-sample covariance, and thus weaken their constraining power. We quantify the super-sample effect on BAO, AP, and RSD measurements, and study its impact on current and future surveys.

astro-ph.CO↗

arXiv2017

nbodykit: an open-source, massively parallel toolkit for large-scale structure

We present nbodykit, an open-source, massively parallel Python toolkit for analyzing large-scale structure (LSS) data. Using Python bindings of the Message Passing Interface (MPI), we provide parallel implementations of many commonly used algorithms in LSS. nbodykit is both an interactive and scalable piece of scientific software, performing well in a supercomputing environment while still taking advantage of the interactive tools provided by the Python ecosystem. Existing functionality includes estimators of the power spectrum, 2 and 3-point correlation functions, a Friends-of-Friends grouping algorithm, mock catalog creation via the halo occupation distribution technique, and approximate N-body simulations via the FastPM scheme. The package also provides a set of distributed data containers, insulated from the algorithms themselves, that enable nbodykit to provide a unified treatment of both simulation and observational data sets. nbodykit can be easily deployed in a high performance computing environment, overcoming some of the traditional difficulties of using Python on supercomputers. We provide performance benchmarks illustrating the scalability of the software. The modular, component-based approach of nbodykit allows researchers to easily build complex applications using its tools. The package is extensively documented at http://nbodykit.readthedocs.io, which also includes an interactive set of example recipes for new users to explore. As open-source software, we hope nbodykit provides a common framework for the community to use and develop in confronting the analysis challenges of future LSS surveys.

astro-ph.IM↗

arXiv2017

Large-scale tidal effect on redshift-space power spectrum in a finite-volume survey

Long-wavelength matter inhomogeneities contain cleaner information on the nature of primordial perturbations as well as the physics of the early universe. The large-scale coherent overdensity and tidal force, not directly observable for a finite-volume galaxy survey, are both related to the Hessian of large-scale gravitational potential and therefore of equal importance. We show that the coherent tidal force causes a homogeneous anisotropic distortion of the observed distribution of galaxies in all three directions, perpendicular and parallel to the line-of-sight direction. This effect mimics the redshift-space distortion signal of galaxy peculiar velocities, as well as a distortion by the Alcock-Paczynski effect. We quantify its impact on the redshift-space power spectrum to the leading order, and discuss its importance for the ongoing and upcoming galaxy surveys.

astro-ph.CO↗

arXiv2017

An optimal FFT-based anisotropic power spectrum estimator

Measurements of line-of-sight dependent clustering via the galaxy power spectrum's multipole moments constitute a powerful tool for testing theoretical models in large-scale structure. Recent work shows that this measurement, including a moving line-of-sight, can be accelerated using Fast Fourier Transforms (FFTs) by decomposing the Legendre polynomials into products of Cartesian vectors. Here, we present a faster, optimal means of using FFTs for this measurement. We avoid redundancy present in the Cartesian decomposition by using a spherical harmonic decomposition of the Legendre polynomials. Consequently, our method is substantially faster: a given multipole of order $\ell$ requires only $2\ell+1$ FFTs rather than the $(\ell+1)(\ell+2)/2$ FFTs of the Cartesian approach. For the hexadecapole ($\ell = 4$), this translates to $40\%$ fewer FFTs, with increased savings for higher $\ell$. The reduction in wall-clock time enables the calculation of finely-binned wedges in $P(k,μ)$, obtained by computing multipoles up to a large $\ell_{\rm max}$ and combining them. This transformation has a number of advantages. We demonstrate that by using non-uniform bins in $μ$, we can isolate plane-of-sky (angular) systematics to a narrow bin at $μ\simeq 0$ while eliminating the contamination from all other bins. We also show that the covariance matrix of clustering wedges binned uniformly in $μ$ becomes ill-conditioned when combining multipoles up to large values of $\ell_{\rm max}$, but that the problem can be avoided with non-uniform binning. As an example, we present results using $\ell_{\rm max}=16$, for which our procedure requires a factor of 3.4 fewer FFTs than the Cartesian method, while removing the first $μ$ bin leads only to a 7% increase in statistical error on $f σ_8$, as compared to a 54% increase with $\ell_{\rm max}=4$.

astro-ph.CO↗

arXiv2016

Quintessential Scale Dependence from Separate Universe Simulations

By absorbing fluctuations into a local background, separate universe simulations provide a powerful technique to characterize the response of small-scale observables to the long-wavelength density fluctuations, for example those of the power spectrum and halo mass function which lead to the squeezed-limit $n$-point function and halo bias, respectively. Using quintessence dark energy as the paradigmatic example, we extend these simulation techniques to cases where non-gravitational forces in other sectors establish a Jeans scale across which the growth of density fluctuations becomes scale dependent. By characterizing the separate universes with matching background expansion histories, we show that the power spectrum and mass function responses depend on whether the long-wavelength mode is above or below the Jeans scale. Correspondingly, the squeezed bispectrum and halo bias also become scale dependent. Models of bias that are effectively local in the density field at a single epoch, initial or observed, cannot describe this effect which highlights the importance of temporal nonlocality in structure formation. Validated by these quintessence tests, our techniques are applicable to a wide range of models where the complex dynamics of additional fields affect the clustering of matter in the linear regime and it would otherwise be difficult to simulate their impact in the nonlinear regime.

astro-ph.CO↗

arXiv2016

Separating the Universe into the Real and Fake

The separate universe technique provides a means of establishing consistency relations between short wavelength observables and the long wavelength matter density fluctuations within which they evolve by absorbing the latter into the cosmological background. We extend it to cases where non-gravitational forces introduce a Jeans scale in other species like dynamical dark energy or massive neutrinos. The technique matches the synchronous gauge matter density fluctuations to the local expansion using the acceleration equation and accounts for the temporal nonlocality and scale dependence of the long wavelength response of small scale matter observables, e.g. the nonlinear power spectrum, halo abundance and the implied halo bias, and $N$-point correlation functions. Above the Jeans scale, the local Friedmann equation relates the expansion to real energy densities and a curvature that is constant in comoving coordinates. Below the Jeans scale, the curvature evolves and acts like a fake density component. In all cases, the matter evolution on small scales is correctly modeled as we illustrate using scalar field dark energy with adiabatic or isocurvature initial conditions across the Jeans scale set by its finite sound speed.

astro-ph.CO↗