arXiv Science⌕ Search

arXiv subjects

Zhiyuan Li

Publications and source records attributed to Zhiyuan Li.

At least 343 records · Page 19Linked to original sources
arXiv2020

NuSTAR and Chandra Observation of the Galactic Center Non-thermal X-ray Filament G0.13-0.11: A Pulsar Wind Nebula Driven Magnetic Filament

One of the most unique phenomena in the Galactic center region is the existence of numerous long and narrow filamentary structures within a few hundred parsecs of Sgr A$^{\star}$. While more than one than one hundred radio filaments have been revealed by MeerKAT, about two dozens X-ray filaments have been discovered so far. In this article, we report our analysis on the deep Chandra and NuSTAR observations of a non-thermal X-ray filament, G0.13-0.11, which is located adjacent to the Radio arc. Chandra revealed a unique morphology of G0.13-0.11, which is an elongated (0.1 pc in width and 3.2 pc in length) structure slightly bended towards the Radio arc. A pulsar candidate ($Γ\sim 1.4$) is detected in the middle of the filament, with a tail of diffuse non-thermal X-ray emission on one side of the filament. The filament is detected by NuSTAR up to 79 keV, with the hard X-ray centroid consistent with the pulsar candidate. We found that the X-ray intensity decays along the filament farther away from the pulsar candidate, dropping to half of its peak value at 2.2 pc away. This system is mostly likely a Pulsar Wind Nebula interacting with ambient interstellar magnetic field, where the filaments are kinetic jets from PWN as recently proposed. The nature of this filament adds to complex origin of the X-ray filaments, which serve as powerful tools to probe local and global powerful particle accelerators in the Galactic center.

astro-ph.HE↗
arXiv2020

Exploring the Mass Segregation Effect of X-ray Sources in Globular Clusters. III. Signs of Binary Disruption in M28

Using archival {\it Chandra} observations with a total effective exposure of 323 ks, we derive an updated catalog of point sources in the bulge globular cluster M28. The catalog contains 502 X-ray sources within an area of $\sim475\, \rm arcmin^{2}$, and more than $90\%$ of these sources are first detected in this cluster. We find significant dips in the radial distribution profiles of X-ray sources in M28, with the projected distance and width of the distribution dip for bright ($L_{X} \gtrsim 4.5\times 10^{30} {\rm\ erg\ \,s^{-1}}$) X-ray sources are larger than the faint ($L_{X} \lesssim 4.5\times 10^{30} {\rm\ erg\ \,s^{-1}}$) sources. The "generalized King model" fitting give a slightly larger average mass for the bright sources ($1.30\pm0.15\,M_{\odot}$) than the faint sources ($1.09\pm0.14\,M_{\odot}$), which support a universal mass segregation delay between heavy objects in GCs. Compared with 47 Tuc and Terzan 5, we show that the dynamical age of M28 is comparable to Terzan 5 and much smaller than 47 Tuc, but it is evolving more fast (i.e., with smaller two-body relaxation timescale) than 47 Tuc. These features may suggest an acceleration effect of cluster dynamical evolution by tidal shock in M28. Besides, we find an abnormal deficiency of X-ray sources in the central region ($R \lesssim 1.5 \rm~arcmin$) of M28 than its outskirts, which indicate that M28 may have suffered an early phase of primordial binary disruption within its central region, and mass segregation effect will erase such a phenomenon as cluster evolve to older dynamical age.

astro-ph.HE↗
arXiv2020

Progressive Learning and Disentanglement of Hierarchical Representations

Learning rich representation from data is an important task for deep generative models such as variational auto-encoder (VAE). However, by extracting high-level abstractions in the bottom-up inference process, the goal of preserving all factors of variations for top-down generation is compromised. Motivated by the concept of "starting small", we present a strategy to progressively learn independent hierarchical representations from high- to low-levels of abstractions. The model starts with learning the most abstract representation, and then progressively grow the network architecture to introduce new representations at different levels of abstraction. We quantitatively demonstrate the ability of the presented model to improve disentanglement in comparison to existing works on two benchmark data sets using three disentanglement metrics, including a new metric we proposed to complement the previously-presented metric of mutual information gap. We further present both qualitative and quantitative evidence on how the progression of learning improves disentangling of hierarchical representations. By drawing on the respective advantage of hierarchical representation learning and progressive learning, this is to our knowledge the first attempt to improve disentanglement by progressively growing the capacity of VAE to learn hierarchical representations.

cs.LG↗
arXiv2020

Explaining Landscape Connectivity of Low-cost Solutions for Multilayer Nets

Mode connectivity is a surprising phenomenon in the loss landscape of deep nets. Optima -- at least those discovered by gradient-based optimization -- turn out to be connected by simple paths on which the loss function is almost constant. Often, these paths can be chosen to be piece-wise linear, with as few as two segments. We give mathematical explanations for this phenomenon, assuming generic properties (such as dropout stability and noise stability) of well-trained deep nets, which have previously been identified as part of understanding the generalization properties of deep nets. Our explanation holds for realistic multilayer nets, and experiments are presented to verify the theory.

cs.LG↗
arXiv2019

A Trio of Massive Black Holes Caught in the Act of Merging

We report the discovery of SDSS J0849+1114 as the first known triple Type 2 Seyfert nucleus. It represents three active black holes that are identified from new spatially resolved optical slit spectroscopy using the Dual Imaging Spectrograph on the 3.5 m telescope at the Apache Point Observatory. We also present new complementary observations including the Hubble Space Telescope Wide Field Camera 3 U- and Y-band imaging, Chandra Advanced CCD Imaging Spectrometer S-array X-ray 0.5--8 keV imaging spectroscopy, and NSF Karl G. Jansky Very Large Array radio 9.0 GHz imaging in its most extended A configuration. These comprehensive multiwavelength observations, when combined together, strongly suggest that all three nuclei are active galactic nuclei. While they are now still at kiloparsec-scale separations, where the host-galaxy gravitational potential dominates, the black holes may evolve into a bound triple system in $\lesssim$2 Gyr. These triple merger systems may explain the overly massive stellar cores that have been observed in some elliptical galaxies such as M87, which are expected to be unique gravitational wave sources. Similar systems may be more common in the early universe, when galaxy mergers are thought to have been more frequent.

astro-ph.GA↗
arXiv2019

The HASHTAG project I. A Survey of CO(3-2) Emission from the Star Forming Disc of M31

We present a CO(3-2) survey of selected regions in the M31 disc as part of the JCMT large programme, HARP and SCUBA-2 High-Resolution Terahertz Andromeda Galaxy Survey (HASHTAG). The 12 CO(3-2) fields in this survey cover a total area of 60 square arcminutes, spanning a deprojected radial range of 2 - 14 kpc across the M31 disc. Combining these observations with existing IRAM 30m CO(1-0) observations and JCMT CO(3-2) maps of the nuclear region of M31, as well as dust temperature and star formation rate surface density maps, we are able to explore the radial distribution of the CO(3-2)/CO(1-0) integrated intensity ratio (R31) and its relationship with dust temperature and star formation. We find that the value of R31 between 2 - 9 kpc galactocentric radius is 0.14, significantly lower than what is seen in the nuclear ring at ~1 kpc (R31 ~ 0.8), only to rise again to 0.27 for the fields centred on the 10 kpc star forming ring. We also found that R31 is positively correlated with dust temperature, with Spearman's rank correlation coefficient $ρ$ = 0.55. The correlation between star formation rate surface density and CO(3--2) intensity is much stronger than with CO(1-0), with $ρ$ = 0.54 compared to -0.05, suggesting that the CO(3-2) line traces warmer and denser star forming gas better. We also find that R31 correlates well with star formation rate surface density, with $ρ$ = 0.69.

astro-ph.GA↗
arXiv2019

An Exponential Learning Rate Schedule for Deep Learning

Intriguing empirical evidence exists that deep learning can work well with exoticschedules for varying the learning rate. This paper suggests that the phenomenon may be due to Batch Normalization or BN, which is ubiquitous and provides benefits in optimization and generalization across all standard architectures. The following new results are shown about BN with weight decay and momentum (in other words, the typical use case which was not considered in earlier theoretical analyses of stand-alone BN. 1. Training can be done using SGD with momentum and an exponentially increasing learning rate schedule, i.e., learning rate increases by some $(1 +α)$ factor in every epoch for some $α>0$. (Precise statement in the paper.) To the best of our knowledge this is the first time such a rate schedule has been successfully used, let alone for highly successful architectures. As expected, such training rapidly blows up network weights, but the net stays well-behaved due to normalization. 2. Mathematical explanation of the success of the above rate schedule: a rigorous proof that it is equivalent to the standard setting of BN + SGD + StandardRate Tuning + Weight Decay + Momentum. This equivalence holds for other normalization layers as well, Group Normalization, LayerNormalization, Instance Norm, etc. 3. A worked-out toy example illustrating the above linkage of hyper-parameters. Using either weight decay or BN alone reaches global minimum, but convergence fails when both are used.

cs.LG↗
arXiv2019

XMM-Newton RGS spectroscopy of the M31 bulge. I: Evidences for a past AGN half a million years ago

Existing analysis based on XMM-Newton/RGS spectra already shows that the G-ratio of the OVII He$α$ triplet in the inner bulge of M31 is too high to be consistent with a pure optically thin thermal plasma in collisional ionization equilibrium (CIE). Different processes that may affect properties of diffuse hot plasma were proposed, such as resonance scattering (RS) and charge exchange (CX) with cold gas. To determine which physical process(es) may be responsible for this inconsistency, we present a systematic spectroscopic analysis based on 0.8 Ms XMM-Newton/RGS data, together with complementary Chandra/ACIS-S images. The combination of these data enables us to reveal multiple non-CIE spectroscopic diagnostics, including but not limited to the large G-ratios of He$α$ triplets (OVII, NVI, and NeIX) and the high Lyman series line ratios (OVIII Ly$β$/Ly$α$ and Ly$γ$/Ly$α$, and NVII Ly$β$/Ly$α$), which are not expected for a CIE plasma, and the high iron line ratios (FeXVIII 14.2 Å/FeXVII~17 Åand FeXVII~15 Å/17 Å), which suggest much higher temperatures than other line ratios, as well as their spatial variations. Neither CX nor RS explains all these spectroscopic diagnostics satisfactorily. Alternatively, we find that an active galactic nucleus (AGN) relic scenario provides a plausible explanation for virtually all the signatures. We estimate that an AGN was present at the center of M31 about half a million years ago and that the initial ionization parameter $ξ$ of the relic plasma is in the range of 3-4.

astro-ph.GA↗
arXiv2019

On Exact Computation with an Infinitely Wide Neural Net

How well does a classic deep net architecture like AlexNet or VGG19 classify on a standard dataset such as CIFAR-10 when its width --- namely, number of channels in convolutional layers, and number of nodes in fully-connected internal layers --- is allowed to increase to infinity? Such questions have come to the forefront in the quest to theoretically understand deep learning and its mysteries about optimization and generalization. They also connect deep learning to notions such as Gaussian processes and kernels. A recent paper [Jacot et al., 2018] introduced the Neural Tangent Kernel (NTK) which captures the behavior of fully-connected deep nets in the infinite width limit trained by gradient descent; this object was implicit in some other recent papers. An attraction of such ideas is that a pure kernel-based method is used to capture the power of a fully-trained deep net of infinite width. The current paper gives the first efficient exact algorithm for computing the extension of NTK to convolutional neural nets, which we call Convolutional NTK (CNTK), as well as an efficient GPU implementation of this algorithm. This results in a significant new benchmark for the performance of a pure kernel-based method on CIFAR-10, being $10\%$ higher than the methods reported in [Novak et al., 2019], and only $6\%$ lower than the performance of the corresponding finite deep net architecture (once batch normalization, etc. are turned off). Theoretically, we also give the first non-asymptotic proof showing that a fully-trained sufficiently wide net is indeed equivalent to the kernel regression predictor using NTK.

cs.LG↗
arXiv2019

Enhanced Convolutional Neural Tangent Kernels

Recent research shows that for training with $\ell_2$ loss, convolutional neural networks (CNNs) whose width (number of channels in convolutional layers) goes to infinity correspond to regression with respect to the CNN Gaussian Process kernel (CNN-GP) if only the last layer is trained, and correspond to regression with respect to the Convolutional Neural Tangent Kernel (CNTK) if all layers are trained. An exact algorithm to compute CNTK (Arora et al., 2019) yielded the finding that classification accuracy of CNTK on CIFAR-10 is within 6-7% of that of that of the corresponding CNN architecture (best figure being around 78%) which is interesting performance for a fixed kernel. Here we show how to significantly enhance the performance of these kernels using two ideas. (1) Modifying the kernel using a new operation called Local Average Pooling (LAP) which preserves efficient computability of the kernel and inherits the spirit of standard data augmentation using pixel shifts. Earlier papers were unable to incorporate naive data augmentation because of the quadratic training cost of kernel regression. This idea is inspired by Global Average Pooling (GAP), which we show for CNN-GP and CNTK is equivalent to full translation data augmentation. (2) Representing the input image using a pre-processing technique proposed by Coates et al. (2011), which uses a single convolutional layer composed of random image patches. On CIFAR-10, the resulting kernel, CNN-GP with LAP and horizontal flip data augmentation, achieves 89% accuracy, matching the performance of AlexNet (Krizhevsky et al., 2012). Note that this is the best such result we know of for a classifier that is not a trained neural network. Similar improvements are obtained for Fashion-MNIST.

cs.LG↗
arXiv2019

Harnessing the Power of Infinitely Wide Deep Nets on Small-data Tasks

Recent research shows that the following two models are equivalent: (a) infinitely wide neural networks (NNs) trained under l2 loss by gradient descent with infinitesimally small learning rate (b) kernel regression with respect to so-called Neural Tangent Kernels (NTKs) (Jacot et al., 2018). An efficient algorithm to compute the NTK, as well as its convolutional counterparts, appears in Arora et al. (2019a), which allowed studying performance of infinitely wide nets on datasets like CIFAR-10. However, super-quadratic running time of kernel methods makes them best suited for small-data tasks. We report results suggesting neural tangent kernels perform strongly on low-data tasks. 1. On a standard testbed of classification/regression tasks from the UCI database, NTK SVM beats the previous gold standard, Random Forests (RF), and also the corresponding finite nets. 2. On CIFAR-10 with 10 - 640 training samples, Convolutional NTK consistently beats ResNet-34 by 1% - 3%. 3. On VOC07 testbed for few-shot image classification tasks on ImageNet with transfer learning (Goyal et al., 2019), replacing the linear SVM currently used with a Convolutional NTK SVM consistently improves performance. 4. Comparing the performance of NTK with the finite-width net it was derived from, NTK behavior starts at lower net widths than suggested by theoretical analysis(Arora et al., 2019a). NTK's efficacy may trace to lower variance of output.

cs.LG↗
arXiv2019

Active Galactic Nucleus Pairs from the Sloan Digital Sky Survey. III. Chandra X-ray Observations Unveil Obscured Double Nuclei

We present Chandra ACIS-S X-ray imaging spectroscopy for five dual active galactic nucleus (AGN) candidates. Our targets were drawn from a sample of 1286 [O III]-selected AGN pairs systematically selected from the Sloan Digital Sky Survey Seventh Data Release. Each of the targets contains two nuclei separated by $\sim$3-9 kpc in projection, both of which are optically classified as Type 2 (obscured) AGNs based on diagnostic ratios of the narrow emission lines. Combined with independent, empirical star formation rate estimates based on the host-galaxy stellar continua, the new Chandra X-ray observations allow us to evaluate the dual-AGN hypothesis for each merging system. We confirm two (SDSS J0907+5203 and SDSS J1544+0446) of the five targets as bona-fide dual AGNs. For the other three targets, the existing data are consistent with the dual-AGN scenario, but we cannot rule out the possibility of stellar/shock heating and/or one AGN ionizing both gaseous components in the merger. The average X-ray-to-[O III] luminosity ratio in our targets seems to be systematically smaller than that observed in single AGNs but is higher than that seen in dual AGNs selected from AGNs with double-peaked narrow emission lines. We suggest that the systematically smaller X-ray-to-[O III] luminosity ratio observed in dual AGNs than in single AGNs is due to a high nuclear gas column likely from strong merger-induced inflows. Unlike double-peaked-[O III]-selected dual AGNs, the new sample selected from resolved galaxy pairs are not subject to the orientation bias caused by the double-peak line-of-sight velocity splitting selection, which also contributes to lowering the X-ray-to-[O III] luminosity ratio.

astro-ph.GA↗
arXiv2019

Intra-cluster GC-LMXB in the Fornax galaxy cluster

The formation of Low mass X-ray binaries (LMXB) is favored within dense stellar systems such as Globular Clusters (GCs). The connection between LMXB and Globular Clusters has been extensively studied in the literature, but these studies have always been restricted to the innermost regions of galaxies. We present a study of LMXB in GCs within the central 1.5 deg^2 of the Fornax cluster with the aim of confirming the existence of a population of LMXB in intra-cluster GCs and understand if their properties are related to the host GCs, to the environment or/and to different formation channels.

astro-ph.HE↗
arXiv2019

Improving Disentangled Representation Learning with the Beta Bernoulli Process

To improve the ability of VAE to disentangle in the latent space, existing works mostly focus on enforcing independence among the learned latent factors. However, the ability of these models to disentangle often decreases as the complexity of the generative factors increases. In this paper, we investigate the little-explored effect of the modeling capacity of a posterior density on the disentangling ability of the VAE. We note that the independence within and the complexity of the latent density are two different properties we constrain when regularizing the posterior density: while the former promotes the disentangling ability of VAE, the latter -- if overly limited -- creates an unnecessary competition with the data reconstruction objective in VAE. Therefore, if we preserve the independence but allow richer modeling capacity in the posterior density, we will lift this competition and thereby allow improved independence and data reconstruction at the same time. We investigate this theoretical intuition with a VAE that utilizes a non-parametric latent factor model, the Indian Buffet Process (IBP), as a latent density that is able to grow with the complexity of the data. Across three widely-used benchmark data sets and two clinical data sets little explored for disentangled learning, we qualitatively and quantitatively demonstrated the improved disentangling performance of IBP-VAE over the state of the art. In the latter two clinical data sets riddled with complex factors of variations, we further demonstrated that unsupervised disentangling of nuisance factors via IBP-VAE -- when combined with a supervised objective -- can not only improve task accuracy in comparison to relevant supervised deep architectures but also facilitate knowledge discovery related to task decision-making. A shorter version of this work will appear in the ICDM 2019 conference proceedings.

cs.LG↗
arXiv2019

Exploring the Mass Segregation Effect of X-ray Sources in Globular Clusters. II. The Case of Terzan 5

Using archival {\it Chandra} observations with a total effective exposure of 734 ks, we derive an updated catalog of point sources in the massive globular cluster Terzan 5. Our catalog covers an area of $58.1\, \rm arcmin^{2}$ ($R\leq 4.3 \, \rm arcmin$) with 489 X-ray sources, and more than $75\%$ of these sources are first detected in this cluster. We find significant dips in the radial distribution profiles of X-ray sources in Terzan 5, with the projected distance and width of the distribution dips for bright ($L_{X} \gtrsim 9.5\times 10^{30} {\rm\ erg\ \,s^{-1}}$) X-ray sources are larger than that of the faint ($L_{X} \lesssim 9.5\times 10^{30} {\rm\ erg\ \,s^{-1}}$) sources. By fitting the radial distribution of the X-ray sources with a"generalized King model", we estimated an average mass of $1.48\pm0.11\,M_{\odot}$ and $1.27\pm0.13\,M_{\odot}$ for the bright and faint X-ray sources, respectively. These results are in agreement with that observed in 47 Tuc, which may suggest a universal mass segregation effect for X-ray sources in GCs. Compared with 47 Tuc, we show that the two-body relaxation timescale of Terzan 5 is much smaller, but its dynamical age is significantly younger than 47 Tuc. These features suggest that the evolution of Terzan 5 is not purely driven by two-body relaxation, and tidal stripping effect also plays an important role in accelerating the dynamical evolution of this cluster.

astro-ph.HE↗
arXiv2019

Semi-Supervised Learning by Disentangling and Self-Ensembling Over Stochastic Latent Space

The success of deep learning in medical imaging is mostly achieved at the cost of a large labeled data set. Semi-supervised learning (SSL) provides a promising solution by leveraging the structure of unlabeled data to improve learning from a small set of labeled data. Self-ensembling is a simple approach used in SSL to encourage consensus among ensemble predictions of unknown labels, improving generalization of the model by making it more insensitive to the latent space. Currently, such an ensemble is obtained by randomization such as dropout regularization and random data augmentation. In this work, we hypothesize -- from the generalization perspective -- that self-ensembling can be improved by exploiting the stochasticity of a disentangled latent space. To this end, we present a stacked SSL model that utilizes unsupervised disentangled representation learning as the stochastic embedding for self-ensembling. We evaluate the presented model for multi-label classification using chest X-ray images, demonstrating its improved performance over related SSL models as well as the interpretability of its disentangled representations.

cs.LG↗
arXiv2019

Massive White Dwarfs in the Galactic Center: A Chandra X-ray Spectroscopy of Cataclysmic Variables

Previous X-ray observations toward the Nuclear Star Cluster (NSC) at the Galactic center have discovered thousands of point sources, most of which were believed to be cataclysmic variables (CVs), i.e., a white dwarf (WD) accreting from a low-mass companion. However, the population properties of these CVs remain unclear, which otherwise contain important information about the evolutionary history of the NSC. In this work we utilize ultradeep archival \textit{Chandra} observations to study the spectral properties of the NSC CVs, in close comparison with those in the Solar vicinity. We find that the NSC CVs have strong Fe XXV and Fe XXVI lines (both of which show equivalent widths $\sim200-300$ eV), indicating metal-rich companions. Moreover, their Fe XXVI to Fe XXV line flux ratio is used to diagnose the characteristic white dwarf mass ($M_{\rm WD}$) of NSC CVs. The results show that the CVs with $L_{\rm 2-10 keV}>6\times10^{31}$ erg s$^{-1}$ have a mean $M_{\rm WD}$ of $\sim0.6/1.0\,M_{\odot}$ if they are magnetic/non-magnetic CVs; while those with $L_{\rm 2-10 keV}$ between $1-6\times10^{31}$ erg s$^{-1}$ have a mean $M_{\rm WD}$ of $\sim0.8/1.2\,M_{\odot}$ if they are magnetic/non-magnetic CVs. All these \textit{Chandra}-detected CVs collectively contribute $\sim$30-50\% of the unresolved 20-40 keV X-ray emission from the NSC. The CV population with massive (i.e., $M_{\rm WD}\sim1.2M_{\odot}$) WDs have not been observed in the Solar vicinity or the Galactic bulge, and they might have been formed via dynamical encounters in the NSC.

astro-ph.HE↗