arXiv subjects

Ashish Mahabal

Publications and source records attributed to Ashish Mahabal.

At least 91 records · Page 5Linked to original sources

arXiv2016

Detection of quasars in the time domain

The time domain is the emerging forefront of astronomical research with new facilities and instruments providing unprecedented amounts of data on the temporal behavior of astrophysical populations. Dealing with the size and complexity of this requires new techniques and methodologies. Quasars are an ideal work set for developing and applying these: they vary in a detectable but not easily quantifiable manner whose physical origins are poorly understood. In this paper, we will review how quasars are identified by their variability and how these techniques can be improved, what physical insights into their variability can be gained from studying extreme examples of variability, and what approaches can be taken to increase the number of quasars known. These will demonstrate how astroinformatics is essential to discovering and understanding this important population.

astro-ph.GA↗

arXiv2015

Bigger Buffer k-d Trees on Multi-Many-Core Systems

A buffer k-d tree is a k-d tree variant for massively-parallel nearest neighbor search. While providing valuable speed-ups on modern many-core devices in case both a large number of reference and query points are given, buffer k-d trees are limited by the amount of points that can fit on a single device. In this work, we show how to modify the original data structure and the associated workflow to make the overall approach capable of dealing with massive data sets. We further provide a simple yet efficient way of using multiple devices given in a single workstation. The applicability of the modified framework is demonstrated in the context of astronomy, a field that is faced with huge amounts of data.

cs.DC↗

arXiv2014

Immersive and Collaborative Data Visualization Using Virtual Reality Platforms

Effective data visualization is a key part of the discovery process in the era of big data. It is the bridge between the quantitative content of the data and human intuition, and thus an essential component of the scientific path from data into knowledge and understanding. Visualization is also essential in the data mining process, directing the choice of the applicable algorithms, and in helping to identify and remove bad data from the analysis. However, a high complexity or a high dimensionality of modern data sets represents a critical obstacle. How do we visualize interesting structures and patterns that may exist in hyper-dimensional data spaces? A better understanding of how we can perceive and interact with multi dimensional information poses some deep questions in the field of cognition technology and human computer interaction. To this effect, we are exploring the use of immersive virtual reality platforms for scientific data visualization, both as software and inexpensive commodity hardware. These potentially powerful and innovative tools for multi dimensional data visualization can also provide an easy and natural path to a collaborative data visualization and exploration, where scientists can interact with their data and their colleagues in the same visual space. Immersion provides benefits beyond the traditional desktop visualization tools: it leads to a demonstrably better perception of a datascape geometry, more intuitive data understanding, and a better retention of the perceived relationships in the data.

cs.HC↗

arXiv2014

Modeling Light Curves for Improved Classification

Many synoptic surveys are observing large parts of the sky multiple times. The resulting lightcurves provide a wonderful window to the dynamic nature of the universe. However, there are many significant challenges in analyzing these light curves. These include heterogeneity of the data, irregularly sampled data, missing data, censored data, known but variable measurement errors, and most importantly, the need to classify in astronomical objects in real time using these imperfect light curves. We describe a modeling-based approach using Gaussian process regression for generating critical measures representing features for the classification of such lightcurves. We demonstrate that our approach performs better by comparing it with past methods. Finally, we provide future directions for use in sky-surveys that are getting even bigger by the day.

stat.AP↗

arXiv2014

10 Simple Rules for the Care and Feeding of Scientific Data

This article offers a short guide to the steps scientists can take to ensure that their data and associated analyses continue to be of value and to be recognized. In just the past few years, hundreds of scholarly papers and reports have been written on questions of data sharing, data provenance, research reproducibility, licensing, attribution, privacy, and more, but our goal here is not to review that literature. Instead, we present a short guide intended for researchers who want to know why it is important to "care for and feed" data, with some practical advice on how to do that.

cs.DL↗

arXiv2013

Dust Reddened Quasars in FIRST and UKIDSS: Beyond the Tip of the Iceberg

We present the results of a pilot survey to find dust-reddened quasars by matching the FIRST radio catalog to the UKIDSS near-infrared survey, and using optical data from SDSS to select objects with very red colors. The deep K-band limit provided by UKIDSS allows for finding more heavily-reddened quasars at higher redshifts as compared with previous work using FIRST and 2MASS. We selected 87 candidates with K<=17.0 from the UKIDSS Large Area Survey (LAS) First Data Release (DR1) which covers 190 deg2. These candidates reach up to ~1.5 magnitudes below the 2MASS limit and obey the color criteria developed to identify dust-reddened quasars. We have obtained 61 spectroscopic observations in the optical and/or near-infrared as well as classifications in the literature and have identified 14 reddened quasars with E(B-V)>0.1, including three at z>2. We study the infrared properties of the sample using photometry from the WISE Observatory and find that infrared colors improve the efficiency of red quasar selection, removing many contaminants in an infrared-to-optical color-selected sample alone. The highest-redshift quasars (z > 2) are only moderately reddened, with E(B-V) ~ 0.2-0.3. We find that the surface density of red quasars rises sharply with faintness, comprising up to 17% of blue quasars at the same apparent K-band flux limit. We estimate that to reach more heavily reddened quasars (i.e., E(B-V) > 0.5) at z>2 and a depth of K=17 we would need to survey at least ~2.5 times more area.

astro-ph.CO↗

arXiv2012

Data challenges of time domain astronomy

Astronomy has been at the forefront of the development of the techniques and methodologies of data intensive science for over a decade with large sky surveys and distributed efforts such as the Virtual Observatory. However, it faces a new data deluge with the next generation of synoptic sky surveys which are opening up the time domain for discovery and exploration. This brings both new scientific opportunities and fresh challenges, in terms of data rates from robotic telescopes and exponential complexity in linked data, but also for data mining algorithms used in classification and decision making. In this paper, we describe how an informatics-based approach-part of the so-called "fourth paradigm" of scientific discovery-is emerging to deal with these. We review our experiences with the Palomar-Quest and Catalina Real-Time Transient Sky Surveys; in particular, addressing the issue of the heterogeneity of data associated with transient astronomical events (and other sensor networks) and how to manage and analyze it.

astro-ph.IM↗

arXiv2012

FIRST-2MASS Red Quasars: Transitional Objects Emerging from the Dust

We present a sample of 120 dust-reddened quasars identified by matching radio sources detected at 1.4 GHz in the FIRST survey with the near-infrared 2MASS catalog and color-selecting red sources. Optical and/or near-infrared spectroscopy provide broad wavelength sampling of their spectral energy distributions that we use to determine their reddening, characterized by E(B-V). We demonstrate that the reddening in these quasars is best-described by SMC-like dust. This sample spans a wide range in redshift and reddening (0.1 < z < 3, 0.1 < E(B-V) < 1.5), which we use to investigate the possible correlation of luminosity with reddening. At every redshift, dust-reddened quasars are intrinsically the most luminous quasars. We interpret this result in the context of merger-driven quasar/galaxy co-evolution where these reddened quasars are revealing an emergent phase during which the heavily obscured quasar is shedding its cocoon of dust prior to becoming a "normal" blue quasar. When correcting for extinction, we find that, depending on how the parent population is defined, these red quasars make up < 15-20% of the luminous quasar population. We estimate, based on the fraction of objects in this phase, that its duration is 15-20% as long as the unobscured, blue quasar phase.

astro-ph.CO↗

arXiv2012

Astronomy with Cutting-Edge ICT: From Transients in the Sky to Data over the Continents (India-US)

Astronomy has always been at the forefront of information technology, moving from the era of photographic plates, to digital snapshots and now to digital movies of the sky. This has brought about a data explosion with multi- terabyte surveys already happening and upcoming petabyte scale surveys. By scanning the sky repeatedly and automatically, astronomers find rapidly changing phenomena - transients - of a great variety. Surveys like the Catalina Real-time Transient Survey (CRTS) publish details on the transients right away since many of these fade in a matter of minutes and it is important to get additional observations in order to determine their nature. This involves being able to combine a variety of datasets, small and large, in real-time. With networks like the Asia Pacific Advanced Network (APAN) and India's National Knowledge Network (NKN) we are in the realm where such a data transfer is possible in real time across continents. Here we describe the live demonstration we were able to carry out at data transfer speeds of several hundred megabits per second (Mbps) between California Institute of Technology (Caltech, USA) and the Inter-University Centre for Astronomy and Astrophysics (IUCAA, India). This project illustrates how machines can make rapid decisions in response to complex, heterogeneous data, using sophisticated software and networking. While the broader impact covers all aspects of society (disaster response, power grids, earthquakes, and many more), we have used astronomy to show how the APAN and NKN make this possible.

astro-ph.IM↗

arXiv2011

The VAO Transient Facility

The time domain community wants robust and reliable tools to enable production of and subscription to community-endorsed event notification packets (VOEvent). The VAO Transient Facility (VTF) is being designed to be the premier brokering service for the community, both collecting and disseminating observations about time-critical astronomical transients but also supporting annotations and the application of intelligent machine-learning to those observations. This distinguishes two types of activity associated with the facility: core infrastructure and user services. In this paper, we will review the prior art in both areas and describe the planned capabilities of the VTF. In particular, we will focus on scalability and quality-of-service issues required by the next generation of sky surveys, such as LSST and SKA.

astro-ph.IM↗

arXiv2010

DAME: A Web Oriented Infrastructure for Scientific Data Mining & Exploration

Nowadays, many scientific areas share the same need of being able to deal with massive and distributed datasets and to perform on them complex knowledge extraction tasks. This simple consideration is behind the international efforts to build virtual organizations such as, for instance, the Virtual Observatory (VObs). DAME (DAta Mining & Exploration) is an innovative, general purpose, Web-based, VObs compliant, distributed data mining infrastructure specialized in Massive Data Sets exploration with machine learning methods. Initially fine tuned to deal with astronomical data only, DAME has evolved in a general purpose platform which has found applications also in other domains of human endeavor. We present the products and a short outline of a science case, together with a detailed description of main features available in the beta release of the web application now released.

astro-ph.IM↗

arXiv2010

Results from the Supernova Photometric Classification Challenge

We report results from the Supernova Photometric Classification Challenge (SNPCC), a publicly released mix of simulated supernovae (SNe), with types (Ia, Ibc, and II) selected in proportion to their expected rate. The simulation was realized in the griz filters of the Dark Energy Survey (DES) with realistic observing conditions (sky noise, point-spread function and atmospheric transparency) based on years of recorded conditions at the DES site. Simulations of non-Ia type SNe are based on spectroscopically confirmed light curves that include unpublished non-Ia samples donated from the Carnegie Supernova Project (CSP), the Supernova Legacy Survey (SNLS), and the Sloan Digital Sky Survey-II (SDSS-II). A spectroscopically confirmed subset was provided for training. We challenged scientists to run their classification algorithms and report a type and photo-z for each SN. Participants from 10 groups contributed 13 entries for the sample that included a host-galaxy photo-z for each SN, and 9 entries for the sample that had no redshift information. Several different classification strategies resulted in similar performance, and for all entries the performance was significantly better for the training subset than for the unconfirmed sample. For the spectroscopically unconfirmed subset, the entry with the highest average figure of merit for classifying SNe~Ia has an efficiency of 0.96 and an SN~Ia purity of 0.79. As a public resource for the future development of photometric SN classification and photo-z estimators, we have released updated simulations with improvements based on our experience from the SNPCC, added samples corresponding to the Large Synoptic Survey Telescope (LSST) and the SDSS, and provided the answer keys so that developers can evaluate their own analysis.

astro-ph.CO↗

arXiv2009

The Faint End of the Quasar Luminosity Function at z~4

We have conducted a spectroscopic survey to find faint quasars (-26.0 < M_{1450} < -22.0) at redshifts z=3.8-5.2 in order to measure the faint end of the quasar luminosity function at these early times. Using available optical imaging data from portions of the NOAO Deep Wide-Field Survey and the Deep Lens Survey, we have color-selected quasar candidates in a total area of 3.76 deg^2. Thirty candidates have R <= 23 mags. We conducted spectroscopic followup for 28 of our candidates and found 23 QSOs, 21 of which are reported here for the first time, in the 3.74 < z <5.06 redshift range. We estimate our survey completeness through detailed Monte Carlo simulations and derive the first measurement of the density of quasars in this magnitude and redshift interval. We find that the binned luminosity function is somewhat affected by the K-correction used to compute the rest-frame absolute magnitude at 1450A. Considering only our R <= 23 sample, the best-fit single power-law (Phi \propto L^beta) gives a faint-end slope beta = -1.6+/-0.2. If we consider our larger, but highly incomplete sample going one magnitude fainter, we measure a steeper faint-end slope -2 < beta < -2.5. In all cases, we consistently find faint-end slopes that are steeper than expected based on measurements at z ~ 3. We combine our sample with bright quasars from the Sloan Digital Sky Survey to derive parameters for a double-power-law luminosity function. Our best fit finds a bright-end slope, alpha = -2.4+/-0.2, and faint-end slope, beta = -2.3+/-0.2, without a well-constrained break luminosity. This is effectively a single power-law, with beta = -2.7+/-0.1. We use these results to place limits on the amount of ultraviolet radiation produced by quasars and find that quasars are able to ionize the intergalactic medium at these redshifts.

astro-ph.CO↗

arXiv2009

Highly Variable Objects in the Palomar-QUEST Survey: A Blazar Search using Optical Variability

We identify 3,113 highly variable objects in 7,200 square degrees of the Palomar-QUEST Survey, which each varied by more than 0.4 magnitudes simultaneously in two broadband optical filters on timescales from hours to roughly 3.5 years. The primary goal of the selection is to find blazars by their well-known violent optical variability. Because most known blazars have been found in radio and/or X-ray wavelengths, a sample discovered through optical variability may have very different selection effects, elucidating the range of behavior possible in these systems. A set of blazars selected in this unusual manner will improve our understanding of the physics behind this extremely variable and diverse class of AGN. The object positions, variability statistics, and color information are available using the Palomar-QUEST CasJobs server. The time domain is just beginning to be explored over large sky areas; we do not know exactly what a violently variable sample will hold. About 20% of the sample has been classified in the literature; over 70% of those objects are known or likely AGN. The remainder largely consists of a variety of variable stars, including a number of RR Lyrae and cataclysmic variables.

astro-ph.CO↗

arXiv2009

Binary Quasars at High Redshift I: 24 New Quasar Pairs at z ~ 3-4

The clustering of quasars on small scales yields fundamental constraints on models of quasar evolution and the buildup of supermassive black holes. This paper describes the first systematic survey to discover high redshift binary quasars. Using color-selection and photometric redshift techniques, we searched 8142 deg^2 of SDSS imaging data for binary quasar candidates, and confirmed them with follow-up spectroscopy. Our sample of 27 high redshift binaries (24 of them new discoveries) at redshifts 2.9 < z < 4.3 with proper transverse separations 10 kpc < R_{\perp} < 650 kpc increases the number of such objects known by an order of magnitude. Eight members of this sample are very close pairs with R_{\perp} < 100 kpc, and of these close systems four are at z > 3.5. The completeness and efficiency of our well-defined selection algorithm are quantified using simulated photometry and we find that our sample is ~ 50% complete. Our companion paper uses this knowledge to make the first measurement of the small scale clustering (R < 1 Mpc/h comoving) of high-redshift quasars. High redshift binaries constitute exponentially rare coincidences of two extreme (M >~ 10^9 Msun) supermassive black holes. At z ~ 4 there is about one close binary per 10 Gpc^3, thus these could be the highest sigma peaks, the analogs of superclusters, in the early Universe.

astro-ph.CO↗

arXiv2009

Binary Quasars at High Redshift II: Sub-Mpc Clustering at z ~ 3-4

We present measurements of the small-scale (0.1<~ r <~ 1 Mpc/h) quasar two-point correlation function at z>2.9, for a flux-limited (i<21) sample of 15 binary quasars compiled by Hennawi et al. (2009). The amplitude of the small-scale clustering increases from z ~ 3 to z ~ 4. The small-scale clustering amplitude is comparable to or lower than power-law extrapolations (with slope gamma=2) from the large-scale correlation function of the i<20.2 quasar sample from the Sloan Digital Sky Survey. Using simple prescriptions relating quasars to dark matter halos, we model the observed small-scale clustering with halo occupation models. Reproducing the large-scale clustering amplitude requires that the active fraction of the black holes in the central galaxies of halos is near unity, but the level of small-scale clustering favors an active fraction of black holes in satellite galaxies 0.1 <~ f_s <~ 0.5 at z >~ 3.

astro-ph.CO↗

arXiv2008

An Exploratory Search for z~6 Quasars in the UKIDSS Early Data Release

We conducted an exploratory search for quasars at z~ 6 - 8, using the Early Data Release from United Kingdom Infrared Deep Sky survey (UKIDSS) cross-matched to panoramic optical imagery. High redshift quasar candidates are chosen using multi-color selection in i,z,Y,J,H and K bands. After removal of apparent instrumental artifacts, our candidate list consisted of 34 objects. We further refined this list with deeper imaging in the optical for ten of our candidates. Twenty-five candidates were followed up spectroscopically in the near-infrared and in the optical. We confirmed twenty-five of our spectra as very low-mass main-sequence stars or brown dwarfs, which were indeed expected as the main contaminants of this exploratory search. The lack of quasar detection is not surprising: the estimated probability of finding a single z>6 quasar down to the limit of UKIDSS in the 27.3 square degrees of the EDR is <5%. We find that the most important limiting factor in this work is the depth of the available optical data. Experience gained in this pilot project can help refine high-redshift quasar selection criteria for subsequent UKIDSS data releases.

astro-ph↗

arXiv2007

Discovery of Two Spectroscopically Peculiar, Low-Luminosity Quasars at z~4

We report the discovery of two low-luminosity quasars at z~4, both of which show prominent N IV] 1486A emission. This line is extremely rare in quasar spectra at any redshift; detecting it in two out of a sample of 23 objects (i.e., ~ 9% of the sample) is intriguing and is likely due to the low-luminosity, high-redshift quasar sample we are studying. This is still a poorly explored regime, where contributions from associated, early starbursts may be significant. One interpretation of this line posits photoionization by very massive young stars. Seeing N IV] 1486A emission in a high-redshift quasar may thus be understood in the context of co-formation and early co-evolution of galaxies and their supermassive black holes. Alternatively, we may be seeing a phenomenon related to the early evolution of quasar broad emission line regions. The non-detection (and possibly even broad absorption) of N V 1240A line in the spectrum of one of these quasars may support that interpretation. These two objects may signal a new faint quasar population or an early AGN evolutionary stage at high redshifts.

astro-ph↗