arXiv subjects

Qiang Liu

Publications and source records attributed to Qiang Liu.

At least 523 records · Page 29Linked to original sources

arXiv2015

Cheaper and Better: Selecting Good Workers for Crowdsourcing

Crowdsourcing provides a popular paradigm for data collection at scale. We study the problem of selecting subsets of workers from a given worker pool to maximize the accuracy under a budget constraint. One natural question is whether we should hire as many workers as the budget allows, or restrict on a small number of top-quality workers. By theoretically analyzing the error rate of a typical setting in crowdsourcing, we frame the worker selection problem into a combinatorial optimization problem and propose an algorithm to solve it efficiently. Empirical results on both simulated and real-world datasets show that our algorithm is able to select a small number of high-quality workers, and performs as good as, sometimes even better than, the much larger crowds as the budget allows.

stat.ML↗

arXiv2014

Distributed Estimation, Information Loss and Exponential Families

Distributed learning of probabilistic models from multiple data repositories with minimum communication is increasingly important. We study a simple communication-efficient learning framework that first calculates the local maximum likelihood estimates (MLE) based on the data subsets, and then combines the local MLEs to achieve the best possible approximation to the global MLE given the whole dataset. We study this framework's statistical properties, showing that the efficiency loss compared to the global setting relates to how much the underlying distribution families deviate from full exponential families, drawing connection to the theory of information loss by Fisher, Rao and Efron. We show that the "full-exponential-family-ness" represents the lower bound of the error rate of arbitrary combinations of local MLEs, and is achieved by a KL-divergence-based combination method but not by a more common linear combination method. We also study the empirical properties of both methods, showing that the KL method significantly outperforms linear combination in practical settings with issues such as model misspecification, non-convexity, and heterogeneous data partitions.

stat.ML↗

arXiv2014

Marginal Structured SVM with Hidden Variables

In this work, we propose the marginal structured SVM (MSSVM) for structured prediction with hidden variables. MSSVM properly accounts for the uncertainty of hidden variables, and can significantly outperform the previously proposed latent structured SVM (LSSVM; Yu & Joachims (2009)) and other state-of-art methods, especially when that uncertainty is large. Our method also results in a smoother objective function, making gradient-based optimization of MSSVMs converge significantly faster than for LSSVMs. We also show that our method consistently outperforms hidden conditional random fields (HCRFs; Quattoni et al. (2007)) on both simulated and real-world datasets. Furthermore, we propose a unified framework that includes both our and several other existing methods as special cases, and provides insights into the comparison of different models in practice.

stat.ML↗

arXiv2014

Meteorological data for the astronomical site at Dome A, Antarctica

We present an analysis of the meteorological data collected at Dome A, Antarctica by the Kunlun Automated Weather Station, including temperatures and wind speeds at eight elevations above the snow surface between 0m and 14.5m. The average temperatures at 2m and 14.5m are $-54^{\circ}$C and $-46^{\circ}$C, respectively. We find that a strong temperature inversion existed at all heights for more than 70% of the time, and the temperature inversion typically lasts longer than 25 hours, indicating an extremely stable atmosphere. The temperature gradient is larger at lower elevations than higher elevations. The average wind speed was 1.5m/s at 4m elevation. We find that the temperature inversion is stronger when the wind speed is lower and the temperature gradient decreases sharply at a specific wind speed for each elevation. The strong temperature inversion and low wind speed results in a shallow and stable boundary layer with weak atmospheric turbulence above it, suggesting that Dome A should be an excellent site for astronomical observations. All the data from the weather station are available for download.

astro-ph.IM↗

arXiv2014

A new method of CCD dark current correction via extracting the dark information from scientific images

We have developed a new method to correct dark current at relatively high temperatures for Charge-Coupled Device (CCD) images when dark frames cannot be obtained on the telescope. For images taken with the Antarctic Survey Telescopes (AST3) in 2012, due to the low cooling efficiency, the median CCD temperature was -46$^\circ$C, resulting in a high dark current level of about 3$e^-$/pix/sec, even comparable to the sky brightness (10$e^-$/pix/sec). If not corrected, the nonuniformity of the dark current could even overweight the photon noise of the sky background. However, dark frames could not be obtained during the observing season because the camera was operated in frame-transfer mode without a shutter, and the telescope was unattended in winter. Here we present an alternative, but simple and effective method to derive the dark current frame from the scientific images. Then we can scale this dark frame to the temperature at which the scientific images were taken, and apply the dark frame corrections to the scientific images. We have applied this method to the AST3 data, and demonstrated that it can reduce the noise to a level roughly as low as the photon noise of the sky brightness, solving the high noise problem and improving the photometric precision. This method will also be helpful for other projects that suffer from similar issues.

astro-ph.IM↗

arXiv2014

The nonlinear photon transfer curve of CCDs and its effects on photometry

The photon transfer curve (PTC, variance vs. signal level) is a commonly used and effective tool in characterizing CCD performance. It is theoretically linear in the range where photon shot noise dominates, and its slope is utilized to derive the gain of the CCD. However, recent researches on different CCDs have revealed that the variance progressively drops at high signal levels, while the linearity shown by signal versus exposure time is still excellent and unaffected. On the other hand, bright stars are found to exhibit fatter point spread function (PSF). Both nonlinear PTC and the brighter-fatter effect are regarded as the result of spreading of charges between pixels, an interaction progress increasing with signal level. In this work we investigate the nonlinear PTC based on the images with a STA1600FT CCD camera, whose PTC starts to become nonlinear at about 1/3 full well. To explain the phenomenon, we present a model to characterize the charge-sharing PSF. This signal-dependent PSF can be derived from flat-field frames, and allow us to quantify the effects on photometry and measured shape of stars. This effect is essentially critical for projects requiring accurate photometry and shape parameters.

astro-ph.IM↗

arXiv2014

Problems with twilight/supersky flat-field for wide-field robotic telescopes and the solution

Twilight/night sky images are often used for flat-fielding CCD images, but the brightness gradient in twilight/night sky causes problems of accurate flat-field correction in astronomical images for wide-field telescopes. Using data from the Antarctic Survey Telescope (AST3), we found that when the sky brightness gradient is minimum and stable, there is still a gradient of 1% across AST3's field-of-view of 4.3 square degrees. We tested various approaches to remove the varying gradients in individual flat-field images. Our final optimal method can reduce the spatially dependent errors caused by the gradient to the negligible level. We also suggest a guideline of flat-fielding using twilight/night sky images for wide-field robotic autonomous telescopes.

astro-ph.IM↗

arXiv2014

Planetary Transit Candidates in the CSTAR Field: Analysis of the 2008 Data

The Chinese Small Telescope ARray (CSTAR) is a group of four identical, fully automated, static 14.5 cm telescopes. CSTAR is located at Dome A, Antarctica and covers 20 square degree of sky around the South Celestial Pole. The installation is designed to provide high-cadence photometry for the purpose of monitoring the quality of the astronomical observing conditions at Dome A and detecting transiting exoplanets. CSTAR has been operational since 2008, and has taken a rich and high-precision photometric data set of 10,690 stars. In the first observing season, we obtained 291,911 qualified science frames with 20-second integrations in the i-band. Photometric precision reaches about 4 mmag at 20-second cadence at i=7.5, and is about 20 mmag at i=12. Using robust detection methods, ten promising exoplanet candidates were found. Four of these were found to be giants using spectroscopic follow-up. All of these transit candidates are presented here along with the discussion of their detailed properties as well as the follow-up observations.

astro-ph.EP↗

arXiv2013

Photometry of Variable Stars from Dome A, Antarctica: Results from the 2010 Observing Season

We present results from a season of observations with the Chinese Small Telescope ARray (CSTAR), obtained over 183 days of the 2010 Antarctic winter. We carried out high-cadence time-series aperture photometry of 20,000 stars with i<15.3 mag located in a 23 square-degree region centered on the south celestial pole. We identified 188 variable stars, including 67 new objects relative to our 2008 observations, thanks to broader synoptic coverage, a deeper magnitude limit and a larger field of view. We used the photometric data set to derive site statistics from Dome A. Based on two years of observations, we find that extinction due to clouds at this site is less than 0.1 and 0.4 mag during 45% and 75% of the dark time, respectively.

astro-ph.SR↗

arXiv2013

Variational Algorithms for Marginal MAP

The marginal maximum a posteriori probability (MAP) estimation problem, which calculates the mode of the marginal posterior distribution of a subset of variables with the remaining variables marginalized, is an important inference problem in many models, such as those with hidden variables or uncertain parameters. Unfortunately, marginal MAP can be NP-hard even on trees, and has attracted less attention in the literature compared to the joint MAP (maximization) and marginalization problems. We derive a general dual representation for marginal MAP that naturally integrates the marginalization and maximization operations into a joint variational optimization problem, making it possible to easily extend most or all variational-based algorithms to marginal MAP. In particular, we derive a set of "mixed-product" message passing algorithms for marginal MAP, whose form is a hybrid of max-product, sum-product and a novel "argmax-product" message updates. We also derive a class of convergent algorithms based on proximal point methods, including one that transforms the marginal MAP problem into a sequence of standard marginalization problems. Theoretically, we provide guarantees under which our algorithms give globally or locally optimal solutions, and provide novel upper bounds on the optimal objectives. Empirically, we demonstrate that our algorithms significantly outperform the existing approaches, including a state-of-the-art algorithm based on local search methods.

stat.ML↗

arXiv2012

Belief Propagation for Structured Decision Making

Variational inference algorithms such as belief propagation have had tremendous impact on our ability to learn and use graphical models, and give many insights for developing or understanding exact and approximate inference. However, variational approaches have not been widely adoped for decision making in graphical models, often formulated through influence diagrams and including both centralized and decentralized (or multi-agent) decisions. In this work, we present a general variational framework for solving structured cooperative decision-making problems, use it to propose several belief propagation-like algorithms, and analyze them both theoretically and empirically.

cs.AI↗

arXiv2012

Distributed Parameter Estimation via Pseudo-likelihood

Estimating statistical models within sensor networks requires distributed algorithms, in which both data and computation are distributed across the nodes of the network. We propose a general approach for distributed learning based on combining local estimators defined by pseudo-likelihood components, encompassing a number of combination methods, and provide both theoretical and experimental analysis. We show that simple linear combination or max-voting methods, when combined with second-order information, are statistically competitive with more advanced and costly joint optimization. Our algorithms have many attractive properties including low communication and computational cost and "any-time" behavior.

cs.LG↗

arXiv2012

Negative Tree Reweighted Belief Propagation

We introduce a new class of lower bounds on the log partition function of a Markov random field which makes use of a reversed Jensen's inequality. In particular, our method approximates the intractable distribution using a linear combination of spanning trees with negative weights. This technique is a lower-bound counterpart to the tree-reweighted belief propagation algorithm, which uses a convex combination of spanning trees with positive weights to provide corresponding upper bounds. We develop algorithms to optimize and tighten the lower bounds over the non-convex set of valid parameter values. Our algorithm generalizes mean field approaches (including naive and structured mean field approximations), which it includes as a limiting case.

cs.LG↗

arXiv2012

Variational Algorithms for Marginal MAP

Marginal MAP problems are notoriously difficult tasks for graphical models. We derive a general variational framework for solving marginal MAP problems, in which we apply analogues of the Bethe, tree-reweighted, and mean field approximations. We then derive a "mixed" message passing algorithm and a convergent alternative using CCCP to solve the BP-type approximations. Theoretically, we give conditions under which the decoded solution is a global or local optimum, and obtain novel upper bounds on solutions. Experimentally we demonstrate that our algorithms outperform related approaches. We also show that EM and variational EM comprise a special case of our framework.

cs.LG↗

arXiv2011

Photometry of Variable Stars from Dome A, Antarctica

Dome A on the Antarctic plateau is likely one of the best observing sites on Earth thanks to the excellent atmospheric conditions present at the site during the long polar winter night. We present high-cadence time-series aperture photometry of 10,000 stars with i<14.5 mag located in a 23 square-degree region centered on the south celestial pole. The photometry was obtained with one of the CSTAR telescopes during 128 days of the 2008 Antarctic winter. We used this photometric data set to derive site statistics for Dome A and to search for variable stars. Thanks to the nearly-uninterrupted synoptic coverage, we find 6 times as many variables as previous surveys with similar magnitude limits. We detected 157 variable stars, of which 55% are unclassified, 27% are likely binaries and 17% are likely pulsating stars. The latter category includes delta Scuti, gamma Doradus and RR Lyrae variables. One variable may be a transiting exoplanet.

astro-ph.SR↗

arXiv2011

C2H, HC3N and HNC Observations in OMC-2/3

For the first time, the OMC-2/3 region was mapped in C2H(1-0), HC3N(10-9) and HNC(1-0) lines. In general, the emissions from all the three molecular species reveal an extended filamentary structure. The distribution of C2H cores almost follows that of the 1300 $μ$m condensations, which might suggest that C2H is a good tracer to study the core structure of molecular clouds. The core masses traced by HNC are rather flat, ranging from 18.8 to 49.5 $M_{\odot}$, while present a large span for those from C2H, ranging from 6.4 to 36.0 $M_{\odot}$. The line widths of both HNC and C2H look very similar, and both are wider than that of HC3N. The line widths of the three lines are all wider than those from dark clouds, implying that the former is more active than the latter, and has larger turbulence caused by winds and UV radiation from the surrounding massive stars.

astro-ph.SR↗

arXiv2010

Data characterization using artificial-star tests: performance evaluation

Traditional artificial-star tests are widely applied to photometry in crowded stellar fields. However, to obtain reliable binary fractions (and their uncertainties) of remote, dense, and rich star clusters, one needs to recover huge numbers of artificial stars. Hence, this will consume much computation time for data reduction of the images to which the artificial stars must be added. In this paper, we present a new method applicable to data sets characterized by stable, well-defined point-spread functions, in which we add artificial stars to the retrieved-data catalog instead of the raw images. Taking the young Large Magellanic Cloud cluster NGC 1818 as an example, we compare results from both methods and show that they are equivalent, while our new method saves significant computational time.

astro-ph.IM↗

arXiv2010

The binary fraction of the young cluster NGC 1818 in the Large Magellanic Cloud

We use high-resolution {\sl Hubble Space Telescope} imaging observations of the young ($\sim 15-25$ Myr-old) star cluster NGC 1818 in the Large Magellanic Cloud to derive an estimate for the binary fraction of F stars ($1.3 < M_\star/M_\odot < 1.6$). This study provides the strongest constraints yet on the binary fraction in a young star cluster in a low-metallicity environment (${[Fe/H]} \sim -0.4$ dex). Employing artificial-star tests, we develop a simple method that can efficiently measure the probabilities of stellar blends and superpositions from the observed stellar catalog. We create synthetic color-magnitude diagrams matching the fundamental parameters of NGC 1818, with different binary fractions and mass-ratio distributions. We find that this method is sensitive to binaries with mass ratios, $q \ga 0.4$. For binaries with F-star primaries and mass ratios $q > 0.4$, the binary fraction is $\sim 0.35$. This suggests a total binary fraction for F stars of 0.55 to unity, depending on assumptions about the form of the mass-ratio distribution at low $q$.

astro-ph↗