arXiv subjects

Qiang Liu

Publications and source records attributed to Qiang Liu.

At least 469 records · Page 26Linked to original sources

arXiv2018

Exoplanets in the Antarctic Sky. I. The First Data Release of AST3-II (CHESPA) and New Found Variables within the Southern CVZ of TESS

Located at Dome A, the highest point of the Antarctic plateau, the Chinese Kunlun station is considered to be one of the best ground-based photometric sites because of its extremely cold, dry, and stable atmosphere(Saunders et al. 2009). A target can be monitored from there for over 40 days without diurnal interruption during a polar winter. This makes Kunlun station a perfect site to search for short-period transiting exoplanets. Since 2008, an observatory has been built at Kunlun station and three telescopes are working there. Using these telescopes, the AST3 project has been carried out over the last six years with a search for transiting exoplanets as one of its key programs (CHESPA). In the austral winters of 2016 and 2017, a set of target fields in the Southern CVZ of TESS (Ricker et al. 2009) were monitored by the AST3-II telescope. In this paper, we introduce the CHESPA and present the first data release containing photometry of 26,578 bright stars (m_i < 15). The best photometric precision at the optimum magnitude for the survey is around 2 mmag. To demonstrate the data quality, we also present a catalog of 221 variables with a brightness variation greater than 5 mmag from the 2016 data. Among these variables, 179 are newly identified periodic variables not listed in the AAVSO databasea), and 67 are listed in the Candidate Target List(Stassun et al. 2017). These variables will require careful attention to avoid false-positive signals when searching for transiting exoplanets. Dozens of new transiting exoplanet candidates will be also released in a subsequent paper(Zhang et al. 2018b).

astro-ph.IM↗

arXiv2018

Network localization is unalterable by infections in bursts

To shed light on the disease localization phenomenon, we study a bursty susceptible-infected-susceptible (SIS) model and analyze the model under the mean-field approximation. In the bursty SIS model, the infected nodes infect all their neighbors periodically, and the near-threshold steady-state prevalence is non-constant and maximized by a factor equal to the largest eigenvalue $λ_1$ of the adjacency matrix of the network. We show that the maximum near-threshold prevalence of the bursty SIS process on a localized network tends to zero even if $λ_1$ diverges in the thermodynamic limit, which indicates that the burst of infection cannot turn a localized spreading into a delocalized spreading. Our result is evaluated both on synthetic and real networks.

physics.soc-ph↗

arXiv2018

Observations on a series of merging magnetic flux ropes within an interplanetary coronal mass ejection

Coronal mass ejections (CMEs) are intense solar explosive eruptions. CMEs are highly important players in solar-terrestrial relationships, and they have important consequences for major geomagnetic storms and energetic particle events. It has been unclear how CMEs evolve when they propagate in the heliosphere. Here we report an interplanetary coronal mass ejection (ICME) consisting of multiple magnetic flux ropes measured by WIND on March 25-26, 1998. These magnetic flux ropes were merging with each other. The observations indicate that internal interactions (reconnections) within multi-flux-rope CME can coalesce into large-scale ropes, which may improve our understanding of the interplanetary evolution of CMEs. In addition, we speculated that the reported rope-rope interactions may also exist between successive rope-like CMEs and are important for the space weather forecasting.

physics.space-ph↗

arXiv2018

MV-RNN: A Multi-View Recurrent Neural Network for Sequential Recommendation

Sequential recommendation is a fundamental task for network applications, and it usually suffers from the item cold start problem due to the insufficiency of user feedbacks. There are currently three kinds of popular approaches which are respectively based on matrix factorization (MF) of collaborative filtering, Markov chain (MC), and recurrent neural network (RNN). Although widely used, they have some limitations. MF based methods could not capture dynamic user's interest. The strong Markov assumption greatly limits the performance of MC based methods. RNN based methods are still in the early stage of incorporating additional information. Based on these basic models, many methods with additional information only validate incorporating one modality in a separate way. In this work, to make the sequential recommendation and deal with the item cold start problem, we propose a Multi-View Recurrent Neural Network (MV-RNN}) model. Given the latent feature, MV-RNN can alleviate the item cold start problem by incorporating visual and textual information. First, At the input of MV-RNN, three different combinations of multi-view features are studied, like concatenation, fusion by addition and fusion by reconstructing the original multi-modal data. MV-RNN applies the recurrent structure to dynamically capture the user's interest. Second, we design a separate structure and a united structure on the hidden state of MV-RNN to explore a more effective way to handle multi-view features. Experiments on two real-world datasets show that MV-RNN can effectively generate the personalized ranking list, tackle the missing modalities problem and significantly alleviate the item cold start problem.

cs.IR↗

arXiv2018

Breaking the Curse of Horizon: Infinite-Horizon Off-Policy Estimation

We consider the off-policy estimation problem of estimating the expected reward of a target policy using samples collected by a different behavior policy. Importance sampling (IS) has been a key technique to derive (nearly) unbiased estimators, but is known to suffer from an excessively high variance in long-horizon problems. In the extreme case of in infinite-horizon problems, the variance of an IS-based estimator may even be unbounded. In this paper, we propose a new off-policy estimation method that applies IS directly on the stationary state-visitation distributions to avoid the exploding variance issue faced by existing estimators.Our key contribution is a novel approach to estimating the density ratio of two stationary distributions, with trajectories sampled from only the behavior distribution. We develop a mini-max loss function for the estimation problem, and derive a closed-form solution for the case of RKHS. We support our method with both theoretical and empirical analyses.

cs.LG↗

arXiv2018

Stein Variational Gradient Descent as Moment Matching

Stein variational gradient descent (SVGD) is a non-parametric inference algorithm that evolves a set of particles to fit a given distribution of interest. We analyze the non-asymptotic properties of SVGD, showing that there exists a set of functions, which we call the Stein matching set, whose expectations are exactly estimated by any set of particles that satisfies the fixed point equation of SVGD. This set is the image of Stein operator applied on the feature maps of the positive definite kernel used in SVGD. Our results provide a theoretical framework for analyzing the properties of SVGD with different kernels, shedding insight into optimal kernel choice. In particular, we show that SVGD with linear kernels yields exact estimation of means and variances on Gaussian distributions, while random Fourier features enable probabilistic bounds for distributional approximation. Our results offer a refreshing view of the classical inference problem as fitting Stein's identity or solving the Stein equation, which may motivate more efficient algorithms.

stat.ML↗

arXiv2018

Meteorological data from KLAWS-2G for an astronomical site survey of Dome A, Antarctica

We present an analysis of meteorological data from the second generation of the Kunlun Automated Weather Station (KLAWS-2G) at Dome A, Antarctica during 2015 and 2016. We find that a strong temperature inversion exists for all the elevations up to 14 m that KLAWS-2G can reach, and lasts for more than 10 hours for 50% or more of the time when temperature inversion occurs. The average wind speeds at 4 m elevation are 4.2 m/s and 3.8 m/s during 2015 and 2016, respectively. The strong temperature inversion and moderate wind speed lead to a shallow turbulent boundary layer height at Dome A. By analyzing the temperature and wind shear profiles, we note telescopes should be elevated by at least 8 m above the ice. We also find that the duration of temperature inversions, and the wind speed, vary considerably from year to year. Therefore, long-term and continuous data are still needed for the site survey at Dome A.

astro-ph.IM↗

arXiv2018

Off-Policy Evaluation and Learning from Logged Bandit Feedback: Error Reduction via Surrogate Policy

When learning from a batch of logged bandit feedback, the discrepancy between the policy to be learned and the off-policy training data imposes statistical and computational challenges. Unlike classical supervised learning and online learning settings, in batch contextual bandit learning, one only has access to a collection of logged feedback from the actions taken by a historical policy, and expect to learn a policy that takes good actions in possibly unseen contexts. Such a batch learning setting is ubiquitous in online and interactive systems, such as ad platforms and recommendation systems. Existing approaches based on inverse propensity weights, such as Inverse Propensity Scoring (IPS) and Policy Optimizer for Exponential Models (POEM), enjoy unbiasedness but often suffer from large mean squared error. In this work, we introduce a new approach named Maximum Likelihood Inverse Propensity Scoring (MLIPS) for batch learning from logged bandit feedback. Instead of using the given historical policy as the proposal in inverse propensity weights, we estimate a maximum likelihood surrogate policy based on the logged action-context pairs, and then use this surrogate policy as the proposal. We prove that MLIPS is asymptotically unbiased, and moreover, has a smaller nonasymptotic mean squared error than IPS. Such an error reduction phenomenon is somewhat surprising as the estimated surrogate policy is less accurate than the given historical policy. Results on multi-label classification problems and a large- scale ad placement dataset demonstrate the empirical effectiveness of MLIPS. Furthermore, the proposed surrogate policy technique is complementary to existing error reduction techniques, and when combined, is able to consistently boost the performance of several widely used approaches.

cs.LG↗

arXiv2018

Stein Variational Message Passing for Continuous Graphical Models

We propose a novel distributed inference algorithm for continuous graphical models, by extending Stein variational gradient descent (SVGD) to leverage the Markov dependency structure of the distribution of interest. Our approach combines SVGD with a set of structured local kernel functions defined on the Markov blanket of each node, which alleviates the curse of high dimensionality and simultaneously yields a distributed algorithm for decentralized inference tasks. We justify our method with theoretical analysis and show that the use of local kernels can be viewed as a new type of localized approximation that matches the target distribution on the conditional distributions of each node over its Markov blanket. Our empirical results show that our method outperforms a variety of baselines including standard MCMC and particle message passing methods.

stat.ML↗

arXiv2018

Stein Variational Gradient Descent Without Gradient

Stein variational gradient decent (SVGD) has been shown to be a powerful approximate inference algorithm for complex distributions. However, the standard SVGD requires calculating the gradient of the target density and cannot be applied when the gradient is unavailable. In this work, we develop a gradient-free variant of SVGD (GF-SVGD), which replaces the true gradient with a surrogate gradient, and corrects the induced bias by re-weighting the gradients in a proper form. We show that our GF-SVGD can be viewed as the standard SVGD with a special choice of kernel, and hence directly inherits the theoretical properties of SVGD. We shed insights on the empirical choice of the surrogate gradient and propose an annealed GF-SVGD that leverages the idea of simulated annealing to improve the performance on high dimensional complex distributions. Empirical studies show that our method consistently outperforms a number of recent advanced gradient-free MCMC methods.

stat.ML↗

arXiv2018

The First Release of the AST3-1 Point Source Catalogue from Dome A, Antarctica

The three Antarctic Survey Telescopes (AST3) aim to carry out time domain imaging survey at Dome A, Antarctica. The first of the three telescopes (AST3-1) was successfully deployed on January 2012. AST3-1 is a 500\,mm aperture modified Schmidt telescope with a 680\,mm diameter primary mirror. AST3-1 is equipped with a SDSS $i$ filter and a 10k $\times$ 10k frame transfer CCD camera, reduced to 5k $\times$ 10k by electronic shuttering, resulting in a 4.3 deg$^2$ field-of-view. To verify the capability of AST3-1 for a variety of science goals, extensive commissioning was carried out between March and May 2012. The commissioning included a survey covering 2000 deg$^2$ as well as the entire Large and Small Magellanic Clouds. Frequent repeated images were made of the center of the Large Magellanic Cloud, a selected exoplanet transit field, and fields including some Wolf-Rayet stars. Here we present the data reduction and photometric measurements of the point sources observed by AST3-1. We have achieved a survey depth of 19.3\,mag in 60 s exposures with 5\,mmag precision in the light curves of bright stars. The facility achieves sub-mmag photometric precision under stable survey conditions, approaching its photon noise limit. These results demonstrate that AST3-1 at Dome A is extraordinarily competitive in time-domain astronomy, including both quick searches for faint transients and the detection of tiny transit signals.

astro-ph.IM↗

arXiv2018

Investigation of the near-threshold cluster resonance in $^{14}\rm{C}$

An experiment for $p(^{14}\rm{C}$,$^{14}\rm{C}^{*}\rightarrow^{10}\rm{Be}+α)\mathit{p}$ inelastic excitation and decay was performed in inverse kinematics at a beam energy of 25.3 MeV/u. A series of $^{14}\rm{C}$ excited states, including a new one at 18.3(1) MeV, were observed which decay to various states of the final nucleus of $^{10}\rm{Be}$. A specially designed telescope-system, installed around the zero degree, played an essential role in detecting the resonant states near the $α$-separation threshold. A state at 14.1(1) MeV is clearly identified, being consistent with the predicted band-head of the molecular rotational band characterized by the $π$-bond linear-chain-configuration. Further clarification of the properties of this exotic state is suggested by using appropriate reaction tools.

nucl-ex↗

arXiv2018

Topological Maxwell Metal Bands in a Superconducting Qutrit

We experimentally explore the topological Maxwell metal bands by mapping the momentum space of condensed-matter models to the tunable parameter space of superconducting quantum circuits. An exotic band structure that is effectively described by the spin-1 Maxwell equations is imaged. Three-fold degenerate points dubbed Maxwell points are observed in the Maxwell metal bands. Moreover, we engineer and observe the topological phase transition from the topological Maxwell metal to a trivial insulator, and report the first experiment to measure the Chern numbers that are higher than one.

quant-ph↗

arXiv2018

Stochastic Variance Reduction for Policy Gradient Estimation

Recent advances in policy gradient methods and deep learning have demonstrated their applicability for complex reinforcement learning problems. However, the variance of the performance gradient estimates obtained from the simulation is often excessive, leading to poor sample efficiency. In this paper, we apply the stochastic variance reduced gradient descent (SVRG) to model-free policy gradient to significantly improve the sample-efficiency. The SVRG estimation is incorporated into a trust-region Newton conjugate gradient framework for the policy optimization. On several Mujoco tasks, our method achieves significantly better performance compared to the state-of-the-art model-free policy gradient methods in robotic continuous control such as trust region policy optimization (TRPO)

cs.LG↗

arXiv2018

Learning to Explore with Meta-Policy Gradient

The performance of off-policy learning, including deep Q-learning and deep deterministic policy gradient (DDPG), critically depends on the choice of the exploration policy. Existing exploration methods are mostly based on adding noise to the on-going actor policy and can only explore \emph{local} regions close to what the actor policy dictates. In this work, we develop a simple meta-policy gradient algorithm that allows us to adaptively learn the exploration policy in DDPG. Our algorithm allows us to train flexible exploration behaviors that are independent of the actor policy, yielding a \emph{global exploration} that significantly speeds up the learning process. With an extensive study, we show that our method significantly improves the sample-efficiency of DDPG on a variety of reinforcement learning tasks.

cs.LG↗

arXiv2018

Emulating topological chiral magnetic effects in artificial Weyl semimetals

We realized highly tunable Weyl semimetal-bands and subsequently emulated the topological chiral magnetic effects in superconducting quantum circuits. Driving the superconducting quantum circuits with elaborately designed microwave fields, we mapped the momentum space of a lattice to the parameter space, realizing the Hamiltonian of a Weyl semimetal. By measuring the energy spectrum, we directly imaged the Weyl points of cubic lattices, whose topological winding numbers were further determined from the Berry curvature measurement. In particular, we used an additional microwave field to produce a momentum-dependent chemical potential, from which the chiral magnetic topological current was extracted in the presence of an artificial magnetic field. This pure topological current is proportional to the magnetic field, which is in contrast to the famous Ampere's law, and may have significant impacts on topological materials and quantum devices.

cond-mat.mes-hall↗

arXiv2018

BEBP: An Poisoning Method Against Machine Learning Based IDSs

In big data era, machine learning is one of fundamental techniques in intrusion detection systems (IDSs). However, practical IDSs generally update their decision module by feeding new data then retraining learning models in a periodical way. Hence, some attacks that comprise the data for training or testing classifiers significantly challenge the detecting capability of machine learning-based IDSs. Poisoning attack, which is one of the most recognized security threats towards machine learning-based IDSs, injects some adversarial samples into the training phase, inducing data drifting of training data and a significant performance decrease of target IDSs over testing data. In this paper, we adopt the Edge Pattern Detection (EPD) algorithm to design a novel poisoning method that attack against several machine learning algorithms used in IDSs. Specifically, we propose a boundary pattern detection algorithm to efficiently generate the points that are near to abnormal data but considered to be normal ones by current classifiers. Then, we introduce a Batch-EPD Boundary Pattern (BEBP) detection algorithm to overcome the limitation of the number of edge pattern points generated by EPD and to obtain more useful adversarial samples. Based on BEBP, we further present a moderate but effective poisoning method called chronic poisoning attack. Extensive experiments on synthetic and three real network data sets demonstrate the performance of the proposed poisoning method against several well-known machine learning algorithms and a practical intrusion detection method named FMIFS-LSSVM-IDS.

cs.LG↗

arXiv2018

Action-depedent Control Variates for Policy Optimization via Stein's Identity

Policy gradient methods have achieved remarkable successes in solving challenging reinforcement learning problems. However, it still often suffers from the large variance issue on policy gradient estimation, which leads to poor sample efficiency during training. In this work, we propose a control variate method to effectively reduce variance for policy gradient methods. Motivated by the Stein's identity, our method extends the previous control variate methods used in REINFORCE and advantage actor-critic by introducing more general action-dependent baseline functions. Empirical studies show that our method significantly improves the sample efficiency of the state-of-the-art policy gradient approaches.

stat.ML↗