arXiv subjects

Yuyang Wang

Publications and source records attributed to Yuyang Wang.

At least 145 records · Page 8Linked to original sources

arXiv2021

Deep Reinforcement Learning Optimizes Graphene Nanopores for Efficient Desalination

Two-dimensional nanomaterials, such as graphene, have been extensively studied because of their outstanding physical properties. Structure and geometry optimization of nanopores on such materials is beneficial for their performances in real-world engineering applications, like water desalination. However, the optimization process often involves very large number of experiments or simulations which are expensive and time-consuming. In this work, we propose a graphene nanopore optimization framework via the combination of deep reinforcement learning (DRL) and convolutional neural network (CNN) for efficient water desalination. The DRL agent controls the growth of nanopore by determining the atom to be removed at each timestep, while the CNN predicts the performance of nanoporus graphene for water desalination: the water flux and ion rejection at a certain external pressure. With the synchronous feedback from CNN-accelerated desalination performance prediction, our DRL agent can optimize the nanoporous graphene efficiently in an online manner. Molecular dynamics (MD) simulations on promising DRL-designed graphene nanopores show that they have higher water flux while maintaining rival ion rejection rate compared to the normal circular nanopores. Semi-oval shape with rough edges geometry of DRL-designed pores is found to be the key factor for their high water desalination performance. Ultimately, this study shows that DRL can be a powerful tool for material design.

cs.LG↗

arXiv2020

The GSVD: Where are the ellipses?, Matrix Trigonometry, and more

This paper provides an advanced mathematical theory of the Generalized Singular Value Decomposition (GSVD) and its applications. We explore the geometry of the GSVD which provides a long sought for ellipse picture which includes a horizontal and a vertical multiaxis. We further propose that the GSVD provides natural coordinates for the Grassmann manifold. This paper proves a theorem showing how the finite generalized singular values do or do not relate to the singular values of $AB^\dagger$. We then turn to the applications arguing that this geometrical theory is natural for understanding existing applications and recognizing opportunities for new applications. In particular the generalized singular vectors play a direct and as natural a mathematical role for certain applications as the singular vectors do for the SVD. In the same way that experts on the SVD often prefer not to cast SVD problems as eigenproblems, we propose that the GSVD, often cast as a generalized eigenproblem, is rather best cast in its natural setting. We illustrate this theoretical approach and the natural multiaxes (with labels from technical domains) in the context of applications where the GSVD arises: Tikhonov regularization (unregularized vs regularization), Genome Reconstruction (humans vs yeast), Signal Processing (signal vs noise), and statistical analysis such as ANOVA and discriminant analysis (between clusters vs within clusters.) With the aid of our ellipse figure, we encourage in the future the labelling of the natural multiaxes in any GSVD problem.

math.NA↗

arXiv2020

Intermittent Demand Forecasting with Renewal Processes

Intermittency is a common and challenging problem in demand forecasting. We introduce a new, unified framework for building intermittent demand forecasting models, which incorporates and allows to generalize existing methods in several directions. Our framework is based on extensions of well-established model-based methods to discrete-time renewal processes, which can parsimoniously account for patterns such as aging, clustering and quasi-periodicity in demand arrivals. The connection to discrete-time renewal processes allows not only for a principled extension of Croston-type models, but also for an natural inclusion of neural network based models---by replacing exponential smoothing with a recurrent neural network. We also demonstrate that modeling continuous-time demand arrivals, i.e., with a temporal point process, is possible via a trivial extension of our framework. This leads to more flexible modeling in scenarios where data of individual purchase orders are directly available with granular timestamps. Complementing this theoretical advancement, we demonstrate the efficacy of our framework for forecasting practice via an extensive empirical study on standard intermittent demand data sets, in which we report predictive accuracy in a variety of scenarios that compares favorably to the state of the art.

cs.LG↗

arXiv2020

Swift/BAT and RXTE/ASM Observations of the 35-day X-ray Cycle of Hercules X-1

Swift/BAT and RXTE/ASM observations have monitored the X-ray binary system Her X-1 for approximately 14.5 years each, and both were monitoring Her X-1 for a period of ~5.5 years. Here we study the 35-day cycle using these observations. Using a cross-correlation method we find the times of peaks of the 35-day cycles for ~150 cycles observed by Swift/BAT and ~150 cycles observed by RXTE/ASM. These cycles include ~60 observed with both instruments. The noise level of the RXTE/ASM measurements is larger than that of Swift/BAT, resulting in larger uncertainty in peak times. The distribution of 35-day cycle lengths can be fit with a Gaussian with mean 34.79 d and $σ$ of 1.1 d. The distribution of orbital phases of 35-day cycle peaks is well fit by a uniform distribution, with 76 percent of the cycles, plus a Gaussian distribution peaked at orbital phase ~0.5, with 24 percent of the cycles. We construct the long-term average 35-day lightcurve in the 15-50 keV band from Swift/BAT, and in the 2-12 keV band from RXTE/ASM. The high energy band shows more variability in the Short High state and the low energy band shows more variability in the Main High state. This is consistent with a precessing accretion disk model as cause of the 35-day cycle.

astro-ph.HE↗

arXiv2020

Site-specific online compressive beam codebook learning in mmWave vehicular communication

Millimeter wave (mmWave) communication is one viable solution to support Gbps sensor data sharing in vehicular networks. The use of large antenna arrays at mmWave and high mobility in vehicular communication make it challenging to design fast beam alignment solutions. In this paper, we propose a novel framework that learns the channel angle-of-departure (AoD) statistics at a base station (BS) and uses this information to efficiently acquire channel measurements. Our framework integrates online learning for compressive sensing (CS) codebook learning and the optimized codebook is used for CS-based beam alignment. We formulate a CS matrix optimization problem based on the AoD statistics available at the BS. Furthermore, based on the CS channel measurements, we develop techniques to update and learn such channel AoD statistics at the BS. We use the upper confidence bound (UCB) algorithm to learn the AoD statistics and the CS matrix. Numerical results show that the CS matrix in the proposed framework provides faster beam alignment than standard CS matrix designs. Simulation results indicate that the proposed beam training technique can reduce overhead by 80% compared to exhaustive beam search, and 70% compared to standard CS solutions that do not exploit any AoD statistics.

eess.SP↗

arXiv2019

Intermittent Demand Forecasting with Deep Renewal Processes

Intermittent demand, where demand occurrences appear sporadically in time, is a common and challenging problem in forecasting. In this paper, we first make the connections between renewal processes, and a collection of current models used for intermittent demand forecasting. We then develop a set of models that benefit from recurrent neural networks to parameterize conditional interdemand time and size distributions, building on the latest paradigm in "deep" temporal point processes. We present favorable empirical findings on discrete and continuous time intermittent demand data, validating the practical value of our approach.

cs.LG↗

arXiv2019

Deep learning-based beam alignment in mmWave vehicular networks

Millimeter wave channels exhibit structure that allows beam alignment with fewer channel measurements than exhaustive beam search. From a compressed sensing (CS) perspective, the received channel measurements are usually obtained by multiplying a CS matrix with a sparse representation of the channel matrix. Due to the constraints imposed by analog processing, designing CS matrices that efficiently exploit the channel structure is, however, challenging. In this paper, we propose an end-to-end deep learning technique to design a structured CS matrix that is well suited to the underlying channel distribution, leveraging both sparsity and the particular spatial structure that appears in vehicular channels. The channel measurements acquired with the designed CS matrix are then used to predict the best beam for link configuration. Simulation results for vehicular communication channels indicate that our deep learning-based approach achieves better beam alignment than standard CS techniques that use the random phase shift-based design.

eess.SP↗

arXiv2019

Emission Measures and Emission-measure-weighted Temperatures of Shocked ISM and Ejecta in Supernova Remnants

A goal of supernova remnant (SNR) evolution models is to relate fundamental parameters of a supernova (SN) explosion and progenitor star to the current state of its SNR. The SNR hot plasma is characterized by its observed X-ray spectrum, which yields electron temperature, emission measure and abundances. Depending on their brightness, the properties of the plasmas heated by the SNR forward shock, reverse shock or both can be measured. The current work utilizes models which are spherically symmetric. One dimensional hydrodynamic simulations are carried out for SNR evolution prior to onset of radiative losses. From these, we derive dimensionless emission measures and emission-measure-weighted temperatures, and we present fitting formulae for these quantities as functions of scaled SNR time. These models allow one to infer SNR explosion energy, circumstellar medium density, age, ejecta mass and ejecta density profile from SNR observations. The new results are incorporated into the SNR modelling code SNRPy. The code is demonstrated with application to three historical SNRs: Kepler, Tycho and SN1006.

astro-ph.GA↗

arXiv2019

GluonTS: Probabilistic Time Series Models in Python

We introduce Gluon Time Series (GluonTS, available at https://gluon-ts.mxnet.io), a library for deep-learning-based time series modeling. GluonTS simplifies the development of and experimentation with time series models for common tasks such as forecasting or anomaly detection. It provides all necessary components and tools that scientists need for quickly building new models, for efficiently running and analyzing experiments and for evaluating model accuracy.

cs.LG↗

arXiv2019

Deep Factors for Forecasting

Producing probabilistic forecasts for large collections of similar and/or dependent time series is a practically relevant and challenging task. Classical time series models fail to capture complex patterns in the data, and multivariate techniques struggle to scale to large problem sizes. Their reliance on strong structural assumptions makes them data-efficient, and allows them to provide uncertainty estimates. The converse is true for models based on deep neural networks, which can learn complex patterns and dependencies given enough data. In this paper, we propose a hybrid model that incorporates the benefits of both approaches. Our new method is data-driven and scalable via a latent, global, deep component. It also handles uncertainty through a local classical model. We provide both theoretical and empirical evidence for the soundness of our approach through a necessary and sufficient decomposition of exchangeable time series into a global and a local part. Our experiments demonstrate the advantages of our model both in term of data efficiency, accuracy and computational complexity.

stat.ML↗

arXiv2018

Deep Factors with Gaussian Processes for Forecasting

A large collection of time series poses significant challenges for classical and neural forecasting approaches. Classical time series models fail to fit data well and to scale to large problems, but succeed at providing uncertainty estimates. The converse is true for deep neural networks. In this paper, we propose a hybrid model that incorporates the benefits of both approaches. Our new method is data-driven and scalable via a latent, global, deep component. It also handles uncertainty through a local classical Gaussian Process model. Our experiments demonstrate that our method obtains higher accuracy than state-of-the-art methods.

stat.ML↗

arXiv2018

MmWave Beam Prediction with Situational Awareness: A Machine Learning Approach

Millimeter-wave communication is a challenge in the highly mobile vehicular context. Traditional beam training is inadequate in satisfying low overheads and latency. In this paper, we propose to combine machine learning tools and situational awareness to learn the beam information (power, optimal beam index, etc) from past observations. We consider forms of situational awareness that are specific to the vehicular setting including the locations of the receiver and the surrounding vehicles. We leverage regression models to predict the received power with different beam power quantizations. The result shows that situational awareness can largely improve the prediction accuracy and the model can achieve throughput with little performance loss with almost zero overhead.

cs.IT↗

arXiv2018

MmWave vehicle-to-infrastructure communication: Analysis of urban microcellular networks

Vehicle-to-infrastructure (V2I) communication may provide high data rates to vehicles via millimeter-wave (mmWave) microcellular networks. This paper uses stochastic geometry to analyze the coverage of urban mmWave microcellular networks. Prior work used a pathloss model with a line-of-sight probability function based on randomly oriented buildings, to determine whether a link was line-of-sight or non-line-of-sight. In this paper, we use a pathloss model inspired by measurements, which uses a Manhattan distance pathloss model and accounts for differences in pathloss exponents and losses when turning corners. In our model, streets are randomly located as a Manhattan Poisson line process (MPLP) and the base stations (BSs) are distributed according to a Poisson point process. Our model is well suited for urban microcellular networks where the BSs are deployed at street level. Based on this new approach, we derive the coverage probability under certain BS association rules to obtain closed-form solutions without much complexity. In addition, we draw two main conclusions from our work. First, non-line-of-sight BSs are not a major benefit for association or source of interference most of the time. Second, there is an ultra-dense regime where deploying active BSs does not enhance coverage.

cs.NI↗

arXiv2017

Gini-regularized Optimal Transport with an Application to Spatio-Temporal Forecasting

Rapidly growing product lines and services require a finer-granularity forecast that considers geographic locales. However the open question remains, how to assess the quality of a spatio-temporal forecast? In this manuscript we introduce a metric to evaluate spatio-temporal forecasts. This metric is based on an Opti- mal Transport (OT) problem. The metric we propose is a constrained OT objec- tive function using the Gini impurity function as a regularizer. We demonstrate through computer experiments both the qualitative and the quantitative charac- teristics of the Gini regularized OT problem. Moreover, we show that the Gini regularized OT problem converges to the classical OT problem, when the Gini regularized problem is considered as a function of λ, the regularization parame-ter. The convergence to the classical OT solution is faster than the state-of-the-art Entropic-regularized OT[Cuturi, 2013] and results in a numerically more stable algorithm.

stat.ML↗

arXiv2017

Approximate Bayesian Inference in Linear State Space Models for Intermittent Demand Forecasting at Scale

We present a scalable and robust Bayesian inference method for linear state space models. The method is applied to demand forecasting in the context of a large e-commerce platform, paying special attention to intermittent and bursty target statistics. Inference is approximated by the Newton-Raphson algorithm, reduced to linear-time Kalman smoothing, which allows us to operate on several orders of magnitude larger problems than previous related work. In a study on large real-world sales datasets, our method outperforms competing approaches on fast and medium moving items.

stat.ML↗

arXiv2013

Infinite Shift-invariant Grouped Multi-task Learning for Gaussian Processes

Multi-task learning leverages shared information among data sets to improve the learning performance of individual tasks. The paper applies this framework for data where each task is a phase-shifted periodic time series. In particular, we develop a novel Bayesian nonparametric model capturing a mixture of Gaussian processes where each task is a sum of a group-specific function and a component capturing individual variation, in addition to each task being phase shifted. We develop an efficient \textsc{em} algorithm to learn the parameters of the model. As a special case we obtain the Gaussian mixture model and \textsc{em} algorithm for phased-shifted periodic time series. Furthermore, we extend the proposed model by using a Dirichlet Process prior and thereby leading to an infinite mixture model that is capable of doing automatic model selection. A Variational Bayesian approach is developed for inference in this model. Experiments in regression, classification and class discovery demonstrate the performance of the proposed models using both synthetic data and real-world time series data from astrophysics. Our methods are particularly useful when the time series are sparsely and non-synchronously sampled.

cs.LG↗

arXiv2013

Online Learning with Pairwise Loss Functions

Efficient online learning with pairwise loss functions is a crucial component in building large-scale learning system that maximizes the area under the Receiver Operator Characteristic (ROC) curve. In this paper we investigate the generalization performance of online learning algorithms with pairwise loss functions. We show that the existing proof techniques for generalization bounds of online algorithms with a univariate loss can not be directly applied to pairwise losses. In this paper, we derive the first result providing data-dependent bounds for the average risk of the sequence of hypotheses generated by an arbitrary online learner in terms of an easily computable statistic, and show how to extract a low risk hypothesis from the sequence. We demonstrate the generality of our results by applying it to two important problems in machine learning. First, we analyze two online algorithms for bipartite ranking; one being a natural extension of the perceptron algorithm and the other using online convex optimization. Secondly, we provide an analysis for the risk bound for an online algorithm for supervised metric learning.

stat.ML↗

arXiv2012

Nonparametric Bayesian Mixed-effect Model: a Sparse Gaussian Process Approach

Multi-task learning models using Gaussian processes (GP) have been developed and successfully applied in various applications. The main difficulty with this approach is the computational cost of inference using the union of examples from all tasks. Therefore sparse solutions, that avoid using the entire data directly and instead use a set of informative "representatives" are desirable. The paper investigates this problem for the grouped mixed-effect GP model where each individual response is given by a fixed-effect, taken from one of a set of unknown groups, plus a random individual effect function that captures variations among individuals. Such models have been widely used in previous work but no sparse solutions have been developed. The paper presents the first sparse solution for such problems, showing how the sparse approximation can be obtained by maximizing a variational lower bound on the marginal likelihood, generalizing ideas from single-task Gaussian processes to handle the mixed-effect model as well as grouping. Experiments using artificial and real data validate the approach showing that it can recover the performance of inference with the full sample, that it outperforms baseline methods, and that it outperforms state of the art sparse solutions for other multi-task GP formulations.

cs.LG↗