arXiv subjects

Zheng Li

Publications and source records attributed to Zheng Li.

At least 415 records · Page 23Linked to original sources

arXiv2019

Multi-Agent Deep Reinforcement Learning based Spectrum Allocation for D2D Underlay Communications

Device-to-device (D2D) communication underlay cellular networks is a promising technique to improve spectrum efficiency. In this situation, D2D transmission may cause severe interference to both the cellular and other D2D links, which imposes a great technical challenge to spectrum allocation. Existing centralized schemes require global information, which causes a large signaling overhead. While existing distributed schemes requires frequent information exchange among D2D users and cannot achieve global optimization. In this paper, a distributed spectrum allocation framework based on multi-agent deep reinforcement learning is proposed, named multi-agent actor critic (MAAC). MAAC shares global historical states, actions and policies during centralized training, requires no signal interaction during execution and utilizes cooperation among users to further optimize system performance. Moreover, in order to decrease the computing complexity of the training, we further propose the neighbor-agent actor critic (NAAC) based on the neighbor users' historical information for centralized training. The simulation results show that the proposed MAAC and NAAC can effectively reduce the outage probability of cellular links, greatly improve the sum rate of D2D links and converge quickly.

cs.NI↗

arXiv2019

A Multi-Agent Deep Reinforcement Learning based Spectrum Allocation Framework for D2D Communications

Device-to-device (D2D) communication has been recognized as a promising technique to improve spectrum efficiency. However, D2D transmission as an underlay causes severe interference, which imposes a technical challenge to spectrum allocation. Existing centralized schemes require global information, which can cause serious signaling overhead. While existing distributed solution requires frequent information exchange between users and cannot achieve global optimization. In this paper, a distributed spectrum allocation framework based on multi-agent deep reinforcement learning is proposed, named Neighbor-Agent Actor Critic (NAAC). NAAC uses neighbor users' historical information for centralized training but is executed distributedly without that information, which not only has no signal interaction during execution, but also utilizes cooperation between users to further optimize system performance. The simulation results show that the proposed framework can effectively reduce the outage probability of cellular links, improve the sum rate of D2D links and have good convergence.

cs.NI↗

arXiv2019

Efficient Network Construction through Structural Plasticity

Deep Neural Networks (DNNs) on hardware is facing excessive computation cost due to the massive number of parameters. A typical training pipeline to mitigate over-parameterization is to pre-define a DNN structure first with redundant learning units (filters and neurons) under the goal of high accuracy, then to prune redundant learning units after training with the purpose of efficient inference. We argue that it is sub-optimal to introduce redundancy into training for the purpose of reducing redundancy later in inference. Moreover, the fixed network structure further results in poor adaption to dynamic tasks, such as lifelong learning. In contrast, structural plasticity plays an indispensable role in mammalian brains to achieve compact and accurate learning. Throughout the lifetime, active connections are continuously created while those no longer important are degenerated. Inspired by such observation, we propose a training scheme, namely Continuous Growth and Pruning (CGaP), where we start the training from a small network seed, then literally execute continuous growth by adding important learning units and finally prune secondary ones for efficient inference. The inference model generated from CGaP is sparse in the structure, largely decreasing the inference power and latency when deployed on hardware platforms. With popular DNN structures on representative datasets, the efficacy of CGaP is benchmarked by both algorithm simulation and architectural modeling on Field-programmable Gate Arrays (FPGA). For example, CGaP decreases the FLOPs, model size, DRAM access energy and inference latency by 63.3%, 64.0%, 11.8% and 40.2%, respectively, for ResNet-110 on CIFAR-10.

cs.NE↗

arXiv2019

Spectroscopic Signature of Chemical Bond Dissociation Revealed by Calculated Core-Electron Spectra

The advent of ultrashort soft x-ray pulse sources permits the use of established gas phase spectroscopy methods to investigate ultrafast photochemistry in isolated molecules with element and site specificity. In the present study, we simulate excited state wavepacket dynamics of a prototypical process, the ultrafast photodissociation of methyl iodide. Based on the simulation, we calculate time-dependent excited state carbon edge photoelectron and Auger electron spectra. We observe distinct signatures in both types of spectra and show their direct connection to C-I bond dissociation and charge rearrangement processes in the molecule. We demonstrate at the CH$_3$I molecule that the observed signatures allow us to map the time-dependent dynamics of ultrafast photo-induced bond breaking with unprecedented details.

physics.chem-ph↗

arXiv2019

SynC: A Unified Framework for Generating Synthetic Population with Gaussian Copula

Synthetic population generation is the process of combining multiple socioeconomic and demographic datasets from different sources and/or granularity levels, and downscaling them to an individual level. Although it is a fundamental step for many data science tasks, an efficient and standard framework is absent. In this study, we propose a multi-stage framework called SynC (Synthetic Population via Gaussian Copula) to fill the gap. SynC first removes potential outliers in the data and then fits the filtered data with a Gaussian copula model to correctly capture dependencies and marginal distributions of sampled survey data. Finally, SynC leverages predictive models to merge datasets into one and then scales them accordingly to match the marginal constraints. We make three key contributions in this work: 1) propose a novel framework for generating individual level data from aggregated data sources by combining state-of-the-art machine learning and statistical techniques, 2) demonstrate its value as a feature engineering tool, as well as an alternative to data collection in situations where gathering is difficult through two real-world datasets, 3) release an easy-to-use framework implementation for reproducibility, and 4) ensure the methodology is scalable at the production level and can easily incorporate new data.

cs.LG↗

arXiv2019

How to Prove Your Model Belongs to You: A Blind-Watermark based Framework to Protect Intellectual Property of DNN

Deep learning techniques have made tremendous progress in a variety of challenging tasks, such as image recognition and machine translation, during the past decade. Training deep neural networks is computationally expensive and requires both human and intellectual resources. Therefore, it is necessary to protect the intellectual property of the model and externally verify the ownership of the model. However, previous studies either fail to defend against the evasion attack or have not explicitly dealt with fraudulent claims of ownership by adversaries. Furthermore, they can not establish a clear association between the model and the creator's identity. To fill these gaps, in this paper, we propose a novel intellectual property protection (IPP) framework based on blind-watermark for watermarking deep neural networks that meet the requirements of security and feasibility. Our framework accepts ordinary samples and the exclusive logo as inputs, outputting newly generated samples as watermarks, which are almost indistinguishable from the origin, and infuses these watermarks into DNN models by assigning specific labels, leaving the backdoor as the basis for our copyright claim. We evaluated our IPP framework on two benchmark datasets and 15 popular deep learning models. The results show that our framework successfully verifies the ownership of all the models without a noticeable impact on their primary task. Most importantly, we are the first to successfully design and implement a blind-watermark based framework, which can achieve state-of-art performances on undetectability against evasion attack and unforgeability against fraudulent claims of ownership. Further, our framework shows remarkable robustness and establishes a clear association between the model and the author's identity.

cs.CR↗

arXiv2019

AIM 2019 Challenge on Constrained Super-Resolution: Methods and Results

This paper reviews the AIM 2019 challenge on constrained example-based single image super-resolution with focus on proposed solutions and results. The challenge had 3 tracks. Taking the three main aspects (i.e., number of parameters, inference/running time, fidelity (PSNR)) of MSRResNet as the baseline, Track 1 aims to reduce the amount of parameters while being constrained to maintain or improve the running time and the PSNR result, Tracks 2 and 3 aim to optimize running time and PSNR result with constrain of the other two aspects, respectively. Each track had an average of 64 registered participants, and 12 teams submitted the final results. They gauge the state-of-the-art in single image super-resolution.

eess.IV↗

arXiv2019

Transferable End-to-End Aspect-based Sentiment Analysis with Selective Adversarial Learning

Joint extraction of aspects and sentiments can be effectively formulated as a sequence labeling problem. However, such formulation hinders the effectiveness of supervised methods due to the lack of annotated sequence data in many domains. To address this issue, we firstly explore an unsupervised domain adaptation setting for this task. Prior work can only use common syntactic relations between aspect and opinion words to bridge the domain gaps, which highly relies on external linguistic resources. To resolve it, we propose a novel Selective Adversarial Learning (SAL) method to align the inferred correlation vectors that automatically capture their latent relations. The SAL method can dynamically learn an alignment weight for each word such that more important words can possess higher alignment weights to achieve fine-grained (word-level) adaptation. Empirically, extensive experiments demonstrate the effectiveness of the proposed SAL method.

cs.CL↗

arXiv2019

Intermolecular Vibrations Drive Ultrafast Singlet Fission

Singlet fission is a spin-allowed exciton multiplication process in organic semiconductors that converts one spin-singlet exciton to two triplet excitons. It offers the potential to enhance solar energy conversion by circumventing the Shockley-Queisser limit on efficiency. Recently, the mechanism of the primary singlet fission process in pentacene and its derivatives have been extensively investigated, however, the nature of the primary ultrafast process in singlet fission is still a matter of debate. Here, we study the singlet fission process in a pentacene film by employing a combination of transient-grating (TG) and two-dimensional (2D) electronic spectroscopy complemented by quantum chemical and nonadiabatic dynamics calculations. The high sensitivity of heterodyne detected TG spectroscopy enabled us to capture the vibrational coherence and to show that it mediates the transition from the singlet excited electronic state to the triplet-pair state. This coherent process is further examined by 2D electronic spectroscopy. Detailed analysis of the experimental data reveals that significant vibronic couplings of a few key modes in the low- and high-frequency region connect the excited singlet and triplet-pair states. Based on quantum chemical calculations, we identify these key intermolecular rocking modes along the longitudinal molecular axis between the pentacene molecules. They play the essential role of an electronic bridge between the singlet and triplet-pair states. Along with high-frequency local vibrations acting as tuning modes, these rocking motions drive the ultrafast dynamics at the multidimensional conical intersection in the singlet fission process.

physics.chem-ph↗

arXiv2019

Hybrid LBM-FVM and LBM-MCM Methods for Fluid Flow and Heat Transfer Simulation

The fluid flow and heat transfer problems encountered in industry applications span into different scales and there are different numerical methods for different scales problems. It is not possible to use single scale method to solve problems involving multiple scales. Multiscale methods are needed to solve problems involving multiple scales. In this chapter, meso-macro-multiscale methods are developed by combining various single scale numerical methods, including lattice Boltzmann method (LBM), finite volume method (FVM) and Monte Carlo method (MCM). Macroscale methods include FVM, while LBM and MCM belongs to mesoscale methods. Two strategies exist in combing these numerical methods. For the first one, the whole domain is divided into multiple subdomains and different domains use various numerical methods. Message passing among subdomains decides the accuracy of this type of multiscale numerical method. For the second one, various parameters are solved with different numerical methods. These two types of multiscale methods are both discussed in this chapter.

cs.CE↗

arXiv2019

SVGD: A Virtual Gradients Descent Method for Stochastic Optimization

Inspired by dynamic programming, we propose Stochastic Virtual Gradient Descent (SVGD) algorithm where the Virtual Gradient is defined by computational graph and automatic differentiation. The method is computationally efficient and has little memory requirements. We also analyze the theoretical convergence properties and implementation of the algorithm. Experimental results on multiple datasets and network models show that SVGD has advantages over other stochastic optimization methods.

cs.LG↗

arXiv2019

PyOD: A Python Toolbox for Scalable Outlier Detection

PyOD is an open-source Python toolbox for performing scalable outlier detection on multivariate data. Uniquely, it provides access to a wide range of outlier detection algorithms, including established outlier ensembles and more recent neural network-based approaches, under a single, well-documented API designed for use by both practitioners and researchers. With robustness and scalability in mind, best practices such as unit testing, continuous integration, code coverage, maintainability checks, interactive examples and parallelization are emphasized as core components in the toolbox's development. PyOD is compatible with both Python 2 and 3 and can be installed through Python Package Index (PyPI) or https://github.com/yzhao062/pyod.

cs.LG↗

arXiv2019

Learning Symmetric and Asymmetric Steganography via Adversarial Training

Steganography refers to the art of concealing secret messages within multiple media carriers so that an eavesdropper is unable to detect the presence and content of the hidden messages. In this paper, we firstly propose a novel key-dependent steganographic scheme that achieves steganographic objectives with adversarial training. Symmetric (secret-key) and Asymmetric (public-key) steganographic scheme are separately proposed and each scheme is successfully designed and implemented. We show that these encodings produced by our scheme improve the invisibility by 20% than previous deep-leanring-based work, and further that perform competitively remarkable undetectability 25% better than classic steganographic algorithms. Finally, we simulated our scheme in a real situation where the decoder achieved an accuracy of more than 98% of the original message.

cs.CR↗

arXiv2019

CGaP: Continuous Growth and Pruning for Efficient Deep Learning

Today a canonical approach to reduce the computation cost of Deep Neural Networks (DNNs) is to pre-define an over-parameterized model before training to guarantee the learning capacity, and then prune unimportant learning units (filters and neurons) during training to improve model compactness. We argue it is unnecessary to introduce redundancy at the beginning of the training but then reduce redundancy for the ultimate inference model. In this paper, we propose a Continuous Growth and Pruning (CGaP) scheme to minimize the redundancy from the beginning. CGaP starts the training from a small network seed, then expands the model continuously by reinforcing important learning units, and finally prunes the network to obtain a compact and accurate model. As the growth phase favors important learning units, CGaP provides a clear learning purpose to the pruning phase. Experimental results on representative datasets and DNN architectures demonstrate that CGaP outperforms previous pruning-only approaches that deal with pre-defined structures. For VGG-19 on CIFAR-100 and SVHN datasets, CGaP reduces the number of parameters by 78.9% and 85.8%, FLOPs by 53.2% and 74.2%, respectively; For ResNet-110 On CIFAR-10, CGaP reduces 64.0% number of parameters and 63.3% FLOPs.

cs.CV↗

arXiv2019

Towards Efficient Neural Networks On-a-chip: Joint Hardware-Algorithm Approaches

Machine learning algorithms have made significant advances in many applications. However, their hardware implementation on the state-of-the-art platforms still faces several challenges and are limited by various factors, such as memory volume, memory bandwidth and interconnection overhead. The adoption of the crossbar architecture with emerging memory technology partially solves the problem but induces process variation and other concerns. In this paper, we will present novel solutions to two fundamental issues in crossbar implementation of Artificial Intelligence (AI) algorithms: device variation and insufficient interconnections. These solutions are inspired by the statistical properties of algorithms themselves, especially the redundancy in neural network nodes and connections. By Random Sparse Adaptation and pruning the connections following the Small-World model, we demonstrate robust and efficient performance on representative datasets such as MNIST and CIFAR-10. Moreover, we present Continuous Growth and Pruning algorithm for future learning and adaptation on hardware.

cs.NE↗

arXiv2019

Acoustic funnel and buncher for nanoparticle injection

Acoustics-based techniques are investigated to focus and bunch nanoparticle beams. This allows to overcome the prominent problem of the longitudinal and transverse mismatch of particle stream and x-ray beam in single-particle/single molecule imaging at x-ray free-electron lasers (XFEL). It will also enable synchronised injection of particle streams at kHz repetition rates. Transverse focusing concentrates the particle flux to the (sub)micrometer x-ray focus. In the longitudinal direction, focused acoustic waves can be used to bunch the particle to the same repetition rate as the x-ray pulses. The acoustic manipulation is based on simple mechanical recoil effects and could be advantageous over light-pressure-based methods, which rely on absorption. The acoustic equipment is easy to implement and can be conveniently inserted into current XFEL endstations. With the proposed method, data collection times could be reduced by a factor of $10^4$. This work does not just provide an efficient method for acoustic manipulation of streams of arbitrary gas phase particles, but also opens up wide avenues for acoustics-based particle optics.

physics.app-ph↗

arXiv2019

Lightweight Image Super-Resolution with Adaptive Weighted Learning Network

Deep learning has been successfully applied to the single-image super-resolution (SISR) task with great performance in recent years. However, most convolutional neural network based SR models require heavy computation, which limit their real-world applications. In this work, a lightweight SR network, named Adaptive Weighted Super-Resolution Network (AWSRN), is proposed for SISR to address this issue. A novel local fusion block (LFB) is designed in AWSRN for efficient residual learning, which consists of stacked adaptive weighted residual units (AWRU) and a local residual fusion unit (LRFU). Moreover, an adaptive weighted multi-scale (AWMS) module is proposed to make full use of features in reconstruction layer. AWMS consists of several different scale convolutions, and the redundancy scale branch can be removed according to the contribution of adaptive weights in AWMS for lightweight network. The experimental results on the commonly used datasets show that the proposed lightweight AWSRN achieves superior performance on x2, x3, x4, and x8 scale factors to state-of-the-art methods with similar parameters and computational overhead. Code is avaliable at: https://github.com/ChaofWang/AWSRN

cs.CV↗

arXiv2019

Scientific Opportunities with an X-ray Free-Electron Laser Oscillator

An X-ray free-electron laser oscillator (XFELO) is a new type of hard X-ray source that would produce fully coherent pulses with meV bandwidth and stable intensity. The XFELO complements existing sources based on self-amplified spontaneous emission (SASE) from high-gain X-ray free-electron lasers (XFEL) that produce ultra-short pulses with broad-band chaotic spectra. This report is based on discussions of scientific opportunities enabled by an XFELO during a workshop held at SLAC on June 29 - July 1, 2016

physics.ins-det↗