arXiv subjects

Lei Yang

Publications and source records attributed to Lei Yang.

At least 451 records · Page 25Linked to original sources

arXiv2020

Hardware/Software Co-Exploration of Neural Architectures

We propose a novel hardware and software co-exploration framework for efficient neural architecture search (NAS). Different from existing hardware-aware NAS which assumes a fixed hardware design and explores the neural architecture search space only, our framework simultaneously explores both the architecture search space and the hardware design space to identify the best neural architecture and hardware pairs that maximize both test accuracy and hardware efficiency. Such a practice greatly opens up the design freedom and pushes forward the Pareto frontier between hardware efficiency and test accuracy for better design tradeoffs. The framework iteratively performs a two-level (fast and slow) exploration. Without lengthy training, the fast exploration can effectively fine-tune hyperparameters and prune inferior architectures in terms of hardware specifications, which significantly accelerates the NAS process. Then, the slow exploration trains candidates on a validation set and updates a controller using the reinforcement learning to maximize the expected accuracy together with the hardware efficiency. Experiments on ImageNet show that our co-exploration NAS can find the neural architectures and associated hardware design with the same accuracy, 35.24% higher throughput, 54.05% higher energy efficiency and 136x reduced search time, compared with the state-of-the-art hardware-aware NAS.

cs.LG↗

arXiv2019

Toward accurate measurement of property-dependent galaxy clustering I. Comparison of the Vmax method and the "shuffled" method

Galaxy clustering provides insightful clues to our understanding of galaxy formation and evolution, as well as the universe. The redshift assignment for the random sample is one of the key steps to measure the galaxy clustering accurately. In this paper, by virtue of the mock galaxy catalogs, we investigate the effect of two redshift assignment methods on the measurement of galaxy two-point correlation functions (hereafter 2PCFs), the Vmax method and the "shuffled" method. We found that the shuffled method significantly underestimates both of the projected 2PCFs and the two-dimensional 2PCFs in redshift space. While the Vmax method does not show any notable bias on the 2PCFs for volume-limited samples. For flux-limited samples, the bias produced by the Vmax method is less than half of the shuffled method on large scales. Therefore, we strongly recommend the Vmax method to assign redshifts to random samples in the future galaxy clustering analysis.

astro-ph.CO↗

arXiv2019

Calculation of the $B\to K_{0,2}^*(1430)f_0(980)/σ$ decays in the Perturbative QCD Approach

Motivated by the observations of the decays $B^0 \to K_0^{*}(1430)^0 f_0(980)$ and $ B^0 \to K_2^{*}(1430)^0 f_0(980)$ from BaBar collaboration, we study the $B^{0(+)} \to K_{0,2}^{*}(1430)^{0(+)} f_0(980)/σ$ decays in the perturbative QCD approach for the first time. In the absence of reliable nonperturbative wave functions we only assume the scalar meson $f_0(980)$ and $σ$ are two-quark ground states. In our calculations, these decays are all dominated by the hard-scattering emission and annihilation diagrams, while the factorizable emission diagrams are forbidden or suppressed heavily by the vector decay constants. Furthermore, the branching fractions are sensitive to the mixing between $f_0(980)$ and $σ$. Comparing our results with the experimental data, a large mixing angle $θ$ is favored. Taking $θ=145^\circ$, the orders of branching fractions of $B \to K_0^{*}(1430)^0 σ$, $B \to K_{2}^{*}(1430)^0 σ$ and $B \to K_{0,2}^{*}(1430)^0 f_0(980)$ are predicted to be $10^{-4}$, $10^{-5}$ and $10^{-6}$, respectively, which can be measured in the current experiments such as LHCb and Belle-2. In addition, although these decays are penguin dominant, the mixing also leads to large direct $CP$ asymmetries in these decays. With the precise data in future, our results could shed light on the inner structure of the scalar mesons and can be used to determine the mixing angle of the $σ-f_0(980)$ system.

hep-ph↗

arXiv2019

Numerical study of vanishing and spreading dynamics of chemotaxis systems with logistic source and a free boundary

The current paper is to investigate the numerical approximation of logistic type chemotaxis models in one space dimension with a free boundary. Such a model with a free boundary describes the spreading of a new or invasive species subject to the influence of some chemical substances in an environment with a free boundary representing the spreading front (see Bao and Shen [1], [2]). The main challenges in the numerical studies lie in tracking the moving free boundary and the nonlinear terms from chemical. To overcome them, a front fixing framework coupled with finite difference method is introduced. The accuracy of the proposed method, the positivity of the solution, and the stability of the scheme are discussed.The numerical simulations agree well with theoretical results such as the vanishing spreading dichotomy, local persistence, and stability. These simulations also validate some conjectures in our future theoretical studies such as the dependence of the vanishing-spreading dichotomy on the initial solution u0, initial habitat h0, the moving speed ν and the chemotactic sensitivity coefficients \c{hi}1,\c{hi}2.

math.NA↗

arXiv2019

A Pvalue-guided Anomaly Detection Approach Combining Multiple Heterogeneous Log Parser Algorithms on IIoT Systems

Industrial Internet of Things (IIoT) is becoming an attack target of advanced persistent threat (APT). Currently, IIoT logs have not been effectively used for anomaly detection. In this paper, we use blockchain to prevent logs from being tampered with and propose a pvalue-guided anomaly detection approach. This approach uses statistical pvalues to combine multiple heterogeneous log parser algorithms. The weighted edit distance is selected as a score function to calculate the nonconformity score between a log and a predefined event. The pvalue is calculated based on the non-conformity scores which indicate how well a log matches an event. This approach is tested on a large number of real-world HDFS logs and IIoT logs. The experiment results show that abnormal events could be effectively recognized by our pvalue-guided approach.

cs.CR↗

arXiv2019

Learning to Cluster Faces on an Affinity Graph

Face recognition sees remarkable progress in recent years, and its performance has reached a very high level. Taking it to a next level requires substantially larger data, which would involve prohibitive annotation cost. Hence, exploiting unlabeled data becomes an appealing alternative. Recent works have shown that clustering unlabeled faces is a promising approach, often leading to notable performance gains. Yet, how to effectively cluster, especially on a large-scale (i.e. million-level or above) dataset, remains an open question. A key challenge lies in the complex variations of cluster patterns, which make it difficult for conventional clustering methods to meet the needed accuracy. This work explores a novel approach, namely, learning to cluster instead of relying on hand-crafted criteria. Specifically, we propose a framework based on graph convolutional network, which combines a detection and a segmentation module to pinpoint face clusters. Experiments show that our method yields significantly more accurate face clusters, which, as a result, also lead to further performance gain in face recognition.

cs.CV↗

arXiv2019

Adaptive Intelligent Secondary Control of Microgrids Using a Biologically-Inspired Reinforcement Learning

In this paper, a biologically-inspired adaptive intelligent secondary controller is developed for microgrids to tackle system dynamics uncertainties, faults, and/or disturbances. The developed adaptive biologically-inspired controller adopts a novel computational model of emotional learning in mammalian limbic system. The learning capability of the proposed biologically-inspired intelligent controller makes it a promising approach to deal with the power system non-linear and volatile dynamics without increasing the controller complexity, and maintain the voltage and frequency stabilities by using an efficient reference tracking mechanism. The performance of the proposed intelligent secondary controller is validated in terms of the voltage and frequency absolute errors in the simulated microgrid. Simulation results highlight the efficiency and robustness of the proposed intelligent controller under the fault conditions and different system uncertainties compared to other benchmark controllers.

eess.SY↗

arXiv2019

Divergent trajectories under diagonal geodesic flow and splitting of discrete subgroups of $\mathrm{SO}(n,1) \times \mathrm{SO}(n,1)$

Let $H = \mathrm{SO}(n,1)$ and $A = \{a(t): t \in \mathbb{R}\}$ be a maximal $\mathbb{R}$-split Cartan subgroup of $H$. Let $Γ\subset H \times H$ be a nonuniform lattice in $H \times H$ and $X_Γ : = H \times H/ Γ$. Let $A_2 : = \{ a_2(t):=a(t) \times a(t) : t \in \mathbb{R}\} \subset A\times A$ on $X_Γ$ and $\mathcal{D}_Γ\subset X_Γ$ denote the collection of points $x \in X_Γ$ such that $a_2(t)x$ diverges as $t \rightarrow +\infty$. In this note, we will show that if the Hausdorff dimension of $\mathcal{D}_Γ$ is greater than $\dim (H\times H) - 2(n-1)$, then $Γ$ is essentially split, namely, it contains a subgroup of finite index of form $Γ_1 \times Γ_2 $, where $Γ_1$ and $Γ_2$ are both lattices in $H$.

math.DS↗

arXiv2019

Badly approximable points on manifolds and unipotent orbits in homogeneous spaces

In this paper, we study the weighted $n$-dimensional badly approximable points on manifolds. Given a $C^n$ differentiable non-degenerate submanifold $\mathcal{U} \subset \mathbb{R}^n$, we will show that any countable intersection of the sets of the weighted badly approximable points on $\mathcal{U}$ has full Hausdorff dimension. This strengthens a result of Beresnevich by removing the condition on weights and weakening the smoothness condition on manifolds. Compared to the work of Beresnevich, our approach relies on homogeneous dynamics. It turns out that in order to solve this problem, it is crucial to study the distribution of long pieces of unipotent orbits in homogeneous spaces. The proof relies on the linearization technique and representations of $\mathrm{SL}(n+1,\mathbb{R})$.

math.NT↗

arXiv2019

On the Performance Gain of NOMA over OMA in Uplink Communication Systems

In this paper, we investigate and reveal the ergodic sum-rate gain (ESG) of non-orthogonal multiple access (NOMA) over orthogonal multiple access (OMA) in uplink cellular communication systems. A base station equipped with a single-antenna, with multiple antennas, and with massive antenna arrays is considered both in single-cell and multi-cell deployments. In particular, in single-antenna systems, we identify two types of gains brought about by NOMA: 1) a large-scale near-far gain arising from the distance discrepancy between the base station and users; 2) a small-scale fading gain originating from the multipath channel fading. Furthermore, we reveal that the large-scale near-far gain increases with the normalized cell size, while the small-scale fading gain is a constant, given by $γ$ = 0.57721 nat/s/Hz, in Rayleigh fading channels. When extending single-antenna NOMA to $M$-antenna NOMA, we prove that both the large-scale near-far gain and small-scale fading gain achieved by single-antenna NOMA can be increased by a factor of $M$ for a large number of users. Moreover, given a massive antenna array at the base station and considering a fixed ratio between the number of antennas, $M$, and the number of users, $K$, the ESG of NOMA over OMA increases linearly with both $M$ and $K$. We then further extend the analysis to a multi-cell scenario. Compared to the single-cell case, the ESG in multi-cell systems degrades as NOMA faces more severe inter-cell interference due to the non-orthogonal transmissions. Besides, we unveil that a large cell size is always beneficial to the ergodic sum-rate performance of NOMA in both single-cell and multi-cell systems. Numerical results verify the accuracy of the analytical results derived and confirm the insights revealed about the ESG of NOMA over OMA in different scenarios.

cs.IT↗

arXiv2019

Using the Modified Nearest Neighbor Method to Correct Fiber-collision Effects on Galaxy Clustering

Fiber collision is a persistent problem faced by modern spectroscopic galaxy surveys. In this work, we propose a new method to correct for this undesired effect, focusing on the clustering from the fiber-collision scale up to $\lesssim 10 \rm Mpc\,h^{-1}$. We assume that the fiber-collided galaxies are in association with their nearest three angular neighbors. Compared with the conventional nearest-neighbor method, we have properly accounted for the foreground (background) galaxies that are associated with the foreground (background) cosmic webs relative to the nearest neighbor. We have tested the new method with mock catalogs of the Sloan Digital Sky Survey (SDSS) Data Release 7 (DR7). The test demonstrates that our new method can recover the projected two-point correlation functions at an accuracy better than 1\% on small (below the fiber-collision scale) to intermediate (i.e., $10 \rm Mpc\,h^{-1}$) scales, where the fiber collision takes effect and the SDSS main sample can probe. The new method also gives a better recovery of the redshift-space correlation functions almost on all scales that we are interested in.

astro-ph.CO↗

arXiv2019

On the Performance Gain of NOMA over OMA in Uplink Single-cell Systems

In this paper, we investigate the performance gain of non-orthogonal multiple access (NOMA) over orthogonal multiple access (OMA) in uplink single-cell systems. In both single-antenna and multi-antenna scenarios, the performance gain of NOMA over OMA in terms of asymptotic ergodic sum-rate is analyzed for a sufficiently large number of users. In particular, in single-antenna systems, we identify two types of near-far gains brought by NOMA: 1) the large-scale near-far gain via exploiting the large-scale fading increases with the cell size; 2) the small-scale near-far gain via exploiting the small-scale fading is a constant given by $γ= 0.57721$ nat/s/Hz in Rayleigh fading channels. Furthermore, we have analyzed that the performance gain achieved by single-antenna NOMA can be amplified via increasing the number of antennas equipped at the base station due to the extra spatial degrees of freedom. The numerical results confirm the accuracy of the derived analyses and unveil the performance gains of NOMA over OMA in different scenarios.

cs.IT↗

arXiv2019

Accuracy vs. Efficiency: Achieving Both through FPGA-Implementation Aware Neural Architecture Search

A fundamental question lies in almost every application of deep neural networks: what is the optimal neural architecture given a specific dataset? Recently, several Neural Architecture Search (NAS) frameworks have been developed that use reinforcement learning and evolutionary algorithm to search for the solution. However, most of them take a long time to find the optimal architecture due to the huge search space and the lengthy training process needed to evaluate each candidate. In addition, most of them aim at accuracy only and do not take into consideration the hardware that will be used to implement the architecture. This will potentially lead to excessive latencies beyond specifications, rendering the resulting architectures useless. To address both issues, in this paper we use Field Programmable Gate Arrays (FPGAs) as a vehicle to present a novel hardware-aware NAS framework, namely FNAS, which will provide an optimal neural architecture with latency guaranteed to meet the specification. In addition, with a performance abstraction model to analyze the latency of neural architectures without training, our framework can quickly prune architectures that do not satisfy the specification, leading to higher efficiency. Experimental results on common data set such as ImageNet show that in the cases where the state-of-the-art generates architectures with latencies 7.81x longer than the specification, those from FNAS can meet the specs with less than 1% accuracy loss. Moreover, FNAS also achieves up to 11.13x speedup for the search process. To the best of the authors' knowledge, this is the very first hardware aware NAS.

cs.DC↗

arXiv2019

Enhanced Quasi-Maximum Likelihood Decoding of Short LDPC Codes based on Saturation

In this paper, we propose an enhanced quasi-maximum likelihood (EQML) decoder for LDPC codes with short block lengths. After the failure of the conventional belief propagation (BP) decoding, the proposed EQML decoder selects unreliable variable nodes (VNs) and saturates their associated channel output values to generate a list of decoder input sequences. Each decoder input sequence in the list is then decoded by the conventional BP decoder to obtain the most likely codeword. To improve the accuracy of selecting unreliable VNs, we propose an edge-wise selection method based on the sign fluctuation of VNs' extrinsic messages. A partial pruning stopping (PPS) rule is also presented to reduce the decoding latency. Simulation results show that the proposed EQML decoder outperforms the conventional BP decoder and the augmented BP decoder for short LDPC codes. It even approaches the performance of ML decoding within 0.3 dB in terms of frame error rate. In addition, the proposed PPS rule achieves a lower decoding latency compared to the list decoding stopping rule.

cs.IT↗

arXiv2019

RPC: A Large-Scale Retail Product Checkout Dataset

Over recent years, emerging interest has occurred in integrating computer vision technology into the retail industry. Automatic checkout (ACO) is one of the critical problems in this area which aims to automatically generate the shopping list from the images of the products to purchase. The main challenge of this problem comes from the large scale and the fine-grained nature of the product categories as well as the difficulty for collecting training images that reflect the realistic checkout scenarios due to continuous update of the products. Despite its significant practical and research value, this problem is not extensively studied in the computer vision community, largely due to the lack of a high-quality dataset. To fill this gap, in this work we propose a new dataset to facilitate relevant research. Our dataset enjoys the following characteristics: (1) It is by far the largest dataset in terms of both product image quantity and product categories. (2) It includes single-product images taken in a controlled environment and multi-product images taken by the checkout system. (3) It provides different levels of annotations for the check-out images. Comparing with the existing datasets, ours is closer to the realistic setting and can derive a variety of research problems. Besides the dataset, we also benchmark the performance on this dataset with various approaches. The dataset and related resources can be found at \url{https://rpc-dataset.github.io/}.

cs.CV↗

arXiv2018

Rebooting Ultrasonic Positioning Systems for Ultrasound-incapable Smart Devices

An ultrasonic Positioning System (UPS) has outperformed RF-based systems in terms of its accuracy for years. However, few of the developed solutions have been deployed in practice to satisfy the localization demand of today's smart devices, which lack ultrasonic sensors and were considered as being `deaf' to ultrasound. A recent finding demonstrates that ultrasound may be audible to the smart devices under certain conditions due to their microphone's nonlinearity. Inspired by this insight, this work revisits the ultrasonic positioning technique and builds a practical UPS, called UPS+ for ultrasound-incapable smart devices. The core concept is to deploy two types of indoor beacon devices, which will advertise ultrasonic beacons at two different ultrasonic frequencies respectively. Their superimposed beacons are shifted to a low-frequency by virtue of the nonlinearity effect at the receiver's microphone. This underlying property functions as an implicit ultrasonic downconverter without throwing harm to the hearing system of humans. We demonstrate UPS+, a fully functional UPS prototype, with centimeter-level localization accuracy using custom-made beacon hardware and well-designed algorithms.

cs.NI↗

arXiv2018

A Comparison of CP-OFDM, PCC-OFDM and UFMC for 5G Uplink Communications

Polynomial-cancellation-coded orthogonal frequency division multiplexing (PCC-OFDM) is a form of OFDM that has waveforms which are very well localized in both the time and frequency domains and so it is ideally suited for use in the 5G network. This paper analyzes the performance of PCC-OFDM in the uplink of a multiuser system using orthogonal frequency division multiple access (OFDMA) and compares it with conventional cyclic prefix OFDM (CP-OFDM), and universal filtered multicarrier (UFMC). PCC-OFDM is shown to be much less sensitive than either CP-OFDM or UFMC to time and frequency offsets. For a given constellation size, PCC-OFDM in additive white Gaussian noise (AWGN) requires 3dB lower signal-to-noise ratio (SNR) for a given bit-error-rate, and the SNR advantage of PCC-OFDM increases rapidly when there are timing and/or frequency offsets. For PCC-OFDM no frequency guard band is required between different OFDMA users. PCC-OFDM is completely compatible with CP-OFDM and adds negligible complexity and latency, as it uses a simple mapping of data onto pairs of subcarriers at the transmitter, and a simple weighting-and-adding of pairs of subcarriers at the receiver. The weighting and adding step, which has been omitted in some of the literature, is shown to contribute substantially to the SNR advantage of PCC-OFDM. A disadvantage of PCC-OFDM (without overlapping) is the potential reduction in spectral efficiency because subcarriers are modulated in pairs, but this reduction is more than regained because no guard band or cyclic prefix is required and because, for a given channel, larger constellations can be used.

eess.SP↗

arXiv2018

Joint Trajectory and Resource Allocation Design for UAV Communication Systems

In this paper, we investigate resource allocation design for unmanned aerial vehicle (UAV)-enabled communication systems, where a UAV is dispatched to provide communications to multiple user nodes. Our objective is to maximize the communication system throughput by jointly optimizing the subcarrier allocation policy and the trajectory of the UAV, while taking into account the minimum required data rate for each user node, no-fly zones (NFZs), the maximum UAV cruising speed, and initial/final UAV locations. The design is formulated as a mixed integer non-convex optimization problem which is generally intractable. Subsequently, a computationally-efficient iterative algorithm is proposed to obtain a locally optimal solution. Simulation results illustrate that the performance of the proposed iterative algorithm approaches closely to that of the system without NFZ. In addition, the proposed algorithm can achieve a significant throughput gain compared to various benchmark schemes.

cs.IT↗