arXiv subjects

Ming Lei

Publications and source records attributed to Ming Lei.

At least 73 records · Page 4Linked to original sources

arXiv2020

Hydrogen plasma favored modification of anatase TiO$_2$ (001) surface with desirable water splitting performance

We show that when TiO$_2$ anatase (001) is exposed to hydrogen plasma that the pristine surface termination becomes unfavorable to another, slightly modified, surface. On this modified surface the topmost TiO$_2$ layer is intact but out of registry with the bottom layers. Nevertheless, the modified surface has significantly improved ability to split water under exposure to sunlight. We show by explicit calculation of the water splitting reaction that the energy barrier that exists on a pristine surface is not present on the modified surface. The valence band maximum of the surface is raised relative to the pristine surface, which is a favorable way of adjusting the band gap in TiO$_2$ to the solar spectrum.

physics.chem-ph↗

arXiv2020

A PDD Decoder for Binary Linear Codes With Neural Check Polytope Projection

Linear Programming (LP) is an important decoding technique for binary linear codes. However, the advantages of LP decoding, such as low error floor and strong theoretical guarantee, etc., come at the cost of high computational complexity and poor performance at the low signal-to-noise ratio (SNR) region. In this letter, we adopt the penalty dual decomposition (PDD) framework and propose a PDD algorithm to address the fundamental polytope based maximum likelihood (ML) decoding problem. Furthermore, we propose to integrate machine learning techniques into the most time-consuming part of the PDD decoding algorithm, i.e., check polytope projection (CPP). Inspired by the fact that a multi-layer perception (MLP) can theoretically approximate any nonlinear mapping function, we present a specially designed neural CPP (NCPP) algorithm to decrease the decoding latency. Simulation results demonstrate the effectiveness of the proposed algorithms.

eess.SP↗

arXiv2020

Learned Conjugate Gradient Descent Network for Massive MIMO Detection

In this work, we consider the use of model-driven deep learning techniques for massive multiple-input multiple-output (MIMO) detection. Compared with conventional MIMO systems, massive MIMO promises improved spectral efficiency, coverage and range. Unfortunately, these benefits are coming at the cost of significantly increased computational complexity. To reduce the complexity of signal detection and guarantee the performance, we present a learned conjugate gradient descent network (LcgNet), which is constructed by unfolding the iterative conjugate gradient descent (CG) detector. In the proposed network, instead of calculating the exact values of the scalar step-sizes, we explicitly learn their universal values. Also, we can enhance the proposed network by augmenting the dimensions of these step-sizes. Furthermore, in order to reduce the memory costs, a novel quantized LcgNet is proposed, where a low-resolution nonuniform quantizer is integrated into the LcgNet to smartly quantize the aforementioned step-sizes. The quantizer is based on a specially designed soft staircase function with learnable parameters to adjust its shape. Meanwhile, due to fact that the number of learnable parameters is limited, the proposed networks are easy and fast to train. Numerical results demonstrate that the proposed network can achieve promising performance with much lower complexity.

eess.SP↗

arXiv2020

Streaming Chunk-Aware Multihead Attention for Online End-to-End Speech Recognition

Recently, streaming end-to-end automatic speech recognition (E2E-ASR) has gained more and more attention. Many efforts have been paid to turn the non-streaming attention-based E2E-ASR system into streaming architecture. In this work, we propose a novel online E2E-ASR system by using Streaming Chunk-Aware Multihead Attention(SCAMA) and a latency control memory equipped self-attention network (LC-SAN-M). LC-SAN-M uses chunk-level input to control the latency of encoder. As to SCAMA, a jointly trained predictor is used to control the output of encoder when feeding to decoder, which enables decoder to generate output in streaming manner. Experimental results on the open 170-hour AISHELL-1 and an industrial-level 20000-hour Mandarin speech recognition tasks show that our approach can significantly outperform the MoChA-based baseline system under comparable setup. On the AISHELL-1 task, our proposed method achieves a character error rate (CER) of 7.39%, to the best of our knowledge, which is the best published performance for online ASR.

cs.SD↗

arXiv2020

SAN-M: Memory Equipped Self-Attention for End-to-End Speech Recognition

End-to-end speech recognition has become popular in recent years, since it can integrate the acoustic, pronunciation and language models into a single neural network. Among end-to-end approaches, attention-based methods have emerged as being superior. For example, Transformer, which adopts an encoder-decoder architecture. The key improvement introduced by Transformer is the utilization of self-attention instead of recurrent mechanisms, enabling both encoder and decoder to capture long-range dependencies with lower computational complexity.In this work, we propose boosting the self-attention ability with a DFSMN memory block, forming the proposed memory equipped self-attention (SAN-M) mechanism. Theoretical and empirical comparisons have been made to demonstrate the relevancy and complementarity between self-attention and the DFSMN memory block. Furthermore, the proposed SAN-M provides an efficient mechanism to integrate these two modules. We have evaluated our approach on the public AISHELL-1 benchmark and an industrial-level 20,000-hour Mandarin speech recognition task. On both tasks, SAN-M systems achieved much better performance than the self-attention based Transformer baseline system. Specially, it can achieve a CER of 6.46% on the AISHELL-1 task even without using any external LM, comfortably outperforming other state-of-the-art systems.

cs.SD↗

arXiv2020

Off-axis optical trapping and transverse spinning of metallic microparticles with a linearly polarized Gaussian beam

Optical trapping of metallic microparticles remains a big challenge because of the strong scattering and absorption of light by the particles. In the paper, we report a new mechanism for stable trapping of metallic microparticles by using a tightly focused linearly polarized Gaussian spot. We theoretically and experimentally demonstrated that metallic microparticles were confined off the optical axis by such a trap. In the meanwhile, transverse spinning motion occurred as a consequence of the asymmetric force field acting on the particle by the trap. The off-axis trapping and transverse spinning of metallic microparticles provide new manners for the manipulation of metallic microparticles. The works reported in this paper are also of significance for a better understanding of the mechanical interaction between light and metallic particles.

physics.optics↗

arXiv2020

ADMM-based Decoder for Binary Linear Codes Aided by Deep Learning

Inspired by the recent advances in deep learning (DL), this work presents a deep neural network aided decoding algorithm for binary linear codes. Based on the concept of deep unfolding, we design a decoding network by unfolding the alternating direction method of multipliers (ADMM)-penalized decoder. In addition, we propose two improved versions of the proposed network. The first one transforms the penalty parameter into a set of iteration-dependent ones, and the second one adopts a specially designed penalty function, which is based on a piecewise linear function with adjustable slopes. Numerical results show that the resulting DL-aided decoders outperform the original ADMM-penalized decoder for various low density parity check (LDPC) codes with similar computational complexity.

cs.IT↗

arXiv2019

Automatic Spelling Correction with Transformer for CTC-based End-to-End Speech Recognition

Connectionist Temporal Classification (CTC) based end-to-end speech recognition system usually need to incorporate an external language model by using WFST-based decoding in order to achieve promising results. This is more essential to Mandarin speech recognition since it owns a special phenomenon, namely homophone, which causes a lot of substitution errors. The linguistic information introduced by language model will help to distinguish these substitution errors. In this work, we propose a transformer based spelling correction model to automatically correct errors especially the substitution errors made by CTC-based Mandarin speech recognition system. Specifically, we investigate using the recognition results generated by CTC-based systems as input and the ground-truth transcriptions as output to train a transformer with encoder-decoder architecture, which is much similar to machine translation. Results in a 20,000 hours Mandarin speech recognition task show that the proposed spelling correction model can achieve a CER of 3.41%, which results in 22.9% and 53.2% relative improvement compared to the baseline CTC-based systems decoded with and without language model respectively.

eess.AS↗

arXiv2018

Subwavelength resolution Fourier ptychography with hemispherical digital condensers

Fourier ptychography (FP) is a promising computational imaging technique that overcomes the physical space-bandwidth product (SBP) limit of a conventional microscope by applying angular diversity illuminations. However, to date, the effective imaging numerical aperture (NA) achievable with a commercial LED board is still limited to the range of 0.3 to 0.7 with a 4X0.1 NA objective due to the constraint of planar geometry with weak illumination brightness and attenuated signal-to-noise ratio (SNR). Thus the highest achievable half-pitch resolution is usually constrained between 500 to 1000 nm, which cannot fulfill some needs of high-resolution biomedical imaging applications. Although it is possible to improve the resolution by using a higher magnification objective with larger NA instead of enlarging the illumination NA, the SBP is suppressed to some extent, making the FP technique less appealing, since the reduction of field-of-view (FOV) is much larger than the improvement of resolution in this FP platform. Herein, in this paper, we initially present a subwavelength resolution Fourier ptychography (SRFP) platform with a hemispherical digital condenser to provide high-angle programmable plane-wave illuminations of 0.95NA, attaining a 4X0.1 NA objective with the final effective imaging performance of 1.05NA at a half-pitch resolution of 244 nm with a wavelength of 465 nm across a wide FOV of 14.60 mm2, corresponding to an SBP of 245 megapixels. Our work provides an essential step of FP towards high-NA imaging applications without scarfing the FOV, making it more practical and appealing.

physics.optics↗

arXiv2018

Linear networks based speaker adaptation for speech synthesis

Speaker adaptation methods aim to create fair quality synthesis speech voice font for target speakers while only limited resources available. Recently, as deep neural networks based statistical parametric speech synthesis (SPSS) methods become dominant in SPSS TTS back-end modeling, speaker adaptation under the neural network based SPSS framework has also became an important task. In this paper, linear networks (LN) is inserted in multiple neural network layers and fine-tuned together with output layer for best speaker adaptation performance. When adaptation data is extremely small, the low-rank plus diagonal(LRPD) decomposition for LN is employed to make the adapted voice more stable. Speaker adaptation experiments are conducted under a range of adaptation utterances numbers. Moreover, speaker adaptation from 1) female to female, 2) male to female and 3) female to male are investigated. Objective measurement and subjective tests show that LN with LRPD decomposition performs most stable when adaptation data is extremely limited, and our best speaker adaptation (SA) model with only 200 adaptation utterances achieves comparable quality with speaker dependent (SD) model trained with 1000 utterances, in both naturalness and similarity to target speaker.

eess.AS↗

arXiv2018

Deep-FSMN for Large Vocabulary Continuous Speech Recognition

In this paper, we present an improved feedforward sequential memory networks (FSMN) architecture, namely Deep-FSMN (DFSMN), by introducing skip connections between memory blocks in adjacent layers. These skip connections enable the information flow across different layers and thus alleviate the gradient vanishing problem when building very deep structure. As a result, DFSMN significantly benefits from these skip connections and deep structure. We have compared the performance of DFSMN to BLSTM both with and without lower frame rate (LFR) on several large speech recognition tasks, including English and Mandarin. Experimental results shown that DFSMN can consistently outperform BLSTM with dramatic gain, especially trained with LFR using CD-Phone as modeling units. In the 2000 hours Fisher (FSH) task, the proposed DFSMN can achieve a word error rate of 9.4% by purely using the cross-entropy criterion and decoding with a 3-gram language model, which achieves a 1.5% absolute improvement compared to the BLSTM. In a 20000 hours Mandarin recognition task, the LFR trained DFSMN can achieve more than 20% relative improvement compared to the LFR trained BLSTM. Moreover, we can easily design the lookahead filter order of the memory blocks in DFSMN to control the latency for real-time applications.

cs.NE↗

arXiv2018

Deep Feed-forward Sequential Memory Networks for Speech Synthesis

The Bidirectional LSTM (BLSTM) RNN based speech synthesis system is among the best parametric Text-to-Speech (TTS) systems in terms of the naturalness of generated speech, especially the naturalness in prosody. However, the model complexity and inference cost of BLSTM prevents its usage in many runtime applications. Meanwhile, Deep Feed-forward Sequential Memory Networks (DFSMN) has shown its consistent out-performance over BLSTM in both word error rate (WER) and the runtime computation cost in speech recognition tasks. Since speech synthesis also requires to model long-term dependencies compared to speech recognition, in this paper, we investigate the Deep-FSMN (DFSMN) in speech synthesis. Both objective and subjective experiments show that, compared with BLSTM TTS method, the DFSMN system can generate synthesized speech with comparable speech quality while drastically reduce model complexity and speech generation time.

cs.CL↗

arXiv2017

Vignetting effect in Fourier ptychographic microscopy

Fourier ptychographic microscopy (FPM) is a computational imaging technique that overcomes the physical space-bandwidth product (SBP) limit of a conventional microscope by applying angular diversity illuminations. In the usual model of FPM, the microscopic system is approximated by being taken as space-invariant with transfer function determined by a complex pupil function of the objective. However, in real experimental conditions, several unexpected "semi-bright and semi-dark" images with strong vignetting effect can be easily observed when the sample is illuminated by the LED within the "transition zone" between bright field and dark field. These imperfect images, apparently, are not coincident with the space-invariant model and could deteriorate the reconstruction quality severely. In this Letter, we examine the impact of this space-invariant approximation on FPM image formation based on ray-based and rigorous wave optics-based analysis. Our analysis shows that for a practical FPM microscope with a low power objective and a large field of view, the space invariance is destroyed by diffraction at other stops associated with different lens elements to a large extent. A modified version of the space-variant model is derived and discussed. Two simple countermeasures are also presented and experimentally verified to bypass or partially alleviate the vignetting-induced reconstruction artifacts.

physics.optics↗

arXiv2017

SNR-based adaptive acquisition method for fast Fourier ptychographic microscopy

Fourier ptychographic microscopy (FPM) is a computational imaging technique with both high resolution and large field-of-view. However, the effective numerical aperture (NA) achievable with a typical LED panel is ambiguous and usually relies on the repeated tests of different illumination NAs. The imaging quality of each raw image usually depends on the visual assessments, which is subjective and inaccurate especially for those dark field images. Moreover, the acquisition process is really time-consuming.In this paper, we propose a SNR-based adaptive acquisition method for quantitative evaluation and adaptive collection of each raw image according to the signal-to-noise ration (SNR) value, to improve the FPM's acquisition efficiency and automatically obtain the maximum achievable NA, reducing the time of collection, storage and subsequent calculation. The widely used EPRY-FPM algorithm is applied without adding any algorithm complexity and computational burden. The performance has been demonstrated in both USAF targets and biological samples with different imaging sensors respectively, which have either Poisson or Gaussian noises model. Further combined with the sparse LEDs strategy, the number of collection images can be shorten to around 25 frames while the former needs 361 images, the reduction ratio can reach over 90%. This method will make FPM more practical and automatic, and can also be used in different configurations of FPM.

eess.IV↗

arXiv2017

Sparse Digital Cancellation of Receiver Nonlinear Distortion in Carrier Aggregation Systems

In carrier-aggregation systems, digital baseband cancelation of self-interference generated by receiver nonlinearity requires the estimation of several reference signals contributions. As the nonlinearity order and frequency selectivity of the chip response increase, the number of reference signals significantly increases rendering the estimation of their contributions more complex. We propose a sparsity-based approach for the selection of the reference signals to match the distortion interference using a few reference signals. Simulation results show significant performance improvement over prior art with the same complexity.

cs.IT↗

arXiv2017

Data preprocessing methods for robust Fourier ptychographic microscopy

Fourier ptychographic microscopy (FPM) is a recently proposed computational imaging technique with both high resolution and wide field-of-view. In current FP experimental setup, the dark-field images with high-angle illuminations are easily submerged by stray light and background noise due to the low signal-to-noise ratio, thus significantly degrading the reconstruction quality and also imposing a major restriction on the synthetic numerical aperture (NA) of the FP approach. To this end, an overall and systematic data preprocessing scheme for noise removal from FP's raw dataset is provided, which involves sampling analysis as well as underexposed/overexposed treatments, then followed by the elimination of unknown stray light and suppression of inevitable background noise, especially Gaussian noise and CCD dark current in our experiments. The reported non-parametric scheme facilitates great enhancements of the FP's performance, which has been demonstrated experimentally that the benefits of noise removal by these methods far outweigh its defects of concomitant signal loss. In addition, it could be flexibly cooperated with the existing state-of-the-art algorithms, producing a stronger robustness of the FP approach in various applications.

cs.CV↗

arXiv2014

A Framework of Performance Analysis for Distributed Antenna Systems Based on Random Matrix Theory

Future communications systems will definitely be built on green infrastructures. To realize such a goal, recently a new network infrastructure named cloud radio access network (C-RAN) is proposed by China Mobile to enhance network coverage and save energy simultaneously. In C-RANs, to order to save more energy the radio front ends are separated from the colocated baseband units and distributively located in physical positions. C-RAN can be recognized as a variant of distributed antenna systems (DASs). In this paper we analyze the performance of C-RANS using random matrix theory. Due to the fact that the antennas are distributed geographically instead of being installed nearby, the variances of the entries in the considered channel matrix are different from each other. To the best of the authors' knowledge, the work on random matrices with elements having different variances is largely open, which is of great importance for DASs. In our work, some fundamental results on the eigenvalue distributions of the random matrices with different variances are derived first. Then based on these fundamental conclusions the outage probability of the considered DAS is derived. Finally, the accuracy of our analytical results is assessed by some numerical results.

cs.IT↗

arXiv2014

Quantized CSI-Based Tomlinson-Harashima Precoding in Multiuser MIMO Systems

This paper considers the implementation of Tomlinson-Harashima (TH) precoding for multiuser MIMO systems based on quantized channel state information (CSI) at the transmitter side. Compared with the results in [1], our scheme applies to more general system setting where the number of users in the system can be less than or equal to the number of transmit antennas. We also study the achievable average sum rate of the proposed quantized CSI-based TH precoding scheme. The expressions of the upper bounds on both the average sum rate of the systems with quantized CSI and the mean loss in average sum rate due to CSI quantization are derived. We also present some numerical results. The results show that the nonlinear TH precoding can achieve much better performance than that of linear zero-forcing precoding for both perfect CSI and quantized CSI cases. In addition, our derived upper bound on the mean rate loss for TH precoding converges to the true rate loss faster than that of zeroforcing precoding obtained in [2] as the number of feedback bits becomes large. Both the analytical and numerical results show that nonlinear precoding suffers from imperfect CSI more than linear precoding does.

cs.IT↗