arXiv subjects

Xuyang Wang

Publications and source records attributed to Xuyang Wang.

47 records · Page 3Linked to original sources

arXiv2021

TransfoRNN: Capturing the Sequential Information in Self-Attention Representations for Language Modeling

In this paper, we describe the use of recurrent neural networks to capture sequential information from the self-attention representations to improve the Transformers. Although self-attention mechanism provides a means to exploit long context, the sequential information, i.e. the arrangement of tokens, is not explicitly captured. We propose to cascade the recurrent neural networks to the Transformers, which referred to as the TransfoRNN model, to capture the sequential information. We found that the TransfoRNN models which consists of only shallow Transformers stack is suffice to give comparable, if not better, performance than a deeper Transformer model. Evaluated on the Penn Treebank and WikiText-2 corpora, the proposed TransfoRNN model has shown lower model perplexities with fewer number of model parameters. On the Penn Treebank corpus, the model perplexities were reduced up to 5.5% with the model size reduced up to 10.5%. On the WikiText-2 corpus, the model perplexity was reduced up to 2.2% with a 27.7% smaller model. Also, the TransfoRNN model was applied on the LibriSpeech speech recognition task and has shown comparable results with the Transformer models.

cs.CL↗

arXiv2021

The 2020 Personalized Voice Trigger Challenge: Open Database, Evaluation Metrics and the Baseline Systems

The 2020 Personalized Voice Trigger Challenge (PVTC2020) addresses two different research problems a unified setup: joint wake-up word detection with speaker verification on close-talking single microphone data and far-field multi-channel microphone array data. Specially, the second task poses an additional cross-channel matching challenge on top of the far-field condition. To simulate the real-life application scenario, the enrollment utterances are recorded from close-talking cell-phone only, while the test utterances are recorded from both the close-talking cell-phone and the far-field microphone arrays. This paper introduces our challenge setup and the released database as well as the evaluation metrics. In addition, we present a joint end-to-end neural network baseline system trained with the proposed database for speaker-dependent wake-up word detection. Results show that the cost calculated from the miss rate and the false alarm rate, can reach 0.37 in the close-talking single microphone task and 0.31 in the far-field microphone array task. The official website and the open-source baseline system have been released.

eess.AS↗

arXiv2020

Exploring Voice Conversion based Data Augmentation in Text-Dependent Speaker Verification

In this paper, we focus on improving the performance of the text-dependent speaker verification system in the scenario of limited training data. The speaker verification system deep learning based text-dependent generally needs a large scale text-dependent training data set which could be labor and cost expensive, especially for customized new wake-up words. In recent studies, voice conversion systems that can generate high quality synthesized speech of seen and unseen speakers have been proposed. Inspired by those works, we adopt two different voice conversion methods as well as the very simple re-sampling approach to generate new text-dependent speech samples for data augmentation purposes. Experimental results show that the proposed method significantly improves the Equal Error Rare performance from 6.51% to 4.51% in the scenario of limited training data.

cs.SD↗

arXiv2020

Training Wake Word Detection with Synthesized Speech Data on Confusion Words

Confusing-words are commonly encountered in real-life keyword spotting applications, which causes severe degradation of performance due to complex spoken terms and various kinds of words that sound similar to the predefined keywords. To enhance the wake word detection system's robustness on such scenarios, we investigate two data augmentation setups for training end-to-end KWS systems. One is involving the synthesized data from a multi-speaker speech synthesis system, and the other augmentation is performed by adding random noise to the acoustic feature. Experimental results show that augmentations help improve the system's robustness. Moreover, by augmenting the training set with the synthetic data generated by the multi-speaker text-to-speech system, we achieve a significant improvement regarding confusing words scenario.

cs.LG↗

arXiv2020

Mask Detection and Breath Monitoring from Speech: on Data Augmentation, Feature Representation and Modeling

This paper introduces our approaches for the Mask and Breathing Sub-Challenge in the Interspeech COMPARE Challenge 2020. For the mask detection task, we train deep convolutional neural networks with filter-bank energies, gender-aware features, and speaker-aware features. Support Vector Machines follows as the back-end classifiers for binary prediction on the extracted deep embeddings. Several data augmentation schemes are used to increase the quantity of training data and improve our models' robustness, including speed perturbation, SpecAugment, and random erasing. For the speech breath monitoring task, we investigate different bottleneck features based on the Bi-LSTM structure. Experimental results show that our proposed methods outperform the baselines and achieve 0.746 PCC and 78.8% UAR on the Breathing and Mask evaluation set, respectively.

eess.AS↗

arXiv2020

Acoustic Word Embedding System for Code-Switching Query-by-example Spoken Term Detection

In this paper, we propose a deep convolutional neural network-based acoustic word embedding system on code-switching query by example spoken term detection. Different from previous configurations, we combine audio data in two languages for training instead of only using one single language. We transform the acoustic features of keyword templates and searching content to fixed-dimensional vectors and calculate the distances between keyword segments and searching content segments obtained in a sliding manner. An auxiliary variability-invariant loss is also applied to training data within the same word but different speakers. This strategy is used to prevent the extractor from encoding undesired speaker- or accent-related information into the acoustic word embeddings. Experimental results show that our proposed system produces promising searching results in the code-switching test scenario. With the increased number of templates and the employment of variability-invariant loss, the searching performance is further enhanced.

eess.AS↗

arXiv2020

A CNN-Based Blind Denoising Method for Endoscopic Images

The quality of images captured by wireless capsule endoscopy (WCE) is key for doctors to diagnose diseases of gastrointestinal (GI) tract. However, there exist many low-quality endoscopic images due to the limited illumination and complex environment in GI tract. After an enhancement process, the severe noise become an unacceptable problem. The noise varies with different cameras, GI tract environments and image enhancement. And the noise model is hard to be obtained. This paper proposes a convolutional blind denoising network for endoscopic images. We apply Deep Image Prior (DIP) method to reconstruct a clean image iteratively using a noisy image without a specific noise model and ground truth. Then we design a blind image quality assessment network based on MobileNet to estimate the quality of the reconstructed images. The estimated quality is used to stop the iterative operation in DIP method. The number of iterations is reduced about 36% by using transfer learning in our DIP process. Experimental results on endoscopic images and real-world noisy images demonstrate the superiority of our proposed method over the state-of-the-art methods in terms of visual quality and quantitative metrics.

eess.IV↗

arXiv2018

Advantages of the coherent state compared with squeeze state in unidimensional continuous variable quantum key distribution

In this work, a comparison study between unidimensional (UD) coherent-state and UD squeeze-state protocols is performed in the continuous variable quantum key distribution domain. First, the UD squeeze-state protocol is proposed and the equivalence between the prepare-and-measure and entanglement-based schemes of UD squeeze-state protocol is proved. Then, the security of the UD squeeze-state protocol under collective attack in realistic conditions is analyzed. Lastly, the performances of the two UD protocols are analyzed. Based on the uniform expressions established in our study, the squeeze-state and coherent-state protocols can be analyzed simultaneously. Our results show that the UD squeeze-state protocols are quite different from the two-dimensional protocols in that the UD squeeze-state protocols have a poorer performance compared with UD coherent-state protocols, which is opposite in the case of two-dimensional protocols.

quant-ph↗

arXiv2018

Finding and breaking the realistic rate-distance limit of continuous variable quantum key distribution

In this work, the rate-distance limit of continuous variable quantum key distribution is studied. We find that the excess noise generated on Bob's side and the method for calculating the excess noise restrict the rate-distance limit. Then, a realistic rate-distance limit is found. To break the realistic limit, a method for calculating the secret key rate using pure excess noise is proposed. The improvement in the rate-distance limit due to a higher reconciliation efficiency is analyzed. It is found that this improvement is dependent on the excess noise. From a finite-size analysis, the monotonicity of the Holevo bound versus the transmission efficiency is studied, and a tighter rate-distance limit is presented.

quant-ph↗

arXiv2017

Low temperature synthesis of heterostructures of transition metal dichalcogenide alloys (WxMo1-xS2) and graphene with superior catalytic performance for hydrogen evolution

Large-area ($\sim$cm$^2$) films of vertical heterostructures formed by alternating graphene and transition-metal dichalcogenide(TMD) alloys are obtained by wet chemical routes followed by a thermal treatment at low temperature (300 $^\circ$C). In particular, we synthesized stacked graphene and W$_x$Mo$_{1-x}$S$_2$ alloy phases that were used as hydrogen evolution catalysts. We observed a Tafel slope of 38.7 mV dec$^{-1}$ and 96 mV onset potential (at current density of 10 mA cm$^{-2}$) when the heterostructure alloy is annealed at 300 $^o$C. These results indicate that heterostructure formed by graphene and W$_{0.4}$Mo$_{0.6}$S$_2$ alloys are far more efficient than WS$_2$ and MoS$_2$ by at least a factor of two, and it is superior than any other reported TMD system. This strategy offers a cheap and low temperature synthesis alternative able to replace Pt in the hydrogen evolution reaction (HER). Furthermore, the catalytic activity of the alloy is stable over time, i.e. the catalytic activity does not experience a significant change even after 1000 cycles. Using density functional theory calculations, we found that this enhanced hydrogen evolution in the W$_x$Mo$_{1-x}$S$_2$ alloys is mainly due to the lower energy barrier created by a favorable overlap of the d-orbitals from the transition metals and the s-orbitals of H$_2$, with the lowest energy barrier occurring for W$_{0.4}$Mo$_{0.6}$S$_2$ alloy. Thus, it is now possible to further improve the performance of the "inert" TMD basal plane via metal alloying, in addition to the previously reported strategies of creation of point defects, vacancies and edges. The synthesis of graphene/W$_{0.4}$Mo$_{0.6}$S$_2$ produced at relatively low temperatures is scalable and could be used as an effective low cost Pt-free catalyst.

cond-mat.mtrl-sci↗

arXiv2015

Orbital Angular Momentum (OAM) Vertical-Cavity Surface-Emitting Lasers

Harnessing the Orbital Angular Momentum (OAM) of light is an appealing approach to developing photonic technologies for future applications in optical communications and high- dimensional Quantum Key Distributions (QKD). An outstanding challenge to the widespread uptake of the OAM resource is its efficient generation. We design a new device which can directly emit an OAM-carrying light beam. By fabricating micro-scale Spiral Phase Plates (SPPs) within the aperture of a Vertical-Cavity Surface-Emitting Laser (VCSELs), the linearly polarized Gaussian beam emitted by the VCSEL is converted into a beam carrying specific OAM modes and their superposition states with high efficiency and high beam quality. The innovative OAM emitter opens a new horizon in the field of OAM-based optical and quantum communications, especially for short reach data interconnects and Quantum Key Distribution (QKD).

physics.optics↗