arXiv subjects

Liang He

Publications and source records attributed to Liang He.

At least 289 records · Page 16Linked to original sources

arXiv2019

Latent Class Model with Application to Speaker Diarization

In this paper, we apply a latent class model (LCM) to the task of speaker diarization. LCM is similar to Patrick Kenny's variational Bayes (VB) method in that it uses soft information and avoids premature hard decisions in its iterations. In contrast to the VB method, which is based on a generative model, LCM provides a framework allowing both generative and discriminative models. The discriminative property is realized through the use of i-vector (Ivec), probabilistic linear discriminative analysis (PLDA), and a support vector machine (SVM) in this work. Systems denoted as LCM-Ivec-PLDA, LCM-Ivec-SVM, and LCM-Ivec-Hybrid are introduced. In addition, three further improvements are applied to enhance its performance. 1) Adding neighbor windows to extract more speaker information for each short segment. 2) Using a hidden Markov model to avoid frequent speaker change points. 3) Using an agglomerative hierarchical cluster to do initialization and present hard and soft priors, in order to overcome the problem of initial sensitivity. Experiments on the National Institute of Standards and Technology Rich Transcription 2009 speaker diarization database, under the condition of a single distant microphone, show that the diarization error rate (DER) of the proposed methods has substantial relative improvements compared with mainstream systems. Compared to the VB method, the relative improvements of LCM-Ivec-PLDA, LCM-Ivec-SVM, and LCM-Ivec-Hybrid systems are 23.5%, 27.1%, and 43.0%, respectively. Experiments on our collected database, CALLHOME97, CALLHOME00 and SRE08 short2-summed trial conditions also show that the proposed LCM-Ivec-Hybrid system has the best overall performance.

eess.AS↗

arXiv2019

Large Margin Softmax Loss for Speaker Verification

In neural network based speaker verification, speaker embedding is expected to be discriminative between speakers while the intra-speaker distance should remain small. A variety of loss functions have been proposed to achieve this goal. In this paper, we investigate the large margin softmax loss with different configurations in speaker verification. Ring loss and minimum hyperspherical energy criterion are introduced to further improve the performance. Results on VoxCeleb show that our best system outperforms the baseline approach by 15\% in EER, and by 13\%, 33\% in minDCF08 and minDCF10, respectively.

cs.SD↗

arXiv2019

Adaptive Scenario Discovery for Crowd Counting

Crowd counting, i.e., estimation number of the pedestrian in crowd images, is emerging as an important research problem with the public security applications. A key component for the crowd counting systems is the construction of counting models which are robust to various scenarios under facts such as camera perspective and physical barriers. In this paper, we present an adaptive scenario discovery framework for crowd counting. The system is structured with two parallel pathways that are trained with different sizes of the receptive field to represent different scales and crowd densities. After ensuring that these components are present in the proper geometric configuration, a third branch is designed to adaptively recalibrate the pathway-wise responses by discovering and modeling the dynamic scenarios implicitly. Our system is able to represent highly variable crowd images and achieves state-of-the-art results in two challenging benchmarks.

cs.CV↗

arXiv2019

Measurement of directed flow of $D^{0}$ and $\bar{D^{0}}$ mesons in 200 GeV Au+Au collisions at RHIC using the STAR detector

Charm quarks, owing to their large mass, are produced predominantly in the initial hard scatterings in heavy-ion collisions, and therefore can be a valuable tool for studying the early time dynamics of these collisions. The rapidity-odd directed flow at mid-rapidity in heavy-ion collisions originates from a tilt in the reaction plane of the thermalized medium caused by the asymmetry between the number of participants from projectile and target nuclei as a function of rapidity. Recently, it has been predicted that the slope of the directed flow at mid-rapidity for $D^0$ mesons, arising from the transport of charm quarks in the tilted medium, can be several times larger than that of light flavor hadrons. The magnitude of the slope is expected to be sensitive to the magnitude of the tilt and the charm quark drag coefficient in the medium. It has also been predicted that the transient electromagnetic field generated at early time can induce a much larger directed flow for heavy quarks than for light quarks. In these proceedings, we will report on the first measurement of the directed flow for the $D^0$ and $\bar{D}^0$ mesons as a function of rapidity in Au+Au collisions at $\sqrt{s_{_{\rm NN}}}$ = 200 GeV using high statistics data collected with the Heavy Flavor Tracker in 2014 and 2016 RHIC runs.

nucl-ex↗

arXiv2018

Multiobjective Optimization Training of PLDA for Speaker Verification

Most current state-of-the-art text-independent speaker verification systems take probabilistic linear discriminant analysis (PLDA) as their backend classifiers. The parameters of PLDA are often estimated by maximizing the objective function, which focuses on increasing the value of log-likelihood function, but ignoring the distinction between speakers. In order to better distinguish speakers, we propose a multi-objective optimization training for PLDA. Experiment results show that the proposed method has more than 10% relative performance improvement in both EER and MinDCF on the NIST SRE14 i-vector challenge dataset, and about 20% relative performance improvement in EER on the MCE18 dataset.

cs.SD↗

arXiv2018

Investigation of Frame Alignments for GMM-based Digit-prompted Speaker Verification

Frame alignments can be computed by different methods in GMM-based speaker verification. By incorporating a phonetic Gaussian mixture model (PGMM), we are able to compare the performance using alignments extracted from the deep neural networks (DNN) and the conventional hidden Markov model (HMM) in digit-prompted speaker verification. Based on the different characteristics of these two alignments, we present a novel content verification method to improve the system security without much computational overhead. Our experiments on the RSR2015 Part-3 digit-prompted task show that, the DNN based alignment performs on par with the HMM alignment. The results also demonstrate the effectiveness of the proposed Kullback-Leibler (KL) divergence based scoring to reject speech with incorrect pass-phrases.

cs.SD↗

arXiv2018

Exploring a Unified Attention-Based Pooling Framework for Speaker Verification

The pooling layer is an essential component in the neural network based speaker verification. Most of the current networks in speaker verification use average pooling to derive the utterance-level speaker representations. Average pooling takes every frame as equally important, which is suboptimal since the speaker-discriminant power is different between speech segments. In this paper, we present a unified attention-based pooling framework and combine it with the multi-head attention. Experiments on the Fisher and NIST SRE 2010 dataset show that involving outputs from lower layers to compute the attention weights can outperform average pooling and achieve better results than vanilla attention method. The multi-head attention further improves the performance.

cs.SD↗

arXiv2018

Speaker Embedding Extraction with Phonetic Information

Speaker embeddings achieve promising results on many speaker verification tasks. Phonetic information, as an important component of speech, is rarely considered in the extraction of speaker embeddings. In this paper, we introduce phonetic information to the speaker embedding extraction based on the x-vector architecture. Two methods using phonetic vectors and multi-task learning are proposed. On the Fisher dataset, our best system outperforms the original x-vector approach by 20% in EER, and by 15%, 15% in minDCF08 and minDCF10, respectively. Experiments conducted on NIST SRE10 further demonstrate the effectiveness of the proposed methods.

cs.SD↗

arXiv2018

Precise Temporal Action Localization by Evolving Temporal Proposals

Locating actions in long untrimmed videos has been a challenging problem in video content analysis. The performances of existing action localization approaches remain unsatisfactory in precisely determining the beginning and the end of an action. Imitating the human perception procedure with observations and refinements, we propose a novel three-phase action localization framework. Our framework is embedded with an Actionness Network to generate initial proposals through frame-wise similarity grouping, and then a Refinement Network to conduct boundary adjustment on these proposals. Finally, the refined proposals are sent to a Localization Network for further fine-grained location regression. The whole process can be deemed as multi-stage refinement using a novel non-local pyramid feature under various temporal granularities. We evaluate our framework on THUMOS14 benchmark and obtain a significant improvement over the state-of-the-arts approaches. Specifically, the performance gain is remarkable under precise localization with high IoU thresholds. Our proposed framework achieves mAP@IoU=0.5 of 34.2%.

cs.CV↗

arXiv2018

MTGAN: Speaker Verification through Multitasking Triplet Generative Adversarial Networks

In this paper, we propose an enhanced triplet method that improves the encoding process of embeddings by jointly utilizing generative adversarial mechanism and multitasking optimization. We extend our triplet encoder with Generative Adversarial Networks (GANs) and softmax loss function. GAN is introduced for increasing the generality and diversity of samples, while softmax is for reinforcing features about speakers. For simplification, we term our method Multitasking Triplet Generative Adversarial Networks (MTGAN). Experiment on short utterances demonstrates that MTGAN reduces the verification equal error rate (EER) by 67% (relatively) and 32% (relatively) over conventional i-vector method and state-of-the-art triplet loss method respectively. This effectively indicates that MTGAN outperforms triplet methods in the aspect of expressing the high-level feature of speaker information.

cs.SD↗

arXiv2017

Beyond Powers of Two: Hexagonal Modulation and Non-Binary Coding for Wireless Communication Systems

Adaptive modulation and coding (AMC) is widely employed in modern wireless communication systems to improve the transmission efficiency by adjusting the transmission rate according to the channel conditions. Thus, AMC can provide very efficient use of channel resources especially over fading channels. Quadrature Amplitude Modulation (QAM) is an ef- ficient and widely employed digital modulation technique. It typically employs a rectangular signal constellation. Therefore the decision regions of the constellation are square partitions of the two-dimensional signal space. However, it is well known that hexagons rather than squares provide the most compact regular tiling in two dimensions. A compact tiling means a dense packing of the constellation points and thus more energy efficient data transmission. Hexagonal modulation can be difficult to implement because it does not fit well with the usual power- of-two symbol sizes employed with binary data. To overcome this problem, non-binary coding is combined with hexagonal modulation in this paper to provide a system which is compatible with binary data. The feasibility and efficiency are evaluated using a software-defined radio (SDR) based prototype. Extensive simulation results are presented which show that this approach can provide improved energy efficiency and spectrum utilization in wireless communication systems.

eess.SP↗

arXiv2017

Miscible-Immiscible Transition and Nonequilibrium Scaling in Two-Component Driven Open Condensate Wires

We investigate the steady state phase diagram of two-component driven open condensates in one dimension. We identify a miscible-immiscible transition which is predominantly driven by gapped density fluctuations and occurs upon increasing the inter-component inelastic coupling. Below the transition in the miscible phase, we find the effective long wavelength dynamics to be described by a two-component Kardar-Parisi-Zhang (KPZ) equation that belongs to the nonequilibrium universality class of the one-dimensional single-component KPZ equation at generic choices of parameters. Our results are relevant for different experimental realizations for two-component driven open condensates in exciton-polariton systems.

cond-mat.stat-mech↗

arXiv2017

How Long Will My Phone Battery Last?

Mobile devices are only as useful as their battery lasts. Unfortunately, the operation and life of a mobile device's battery degrade over time and usage. The state-of-health (SoH) of batteries quantifies their degradation, but mobile devices are unable to support its accurate estimation -- despite its importance -- due mainly to their limited hardware and dynamic usage patterns, causing various problems such as unexpected device shutoffs or even fire/explosion. To remedy this lack of support, we design, implement and evaluate V-Health, a low-cost user-level SoH estimation service for mobile devices based only on their battery voltage, which is commonly available on all commodity mobile devices. V-Health also enables four novel use-cases that improve mobile users' experience from different perspectives. The design of V-Health is inspired by our empirical finding that the relaxing voltages of a device battery fingerprint its SoH, and is steered by extensive measurements with 15 batteries used for various commodity mobile devices, such as Nexus 6P, Galaxy S3, iPhone 6 Plus, etc. These measurements consist of 13,377 battery discharging/charging/resting cycles and have been conducted over 72 months cumulatively. V-Health has been evaluated via both laboratory experiments and field tests over 4-6 months, showing <5% error in SoH estimation.

eess.SP↗

arXiv2017

Comparison of Multiple Features and Modeling Methods for Text-dependent Speaker Verification

Text-dependent speaker verification is becoming popular in the speaker recognition society. However, the conventional i-vector framework which has been successful for speaker identification and other similar tasks works relatively poorly in this task. Researchers have proposed several new methods to improve performance, but it is still unclear that which model is the best choice, especially when the pass-phrases are prompted during enrollment and test. In this paper, we introduce four modeling methods and compare their performance on the newly published RedDots dataset. To further explore the influence of different frame alignments, Viterbi and forward-backward algorithms are both used in the HMM-based models. Several bottleneck features are also investigated. Our experiments show that, by explicitly modeling the lexical content, the HMM-based modeling achieves good results in the fixed-phrase condition. In the prompted-phrase condition, GMM-HMM and i-vector/HMM are not as successful. In both conditions, the forward-backward algorithm brings more benefits to the i-vector/HMM system. Additionally, we also find that even though bottleneck features perform well for text-independent speaker verification, they do not outperform MFCCs on the most challenging Imposter-Correct trials on RedDots.

cs.SD↗

arXiv2017

Origin of the mass splitting of azimuthal anisotropies in a multi-phase transport model

Both hydrodynamics-based models and a multi-phase transport (AMPT) model can reproduce the mass splitting of azimuthal anisotropy ($v_n$) at low transverse momentum ($p_{\perp}$) as observed in heavy ion collisions. In the AMPT model, however, $v_n$ is mainly generated by the parton escape mechanism, not by the hydrodynamic flow. In this study we provide detailed results on the mass splitting of $v_n$ in this transport model, including $v_2$ and $v_3$ of various hadron species in d+Au and Au+Au collisions at the Relativistic Heavy Ion Collider and p+Pb collisions at the Large Hadron Collider. We show that the mass splitting of hadron $v_2$ and $v_3$ in AMPT first arises from the kinematics in the quark coalescence hadronization process, and then, more dominantly, comes from hadronic rescatterings, even though the contribution from the latter to the overall charged hadron $v_n$ is small. We further show that there is no qualitative difference between heavy ion collisions and small-system collisions or between elliptic ($v_2$) and triangular ($v_3$) anisotropies. Our studies thus demonstrate that the mass splitting of $v_2$ and $v_3$ at low-$p_{\perp}$ is not a unique signature of hydrodynamic collective flow but can be the interplay of several physics effects.

nucl-th↗

arXiv2017

Space-time vortex driven crossover and vortex turbulence phase transition in one-dimensional driven open condensates

We find a first order transition driven by the strength of non-equilibrium conditions of one-dimensional driven open condensates. Associated with this transition is a new stable non-equilibrium phase, space-time vortex turbulence, whose vortex density and quasiparticle distribution show strongly non-thermal behavior. Below the transition, we identify a new time scale associated with noise activated unbound space-time vortices, beyond which the temporal coherence function changes from a Kardar-Parisi-Zhang type subexponential to a disordered exponential decay. Experimental realization of the non-equilibrium vortex turbulent phase is facilitated in driven open condensates with a large diffusion rate.

cond-mat.stat-mech↗

arXiv2016

Efficient Multi-Agent Global Navigation Using Interpolating Bridges

We present a novel approach for collision-free global navigation for continuous-time multi-agent systems with general linear dynamics. Our approach is general and can be used to perform collision-free navigation in 2D and 3D workspaces with narrow passages and crowded regions. As part of pre-computation, we compute multiple bridges in the narrow or tight regions in the workspace using kinodynamic RRT algorithms. Our bridge has certain geometric characteristics, that en- able us to calculate a collision-free trajectory for each agent using simple interpolation at runtime. Moreover, we combine interpolated bridge trajectories with local multi-agent navigation algorithms to compute global collision-free paths for each agent. The overall approach combines the performance benefits of coupled multi-agent algorithms with the pre- computed trajectories of the bridges to handle challenging scenarios. In practice, our approach can handle tens to hundreds of agents in real-time on a single CPU core in 2D and 3D workspaces.

cs.RO↗

arXiv2016

Origin of the mass splitting of elliptic anisotropy in a multiphase transport model

The mass splitting of elliptic anisotropy ($v_2$) at low transverse momentum is considered as a hallmark of hydrodynamic collective flow. We investigate a multiphase transport (AMPT) model where the $v_2$ is mainly generated by an anisotropic escape mechanism, not of the hydrodynamic flow nature, and where mass splitting is also observed. We demonstrate that the $v_2$ mass splitting in AMPT is small right after hadronization (especially when resonance decays are included); the mass splitting mainly comes from hadronic rescatterings, even though their contribution to the overall charged hadron $v_2$ is small. These findings are qualitatively the same as those from hybrid models that combine hydrodynamics with a hadron cascade. We further show that there is no qualitative difference between heavy ion collisions and small system collisions. Our results indicate that the $v_2$ mass splitting is not a unique signature of hydrodynamic collective flow and thus cannot distinguish whether the elliptic flow is generated mainly from hydrodynamics or the anisotropic parton escape.

nucl-th↗