arXiv subjects

Yi Yu

Publications and source records attributed to Yi Yu.

At least 271 records · Page 15Linked to original sources

arXiv2020

Localizing Changes in High-Dimensional Vector Autoregressive Processes

Autoregressive models capture stochastic processes in which past realizations determine the generative distribution of new data; they arise naturally in a variety of industrial, biomedical, and financial settings. A key challenge when working with such data is to determine when the underlying generative model has changed, as this can offer insights into distinct operating regimes of the underlying system. This paper describes a novel dynamic programming approach to localizing changes in high-dimensional autoregressive processes and associated error rates that improve upon the prior state of the art. When the model parameters are piecewise constant over time and the corresponding process is piecewise stable, the proposed dynamic programming algorithm consistently localizes change points even as the dimensionality, the sparsity of the coefficient matrices, the temporal spacing between two consecutive change points, and the magnitude of the difference of two consecutive coefficient matrices are allowed to vary with the sample size. Furthermore, the accuracy of initial, coarse change point localization estimates can be boosted via a computationally-efficient refinement algorithm that provably improves the localization error rate. Finally, a comprehensive simulation experiments and a real data analysis are provided to show the numerical superiority of our proposed methods.

math.ST↗

arXiv2020

Unsupervised Generative Adversarial Alignment Representation for Sheet music, Audio and Lyrics

Sheet music, audio, and lyrics are three main modalities during writing a song. In this paper, we propose an unsupervised generative adversarial alignment representation (UGAAR) model to learn deep discriminative representations shared across three major musical modalities: sheet music, lyrics, and audio, where a deep neural network based architecture on three branches is jointly trained. In particular, the proposed model can transfer the strong relationship between audio and sheet music to audio-lyrics and sheet-lyrics pairs by learning the correlation in the latent shared subspace. We apply CCA components of audio and sheet music to establish new ground truth. The generative (G) model learns the correlation of two couples of transferred pairs to generate new audio-sheet pair for a fixed lyrics to challenge the discriminative (D) model. The discriminative model aims at distinguishing the input which is from the generative model or the ground truth. The two models simultaneously train in an adversarial way to enhance the ability of deep alignment representation learning. Our experimental results demonstrate the feasibility of our proposed UGAAR for alignment representation learning among sheet music, audio, and lyrics.

eess.AS↗

arXiv2020

Optimal nonparametric multivariate change point detection and localization

We study the multivariate nonparametric change point detection problem, where the data are a sequence of independent $p$-dimensional random vectors whose distributions are piecewise-constant with Lipschitz densities changing at unknown times, called change points. We quantify the size of the distributional change at any change point with the supremum norm of the difference between the corresponding densities. We are concerned with the localization task of estimating the positions of the change points. In our analysis, we allow for the model parameters to vary with the total number of time points, including the minimal spacing between consecutive change points and the magnitude of the smallest distributional change. We provide information-theoretic lower bounds on both the localization rate and the minimal signal-to-noise ratio required to guarantee consistent localization. We formulate a novel algorithm based on kernel density estimation that nearly achieves the minimax lower bound, save possibly for logarithm factors. We have provided extensive numerical evidence to support our theoretical findings.

math.ST↗

arXiv2020

Graph matching beyond perfectly-overlapping Erdős--Rényi random graphs

Graph matching is a fruitful area in terms of both algorithms and theories. In this paper, we exploit the degree information, which was previously used only in noiseless graphs and perfectly-overlapping Erdős--Rényi random graphs matching. We are concerned with graph matching of partially-overlapping graphs and stochastic block models, which are more useful in tackling real-life problems. We propose the edge exploited degree profile graph matching method and two refined varations. We conduct a thorough analysis of our proposed methods' performances in a range of challenging scenarios, including a zebrafish neuron activity data set and a coauthorship data set. Our methods are proved to be numerically superior than the state-of-the-art methods.

stat.ME↗

arXiv2020

Detecting Abrupt Changes in High-Dimensional Self-Exciting Poisson Processes

High-dimensional self-exciting point processes have been widely used in many application areas to model discrete event data in which past and current events affect the likelihood of future events. In this paper, we are concerned with detecting abrupt changes of the coefficient matrices in discrete-time high-dimensional self-exciting Poisson processes, which have yet to be studied in the existing literature due to both theoretical and computational challenges rooted in the non-stationary and high-dimensional nature of the underlying process. We propose a penalized dynamic programming approach which is supported by a theoretical rate analysis and numerical evidence.

stat.ME↗

arXiv2020

End-to-end Named Entity Recognition from English Speech

Named entity recognition (NER) from text has been a widely studied problem and usually extracts semantic information from text. Until now, NER from speech is mostly studied in a two-step pipeline process that includes first applying an automatic speech recognition (ASR) system on an audio sample and then passing the predicted transcript to a NER tagger. In such cases, the error does not propagate from one step to another as both the tasks are not optimized in an end-to-end (E2E) fashion. Recent studies confirm that integrated approaches (e.g., E2E ASR) outperform sequential ones (e.g., phoneme based ASR). In this paper, we introduce a first publicly available NER annotated dataset for English speech and present an E2E approach, which jointly optimizes the ASR and NER tagger components. Experimental results show that the proposed E2E approach outperforms the classical two-step approach. We also discuss how NER from speech can be used to handle out of vocabulary (OOV) words in an ASR system.

cs.CL↗

arXiv2020

Effects of Initial State on Opinion Formation in Complex Social Networks with Noises

Opinion formation in complex social networks may exhibit complex system dynamics even when based on some simplest system evolution models. An interesting and important issue is the effects of the initial state on the final steady-state opinion distribution. We show that, while different initial opinion distributions certainly make differences to opinion evolution in social systems without noises, in systems with noises, given enough time, different initial states basically do not contribute to making any significant differences in the final steady state. Instead, it is the basal distribution of the preferred opinions that contributes to deciding the final state of the systems. Such an observation contradicts with a long-term belief on the roles of system initial state in opinion formation. We propose some brief discussions on the reasons supporting our statement, and the implications of such an observation in real-life applications.

cs.SI↗

arXiv2020

Unusual destruction and enhancement of superfluidity of atomic Fermi gases by population imbalance in a one-dimensional optical lattice

We study the superfluid behavior of a population imbalanced ultracold atomic Fermi gases with a short range attractive interaction in a one-dimensional (1D) optical lattice, using a pairing fluctuation theory. We show that, besides widespread pseudogap phenomena and intermediate temperature superfluidity, the superfluid phase is readily destroyed except in a limited region of the parameter space. We find a new mechanism for pair hopping, assisted by the excessive majority fermions, in the presence of continuum-lattice mixing, which leads to an unusual constant BEC asymptote for $T_c$ that is independent of pairing strength. In result, on the BEC side of unitarity, superfluidity, when it exists, may be strongly enhanced by population imbalance.

cond-mat.quant-gas↗

arXiv2020

Superfluidity and pairing phenomena in ultracold atomic Fermi gases in one-dimensional optical lattices, Part II: Effects of population imbalance

In this paper, we study the effect of population imbalance and its interplay with pairing strength and lattice effect in atomic Fermi gases in a one-dimensional optical lattice. We compute various phase diagrams as the system undergoes BCS-BEC crossover, using the same pairing fluctuation theory as in Part I. We find widespread pseudogap phenomena beyond the BCS regime and intermediate temperature superfluid states for relatively low population imbalances. The Fermi surface topology plays an important role in the behavior of $T_\text{c}$. For large $d$ and/or small $t$, which yield an open Fermi surface, superfluidity can be readily destroyed by a small amount of population imbalance $p$. The superfluid phase, especially in the BEC regime, can exist only for a highly restricted volume of the parameter space. Due to the continuum-lattice mixing, population imbalance gives rise to a new mechanism for pair hopping, as assisted by excessive majority fermions, which may lead to significant enhancement of $T_\text{c}$ on the BEC side of the Feshbach resonance, and also render $T_\text{c}$ approaching a constant asymptote in the BEC limit, when it exists. Furthermore, we find that not all minority fermions will be paired up in BEC limit, unlike the 3D continuum case. These predictions can be tested in future experiments.

cond-mat.quant-gas↗

arXiv2020

Superfluidity and pairing phenomena in ultracold atomic Fermi gases in one-dimensional optical lattices, Part I: Balanced case

The superfluidity and pairing phenomena in ultracold atomic Fermi gases have been of great interest in recent years, with multiple tunable parameters. Here we study the BCS-BEC crossover behavior of balanced two-component Fermi gases in a one-dimensional optical lattice, which is distinct from the simple three-dimensional (3D) continuum and a fully 3D lattice often found in a condensed matter system. We use a pairing fluctuation theory which includes self-consistent feedback effects at finite temperatures, and find widespread pseudogap phenomena beyond the BCS regime. As a consequence of the lattice periodicity, the superfluid transition temperature $T_c$ decreases with pairing strength in the BEC regime, where it approaches asymptotically $T_c = πan/2m$, with $a$ being the $s$-wave scattering length, and $n$ ($m$) the fermion density (mass). In addition, the quasi-two dimensionality leads to fast growing (absolute value of the) fermionic chemical potential $μ$ and pairing gap $Δ$, which depends exponentially on the ratio $d/a$. Importantly, $T_c$ at unitarity increases with the lattice constant $d$ and hopping integral $t$. The effect of the van Hove singularity on $T_c$ is identified. The superfluid density exhibits $T^{3/2}$ power laws at low $T$, away from the extreme BCS limit. These predictions can be tested in future experiments.

cond-mat.quant-gas↗

arXiv2019

Text2FaceGAN: Face Generation from Fine Grained Textual Descriptions

Powerful generative adversarial networks (GAN) have been developed to automatically synthesize realistic images from text. However, most existing tasks are limited to generating simple images such as flowers from captions. In this work, we extend this problem to the less addressed domain of face generation from fine-grained textual descriptions of face, e.g., "A person has curly hair, oval face, and mustache". We are motivated by the potential of automated face generation to impact and assist critical tasks such as criminal face reconstruction. Since current datasets for the task are either very small or do not contain captions, we generate captions for images in the CelebA dataset by creating an algorithm to automatically convert a list of attributes to a set of captions. We then model the highly multi-modal problem of text to face generation as learning the conditional distribution of faces (conditioned on text) in same latent space. We utilize the current state-of-the-art GAN (DC-GAN with GAN-CLS loss) for learning conditional multi-modality. The presence of more fine-grained details and variable length of the captions makes the problem easier for a user but more difficult to handle compared to the other text-to-image tasks. We flipped the labels for real and fake images and added noise in discriminator. Generated images for diverse textual descriptions show promising results. In the end, we show how the widely used inceptions score is not a good metric to evaluate the performance of generative models used for synthesizing faces from text.

cs.LG↗

arXiv2019

Data-Free Point Cloud Network for 3D Face Recognition

Point clouds-based Networks have achieved great attention in 3D object classification, segmentation and indoor scene semantic parsing. In terms of face recognition, 3D face recognition method which directly consume point clouds as input is still under study. Two main factors account for this: One is how to get discriminative face representations from 3D point clouds using deep network; the other is the lack of large 3D training dataset. To address these problems, a data-free 3D face recognition method is proposed only using synthesized unreal data from statistical 3D Morphable Model to train a deep point cloud network. To ease the inconsistent distribution between model data and real faces, different point sampling methods are used in train and test phase. In this paper, we propose a curvature-aware point sampling(CPS) strategy replacing the original furthest point sampling(FPS) to hierarchically down-sample feature-sensitive points which are crucial to pass and aggregate features deeply. A PointNet++ like Network is used to extract face features directly from point clouds. The experimental results show that the network trained on generated data generalizes well for real 3D faces. Fine tuning on a small part of FRGCv2.0 and Bosphorus, which include real faces in different poses and expressions, further improves recognition accuracy.

cs.CV↗

arXiv2019

Suppression of coherence collapse in semiconductor Fano lasers

We show that semiconductor Fano lasers strongly suppress dynamic instabilities induced by external optical feedback. A comparison with conventional Fabry-Perot lasers shows orders of magnitude improvement in feedback stability, and in many cases even total suppression of coherence collapse, which is of major importance for applications in integrated photonics. The laser dynamics are analysed using a generalisation of the Lang-Kobayashi model for semiconductor lasers with external feedback, and an analytical expression for the critical feedback level is derived.

physics.optics↗

arXiv2019

Mean-Square Performance Analysis of Noise-Robust Normalized Subband Adaptive Filter Algorithm

This paper studies the statistical models of the noise-robust normalized subband adaptive filter (NR-NSAF) algorithm in the mean and mean square deviation senses involving transient-state and steady-state behavior by resorting to the method of the vectorization operation and the Kronecker product. The analysis method does not require the Gaussian input signal. Moreover, the proposed analysis removes the paraunitary assumption imposed on the analysis filter banks as in the existing analyses of subband adaptive algorithms. Simulation results in various conditions demonstrate the effectiveness of our theoretical analysis. For a special form of the algorithm, the proposed steady-state expression is also better accurate than the previous analysis.

eess.SP↗

arXiv2019

Personalized Music Recommendation with Triplet Network

Since many online music services emerged in recent years so that effective music recommendation systems are desirable. Some common problems in recommendation system like feature representations, distance measure and cold start problems are also challenges for music recommendation. In this paper, I proposed a triplet neural network, exploiting both positive and negative samples to learn the representation and distance measure between users and items, to solve the recommendation task.

cs.IR↗

arXiv2019

Audio-Visual Embedding for Cross-Modal MusicVideo Retrieval through Supervised Deep CCA

Deep learning has successfully shown excellent performance in learning joint representations between different data modalities. Unfortunately, little research focuses on cross-modal correlation learning where temporal structures of different data modalities, such as audio and video, should be taken into account. Music video retrieval by given musical audio is a natural way to search and interact with music contents. In this work, we study cross-modal music video retrieval in terms of emotion similarity. Particularly, audio of an arbitrary length is used to retrieve a longer or full-length music video. To this end, we propose a novel audio-visual embedding algorithm by Supervised Deep CanonicalCorrelation Analysis (S-DCCA) that projects audio and video into a shared space to bridge the semantic gap between audio and video. This also preserves the similarity between audio and visual contents from different videos with the same class label and the temporal structure. The contribution of our approach is mainly manifested in the two aspects: i) We propose to select top k audio chunks by attention-based Long Short-Term Memory (LSTM)model, which can represent good audio summarization with local properties. ii) We propose an end-to-end deep model for cross-modal audio-visual learning where S-DCCA is trained to learn the semantic correlation between audio and visual modalities. Due to the lack of music video dataset, we construct 10K music video dataset from YouTube 8M dataset. Some promising results such as MAP and precision-recall show that our proposed model can be applied to music video retrieval.

cs.MM↗

arXiv2019

Social Influence-based Attentive Mavens Mining and Aggregative Representation Learning for Group Recommendation

Frequent group activities of human beings have become an indispensable part in their daily life. Group recommendation can recommend satisfactory activities to group members in the recommender systems, and the key issue is how to aggregate preferences in different group members. Most existing group recommendation employed the predefined static aggregation strategies to aggregate the preferences of different group members, but these static strategies cannot simulate the dynamic group decision-making. Meanwhile, most of these methods depend on intuitions or assumptions to analyze the influence of group members and lack of convincing theoretical support. We argue that the influence of group members plays a particularly important role in group decision-making and it can better assist group profile modeling and perform more accurate group recommendation. To tackle the issue of preference aggregation for group recommendation, we propose a novel attentive aggregation representation learning method based on sociological theory for group recommendation, namely SIAGR (short for "Social Influence-based Attentive Group Recommendation"), which takes attention mechanisms and the popular method (BERT) as the aggregation representation for group profile modeling. Specifically, we analyze the influence of group members based on social identity theory and two-step flow theory and exploit an attentive mavens mining method. In addition, we develop a BERT-based representation method to learn the interaction of group members. Lastly, we complete the group recommendation under the neural collaborative filtering framework and verify the effectiveness of the proposed method by experimenting.

cs.SI↗

arXiv2019

Radio Frequency Fingerprint Identification Based on Denoising Autoencoders

Radio Frequency Fingerprinting (RFF) is one of the promising passive authentication approaches for improving the security of the Internet of Things (IoT). However, with the proliferation of low-power IoT devices, it becomes imperative to improve the identification accuracy at low SNR scenarios. To address this problem, this paper proposes a general Denoising AutoEncoder (DAE)-based model for deep learning RFF techniques. Besides, a partially stacking method is designed to appropriately combine the semi-steady and steady-state RFFs of ZigBee devices. The proposed Partially Stacking-based Convolutional DAE (PSC-DAE) aims at reconstructing a high-SNR signal as well as device identification. Experimental results demonstrate that compared to Convolutional Neural Network (CNN), PSCDAE can improve the identification accuracy by 14% to 23.5% at low SNRs (from -10 dB to 5 dB) under Additive White Gaussian Noise (AWGN) corrupted channels. Even at SNR = 10 dB, the identification accuracy is as high as 97.5%.

eess.SP↗