arXiv subjects

Yuan Yao

Publications and source records attributed to Yuan Yao.

At least 343 records · Page 19Linked to original sources

arXiv2018

FDR-HS: An Empirical Bayesian Identification of Heterogenous Features in Neuroimage Analysis

Recent studies found that in voxel-based neuroimage analysis, detecting and differentiating "procedural bias" that are introduced during the preprocessing steps from lesion features, not only can help boost accuracy but also can improve interpretability. To the best of our knowledge, GSplit LBI is the first model proposed in the literature to simultaneously capture both procedural bias and lesion features. Despite the fact that it can improve prediction power by leveraging the procedural bias, it may select spurious features due to the multicollinearity in high dimensional space. Moreover, it does not take into account the heterogeneity of these two types of features. In fact, the procedural bias and lesion features differ in terms of volumetric change and spatial correlation pattern. To address these issues, we propose a "two-groups" Empirical-Bayes method called "FDR-HS" (False-Discovery-Rate Heterogenous Smoothing). Such method is able to not only avoid multicollinearity, but also exploit the heterogenous spatial patterns of features. In addition, it enjoys the simplicity in implementation by introducing hidden variables, which turns the problem into a convex optimization scheme and can be solved efficiently by the expectation-maximum (EM) algorithm. Empirical experiments have been evaluated on the Alzheimer's Disease Neuroimage Initiative (ADNI) database. The advantage of the proposed model is verified by improved interpretability and prediction power using selected features by FDR-HS.

stat.AP↗

arXiv2018

MSplit LBI: Realizing Feature Selection and Dense Estimation Simultaneously in Few-shot and Zero-shot Learning

It is one typical and general topic of learning a good embedding model to efficiently learn the representation coefficients between two spaces/subspaces. To solve this task, $L_{1}$ regularization is widely used for the pursuit of feature selection and avoiding overfitting, and yet the sparse estimation of features in $L_{1}$ regularization may cause the underfitting of training data. $L_{2}$ regularization is also frequently used, but it is a biased estimator. In this paper, we propose the idea that the features consist of three orthogonal parts, \emph{namely} sparse strong signals, dense weak signals and random noise, in which both strong and weak signals contribute to the fitting of data. To facilitate such novel decomposition, \emph{MSplit} LBI is for the first time proposed to realize feature selection and dense estimation simultaneously. We provide theoretical and simulational verification that our method exceeds $L_{1}$ and $L_{2}$ regularization, and extensive experimental results show that our method achieves state-of-the-art performance in the few-shot and zero-shot learning.

cs.CV↗

arXiv2018

Anomaly matching and symmetry-protected critical phases in $SU(N)$ spin systems in 1+1 dimensions

We study $(1+1)$-dimensional $SU(N)$ spin systems in the presence of the global $SU(N)$ rotation and lattice translation symmetries. By matching the mixed anomaly of the $PSU(N)\times\mathbb{Z}$ symmetry in the continuum limit, we identify a topological index for spin model evaluated as the total number of Young-tableaux boxes of spins per unit cell modulo $N$, which characterizes the "ingappability" of the system. A nontrivial index implies either a ground-state degeneracy in a gapped phase, which can be regarded as a field-theory version of the Lieb-Schultz-Mattis theorem, or a restriction of the possible universality classes in a critical phase -- the symmetry-protected critical phase, e.g. only a class of $SU(N)$ Wess-Zumino-Witten theories can be realized in the low-energy limit of the given lattice model in the presence of the symmetries. Similar constraints also apply when a higher global symmetry emerges in the model with a lower symmetry. Our prediction agrees with several examples known in previous studies of $SU(N)$ models.

cond-mat.str-el↗

arXiv2018

A Proximal Block Coordinate Descent Algorithm for Deep Neural Network Training

Training deep neural networks (DNNs) efficiently is a challenge due to the associated highly nonconvex optimization. The backpropagation (backprop) algorithm has long been the most widely used algorithm for gradient computation of parameters of DNNs and is used along with gradient descent-type algorithms for this optimization task. Recent work have shown the efficiency of block coordinate descent (BCD) type methods empirically for training DNNs. In view of this, we propose a novel algorithm based on the BCD method for training DNNs and provide its global convergence results built upon the powerful framework of the Kurdyka-Lojasiewicz (KL) property. Numerical experiments on standard datasets demonstrate its competitive efficiency against standard optimizers with backprop.

stat.ML↗

arXiv2018

From Social to Individuals: a Parsimonious Path of Multi-level Models for Crowdsourced Preference Aggregation

In crowdsourced preference aggregation, it is often assumed that all the annotators are subject to a common preference or social utility function which generates their comparison behaviors in experiments. However, in reality annotators are subject to variations due to multi-criteria, abnormal, or a mixture of such behaviors. In this paper, we propose a parsimonious mixed-effects model, which takes into account both the fixed effect that the majority of annotators follows a common linear utility model, and the random effect that some annotators might deviate from the common significantly and exhibit strongly personalized preferences. The key algorithm in this paper establishes a dynamic path from the social utility to individual variations, with different levels of sparsity on personalization. The algorithm is based on the Linearized Bregman Iterations, which leads to easy parallel implementations to meet the need of large-scale data analysis. In this unified framework, three kinds of random utility models are presented, including the basic linear model with L2 loss, Bradley-Terry model, and Thurstone-Mosteller model. The validity of these multi-level models are supported by experiments with both simulated and real-world datasets, which shows that the parsimonious multi-level models exhibit improvements in both interpretability and predictive precision compared with traditional HodgeRank.

cs.IR↗

arXiv2018

Facile and fast growth of high mobility nanoribbons of ZrTe$_5$

Recently, ZrTe$_5$ has received a lot of attention as it exhibits various topological phases, such as weak and strong topological insulators, a Dirac semimetal, and a quantum spin Hall insulator in the monolayer limit. While most of studies have been focused on the three-dimensional bulk material, it is highly desired to obtain nanostructured materials due to their advantages in device applications. We report the synthesis and characterizations of ZrTe$_5$ nanoribbons. Via a silicon-assisted chemical vapor transport method, long nanoribbons with thickness as thin as 20 nm can be grown. The growth rate is over an order of magnitude faster than the previous method for growth of bulk crystals. Moreover, transport studies show that nanoribbons are of low unintentional doping and high carrier mobility, over 30,000 cm$^2$/Vs, which enable reliable determination of the Berry phase of $π$ in the $ac$ plane from quantum oscillations. Our method holds great potential in growth of high quality ultra-thin nanostructures of ZrTe$_5$.

cond-mat.mtrl-sci↗

arXiv2018

Finding Global Optima in Nonconvex Stochastic Semidefinite Optimization with Variance Reduction

There is a recent surge of interest in nonconvex reformulations via low-rank factorization for stochastic convex semidefinite optimization problem in the purpose of efficiency and scalability. Compared with the original convex formulations, the nonconvex ones typically involve much fewer variables, allowing them to scale to scenarios with millions of variables. However, it opens a new challenge that under what conditions the nonconvex stochastic algorithms may find the global optima effectively despite their empirical success in applications. In this paper, we provide an answer that a stochastic gradient descent method with variance reduction, can be adapted to solve the nonconvex reformulation of the original convex problem, with a \textit{global linear convergence}, i.e., converging to a global optimum exponentially fast, at a proper initial choice in the restricted strongly convex case. Experimental studies on both simulation and real-world applications on ordinal embedding are provided to show the effectiveness of the proposed algorithms.

math.OC↗

arXiv2018

Stochastic Non-convex Ordinal Embedding with Stabilized Barzilai-Borwein Step Size

Learning representation from relative similarity comparisons, often called ordinal embedding, gains rising attention in recent years. Most of the existing methods are batch methods designed mainly based on the convex optimization, say, the projected gradient descent method. However, they are generally time-consuming due to that the singular value decomposition (SVD) is commonly adopted during the update, especially when the data size is very large. To overcome this challenge, we propose a stochastic algorithm called SVRG-SBB, which has the following features: (a) SVD-free via dropping convexity, with good scalability by the use of stochastic algorithm, i.e., stochastic variance reduced gradient (SVRG), and (b) adaptive step size choice via introducing a new stabilized Barzilai-Borwein (SBB) method as the original version for convex problems might fail for the considered stochastic \textit{non-convex} optimization problem. Moreover, we show that the proposed algorithm converges to a stationary point at a rate $\mathcal{O}(\frac{1}{T})$ in our setting, where $T$ is the number of total iterations. Numerous simulations and real-world data experiments are conducted to show the effectiveness of the proposed algorithm via comparing with the state-of-the-art methods, particularly, much lower computational cost with good prediction performance.

stat.ML↗

arXiv2017

Accelerated Block Coordinate Proximal Gradients with Applications in High Dimensional Statistics

Nonconvex optimization problems arise in different research fields and arouse lots of attention in signal processing, statistics and machine learning. In this work, we explore the accelerated proximal gradient method and some of its variants which have been shown to converge under nonconvex context recently. We show that a novel variant proposed here, which exploits adaptive momentum and block coordinate update with specific update rules, further improves the performance of a broad class of nonconvex problems. In applications to sparse linear regression with regularizations like Lasso, grouped Lasso, capped $\ell_1$ and SCAP, the proposed scheme enjoys provable local linear convergence, with experimental justification.

math.OC↗

arXiv2017

Zero-shot Learning via Shared-Reconstruction-Graph Pursuit

Zero-shot learning (ZSL) aims to recognize objects from novel unseen classes without any training data. Recently, structure-transfer based methods are proposed to implement ZSL by transferring structural knowledge from the semantic embedding space to image feature space to classify testing images. However, we observe that such a knowledge transfer framework may suffer from the problem of the geometric inconsistency between the data in the training and testing spaces. We call this problem as the space shift problem. In this paper, we propose a novel graph based method to alleviate this space shift problem. Specifically, a Shared Reconstruction Graph (SRG) is pursued to capture the common structure of data in the two spaces. With the learned SRG, each unseen class prototype (cluster center) in the image feature space can be synthesized by the linear combination of other class prototypes, so that testing instances can be classified based on the distance to these synthesized prototypes. The SRG bridges the image feature space and semantic embedding space. By applying spectral clustering on the learned SRG, many meaningful clusters can be discovered, which interprets ZSL performance on the datasets. Our method can be easily extended to the generalized zero-shot learning setting. Experiments on three popular datasets show that our method outperforms other methods on all datasets. Even with a small number of training samples, our method can achieve the state-of-the-art performance.

cs.CV↗

arXiv2017

Theory of electron spin resonance in one-dimensional topological insulators with spin-orbit couplings

Edge/surface states often appear in a topologically nontrivial phase, when the system has a boundary. The edge state of a one-dimensional topological insulator is one of the simplest examples. Electron Spin Resonance (ESR) is an ideal probe to detect and analyze the edge state for its high sensitivity and precision. We consider ESR of the edge state of a generalized Su-Schrieffer-Heeger model with a next-nearest neighbor (NNN) hopping and a staggered spin-orbit coupling. The spin-orbit coupling is generally expected to bring about nontrivial changes on the ESR spectrum. Nevertheless, in the absence of the NNN hoppings, we find that the ESR spectrum is unaffected by the spin-orbit coupling thanks to the chiral symmetry. In the presence of both the NNN hopping and the spin-orbit coupling, on the other hand, the edge ESR spectrum exhibits a nontrivial frequency shift. We derive an explicit analytical formula for the ESR shift in the second order perturbation theory, which agrees very well with a non-perturbative numerical calculation.

cond-mat.str-el↗

arXiv2017

HodgeRank with Information Maximization for Crowdsourced Pairwise Ranking Aggregation

Recently, crowdsourcing has emerged as an effective paradigm for human-powered large scale problem solving in various domains. However, task requester usually has a limited amount of budget, thus it is desirable to have a policy to wisely allocate the budget to achieve better quality. In this paper, we study the principle of information maximization for active sampling strategies in the framework of HodgeRank, an approach based on Hodge Decomposition of pairwise ranking data with multiple workers. The principle exhibits two scenarios of active sampling: Fisher information maximization that leads to unsupervised sampling based on a sequential maximization of graph algebraic connectivity without considering labels; and Bayesian information maximization that selects samples with the largest information gain from prior to posterior, which gives a supervised sampling involving the labels collected. Experiments show that the proposed methods boost the sampling efficiency as compared to traditional sampling schemes and are thus valuable to practical crowdsourcing experiments.

stat.ML↗

arXiv2017

Exploring Outliers in Crowdsourced Ranking for QoE

Outlier detection is a crucial part of robust evaluation for crowdsourceable assessment of Quality of Experience (QoE) and has attracted much attention in recent years. In this paper, we propose some simple and fast algorithms for outlier detection and robust QoE evaluation based on the nonconvex optimization principle. Several iterative procedures are designed with or without knowing the number of outliers in samples. Theoretical analysis is given to show that such procedures can reach statistically good estimates under mild conditions. Finally, experimental results with simulated and real-world crowdsourcing datasets show that the proposed algorithms could produce similar performance to Huber-LASSO approach in robust ranking, yet with nearly 8 or 90 times speed-up, without or with a prior knowledge on the sparsity size of outliers, respectively. Therefore the proposed methodology provides us a set of helpful tools for robust QoE evaluation with crowdsourcing data.

stat.ML↗

arXiv2017

Vision-Based Classification of Social Gestures in Videochat Sessions

This paper describes the design and evaluation of the vision-based classification of social gestures, such as handshake, hug, high-five, etc. This is a component of the mediated social touch systems, which can be incorporated into ShareTable and SqueezeBands system to achieve automated gestures recognition and transmission of the touch between the users in real time. The results from our pilot study show the recognition accuracy of each gestures, and they indicate that significant future work is necessary to improve its practical feasibility in the mediated social touch applications.

cs.HC↗

arXiv2017

GSplit LBI: Taming the Procedural Bias in Neuroimaging for Disease Prediction

In voxel-based neuroimage analysis, lesion features have been the main focus in disease prediction due to their interpretability with respect to the related diseases. However, we observe that there exists another type of features introduced during the preprocessing steps and we call them "\textbf{Procedural Bias}". Besides, such bias can be leveraged to improve classification accuracy. Nevertheless, most existing models suffer from either under-fit without considering procedural bias or poor interpretability without differentiating such bias from lesion ones. In this paper, a novel dual-task algorithm namely \emph{GSplit LBI} is proposed to resolve this problem. By introducing an augmented variable enforced to be structural sparsity with a variable splitting term, the estimators for prediction and selecting lesion features can be optimized separately and mutually monitored by each other following an iterative scheme. Empirical experiments have been evaluated on the Alzheimer's Disease Neuroimaging Initiative\thinspace(ADNI) database. The advantage of proposed model is verified by improved stability of selected lesion features and better classification results.

stat.AP↗

arXiv2017

Visual Attribute Transfer through Deep Image Analogy

We propose a new technique for visual attribute transfer across images that may have very different appearance but have perceptually similar semantic structure. By visual attribute transfer, we mean transfer of visual information (such as color, tone, texture, and style) from one image to another. For example, one image could be that of a painting or a sketch while the other is a photo of a real scene, and both depict the same type of scene. Our technique finds semantically-meaningful dense correspondences between two input images. To accomplish this, it adapts the notion of "image analogy" with features extracted from a Deep Convolutional Neutral Network for matching; we call our technique Deep Image Analogy. A coarse-to-fine strategy is used to compute the nearest-neighbor field for generating the results. We validate the effectiveness of our proposed method in a variety of cases, including style/texture transfer, color/style swap, sketch/painting to photo, and time lapse.

cs.CV↗

arXiv2017

Boosting with Structural Sparsity: A Differential Inclusion Approach

Boosting as gradient descent algorithms is one popular method in machine learning. In this paper a novel Boosting-type algorithm is proposed based on restricted gradient descent with structural sparsity control whose underlying dynamics are governed by differential inclusions. In particular, we present an iterative regularization path with structural sparsity where the parameter is sparse under some linear transforms, based on variable splitting and the Linearized Bregman Iteration. Hence it is called \emph{Split LBI}. Despite its simplicity, Split LBI outperforms the popular generalized Lasso in both theory and experiments. A theory of path consistency is presented that equipped with a proper early stopping, Split LBI may achieve model selection consistency under a family of Irrepresentable Conditions which can be weaker than the necessary and sufficient condition for generalized Lasso. Furthermore, some $\ell_2$ error bounds are also given at the minimax optimal rates. The utility and benefit of the algorithm are illustrated by several applications including image denoising, partial order ranking of sport teams, and world university grouping with crowdsourced ranking data.

stat.ML↗

arXiv2017

Topological Casimir effect in a quantum LC circuit: real-time dynamics

We study novel contributions to the partition function of the Maxwell system defined on a small compact manifold ${\mathbb{M}}$ with nontrivial mappings $π_1[U(1)]\cong\mathbb{Z}$. These contributions cannot be described in terms of conventional physical propagating photons with two transverse polarizations, and instead emerge as a result of tunneling transitions between topologically different but physically identical vacuum winding states.\exclude{These new terms give an extra contribution to the Casimir pressure, yet to be measured.} We argue that if the same system is considered in the background of a small external time-dependent E\&M field, then real physical photons will be emitted from the vacuum, similar to the dynamical Casimir effect (DCE) where photons are radiated from the vacuum due to time-dependent boundary conditions. The fundamental technical difficulty for such an analysis is that the radiation of physical photons on mass shell is inherently a real-time Minkowskian phenomenon while the vacuum fluctuations interpolating between topological $|k\rangle$ sectors rest upon a Euclidean instanton formulation. We overcome this obstacle by introducing auxiliary topological fields which allows for a simple analytical continuation between Minkowski and Euclidean descriptions, and develop a quantum mechanical technique to compute these effects. We also propose an experimental realization of such small effects using a microwave cavity with appropriate boundary conditions. Finally, we comment on the possible cosmological implications of this effect.

hep-th↗