arXiv subjects

Yuan Yao

Publications and source records attributed to Yuan Yao.

At least 361 records · Page 20Linked to original sources

arXiv2017

Learning Rates of Regression with q-norm Loss and Threshold

This paper studies some robust regression problems associated with the $q$-norm loss ($q\ge1$) and the $ε$-insensitive $q$-norm loss in the reproducing kernel Hilbert space. We establish a variance-expectation bound under a priori noise condition on the conditional distribution, which is the key technique to measure the error bound. Explicit learning rates will be given under the approximation ability assumptions on the reproducing kernel Hilbert space.

math.ST↗

arXiv2016

Optical frequency divider with division uncertainty at the 10^(-21) level

Optical clocks with unprecedented accuracy of 10^(-18) will lead to innovations in many research areas. All the applications of optical clocks rely on the ability of precisely converting the frequency from one optical clock to another, or particularly to the frequencies in the fiber telecom band for long-distance transmission. Here, we report a low-noise, high precision optical frequency divider. It can realize accurate optical frequency conversion as well as enable precise measurement of optical frequency ratios. By comparing against the frequency ratio between the fundamental and the second harmonic of a 1064 nm laser rather than a second similar system, the optical frequency divider is demonstrated to have a frequency division instability of 6e-19 at 1 s and a fractional frequency division uncertainty of 1.4e-21, nearly three orders of magnitude better than the most accurate optical clocks. It allows optical clocks to be accessible to many precision measurement applications.

physics.optics↗

arXiv2016

Parsimonious Mixed-Effects HodgeRank for Crowdsourced Preference Aggregation

In crowdsourced preference aggregation, it is often assumed that all the annotators are subject to a common preference or utility function which generates their comparison behaviors in experiments. However, in reality annotators are subject to variations due to multi-criteria, abnormal, or a mixture of such behaviors. In this paper, we propose a parsimonious mixed-effects model based on HodgeRank, which takes into account both the fixed effect that the majority of annotators follows a common linear utility model, and the random effect that a small subset of annotators might deviate from the common significantly and exhibits strongly personalized preferences. HodgeRank has been successfully applied to subjective quality evaluation of multimedia and resolves pairwise crowdsourced ranking data into a global consensus ranking and cyclic conflicts of interests. As an extension, our proposed methodology further explores the conflicts of interests through the random effect in annotator specific variations. The key algorithm in this paper establishes a dynamic path from the common utility to individual variations, with different levels of parsimony or sparsity on personalization, based on newly developed Linearized Bregman Algorithms with Inverse Scale Space method. Finally the validity of the methodology are supported by experiments with both simulated examples and three real-world crowdsourcing datasets, which shows that our proposed method exhibits better performance (i.e. smaller test error) compared with HodgeRank due to its parsimonious property.

cs.HC↗

arXiv2016

False Discovery Rate Control and Statistical Quality Assessment of Annotators in Crowdsourced Ranking

With the rapid growth of crowdsourcing platforms it has become easy and relatively inexpensive to collect a dataset labeled by multiple annotators in a short time. However due to the lack of control over the quality of the annotators, some abnormal annotators may be affected by position bias which can potentially degrade the quality of the final consensus labels. In this paper we introduce a statistical framework to model and detect annotator's position bias in order to control the false discovery rate (FDR) without a prior knowledge on the amount of biased annotators - the expected fraction of false discoveries among all discoveries being not too high, in order to assure that most of the discoveries are indeed true and replicable. The key technical development relies on some new knockoff filters adapted to our problem and new algorithms based on the Inverse Scale Space dynamics whose discretization is potentially suitable for large scale crowdsourcing data analysis. Our studies are supported by experiments with both simulated examples and real-world data. The proposed framework provides us a useful tool for quantitatively studying annotator's abnormal behavior in crowdsourcing data arising from machine learning, sociology, computer vision, multimedia, etc.

stat.ML↗

arXiv2016

A Tutorial on Libra: R package for the Linearized Bregman Algorithm in High Dimensional Statistics

The R package, Libra, stands for the LInearized BRegman Al- gorithm in high dimensional statistics. The Linearized Bregman Algorithm is a simple iterative procedure to generate sparse regularization paths of model estimation, which are rstly discovered in applied mathematics for image restoration and particularly suitable for parallel implementation in large scale problems. The limit of such an algorithm is a sparsity-restricted gradient descent ow, called the Inverse Scale Space, evolving along a par- simonious path of sparse models from the null model to over tting ones. In sparse linear regression, the dynamics with early stopping regularization can provably meet the unbiased Oracle estimator under nearly the same condition as LASSO, while the latter is biased. Despite their successful applications, statistical consistency theory of such dynamical algorithms remains largely open except for some recent progress on linear regression. In this tutorial, algorithmic implementations in the package are discussed for several widely used sparse models in statistics, including linear regression, logistic regres- sion, and several graphical models (Gaussian, Ising, and Potts). Besides the simulation examples, various application cases are demonstrated, with real world datasets from diabetes, publications of COPSS award winners, as well as social networks of two Chinese classic novels, Journey to the West and Dream of the Red Chamber.

stat.AP↗

arXiv2016

Analysis of Crowdsourced Sampling Strategies for HodgeRank with Sparse Random Graphs

Crowdsourcing platforms are now extensively used for conducting subjective pairwise comparison studies. In this setting, a pairwise comparison dataset is typically gathered via random sampling, either \emph{with} or \emph{without} replacement. In this paper, we use tools from random graph theory to analyze these two random sampling methods for the HodgeRank estimator. Using the Fiedler value of the graph as a measurement for estimator stability (informativeness), we provide a new estimate of the Fiedler value for these two random graph models. In the asymptotic limit as the number of vertices tends to infinity, we prove the validity of the estimate. Based on our findings, for a small number of items to be compared, we recommend a two-stage sampling strategy where a greedy sampling method is used initially and random sampling \emph{without} replacement is used in the second stage. When a large number of items is to be compared, we recommend random sampling with replacement as this is computationally inexpensive and trivially parallelizable. Experiments on synthetic and real-world datasets support our analysis.

stat.ML↗

arXiv2016

Sparse Recovery via Differential Inclusions

In this paper, we recover sparse signals from their noisy linear measurements by solving nonlinear differential inclusions, which is based on the notion of inverse scale space (ISS) developed in applied mathematics. Our goal here is to bring this idea to address a challenging problem in statistics, \emph{i.e.} finding the oracle estimator which is unbiased and sign-consistent using dynamics. We call our dynamics \emph{Bregman ISS} and \emph{Linearized Bregman ISS}. A well-known shortcoming of LASSO and any convex regularization approaches lies in the bias of estimators. However, we show that under proper conditions, there exists a bias-free and sign-consistent point on the solution paths of such dynamics, which corresponds to a signal that is the unbiased estimate of the true signal and whose entries have the same signs as those of the true signs, \emph{i.e.} the oracle estimator. Therefore, their solution paths are regularization paths better than the LASSO regularization path, since the points on the latter path are biased when sign-consistency is reached. We also show how to efficiently compute their solution paths in both continuous and discretized settings: the full solution paths can be exactly computed piece by piece, and a discretization leads to \emph{Linearized Bregman iteration}, which is a simple iterative thresholding rule and easy to parallelize. Theoretical guarantees such as sign-consistency and minimax optimal $l_2$-error bounds are established in both continuous and discrete settings for specific points on the paths. Early-stopping rules for identifying these points are given. The key treatment relies on the development of differential inequalities for differential inclusions and their discretizations, which extends the previous results and leads to exponentially fast recovering of sparse signals before selecting wrong ones.

math.ST↗

arXiv2015

Aharonov-Bohm phases in a quantum LC circuit

We study novel types of contributions to the partition function of the Maxwell system defined on a small compact manifold. These contributions, often not addressed in the perturbative treatment with physical photons, emerge as a result of tunneling transitions between topologically distinct but physically identical vacuum winding states. These new terms give an extra contribution to the Casimir pressure, yet to be measured. We argue that this effect is highly sensitive to a small external electric field, which should be contrasted with the conventional Casimir effect where the vacuum photons are essentially unaffected by any external field. Furthermore, photons will be emitted from the vacuum in response to a time-dependent electric field, similar to the dynamical Casimir effect in which real particles are radiated from the vacuum due to the time-dependent boundary conditions. We also propose an experimental setup using a quantum LC circuit to detect this novel effect. We expect physical electric charges to appear on the capacitor plates when the system dimension is such that coherent Aharonov-Bohm phases can be maintained over macroscopically large distances.

hep-th↗

arXiv2015

High Electron Mobility and Large Magnetoresistance in the Half-Heusler Semimetal LuPtBi

Materials with high carrier mobility showing large magnetoresistance (MR) have recently received much attention because of potential applications in future high-performance magneto-electric devices. Here, we report on the discovery of an electron-hole-compensated half-Heusler semimetal LuPtBi that exhibits an extremely high electron mobility of up to 79000 cm2/Vs with a non-saturating positive MR as large as 3200% at 2 K. Remarkably, the mobility at 300 K is found to exceed 10500 cm2/Vs, which is among the highest values reported in three-dimensional bulk materials thus far. The clean Shubnikov-de Haas quantum oscillation observed at low temperatures and the first-principles calculations together indicate that the high electron mobility is due to a rather small effective carrier mass caused by the distinctive band structure of the crystal. Our finding provide a new approach for finding large, high-mobility MR materials by designing an appropriate Fermi surface topology starting from simple electron-hole-compensated semimetals.

cond-mat.mtrl-sci↗

arXiv2015

Mixed and missing data: a unified treatment with latent graphical models

We propose to learn latent graphical models when data have mixed variables and missing values. This model could be used for further data analysis, including regression, classification, ranking etc. It also could be used for imputing missing values. We specify a latent Gaussian model for the data, where the categorical variables are generated by discretizing an unobserved variable and the latent variables are multivariate Gaussian. The observed data consists of two parts: observed Gaussian variables and observed categorical variables, where the latter part is considered as partially missing Gaussian variables. We use the Expectation-Maximization algorithm to fit the model. To prevent overfitting we use sparse inverse covariance estimation to obtain sparse estimate of the latent covariance matrix, equivalently, the graphical model. The fitted model then could be used for problems including re- gression, classification and ranking. Such an approach is applied to a medical data set where our method outperforms the state-of-the-art methods. Simulation studies and real data results suggest that our proposed model performs better than random forest in terms of prediction error when the model is correctly specified, and is a better imputation method than hot deck imputation even if the model is not correctly specified.

stat.ME↗

arXiv2015

Robust Subjective Visual Property Prediction from Crowdsourced Pairwise Labels

The problem of estimating subjective visual properties from image and video has attracted increasing interest. A subjective visual property is useful either on its own (e.g. image and video interestingness) or as an intermediate representation for visual recognition (e.g. a relative attribute). Due to its ambiguous nature, annotating the value of a subjective visual property for learning a prediction model is challenging. To make the annotation more reliable, recent studies employ crowdsourcing tools to collect pairwise comparison labels because human annotators are much better at ranking two images/videos (e.g. which one is more interesting) than giving an absolute value to each of them separately. However, using crowdsourced data also introduces outliers. Existing methods rely on majority voting to prune the annotation outliers/errors. They thus require large amount of pairwise labels to be collected. More importantly as a local outlier detection method, majority voting is ineffective in identifying outliers that can cause global ranking inconsistencies. In this paper, we propose a more principled way to identify annotation outliers by formulating the subjective visual property prediction task as a unified robust learning to rank problem, tackling both the outlier detection and learning to rank jointly. Differing from existing methods, the proposed method integrates local pairwise comparison labels together to minimise a cost that corresponds to global inconsistency of ranking order. This not only leads to better detection of annotation outliers but also enables learning with extremely sparse annotations. Extensive experiments on various benchmark datasets demonstrate that our new approach significantly outperforms state-of-the-arts alternatives.

cs.CV↗

arXiv2015

Embeddings and immersions of tropical curves

We construct immersions of trivalent abstract tropical curves in the Euclidean plane and embeddings of all abstract tropical curves in higher dimensional Euclidean space. Since not all curves have an embedding in the plane, we define the tropical crossing number of an abstract tropical curve to be the minimum number of self-intersections, counted with multiplicity, over all its immersions in the plane. We show that the tropical crossing number is at most quadratic in the number of edges and this bound is sharp. For curves of genus up to two, we systematically compute the crossing number. Finally, we use our immersed tropical curves to construct totally faithful nodal algebraic curves via lifting results of Mikhalkin and Shustin.

math.CO↗

arXiv2015

Determining phase-space properties of the IHEP RFQ output beam using the RMS beam widths from wire-scanners

A beam line is built after the IHEP RFQ for halo study. To determine transverse emittance and ellipse parameters of the RFQ output beam, beam size data obtained from the first two of 14 wire scanners are employed. By using the transfer matrix method and the least square method, a set of linear equations were set up and solved. The solutions were then applied as initial beam parameters in multi-particle simulations to check the method of calculation. It is shown that difference between the simulated RMS beam size and the measured one at the measurement location is less than 7%, which is acceptable in our experiments.

physics.acc-ph↗

arXiv2015

Low-temperature linear transport of two-dimensional massive Dirac fermions in silicene: residual conductivity and spin/valley Hall effects

Considering finite-temperature screened electron-impurity scattering, we present a kinetic equation approach to investigate transport properties of two-dimensional massive fermions in silicene. We find that the longitudinal conductivity is always nonvanishing when chemical potential lies within the energy gap. This residual conductivity arises from interband correlation and strongly depends on strength of electron-impurity scattering. We also clarify that the electron-impurity interaction makes substantial contributions to the spin- and valley-Hall conductivities, which, however, are almost independent of impurity density. The dependencies of longitudinal conductivity as well as of spin- and valley-Hall conductivities on chemical potential, on temperature, and on gap energy are analyzed.

cond-mat.mes-hall↗

arXiv2015

Geometric Tight Frame based Stylometry for Art Authentication of van Gogh Paintings

This paper is about authenticating genuine van Gogh paintings from forgeries. The authentication process depends on two key steps: feature extraction and outlier detection. In this paper, a geometric tight frame and some simple statistics of the tight frame coefficients are used to extract features from the paintings. Then a forward stage-wise rank boosting is used to select a small set of features for more accurate classification so that van Gogh paintings are highly concentrated towards some center point while forgeries are spread out as outliers. Numerical results show that our method can achieve 86.08% classification accuracy under the leave-one-out cross-validation procedure. Our method also identifies five features that are much more predominant than other features. Using just these five features for classification, our method can give 88.61% classification accuracy which is the highest so far reported in literature. Evaluation of the five features is also performed on two hundred datasets generated by bootstrap sampling with replacement. The median and the mean are 88.61% and 87.77% respectively. Our results show that a small set of statistics of the tight frame coefficients along certain orientations can serve as discriminative features for van Gogh paintings. It is more important to look at the tail distributions of such directional coefficients than mean values and standard deviations. It reflects a highly consistent style in van Gogh's brushstroke movements, where many forgeries demonstrate a more diverse spread in these features.

cs.LG↗

arXiv2014

Regression Analysis with Response-biased Sampling

Response-biased sampling, in which samples are drawn from a popula- tion according to the values of the response variable, is common in biomedical, epidemiological, economic and social studies. In particular, the complete obser- vations in data with censoring, truncation or missing covariates can be regarded as response-biased sampling under certain conditions. This paper proposes to use transformation models, known as the generalized accelerated failure time model in econometrics, for regression analysis with response-biased sampling. With unknown error distribution, the transformation models are broad enough to cover linear re- gression models, the Cox's model and the proportional odds model as special cases. To the best of our knowledge, except for the case-control logistic regression, there is no report in the literature that a prospective estimation approach can work for biased sampling without any modification. We prove that the maximum rank corre- lation estimation is valid for response-biased sampling and establish its consistency and asymptotic normality. Unlike the inverse probability methods, the proposed method of estimation does not involve the sampling probabilities, which are often difficult to obtain in practice. Without the need of estimating the unknown trans- formation function or the error distribution, the proposed method is numerically easy to implement with the Nelder-Mead simplex algorithm, which does not require convexity or continuity. We propose an inference procedure using random weight- ing to avoid the complication of density estimation when using the plug-in rule for variance estimation. Numerical studies with supportive evidence are presented. Applications are illustrated with the Forbes Global 2000 data and the Stanford heart transplant data.

stat.ME↗

arXiv2014

Fast Adaptive Algorithm for Robust Evaluation of Quality of Experience

Outlier detection is an integral part of robust evaluation for crowdsourceable Quality of Experience (QoE) and has attracted much attention in recent years. In QoE for multimedia, outliers happen because of different test conditions, human errors, abnormal variations in context, {etc}. In this paper, we propose a simple yet effective algorithm for outlier detection and robust QoE evaluation named iterative Least Trimmed Squares (iLTS). The algorithm assigns binary weights to samples, i.e., 0 or 1 indicating if a sample is an outlier, then the outlier-trimmed subset least squares solutions give robust ranking scores. An iterative optimization is carried alternatively between updating weights and ranking scores which converges to a local optimizer in finite steps. In our test setting, iLTS is up to 190 times faster than LASSO-based methods with a comparable performance. Moreover, a varied version of this method shows adaptation in outlier detection, which provides an automatic detection to determine whether a data sample is an outlier without \emph{a priori} knowledge about the amount of the outliers. The effectiveness and efficiency of iLTS are demonstrated on both simulated examples and real-world applications. A Matlab package is provided to researchers exploiting crowdsourcing paired comparison data for robust ranking.

cs.MM↗

arXiv2014

Black Silicon Solar Thin-film Microcells Integrating Top Nanocone Structures for Broadband and Omnidirectional Light-Trapping

Recently developed classes of monocrystalline silicon solar microcells (u-cell) can be assembled into modules with characteristics (i.e., mechanically flexible forms, compact concentrator designs, and high-voltage outputs) that would be impossible to achieve using conventional, wafer-based approaches. In this paper, we describe a highly dense, uniform and non-periodic nanocone forest structure of black silicon (bSi) created on optically-thin (30 um) u-cells for broadband and omnidirectional light-trapping with a lithography-free and high-throughput plasma texturizing process. With optimized plasma etching conditions and a silicon nitride passivation layer, black silicon u-cells, when embedded in a polymer waveguiding layer, display dramatic increases of as much as 65.7% in short circuit current, as compared to a bare silicon device. The conversion efficiency increases from 8% to 11.5% with a small drop in open circuit voltage and fill factor.

physics.optics↗