arXiv Science⌕ Search

arXiv subjects

Yu-Feng Li

Publications and source records attributed to Yu-Feng Li.

133 records · Page 8Linked to original sources

Convex and Scalable Weakly Labeled SVMs

In this paper, we study the problem of learning from weakly labeled data, where labels of the training examples are incomplete. This includes, for example, (i) semi-supervised learning where labels are partially known; (ii) multi-instance learning where labels are implicitly known; and (iii) clustering where labels are completely unknown. Unlike supervised learning, learning with weak labels involves a difficult Mixed-Integer Programming (MIP) problem. Therefore, it can suffer from poor scalability and may also get stuck in local minimum. In this paper, we focus on SVMs and propose the WellSVM via a novel label generation strategy. This leads to a convex relaxation of the original MIP, which is at least as tight as existing convex Semi-Definite Programming (SDP) relaxations. Moreover, the WellSVM can be solved via a sequence of SVM subproblems that are much more scalable than previous convex SDP relaxations. Experiments on three weakly labeled learning tasks, namely, (i) semi-supervised learning; (ii) multi-instance learning for locating regions of interest in content-based information retrieval; and (iii) clustering, clearly demonstrate improved performance, and WellSVM is also readily applicable on large data sets.

cs.LG↗

Unambiguous Determination of the Neutrino Mass Hierarchy Using Reactor Neutrinos

Determination of the neutrino mass hierarchy in a reactor neutrino experiment at medium baseline is discussed. Observation of the interference effects between the Δm^2_{31} and Δm^2_{32} oscillations enables a relative measurement independent of the knowledge of the absolute mass-squared difference. With a 20 kton liquid scintillator detector of 3%/\sqrt{E(MeV)} energy resolution, the Daya Bay II Experiment at a baseline of \sim 50 km from reactors of total thermal power 36 GW can determine the mass hierarchy at a confidence level of Δχ^2_{MH} \sim (10-12) (3-3.5 σ) in 6 years after taking into account the real spatial distribution of reactor cores. We show that the unknown residual energy non-linearity of the liquid scintillator detector has limited impact on the sensitivity due to the self-calibration of small oscillation peaks. Furthermore, an extra increase of Δχ^2_{MH} \simeq 4(9) can be obtained, by including the precise measurement of the effective mass-squared difference Δm^2_{μμ} of expected relative error 1.5% (1%) from ongoing long-baseline muon neutrino disappearance experiments. The sensitivities from the interference and from absolute measurements can be cross checked. When combining these two, the mass hierarchy can be determined at a confidence level of Δχ^2_{MH} \sim (15-20) (4 σ) in 6 years.

hep-ex↗

Improved Bound for the Nystrom's Method and its Application to Kernel Classification

We develop two approaches for analyzing the approximation error bound for the Nyström method, one based on the concentration inequality of integral operator, and one based on the compressive sensing theory. We show that the approximation error, measured in the spectral norm, can be improved from $O(N/\sqrt{m})$ to $O(N/m^{1 - ρ})$ in the case of large eigengap, where $N$ is the total number of data points, $m$ is the number of sampled data points, and $ρ\in (0, 1/2)$ is a positive constant that characterizes the eigengap. When the eigenvalues of the kernel matrix follow a $p$-power law, our analysis based on compressive sensing theory further improves the bound to $O(N/m^{p - 1})$ under an incoherence assumption, which explains why the Nyström method works well for kernel matrix with skewed eigenvalues. We present a kernel classification approach based on the Nyström method and derive its generalization performance using the improved bound. We show that when the eigenvalues of kernel matrix follow a $p$-power law, we can reduce the number of support vectors to $N^{2p/(p^2 - 1)}$, a number less than $N$ when $p > 1+\sqrt{2}$, without seriously sacrificing its generalization performance.

cs.LG↗

Multi-Instance Multi-Label Learning

In this paper, we propose the MIML (Multi-Instance Multi-Label learning) framework where an example is described by multiple instances and associated with multiple class labels. Compared to traditional learning frameworks, the MIML framework is more convenient and natural for representing complicated objects which have multiple semantic meanings. To learn from MIML examples, we propose the MimlBoost and MimlSvm algorithms based on a simple degeneration strategy, and experiments show that solving problems involving complicated objects with multiple semantic meanings in the MIML framework can lead to good performance. Considering that the degeneration process may lose information, we propose the D-MimlSvm algorithm which tackles MIML problems directly in a regularization framework. Moreover, we show that even when we do not have access to the real objects and thus cannot capture more information from real objects by using the MIML representation, MIML is still useful. We propose the InsDif and SubCod algorithms. InsDif works by transforming single-instances into the MIML representation for learning, while SubCod works by transforming single-label examples into the MIML representation for learning. Experiments show that in some tasks they are able to achieve better performance than learning the single-instances or single-label examples directly.

cs.LG↗

Improving Semi-Supervised Support Vector Machines Through Unlabeled Instances Selection

Semi-supervised support vector machines (S3VMs) are a kind of popular approaches which try to improve learning performance by exploiting unlabeled data. Though S3VMs have been found helpful in many situations, they may degenerate performance and the resultant generalization ability may be even worse than using the labeled data only. In this paper, we try to reduce the chance of performance degeneration of S3VMs. Our basic idea is that, rather than exploiting all unlabeled data, the unlabeled instances should be selected such that only the ones which are very likely to be helpful are exploited, while some highly risky unlabeled instances are avoided. We propose the S3VM-\emph{us} method by using hierarchical clustering to select the unlabeled instances. Experiments on a broad range of data sets over eighty-eight different settings show that the chance of performance degeneration of S3VM-\emph{us} is much smaller than that of existing S3VMs.

cs.LG↗

Matter Effects in Solar Neutrino Active-Sterile Oscillations

We study the matter effects for solar neutrino oscillations in a general scheme, without any constraint on the number of sterile neutrinos and the mixing matrix elements, only assuming a realistic hierarchy of neutrino squared-mass differences in which the smallest squared-mass difference is effective in solar neutrino oscillations. The validity of the analytic results are illustrated with a numerical solution of the evolution equation in the simplest case of four-neutrino mixing with the realistic matter density profile inside the Sun.

hep-ph↗

Multi-Instance Learning by Treating Instances As Non-I.I.D. Samples

Multi-instance learning attempts to learn from a training set consisting of labeled bags each containing many unlabeled instances. Previous studies typically treat the instances in the bags as independently and identically distributed. However, the instances in a bag are rarely independent, and therefore a better performance can be expected if the instances are treated in an non-i.i.d. way that exploits the relations among instances. In this paper, we propose a simple yet effective multi-instance learning method, which regards each bag as a graph and uses a specific kernel to distinguish the graphs by considering the features of the nodes as well as the features of the edges that convey some relations among instances. The effectiveness of the proposed method is validated by experiments.

cs.LG↗