arXiv Science⌕ Search

arXiv subjects

Yuchen Liu

Publications and source records attributed to Yuchen Liu.

At least 253 records · Page 14Linked to original sources
arXiv2020

Rethinking Class-Discrimination Based CNN Channel Pruning

Channel pruning has received ever-increasing focus on network compression. In particular, class-discrimination based channel pruning has made major headway, as it fits seamlessly with the classification objective of CNNs and provides good explainability. Prior works singly propose and evaluate their discriminant functions, while further study on the effectiveness of the adopted metrics is absent. To this end, we initiate the first study on the effectiveness of a broad range of discriminant functions on channel pruning. Conventional single-variate binary-class statistics like Student's T-Test are also included in our study via an intuitive generalization. The winning metric of our study has a greater ability to select informative channels over other state-of-the-art methods, which is substantiated by our qualitative and quantitative analysis. Moreover, we develop a FLOP-normalized sensitivity analysis scheme to automate the structural pruning procedure. On CIFAR-10, CIFAR-100, and ILSVRC-2012 datasets, our pruned models achieve higher accuracy with less inference cost compared to state-of-the-art results. For example, on ILSVRC-2012, our 44.3% FLOPs-pruned ResNet-50 has only a 0.3% top-1 accuracy drop, which significantly outperforms the state of the art.

cs.CV↗
arXiv2020

Learning to Make Chemical Predictions: the Interplay of Feature Representation, Data, and Machine Learning Algorithms

Recently supervised machine learning has been ascending in providing new predictive approaches for chemical, biological and materials sciences applications. In this Perspective we focus on the interplay of machine learning algorithm with the chemically motivated descriptors and the size and type of data sets needed for molecular property prediction. Using Nuclear Magnetic Resonance chemical shift prediction as an example, we demonstrate that success is predicated on the choice of feature extracted or real-space representations of chemical structures, whether the molecular property data is abundant and/or experimentally or computationally derived, and how these together will influence the correct choice of popular machine learning algorithms drawn from deep learning, random forests, or kernel methods.

physics.chem-ph↗
arXiv2019

Synchronous Speech Recognition and Speech-to-Text Translation with Interactive Decoding

Speech-to-text translation (ST), which translates source language speech into target language text, has attracted intensive attention in recent years. Compared to the traditional pipeline system, the end-to-end ST model has potential benefits of lower latency, smaller model size, and less error propagation. However, it is notoriously difficult to implement such a model without transcriptions as intermediate. Existing works generally apply multi-task learning to improve translation quality by jointly training end-to-end ST along with automatic speech recognition (ASR). However, different tasks in this method cannot utilize information from each other, which limits the improvement. Other works propose a two-stage model where the second model can use the hidden state from the first one, but its cascade manner greatly affects the efficiency of training and inference process. In this paper, we propose a novel interactive attention mechanism which enables ASR and ST to perform synchronously and interactively in a single model. Specifically, the generation of transcriptions and translations not only relies on its previous outputs but also the outputs predicted in the other task. Experiments on TED speech translation corpora have shown that our proposed model can outperform strong baselines on the quality of speech translation and achieve better speech recognition performances as well.

cs.CL↗
arXiv2019

Accurate Prediction of Chemical Shifts for Aqueous Protein Structure for "Real World" Cases using Machine Learning

Accurate prediction of NMR chemical shifts can in principle help refine aqueous solution structure of proteins to the quality of X-ray structures. We report a new machine learning algorithm for protein chemical shift prediction that outperforms existing chemical shift calculators on realistic NMR solution data. Our UCBShift predictor implements two modules: a transfer prediction module that employs both sequence and structural alignment to select reference candidates for experimental chemical shift replication, and a redesigned machine learning module based on random forest regression which utilizes more, and more carefully curated, feature extracted data. When combined together, this new predictor achieves state of the art accuracy for predicting chemical shifts on a "real-world" dataset, with root-mean-square errors of 0.31 ppm for amide hydrogens, 0.19 ppm for Halpha, 0.87 ppm for C, 0.81 ppm for Calpha, 1.01 ppm for Cbeta, and 1.83 ppm for N, exceeding current prediction accuracy of popular chemical shift predictors such as SPARTA+ and SHIFTX2.

physics.chem-ph↗
arXiv2019

The normalized volume of a singularity is lower semicontinuous

We show that in any $\mathbb{Q}$-Gorenstein flat family of klt singularities, normalized volumes are lower semicontinuous with respect to the Zariski topology. A quick consequence is that smooth points have the largest normalized volume among all klt singularities. Using an alternative characterization of K-semistability developed by Li, Liu and Xu, we show that K-semistability is a very generic or empty condition in any $\mathbb{Q}$-Gorenstein flat family of log Fano pairs.

math.AG↗
arXiv2019

On the Cheltsov--Rubinstein conjecture

In this note we investigate the Cheltsov--Rubinstein conjecture. We show that this conjecture does not hold in general and some counterexamples will be presented.

math.AG↗
arXiv2019

End-to-End Speech Translation with Knowledge Distillation

End-to-end speech translation (ST), which directly translates from source language speech into target language text, has attracted intensive attentions in recent years. Compared to conventional pipeline systems, end-to-end ST models have advantages of lower latency, smaller model size and less error propagation. However, the combination of speech recognition and text translation in one model is more difficult than each of these two tasks. In this paper, we propose a knowledge distillation approach to improve ST model by transferring the knowledge from text translation model. Specifically, we first train a text translation model, regarded as a teacher model, and then ST model is trained to learn output probabilities from teacher model through knowledge distillation. Experiments on English- French Augmented LibriSpeech and English-Chinese TED corpus show that end-to-end ST is possible to implement on both similar and dissimilar language pairs. In addition, with the instruction of teacher model, end-to-end ST model can gain significant improvements by over 3.5 BLEU points.

cs.CL↗
arXiv2019

K-stability of cubic threefolds

We prove the K-moduli space of cubic threefolds is identical to their GIT moduli. More precisely, the K-(semi,poly)-stability of cubic threefolds coincide to the corresponding GIT stabilities, which could be explicitly calculated. In particular, this implies that all smooth cubic threefolds admit Kähler-Einstein metric as well as provides a precise list of singular KE ones. To achieve this, our main new contribution is an estimate in dimension three of the volumes of kawamata log terminal singularities introduced by Chi Li. This is obtained via a detailed study of the classification of three dimensional canonical and terminal singularities, which was established during the study of the explicit three dimensional minimal model program.

math.AG↗
arXiv2019

Radial velocity measurements from LAMOST medium-resolution spectroscopic observations: A pointing towards the Kepler field

Radial velocity is one of key measurements in understanding the fundamental properties of stars, stellar clusters and the Galaxy. A plate of stars in the Kepler field were observed in May of 2018 with the medium-resolution spectrographs of LAMOST, aiming to test the performance of this new system which is the upgraded equipment of LAMOST after the first five-year regular survey.We present our analysis on the radial velocity measurements (RVs) derived from these data. The results show that slight and significant systematic errors exist among the RVs obtained from the spectra collected by different spectrographs and exposures, respectively. After correcting the systematic errors with different techniques, the precision of RVs reaches ~1.3, ~1.0, ~0.5 and ~0.3 km/s at S/Nr = 10, 20, 50, and 100, respectively. Comparing with the RVs of the standard stars of the APOGEE survey, our RVs are calibrated with a zero-point shift of ~7 km/s. The results indicate that the LAMOST medium-resolution spectroscopic system may provide RVs in a reasonable accuracy and precision for the selected targets.

astro-ph.SR↗
arXiv2018

Language-Independent Representor for Neural Machine Translation

Current Neural Machine Translation (NMT) employs a language-specific encoder to represent the source sentence and adopts a language-specific decoder to generate target translation. This language-dependent design leads to large-scale network parameters and makes the duality of the parallel data underutilized. To address the problem, we propose in this paper a language-independent representor to replace the encoder and decoder by using weight sharing. This shared representor can not only reduce large portion of network parameters, but also facilitate us to fully explore the language duality by jointly training source-to-target, target-to-source, left-to-right and right-to-left translations within a multi-task learning framework. Experiments show that our proposed framework can obtain significant improvements over conventional NMT models on resource-rich and low-resource translation tasks with only a quarter of parameters.

cs.CL↗
arXiv2018

The volume of singular Kähler-Einstein Fano varieties

We show that the anti-canonical volume of an $n$-dimensional Kähler-Einstein $\mathbb{Q}$-Fano variety is bounded from above by certain invariants of the local singularities, namely $\mathrm{lct}^n\cdot\mathrm{mult}$ for ideals and the normalized volume function for real valuations. This refines a recent result by Fujita. As an application, we get sharp volume upper bounds for Kähler-Einstein Fano varieties with quotient singularities. Based on very recent results by Li and the author, we show that a Fano manifold is K-semistable if and only if a de Fernex-Ein-Mustaţă type inequality holds on its affine cone.

math.AG↗
arXiv2018

Unsupervised Learning of Neural Networks to Explain Neural Networks

This paper presents an unsupervised method to learn a neural network, namely an explainer, to interpret a pre-trained convolutional neural network (CNN), i.e., explaining knowledge representations hidden in middle conv-layers of the CNN. Given feature maps of a certain conv-layer of the CNN, the explainer performs like an auto-encoder, which first disentangles the feature maps into object-part features and then inverts object-part features back to features of higher conv-layers of the CNN. More specifically, the explainer contains interpretable conv-layers, where each filter disentangles the representation of a specific object part from chaotic input feature maps. As a paraphrase of CNN features, the disentangled representations of object parts help people understand the logic inside the CNN. We also learn the explainer to use object-part features to reconstruct features of higher CNN layers, in order to minimize loss of information during the feature disentanglement. More crucially, we learn the explainer via network distillation without using any annotations of sample labels, object parts, or textures for supervision. We have applied our method to different types of CNNs for evaluation, and explainers have significantly boosted the interpretability of CNN features.

cs.CV↗
arXiv2017

Pixie: A System for Recommending 3+ Billion Items to 200+ Million Users in Real-Time

User experience in modern content discovery applications critically depends on high-quality personalized recommendations. However, building systems that provide such recommendations presents a major challenge due to a massive pool of items, a large number of users, and requirements for recommendations to be responsive to user actions and generated on demand in real-time. Here we present Pixie, a scalable graph-based real-time recommender system that we developed and deployed at Pinterest. Given a set of user-specific pins as a query, Pixie selects in real-time from billions of possible pins those that are most related to the query. To generate recommendations, we develop Pixie Random Walk algorithm that utilizes the Pinterest object graph of 3 billion nodes and 17 billion edges. Experiments show that recommendations provided by Pixie lead up to 50% higher user engagement when compared to the previous Hadoop-based production system. Furthermore, we develop a graph pruning strategy at that leads to an additional 58% improvement in recommendations. Last, we discuss system aspects of Pixie, where a single server executes 1,200 recommendation requests per second with 60 millisecond latency. Today, systems backed by Pixie contribute to more than 80% of all user engagement on Pinterest.

cs.IR↗
arXiv2017

On the semi-continuity problem of normalized volumes of singularities

We show that in any $\mathbb{Q}$-Gorenstein flat family of klt singularities, normalized volumes can only jump down at countably many subvarieties. A quick consequence is that smooth points have the largest normalized volume among all klt singularities. Using an alternative characterization of K-semistability developed by Li, Xu and the author, we show that K-semistability is a very generic or empty condition in any $\mathbb{Q}$-Gorenstein flat family of log Fano pairs.

math.AG↗
arXiv2017

Kähler-Einstein metrics and volume minimization

We prove that if a $\mathbb{Q}$-Fano variety $V$ specially degenerates to a Kähler-Einstein $\mathbb{Q}$-Fano variety $V$, then for any ample Cartier divisor $H=-r^{-1} K_V$ with $r\in \mathbb{Q}_{>0}$, the normalized volume $\widehat{\rm vol}(v)=A_{\mathcal{C}}^n(v)\cdot {\rm vol}(v)$ is globally minimized at the canonical valuation ${\rm ord}_V$ among all real valuations which are centered at the vertex of the affine cone $\mathcal{C}:=C(V,H)$. This is also generalized to the logarithmic and the orbifold setting. As a consequence, we complete the confirmation of a conjecture in [arXiv:1511.08164] on an equivalent characterization of K-semistability for any smooth Fano manifold. We also prove that the valuation associated to the Reeb vector field of a smooth Sasaki-Einstein metric minimizes $\widehat{\rm vol}$ over the corresponding Kähler cone. These results strengthen the minimization result of Martelli-Sparks-Yau [Martelli et al 08].

math.AG↗
arXiv2017

Construction of hyperbolic Horikawa surfaces

We construct a Brody hyperbolic Horikawa surface that is a double cover of $\mathbb{P}^2$ branched along a smooth curve of degree $10$. We also construct Brody hyperbolic double covers of Hirzebruch surfaces with branch loci of the lowest possible bidegree.

math.AG↗