arXiv subjects

Jie Yang

Publications and source records attributed to Jie Yang.

At least 613 records · Page 34Linked to original sources

arXiv2018

Some rigidity characterizations of Einstein metrics as critical points for quadratic curvature functionals

We study rigidity results for the Einstein metrics as the critical points of a family of known quadratic curvature functionals involving the scalar curvature, the Ricci curvature and the Riemannian curvature tensor, characterized by some pointwise inequalities involving the Weyl curvature and the traceless Ricci curvature. Moreover, we also provide a few rigidity results for locally conformally flat critical metrics.

math.DG↗

arXiv2018

Design Challenges and Misconceptions in Neural Sequence Labeling

We investigate the design challenges of constructing effective and efficient neural sequence labeling systems, by reproducing twelve neural sequence labeling models, which include most of the state-of-the-art structures, and conduct a systematic model comparison on three benchmarks (i.e. NER, Chunking, and POS tagging). Misconceptions and inconsistent conclusions in existing literature are examined and clarified under statistical experiments. In the comparison and analysis process, we reach several practical conclusions which can be useful to practitioners.

cs.CL↗

arXiv2018

Chinese NER Using Lattice LSTM

We investigate a lattice-structured LSTM model for Chinese NER, which encodes a sequence of input characters as well as all potential words that match a lexicon. Compared with character-based methods, our model explicitly leverages word and word sequence information. Compared with word-based methods, lattice LSTM does not suffer from segmentation errors. Gated recurrent cells allow our model to choose the most relevant characters and words from a sentence for better NER results. Experiments on various datasets show that lattice LSTM outperforms both word-based and character-based LSTM baselines, achieving the best results.

cs.CL↗

arXiv2018

Adaptive guaranteed-performance consensus design for high-order multiagent systems

The current paper addresses the distributed guaranteed-performance consensus design problems for general high-order linear multiagent systems with leaderless and leader-follower structures, respectively. The information about the Laplacian matrix of the interaction topology or its minimum nonzero eigenvalue is usually required in existing works on the guaranteed-performance consensus, which means that their conclusions are not completely distributed. A new translation-adaptive strategy is proposed to realize the completely distributed guaranteed-performance consensus control by using the structure feature of a complete graph in the current paper. For the leaderless case, an adaptive guaranteed-performance consensualization criterion is given in terms of Riccati inequalities and a regulation approach of the consensus control gain is presented by linear matrix inequalities. Extensions to the leader-follower cases are further investigated. Especially, the guaranteed-performance costs for leaderless and leader-follower cases are determined, respectively, which are associated with the intrinsic structure characteristic of the interaction topologies. Finally, two numerical examples are provided to demonstrate theoretical results.

cs.MA↗

arXiv2018

NCRF++: An Open-source Neural Sequence Labeling Toolkit

This paper describes NCRF++, a toolkit for neural sequence labeling. NCRF++ is designed for quick implementation of different neural sequence labeling models with a CRF inference layer. It provides users with an inference for building the custom model structure through configuration file with flexible neural feature design and utilization. Built on PyTorch, the core operations are calculated in batch, making the toolkit efficient with the acceleration of GPU. It also includes the implementations of most state-of-the-art neural sequence labeling models such as LSTM-CRF, facilitating reproducing and refinement on those methods.

cs.CL↗

arXiv2018

YEDDA: A Lightweight Collaborative Text Span Annotation Tool

In this paper, we introduce \textsc{Yedda}, a lightweight but efficient and comprehensive open-source tool for text span annotation. \textsc{Yedda} provides a systematic solution for text span annotation, ranging from collaborative user annotation to administrator evaluation and analysis. It overcomes the low efficiency of traditional text annotation tools by annotating entities through both command line and shortcut keys, which are configurable with custom labels. \textsc{Yedda} also gives intelligent recommendations by learning the up-to-date annotated text. An administrator client is developed to evaluate annotation quality of multiple annotators and generate detailed comparison report for each annotator pair. Experiments show that the proposed system can reduce the annotation time by half compared with existing annotation tools. And the annotation time can be further compressed by 16.47\% through intelligent recommendation.

cs.CL↗

arXiv2018

Structural phase transition, precursory electronic anomaly and strong-coupling superconductivity in quasi-skutterudite (Sr$_{1-x}$Ca$_{x}$)$_{3}$Ir$_{4}$Sn$_{13}$ and Ca$_{3}$Rh$_{4}$Sn$_{13}$

The interplay between superconductivity and structural phase transition has attracted enormous interests in recent years. For example, in Fe-pnictide high temperature superconductors, quantum fluctuations in association with structural phase transition have been proposed to lead to many novel physical properties and even the superconductivity itself. Here we report a finding that the quasi-skutterudite superconductors (Sr$_{1-x}$Ca$_{x}$)$_{3}$Ir$_{4}$Sn$_{13}$ ($x$ = 0, 0.5, 1) and Ca$_{3}$Rh$_{4}$Sn$_{13}$ show some unusual properties similar to the Fe-pnictides, through $^{119}$Sn nuclear magnetic resonance (NMR) measurements. In (Sr$_{1-x}$Ca$_{x}$)$_{3}$Ir$_{4}$Sn$_{13}$, the NMR linewidth increases below a temperature $T^*$ that is higher than the structural phase transition temperature $T_{\rm s}$. The spin-lattice relaxation rate ($1/T_1$) divided by temperature ($T$), $1/T_1T$, and the Knight shift $K$ increase with decreasing $T$ down to $T^*$, but start to decrease below $T^*$ and followed by more distinct changes at $T_{\rm s}$. In contrast, none of the anomalies was observed in Ca$_{3}$Rh$_{4}$Sn$_{13}$ that does not undergo a structural phase transition. The precursory phenomenon above structural phase transition resembles that occurs in Fe-pnictides. In the superconducting state of Ca$_{3}$Ir$_{4}$Sn$_{13}$, $1/T_{1}$ decays as ${\rm exp}(-Δ/k_{\rm B}T)$ with a large gap $Δ= 2.21 k_{\rm B}T_{\rm c}$, yet without a Hebel-Slichter coherence peak, which indicate strong-coupling superconductivity. Our results provide new insight into the relationship between superconductivity and the electronic-structure change associated with structural phase transition.

cond-mat.supr-con↗

arXiv2018

Bayesian active learning for choice models with deep Gaussian processes

In this paper, we propose an active learning algorithm and models which can gradually learn individual's preference through pairwise comparisons. The active learning scheme aims at finding individual's most preferred choice with minimized number of pairwise comparisons. The pairwise comparisons are encoded into probabilistic models based on assumptions of choice models and deep Gaussian processes. The next-to-compare decision is determined by a novel acquisition function. We benchmark the proposed algorithm and models using functions with multiple local optima and one public airline itinerary dataset. The experiments indicate the effectiveness of our active learning algorithm and models.

stat.ML↗

arXiv2018

A Low-Resolution ADC Module Assisted Hybrid Beamforming Architecture for mmWave Communications

We propose a low-resolution analog-to-digital converter (ADC) module assisted hybrid beamforming architecture for millimeter-wave (mmWave) communications. We prove that the proposed low-cost and flexible architecture can reduce the beam training time and complexity dramatically without degradation in the data transmission performance. In addition, we design a fast beam training method which is suitable for the proposed system architecture. The proposed beam training method requires only L + 1 (where L is the number of paths) time slots which is smaller compared to the state-of-the-art.

cs.IT↗

arXiv2018

Leveraging Crowdsourcing Data For Deep Active Learning - An Application: Learning Intents in Alexa

This paper presents a generic Bayesian framework that enables any deep learning model to actively learn from targeted crowds. Our framework inherits from recent advances in Bayesian deep learning, and extends existing work by considering the targeted crowdsourcing approach, where multiple annotators with unknown expertise contribute an uncontrolled amount (often limited) of annotations. Our framework leverages the low-rank structure in annotations to learn individual annotator expertise, which then helps to infer the true labels from noisy and sparse annotations. It provides a unified Bayesian model to simultaneously infer the true labels and train the deep learning model in order to reach an optimal learning efficacy. Finally, our framework exploits the uncertainty of the deep learning model during prediction as well as the annotators' estimated expertise to minimize the number of required annotations and annotators for optimally training the deep learning model. We evaluate the effectiveness of our framework for intent classification in Alexa (Amazon's personal assistant), using both synthetic and real-world datasets. Experiments show that our framework can accurately learn annotator expertise, infer true labels, and effectively reduce the amount of annotations in model training as compared to state-of-the-art approaches. We further discuss the potential of our proposed framework in bridging machine learning and crowdsourcing towards improved human-in-the-loop systems.

cs.LG↗

arXiv2018

Discriminative Localization in CNNs for Weakly-Supervised Segmentation of Pulmonary Nodules

Automated detection and segmentation of pulmonary nodules on lung computed tomography (CT) scans can facilitate early lung cancer diagnosis. Existing supervised approaches for automated nodule segmentation on CT scans require voxel-based annotations for training, which are labor- and time-consuming to obtain. In this work, we propose a weakly-supervised method that generates accurate voxel-level nodule segmentation trained with image-level labels only. By adapting a convolutional neural network (CNN) trained for image classification, our proposed method learns discriminative regions from the activation maps of convolution units at different scales, and identifies the true nodule location with a novel candidate-screening framework. Experimental results on the public LIDC-IDRI dataset demonstrate that, our weakly-supervised nodule segmentation framework achieves competitive performance compared to a fully-supervised CNN-based segmentation method.

cs.CV↗

arXiv2018

Robustness of classification ability of spiking neural networks

It is well-known that the robustness of artificial neural networks (ANNs) is important for their wide ranges of applications. In this paper, we focus on the robustness of the classification ability of a spiking neural network which receives perturbed inputs. Actually, the perturbation is allowed to be arbitrary styles. However, Gaussian perturbation and other regular ones have been rarely investigated. For classification problems, the closer to the desired point, the more perturbed points there are in the input space. In addition, the perturbation may be periodic. Based on these facts, we only consider sinusoidal and Gaussian perturbations in this paper. With the SpikeProp algorithm, we perform extensive experiments on the classical XOR problem and other three benchmark datasets. The numerical results show that there is not significant reduction in the classification ability of the network if the input signals are subject to sinusoidal and Gaussian perturbations.

stat.ML↗

arXiv2018

Edge-Preserving Piecewise Linear Image Smoothing Using Piecewise Constant Filters

Most image smoothing filters in the literature assume a piecewise constant model of smoothed output images. However, the piecewise constant model assumption can cause artifacts such as gradient reversals in applications such as image detail enhancement, HDR tone mapping, etc. In these applications, a piecewise linear model assumption is more preferred. In this paper, we propose a simple yet very effective framework to smooth images of piecewise linear model assumption using classical filters with the piecewise constant model assumption. Our method is capable of handling with gradient reversal artifacts caused by the piecewise constant model assumption. In addition, our method can further help accelerated methods, which need to quantize image intensity values into different bins, to achieve similar results that need a large number of bins using a much smaller number of bins. This can greatly reduce the computational cost. We apply our method to various classical filters with the piecewise constant model assumption. Experimental results of several applications show the effectiveness of the proposed method.

cs.GR↗

arXiv2017

Mesh-based Autoencoders for Localized Deformation Component Analysis

Spatially localized deformation components are very useful for shape analysis and synthesis in 3D geometry processing. Several methods have recently been developed, with an aim to extract intuitive and interpretable deformation components. However, these techniques suffer from fundamental limitations especially for meshes with noise or large-scale deformations, and may not always be able to identify important deformation components. In this paper we propose a novel mesh-based autoencoder architecture that is able to cope with meshes with irregular topology. We introduce sparse regularization in this framework, which along with convolutional operations, helps localize deformations. Our framework is capable of extracting localized deformation components from mesh data sets with large-scale deformations and is robust to noise. It also provides a nonlinear approach to reconstruction of meshes using the extracted basis, which is more effective than the current linear combination approach. Extensive experiments show that our method outperforms state-of-the-art methods in both qualitative and quantitative evaluations.

cs.GR↗

arXiv2017

D-optimal Designs with Ordered Categorical Data

Cumulative link models have been widely used for ordered categorical responses. Uniform allocation of experimental units is commonly used in practice, but often suffers from a lack of efficiency. We consider D-optimal designs with ordered categorical responses and cumulative link models. For a predetermined set of design points, we derive the necessary and sufficient conditions for an allocation to be locally D-optimal and develop efficient algorithms for obtaining approximate and exact designs. We prove that the number of support points in a minimally supported design only depends on the number of predictors, which can be much less than the number of parameters in the model. We show that a D-optimal minimally supported allocation in this case is usually not uniform on its support points. In addition, we provide EW D-optimal designs as a highly efficient surrogate to Bayesian D-optimal designs. Both of them can be much more robust than uniform designs.

math.ST↗

arXiv2017

Multi-stage Suture Detection for Robot Assisted Anastomosis based on Deep Learning

In robotic surgery, task automation and learning from demonstration combined with human supervision is an emerging trend for many new surgical robot platforms. One such task is automated anastomosis, which requires bimanual needle handling and suture detection. Due to the complexity of the surgical environment and varying patient anatomies, reliable suture detection is difficult, which is further complicated by occlusion and thread topologies. In this paper, we propose a multi-stage framework for suture thread detection based on deep learning. Fully convolutional neural networks are used to obtain the initial detection and the overlapping status of suture thread, which are later fused with the original image to learn a gradient road map of the thread. Based on the gradient road map, multiple segments of the thread are extracted and linked to form the whole thread using a curvilinear structure detector. Experiments on two different types of sutures demonstrate the accuracy of the proposed framework.

cs.CV↗

arXiv2017

Configuration Memory in Patchwork Dynamics for Low-dimensional Spin Glasses

A patchwork method is used to study the dynamics of loss and recovery of an initial configuration in spin glass models in dimensions d=1 and d=2. The patchwork heuristic is used to accelerate the dynamics to investigate how models might reproduce the remarkable memory effects seen in experiment. Starting from a ground state configuration computed for one choice of nearest neighbor spin couplings, the sample is aged up to a given scale under new random couplings, leading to the partial erasure of the original ground state. The couplings are then restored to the original choice and patchwork coarsening is again applied, in order to assess the recovery of the original state. Eventual recovery of the original ground state upon coarsening is seen in two-dimensional Ising spin glasses and one-dimensional Potts models, while one-dimensional Ising glasses neither lose nor gain overlap with the ground state during the recovery stage. The recovery for the two-dimensional Ising spin glasses suggests scaling relations that lead to a recovery length scale that grows as a power of the aging length scale.

cond-mat.dis-nn↗

arXiv2017

Atomic theory of viscoelastic response and memory effects in metallic glasses

An atomic-scale theory of the viscoelastic response of metallic glasses is derived from first principles, using a Zwanzig-Caldeira-Leggett system-bath Hamiltonian as a starting point within the framework of nonaffine linear response to mechanical deformation. This approach provides a Generalized-Langevin-Equation (GLE) as the average equation of motion for an atom or ion in the material, from which non-Markovian nonaffine viscoelastic moduli are extracted. These can be evaluated using the vibrational density of states (DOS) as input, where the boson peak plays a prominent role for the mechanics. To compare with experimental data of binary ZrCu alloys, numerical DOS was obtained from simulations of this system, which take also electronic degrees of freedom into account via the embedded atom method (EAM) for the interatomic potential. It is shown that the viscoelastic $α$-relaxation, including the $α$-wing asymmetry in the loss modulus, can be very well described by the theory if the memory kernel (the non-Markovian friction) in the GLE is taken to be a stretched-exponential decaying function of time. This finding directly implies strong memory effects in the atomic-scale dynamics, and suggests that the $α$-relaxation time is related to the characteristic time-scale over which atoms retain memory of their previous collision history. This memory time grows dramatically below the glass transition.

cond-mat.soft↗