arXiv Science⌕ Search

arXiv subjects

Yuan Zhang

Publications and source records attributed to Yuan Zhang.

At least 397 records · Page 22Linked to original sources
arXiv2019

PAWS-X: A Cross-lingual Adversarial Dataset for Paraphrase Identification

Most existing work on adversarial data generation focuses on English. For example, PAWS (Paraphrase Adversaries from Word Scrambling) consists of challenging English paraphrase identification pairs from Wikipedia and Quora. We remedy this gap with PAWS-X, a new dataset of 23,659 human translated PAWS evaluation pairs in six typologically distinct languages: French, Spanish, German, Chinese, Japanese, and Korean. We provide baseline numbers for three models with different capacity to capture non-local context and sentence structure, and using different multilingual training and evaluation regimes. Multilingual BERT fine-tuned on PAWS English plus machine-translated data performs the best, with a range of 83.1-90.8 accuracy across the non-English languages and an average accuracy gain of 23% over the next best model. PAWS-X shows the effectiveness of deep, multilingual pre-training while also leaving considerable headroom as a new challenge to drive multilingual research that better captures structure and contextual information.

cs.CL↗
arXiv2019

Observation of a Room Temperature Two-dimensional Ferroelectric Metal

Materials with reduced dimensions have been shown to host a wide variety of exotic properties and novel quantum states that often defy textbook wisdom1-5. Ferroelectric polarization and metallicity are well-known examples of mutually exclusive properties that cannot coexist in bulk solids because the net electric field in a metal can be fully screened by free electrons6. An atomically thin metallic layer capped by insulating layers has shown decent conductivity at room temperature7. Moreover, a penetrating polarization field can be employed to induce an ion displacement and create an intrinsic polarization in the metallic layer. Here we demonstrate that a ferroelectric metal can be artificially synthesized through imposing a strong polarization field in the form of ferroelectric/unit-cell-thin metal superlattices. In this way the symmetry of an atomically thin conductive layer can be broken and manipulated by a neighboring polar field, thereby forming a two-dimensional (2D) ferroelectric metal. The fabricated of (SrRuO3)1/(BaTiO3)10 superlattices exhibit ferroelectric polarization in an atomically thin layer with metallic conductivity at room temperature. A multipronged investigation combining structural analyses, electrical measurements, and first-principles electronic structure calculations unravels the coexistence of 2D electrical conductivity in the SrRuO3 monolayer accompanied by the electric polarization. Such 2D ferroelectric metal paves a novel way to engineer a quantum multi-state with unusual coexisting properties, such as ferroelectrics, ferromagnetics and metals, manipulated by external fields8,9.

cond-mat.mtrl-sci↗
arXiv2019

Stationary DLA is well defined

In this paper, we construct an infinite stationary Diffusion Limited Aggregation (SDLA) on the upper half planar lattice, growing from an infinite line, with local growth rate proportional to the stationary harmonic measure. We prove that the SDLA is ergodic with respect to integer left-right translations.

math.PR↗
arXiv2019

Surface plasmon launching by polariton superradiance

The condition of phase matching prohibits the transfer of excitation from free-space photons to surface plasmon polaritons (SPP). We propose and analyze a scheme that excites an ensemble of emitters in a collective state, which is phase matched with the SPP by the optical pulses used for its preparation. By a collective enhancement the ensemble, hence, emits an SPP in a well defined direction. We demonstrate the scheme by analyzing the launching of near-infrared graphene SPP. Our theory incorporates the dispersive and dissipative properties of the plasmon modes to evaluate the non-Markovian emission by the ensembles and will also be applicable for other types of surface polaritons.

quant-ph↗
arXiv2019

Solution Processed Large-scale Multiferroic Complex Oxide Epitaxy with Magnetically Switched Polarization

Complex oxides with tunable structures have many fascinating properties, though high-quality complex oxide epitaxy with precisely controlled composition is still out of reach. Here we have successfully developed solution-based single crystalline epitaxy for multiferroic (1-x)BiTi(1-y)/2FeyMg(1-y)/2O3-(x)CaTiO3 (BTFM-CTO) solid solution in large area, confirming its ferroelectricity at atomic-scale with a spontaneous polarization of 79~89uC/cm2. Careful compositional tuning leads to a bulk magnetization of ~0.07uB/Fe at room temperature, enabling magnetically induced polarization switching exhibiting a large magnetoelectric coefficient of 2.7-3.0X10-7s/m. This work demonstrates the great potential of solution processing in large-scale complex oxide epitaxy and establishes novel room-temperature magnetoelectric coupling in epitaxial BTFM-CTO film, making it possible to explore a much wider space of composition, phase, and structure that can be easily scaled up for industrial applications.

cond-mat.mtrl-sci↗
arXiv2019

PAWS: Paraphrase Adversaries from Word Scrambling

Existing paraphrase identification datasets lack sentence pairs that have high lexical overlap without being paraphrases. Models trained on such data fail to distinguish pairs like flights from New York to Florida and flights from Florida to New York. This paper introduces PAWS (Paraphrase Adversaries from Word Scrambling), a new dataset with 108,463 well-formed paraphrase and non-paraphrase pairs with high lexical overlap. Challenging pairs are generated by controlled word swapping and back translation, followed by fluency and paraphrase judgments by human raters. State-of-the-art models trained on existing datasets have dismal performance on PAWS (<40% accuracy); however, including PAWS training data for these models improves their accuracy to 85% while maintaining performance on existing tasks. In contrast, models that do not capture non-local contextual information fail even with PAWS training examples. As such, PAWS provides an effective instrument for driving further progress on models that better exploit structure, context, and pairwise comparisons.

cs.CL↗
arXiv2019

All You Need is a Few Shifts: Designing Efficient Convolutional Neural Networks for Image Classification

Shift operation is an efficient alternative over depthwise separable convolution. However, it is still bottlenecked by its implementation manner, namely memory movement. To put this direction forward, a new and novel basic component named Sparse Shift Layer (SSL) is introduced in this paper to construct efficient convolutional neural networks. In this family of architectures, the basic block is only composed by 1x1 convolutional layers with only a few shift operations applied to the intermediate feature maps. To make this idea feasible, we introduce shift operation penalty during optimization and further propose a quantization-aware shift learning method to impose the learned displacement more friendly for inference. Extensive ablation studies indicate that only a few shift operations are sufficient to provide spatial information communication. Furthermore, to maximize the role of SSL, we redesign an improved network architecture to Fully Exploit the limited capacity of neural Network (FE-Net). Equipped with SSL, this network can achieve 75.0% top-1 accuracy on ImageNet with only 563M M-Adds. It surpasses other counterparts constructed by depthwise separable convolution and the networks searched by NAS in terms of accuracy and practical speed.

cs.CV↗
arXiv2019

Blind Predicting Similar Quality Map for Image Quality Assessment

A key problem in blind image quality assessment (BIQA) is how to effectively model the properties of human visual system in a data-driven manner. In this paper, we propose a simple and efficient BIQA model based on a novel framework which consists of a fully convolutional neural network (FCNN) and a pooling network to solve this problem. In principle, FCNN is capable of predicting a pixel-by-pixel similar quality map only from a distorted image by using the intermediate similarity maps derived from conventional full-reference image quality assessment methods. The predicted pixel-by-pixel quality maps have good consistency with the distortion correlations between the reference and distorted images. Finally, a deep pooling network regresses the quality map into a score. Experiments have demonstrated that our predictions outperform many state-of-the-art BIQA methods.

cs.CV↗
arXiv2019

Structural Controllability of a Networked Dynamic System with LFT Parameterized Subsystems

This paper studies structural controllability for a networked dynamic system (NDS), in which each subsystem may have different dynamics, and unknown parameters may exist both in subsystem dynamics and in subsystem interconnections. In addition, subsystem parameters are parameterized by a linear fractional transformation (LFT). It is proven that controllability keeps to be a generic property for this kind of NDSs. Some necessary and sufficient conditions are then established respectively for them to be structurally controllable, to have a fixed uncontrollable mode, and to have a parameter dependent uncontrollable mode, under the condition that each subsystem interconnection link can take a weight independently. These conditions are scalable, and in their verifications, all arithmetic calculations are performed separately on each subsystem. In addition, these conditions also reveal influences on NDS controllability from subsystem input-output relations, subsystem uncontrollable modes and subsystem interconnection topology. Based on these observations, the problem of selecting the minimal number of subsystem interconnection links is studied under the requirement of constructing a structurally controllable NDS. A heuristic method is derived with some provable approximation bounds and a low computational complexity.

math.OC↗
arXiv2019

Neural IR Meets Graph Embedding: A Ranking Model for Product Search

Recently, neural models for information retrieval are becoming increasingly popular. They provide effective approaches for product search due to their competitive advantages in semantic matching. However, it is challenging to use graph-based features, though proved very useful in IR literature, in these neural approaches. In this paper, we leverage the recent advances in graph embedding techniques to enable neural retrieval models to exploit graph-structured data for automatic feature extraction. The proposed approach can not only help to overcome the long-tail problem of click-through data, but also incorporate external heterogeneous information to improve search results. Extensive experiments on a real-world e-commerce dataset demonstrate significant improvement achieved by our proposed approach over multiple strong baselines both as an individual retrieval model and as a feature used in learning-to-rank frameworks.

cs.IR↗
arXiv2019

Backprop-Q: Generalized Backpropagation for Stochastic Computation Graphs

In real-world scenarios, it is appealing to learn a model carrying out stochastic operations internally, known as stochastic computation graphs (SCGs), rather than learning a deterministic mapping. However, standard backpropagation is not applicable to SCGs. We attempt to address this issue from the angle of cost propagation, with local surrogate costs, called Q-functions, constructed and learned for each stochastic node in an SCG. Then, the SCG can be trained based on these surrogate costs using standard backpropagation. We propose the entire framework as a solution to generalize backpropagation for SCGs, which resembles an actor-critic architecture but based on a graph. For broad applicability, we study a variety of SCG structures from one cost to multiple costs. We utilize recent advances in reinforcement learning (RL) and variational Bayes (VB), such as off-policy critic learning and unbiased-and-low-variance gradient estimation, and review them in the context of SCGs. The generalized backpropagation extends transported learning signals beyond gradients between stochastic nodes while preserving the benefit of backpropagating gradients through deterministic nodes. Experimental suggestions and concerns are listed to help design and test any specific model using this framework.

cs.LG↗
arXiv2019

Modeling Attention Flow on Graphs

Real-world scenarios demand reasoning about process, more than final outcome prediction, to discover latent causal chains and better understand complex systems. It requires the learning algorithms to offer both accurate predictions and clear interpretations. We design a set of trajectory reasoning tasks on graphs with only the source and the destination observed. We present the attention flow mechanism to explicitly model the reasoning process, leveraging the relational inductive biases by basing our models on graph networks. We study the way attention flow can effectively act on the underlying information flow implemented by message passing. Experiments demonstrate that the attention flow driven by and interacting with graph networks can provide higher accuracy in prediction and better interpretation for trajectory reasoning.

cs.AI↗
arXiv2018

On sets of zero stationary harmonic measure

In this paper, we prove that any subset with an appropriate sub-linear horizontal growth has a non-zero stationary harmonic measure. On the other hand, we also show any subset with super-linear horizontal growth will have a $0$ stationary harmonic measure at every point. This result is fundamental to any future study of stationary DLA. As an application we prove that any possible aggregation process with growth rates proportional to the stationary harmonic measure has non zero measure at all times.

math.PR↗
arXiv2018

A Layer Decomposition-Recomposition Framework for Neuron Pruning towards Accurate Lightweight Networks

Neuron pruning is an efficient method to compress the network into a slimmer one for reducing the computational cost and storage overhead. Most of state-of-the-art results are obtained in a layer-by-layer optimization mode. It discards the unimportant input neurons and uses the survived ones to reconstruct the output neurons approaching to the original ones in a layer-by-layer manner. However, an unnoticed problem arises that the information loss is accumulated as layer increases since the survived neurons still do not encode the entire information as before. A better alternative is to propagate the entire useful information to reconstruct the pruned layer instead of directly discarding the less important neurons. To this end, we propose a novel Layer Decomposition-Recomposition Framework (LDRF) for neuron pruning, by which each layer's output information is recovered in an embedding space and then propagated to reconstruct the following pruned layers with useful information preserved. We mainly conduct our experiments on ILSVRC-12 benchmark with VGG-16 and ResNet-50. What should be emphasized is that our results before end-to-end fine-tuning are significantly superior owing to the information-preserving property of our proposed framework.With end-to-end fine-tuning, we achieve state-of-the-art results of 5.13x and 3x speed-up with only 0.5% and 0.65% top-5 accuracy drop respectively, which outperform the existing neuron pruning methods.

cs.CV↗
arXiv2018

Leading Digits of Mersenne Numbers

It has long been known that sequences such as the powers of $2$ and the factorials satisfy Benford's Law; that is, leading digits in these sequences occur with frequencies given by $P(d)=\log_{10}(1+1/d)$, $d=1,2,\dots,9$. In this paper, we consider the leading digits of the Mersenne numbers $M_n=2^{p_n}-1$, where $p_n$ is the $n$-th prime. In light of known irregularities in the distribution of primes, one might expect that the leading digit sequence of $\{M_n\}$ has \emph{worse} distribution properties than "smooth" sequences with similar rates of growth, such as $\{2^{n\log n}\}$. Surprisingly, the opposite seems to be the true; indeed, we present data, based on the first billion terms of the sequence $\{M_n\}$, showing that leading digits of Mersenne numbers behave in many respects \emph{more regularly} than those in the above smooth sequences. We state several conjectures to this effect, and we provide an heuristic explanation for the observed phenomena based on classic models for the distribution of primes.

math.NT↗
arXiv2018

A Fast, Compact, Accurate Model for Language Identification of Codemixed Text

We address fine-grained multilingual language identification: providing a language code for every token in a sentence, including codemixed text containing multiple languages. Such text is prevalent online, in documents, social media, and message boards. We show that a feed-forward network with a simple globally constrained decoder can accurately and rapidly label both codemixed and monolingual text in 100 languages and 100 language pairs. This model outperforms previously published multilingual approaches in terms of both accuracy and speed, yielding an 800x speed-up and a 19.5% averaged absolute gain on three codemixed datasets. It furthermore outperforms several benchmark systems on monolingual language identification.

cs.CL↗
arXiv2018

A Localization Method Avoiding Flip Ambiguities for micro-UAVs with Bounded Distance Measurement Errors

Localization is a fundamental function in cooperative control of micro unmanned aerial vehicles (UAVs), but is easily affected by flip ambiguities because of measurement errors and flying motions. This study proposes a localization method that can avoid the occurrence of flip ambiguities in bounded distance measurement errors and constrained flying motions; to demonstrate its efficacy, the method is implemented on bilateration and trilateration. For bilateration, an improved bi-boundary model based on the unit disk graph model is created to compensate for the shortage of distance constraints, and two boundaries are estimated as the communication range constraint. The characteristic of the intersections of the communication range and distance constraints is studied to present a unique localization criterion which can avoid the occurrence of flip ambiguities. Similarly, for trilateration, another unique localization criterion for avoiding flip ambiguities is proposed according to the characteristic of the intersections of three distance constraints. The theoretical proof shows that these proposed criteria are correct. A localization algorithm is constructed based on these two criteria. The algorithm is validated using simulations for different scenarios and parameters, and the proposed method is shown to provide excellent localization performance in terms of average estimated error. Our code can be found at: https://github.com/QingbeiGuo/AFALA.git.

eess.SP↗