arXiv subjects

Peng-Jen Chen

Publications and source records attributed to Peng-Jen Chen.

29 records · Page 2Linked to original sources

arXiv2021

The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translation

One of the biggest challenges hindering progress in low-resource and multilingual machine translation is the lack of good evaluation benchmarks. Current evaluation benchmarks either lack good coverage of low-resource languages, consider only restricted domains, or are low quality because they are constructed using semi-automatic procedures. In this work, we introduce the FLORES-101 evaluation benchmark, consisting of 3001 sentences extracted from English Wikipedia and covering a variety of different topics and domains. These sentences have been translated in 101 languages by professional translators through a carefully controlled process. The resulting dataset enables better assessment of model quality on the long tail of low-resource languages, including the evaluation of many-to-many multilingual translation systems, as all translations are multilingually aligned. By publicly releasing such a high-quality and high-coverage dataset, we hope to foster progress in the machine translation community and beyond.

cs.CL↗

arXiv2020

Facebook AI's WMT20 News Translation Task Submission

This paper describes Facebook AI's submission to WMT20 shared news translation task. We focus on the low resource setting and participate in two language pairs, Tamil <-> English and Inuktitut <-> English, where there are limited out-of-domain bitext and monolingual data. We approach the low resource problem using two main strategies, leveraging all available data and adapting the system to the target news domain. We explore techniques that leverage bitext and monolingual data from all languages, such as self-supervised model pretraining, multilingual models, data augmentation, and reranking. To better adapt the translation system to the test domain, we explore dataset tagging and fine-tuning on in-domain data. We observe that different techniques provide varied improvements based on the available data of the language pair. Based on the finding, we integrate these techniques into one training pipeline. For En->Ta, we explore an unconstrained setup with additional Tamil bitext and monolingual data and show that further improvement can be obtained. On the test set, our best submitted systems achieve 21.5 and 13.7 BLEU for Ta->En and En->Ta respectively, and 27.9 and 13.0 for Iu->En and En->Iu respectively.

cs.CL↗

arXiv2020

Multilingual Translation with Extensible Multilingual Pretraining and Finetuning

Recent work demonstrates the potential of multilingual pretraining of creating one model that can be used for various tasks in different languages. Previous work in multilingual pretraining has demonstrated that machine translation systems can be created by finetuning on bitext. In this work, we show that multilingual translation models can be created through multilingual finetuning. Instead of finetuning on one direction, a pretrained model is finetuned on many directions at the same time. Compared to multilingual models trained from scratch, starting from pretrained models incorporates the benefits of large quantities of unlabeled monolingual data, which is particularly important for low resource languages where bitext is not available. We demonstrate that pretrained models can be extended to incorporate additional languages without loss of performance. We double the number of languages in mBART to support multilingual machine translation models of 50 languages. Finally, we create the ML50 benchmark, covering low, mid, and high resource languages, to facilitate reproducible research by standardizing training and evaluation data. On ML50, we demonstrate that multilingual finetuning improves on average 1 BLEU over the strongest baselines (being either multilingual from scratch or bilingual finetuning) while improving 9.3 BLEU on average over bilingual baselines from scratch.

cs.CL↗

arXiv2020

The Source-Target Domain Mismatch Problem in Machine Translation

While we live in an increasingly interconnected world, different places still exhibit strikingly different cultures and many events we experience in our every day life pertain only to the specific place we live in. As a result, people often talk about different things in different parts of the world. In this work we study the effect of local context in machine translation and postulate that particularly in low resource settings this causes the domains of the source and target language to greatly mismatch, as the two languages are often spoken in further apart regions of the world with more distinctive cultural traits and unrelated local events. We first formalize the concept of source-target domain mismatch, propose a metric to quantify it, and provide empirical evidence corroborating our intuition that organic text produced by people speaking very different languages exhibits the most dramatic differences. We conclude with an empirical study of how source-target domain mismatch affects training of machine translation systems for low resource language pairs. In particular, we find that it severely affects back-translation, but the degradation can be alleviated by combining back-translation with self-training and by increasing the relative amount of target side monolingual data.

cs.CL↗

arXiv2019

Facebook AI's WAT19 Myanmar-English Translation Task Submission

This paper describes Facebook AI's submission to the WAT 2019 Myanmar-English translation task. Our baseline systems are BPE-based transformer models. We explore methods to leverage monolingual data to improve generalization, including self-training, back-translation and their combination. We further improve results by using noisy channel re-ranking and ensembling. We demonstrate that these techniques can significantly improve not only a system trained with additional monolingual data, but even the baseline system trained exclusively on the provided small parallel dataset. Our system ranks first in both directions according to human evaluation and BLEU, with a gain of over 8 BLEU points above the second best system.

cs.CL↗

arXiv2019

The FLoRes Evaluation Datasets for Low-Resource Machine Translation: Nepali-English and Sinhala-English

For machine translation, a vast majority of language pairs in the world are considered low-resource because they have little parallel data available. Besides the technical challenges of learning with limited supervision, it is difficult to evaluate methods trained on low-resource language pairs because of the lack of freely and publicly available benchmarks. In this work, we introduce the FLoRes evaluation datasets for Nepali-English and Sinhala-English, based on sentences translated from Wikipedia. Compared to English, these are languages with very different morphology and syntax, for which little out-of-domain parallel data is available and for which relatively large amounts of monolingual data are freely available. We describe our process to collect and cross-check the quality of translations, and we report baseline performance using several learning settings: fully supervised, weakly supervised, semi-supervised, and fully unsupervised. Our experiments demonstrate that current state-of-the-art methods perform rather poorly on this benchmark, posing a challenge to the research community working on low-resource MT. Data and code to reproduce our experiments are available at https://github.com/facebookresearch/flores.

cs.CL↗

arXiv2017

The anomalous antiferromagnetic topological phase in pressurized SmB6

Antiferromagnetic materials, whose time-reversal symmetry is broken, can be classified into the Z2 topology if they respect some specific symmetry. Since the theoretical proposal, however, no materials have been found to host the antiferromagnetic topological (AFT) phase to date. Here, for the first time, we demonstrate that the topological Kondo insulator SmB6 can be an AFT system when pressurized to undergo an antiferromagnetic phase transition. In addition to propose the possible candidate for an AFT material, in this work we also illustrate the anomalous topological surface states of the AFT phase which has not been discussed before. Originating from the interplay between the topological properties and the antiferromagnetic surface magnetization, the topological surface states of the AFT phase behave differently as compared with those of a topological insulator. Besides, the AFT insulators are also found promising in the generation of tunable spin currents, which is an important application in spintronics.

cond-mat.mtrl-sci↗

arXiv2016

Superconducting Topological Surface States in Non-centrosymmetric Bulk Superconductor PbTaSe2

The search for topological superconductors (TSCs) is one of the most urgent contemporary problems in condensed matter systems. TSCs are characterized by a full superconducting gap in the bulk and topologically protected gapless surface (or edge) states. Within each vortex core of TSCs, there exist the zero energy Majorana bound states, which are predicted to exhibit non-Abelian statistics and to form the basis of the fault-tolerant quantum computation. So far, no stoichiometric bulk material exhibits the required topological surface states (TSSs) at Fermi level combined with fully gapped bulk superconductivity. Here, we report atomic scale visualization of the TSSs of the non-centrosymmetric fully-gapped superconductor, PbTaSe2. Using quasiparticle scattering interference (QPI) imaging, we find two TSSs with a Dirac point at E~1.0eV, of which the inner TSS and partial outer TSS cross Fermi level, on the Pb-terminated surface of this fully gapped superconductor. This discovery reveals PbTaSe2 as a promising candidate as a TSC.

cond-mat.supr-con↗

arXiv2016

Topological Dirac States and Pairing Correlations in the Non-Centrosymmetric Superconductor PbTaSe2

Superconductivity in topological band structures is a platform for many novel exotic quantum phenomena such as emergent supersymmetry. This potential nourishes the search for topological materials with intrinsic superconducting instabilities, in which Cooper pairing is introduced to electrons with helical spin texture such as the Dirac states of topological insulators and Dirac Semimetals, forming a natural topological superconductor of helical kind. We employ first-principles calculations, ARPES experiments and new theoretical analysis to reveal that PbTaSe2, a non-centrosymmetric superconductor, possesses a nonzero Z2 topological invariant and fully spin-polarized Dirac states. Moreover, we analyze the phonon spectrum of PbTaSe2 to show how superconductivity can emerge due to a stiffening of phonons by the Pb intercalation, which diminishes a competing charge-density-wave instability. Our work establishes PbTaSe2 as a stoichiometric superconductor with nontrivial Z2 topological band structure, and shows that it holds great promise for studying novel forms of topological superconductivity not realized previously.

cond-mat.mes-hall↗

arXiv2015

Drumhead Surface States and Topological Nodal-Line Fermions in TlTaSe2

A topological nodal-line semimetal is a new condensed matter state with one-dimensional bulk nodal lines and two-dimensional drumhead surface bands. Based on first-principles calculations and our effective k . p model, we propose the existence of topological nodal-line fermions in the ternary transition- metal chalcogenide TlTaSe2. The noncentrosymmetric structure and strong spin-orbit coupling give rise to spinful nodal-line bulk states which are protected by a mirror reflection symmetry of this compound. This is remarkably distinguished from other proposed nodal-line semimetals such as Cu3NPb(Zn) in which nodal lines exist only in the limit of vanishing spin-orbit coupling. We show that the drumhead surface states in TlTaSe2, which are associated with the topological nodal lines, exhibit an unconventional chiral spin texture and an exotic Lifshitz transition as a consequence of the linkage among multiple drumhead surface-state pockets.

cond-mat.mes-hall↗

arXiv2015

Two distinct topological phases in the mixed valence compound YbB6 and its differences from SmB6

We discuss the evolution of topological states and their orbital textures in the mixed valence compounds SmB6 and YbB6 within the framework of the generalized gradient approximation plus onsite Coulomb interaction (GGA+U) scheme for a wide range of values of U. In SmB6, the topological Kondo insulator (TKI) gap is found to be insensitive to the value of U, but in sharp contrast, Kondo physics in isostructural YbB6 displays a surprising sensitivity to U. In particular, as U is increased in YbB6, the correlated TKI state in the weak-coupling regime transforms into a d-p-type topological insulator phase with a band inversion between Yb-5d and B-2p orbitals in the intermediate coupling range, without closing the insulating energy gap throughout this process. Our theoretical predictions related to the TKI and non-TKI phases in SmB6 and YbB6 are in substantial accord with recent angle-resolved photoemission spectroscopy (ARPES) experiments.

cond-mat.mtrl-sci↗