arXiv subjects

Yiwen Zhang

Publications and source records attributed to Yiwen Zhang.

120 records · Page 7Linked to original sources

arXiv2021

Investigating Transfer Learning in Multilingual Pre-trained Language Models through Chinese Natural Language Inference

Multilingual transformers (XLM, mT5) have been shown to have remarkable transfer skills in zero-shot settings. Most transfer studies, however, rely on automatically translated resources (XNLI, XQuAD), making it hard to discern the particular linguistic knowledge that is being transferred, and the role of expert annotated monolingual datasets when developing task-specific models. We investigate the cross-lingual transfer abilities of XLM-R for Chinese and English natural language inference (NLI), with a focus on the recent large-scale Chinese dataset OCNLI. To better understand linguistic transfer, we created 4 categories of challenge and adversarial tasks (totaling 17 new datasets) for Chinese that build on several well-known resources for English (e.g., HANS, NLI stress-tests). We find that cross-lingual models trained on English NLI do transfer well across our Chinese tasks (e.g., in 3/4 of our challenge categories, they perform as well/better than the best monolingual models, even on 3/5 uniquely Chinese linguistic phenomena such as idioms, pro drop). These results, however, come with important caveats: cross-lingual models often perform best when trained on a mixture of English and high-quality monolingual NLI data (OCNLI), and are often hindered by automatically translated resources (XNLI-zh). For many phenomena, all models continue to struggle, highlighting the need for our new diagnostics to help benchmark Chinese and cross-lingual models. All new datasets/code are released at https://github.com/huhailinguist/ChineseNLIProbing.

cs.CL↗

arXiv2021

PersonalityGate: A General Plug-and-Play GNN Gate to Enhance Cascade Prediction with Personality Recognition Task

Cascade prediction estimates the size or the state of a cascade from either microscope or macroscope. It is of paramount importance for understanding the information diffusion process such as the spread of rumors and the propagation of new technologies in social networks. Recently, instead of extracting hand-crafted features or embedding cascade sequences into feature vectors for cascade prediction, graph neural networks (GNNs) are introduced to utilize the network structure which governs the cascade effect. However, these models do not take into account social factors such as personality traits which drive human's participation in the information diffusion process. In this work, we propose a novel multitask framework for enhancing cascade prediction with a personality recognition task. Specially, we design a general plug-and-play GNN gate, named PersonalityGate, to couple into existing GNN-based cascade prediction models to enhance their effectiveness and extract individuals' personality traits jointly. Experimental results on two real-world datasets demonstrate the effectiveness of our proposed framework in enhancing GNN-based cascade prediction models and in predicting individuals' personality traits as well.

cs.SI↗

arXiv2021

MUSE: Multi-faceted Attention for Signed Network Embedding

Signed network embedding is an approach to learn low-dimensional representations of nodes in signed networks with both positive and negative links, which facilitates downstream tasks such as link prediction with general data mining frameworks. Due to the distinct properties and significant added value of negative links, existing signed network embedding methods usually design dedicated methods based on social theories such as balance theory and status theory. However, existing signed network embedding methods ignore the characteristics of multiple facets of each node and mix them up in one single representation, which limits the ability to capture the fine-grained attentions between node pairs. In this paper, we propose MUSE, a MUlti-faceted attention-based Signed network Embedding framework to tackle this problem. Specifically, a joint intra- and inter-facet attention mechanism is introduced to aggregate fine-grained information from neighbor nodes. Moreover, balance theory is also utilized to guide information aggregation from multi-order balanced and unbalanced neighbors. Experimental results on four real-world signed network datasets demonstrate the effectiveness of our proposed framework.

cs.SI↗

arXiv2020

CLUE: A Chinese Language Understanding Evaluation Benchmark

The advent of natural language understanding (NLU) benchmarks for English, such as GLUE and SuperGLUE allows new NLU models to be evaluated across a diverse set of tasks. These comprehensive benchmarks have facilitated a broad range of research and applications in natural language processing (NLP). The problem, however, is that most such benchmarks are limited to English, which has made it difficult to replicate many of the successes in English NLU for other languages. To help remedy this issue, we introduce the first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark. CLUE is an open-ended, community-driven project that brings together 9 tasks spanning several well-established single-sentence/sentence-pair classification tasks, as well as machine reading comprehension, all on original Chinese text. To establish results on these tasks, we report scores using an exhaustive set of current state-of-the-art pre-trained Chinese models (9 in total). We also introduce a number of supplementary datasets and additional tools to help facilitate further progress on Chinese NLU. Our benchmark is released at https://www.CLUEbenchmarks.com

cs.CL↗

arXiv2019

Generating optical vortex beams by momentum-space polarization vortices centered at bound states in the continuum

An optical vortex (OV) is a beam with spiral wave front and screw phase dislocation. This kind of beams is attracting rising interest in various fields. Here we theoretically proposed and experimentally realized a novel but easy approach to generate optical vortices. We leverage the inherent topological vortex structures of polarization around bound states in the continuum (BIC) in the momentum space of two dimensional periodic structures, e.g. photonic crystal slabs, to induce Pancharatnam-Berry phases to the beams. This new class of OV generators operates in the momentum space, meaning that there is no real-space center of structure. Thus, not only the fabrication but also the practical alignment would be greatly simplified. Any even order of OV, which is actually a quasi-non-diffractive high-order quasi-Bessel beam, at any desired working wavelength could be achieved in principle. The proposed approach expands the application of bound states in the continuum and topological photonics.

physics.optics↗

arXiv2019

RDMA Performance Isolation With Justitia

Despite its increasing popularity, most of RDMA's benefits such as ultra-low latency can be achieved only when running an application in isolation. Using microbenchmarks and real open-source RDMA applications, we identify a series of performance anomalies when multiple applications coexist and show that such anomalies are pervasive across InfiniBand, RoCEv2, and iWARP. They arise due to a fundamental tradeoff between performance isolation and work conservation, which the state-of-the-art RDMA congestion control protocols such as DCQCN cannot resolve. We present Justitia to address these performance anomalies. Justitia is a software-only, host-based, and easy-to-deploy solution that maximizes RNIC utilization while guaranteeing performance isolation via shaping, rate limiting, and pacing at senders. Our evaluation of Justitia on multiple RDMA implementations show that Justitia effectively isolates different types of traffic and significantly improves latency (by up to 56.9x) and throughput (by up to 9.7x) of real-world RDMA-based applications without compromising low CPU usage or modifying the applications.

cs.NI↗

arXiv2019

Circularly polarized states spawning from bound states in the continuum

Bound states in the continuum in periodic photonic systems like photonic crystal slabs are proved to be accompanied by vortex polarization singularities on the photonic bands in the momentum space. The winding structures of polarization states not only widen the field of topological physics but also show great potential that such systems could be applied in polarization manipulating. In this work, we report the phenomenon that by in-plane inversion ($C_2$) symmetry breaking, pairs of circularly polarized states could spawn from the eliminated Bound states in the continuum. Along with the appearance of the circularly polarized states as the two poles of the Poincaré sphere together with linearly polarized states covering the equator, full coverage on the Poincaré sphere could be realized. As an application, ellipticity modulation of linear polarization is demonstrated in the visible frequency range. This phenomenon provides new degree of freedom in modulating polarization.

physics.optics↗

arXiv2018

Observation of optical states below light cone with compound lattices

For optical systems, states inside the light cone could be detected by far-field measurement, while those below the light cone are not detectable by far-field measurement. A new method for far-field detection has been developed for observing states below the light cone with compound lattices. The basic mechanism involved is that periodic weak scattering leads to band folding, making the states out of the light cone to occur inside. By using polarization-resolved momentum-space imaging spectroscopy the band structures and iso-frequency contours of plasmonic lattices with different dimensions and symmetries are experimentally mapped out, in good agreement with the simulation.

physics.optics↗

arXiv2018

Path of Vowel Raising in Chengdu Dialect of Mandarin

He and Rao (2013) reported a raising phenomenon of /a/ in /Xan/ (X being a consonant or a vowel) in Chengdu dialect of Mandarin, i.e. /a/ is realized as [epsilon] for young speakers but [ae] for older speakers, but they offered no acoustic analysis. We designed an acoustic study that examined the realization of /Xan/ in speakers of different age (old vs. young) and gender (male vs. female) groups, where X represents three conditions: 1) unaspirated consonants: C ([p], [t], [k]), 2) aspirated consonants: Ch ([ph], [th], [kh]), and 3) high vowels: V ([i], [y], [u]). 17 native speakers were asked to read /Xan/ characters and the F1 values are extracted for comparison. Our results confirmed the raising effect in He and Rao (2013), i.e., young speakers realize /a/ as [epsilon] in /an/, whereas older speakers in the most part realize it as [ae]. Also, female speakers raise more than male speakers within the same age group. Interestingly, within the /Van/ condition, older speakers do raise /a/ in /ian/ and /yan/. We interpret this as /a/ first assimilates to its preceding front high vowels /i/ and /y/ for older speakers, which then becomes phonologized in younger speakers in all conditions, including /Chan/ and /Can/. This shows a possible trajectory of the ongoing sound change in the Chengdu dialect.

cs.CL↗

arXiv2017

Observing half and integer polarization vortices at band degeneracies

Far-field polarization vortices were recently found on singlet bands in the momentum-space of two-dimensional photonic lattices, also known as the dark states and bound states in continuum. Here, we theoretically proposed and experimentally verified the existence of the polarization vortices at the degenerate points of photonic dispersions, whose vortex cores can be radiative bright states. Half-charged vortices were generated from the Dirac points of π Berry phase and integer-charged vortices were generated from a quadratic degeneracy. Using a home-made polarization-resolved momentum-space imaging spectroscopy, we observed the complete evolution of the splitting from one quadratic point to a pair of Dirac cones by tracking the winding of the polarization vectors and the full spectrum of iso-frequency contours.

physics.optics↗

arXiv2017

Observation of optical vortices in momentum space

Vortex, the winding of a vector field in two dimensions, has its core the field singularity and its topological charge defined by the quantized winding angle of the vector field. Vortices are one of the most fundamental topological excitations in nature, widely known in hair whorls as the winding of hair strings, in fluid dynamics as the winding of velocities, in angular-momentum beams as the winding of phase angle and in superconductors and superfluids as the winding of order parameters. Nevertheless, vortices have hardly been observed other than those in the real space. Although band degeneracies, such as Dirac cones, can be viewed as momentum-space vortices in their mathematical structures, there lacks a well-defined physical observable whose winding number is an arbitrary signed integer. Here, we experimentally observed momentum-space vortices as the winding of far-field polarization vectors in the Brillouin zone (BZ) of periodic plasmonic structures. Using a home-made polarization-resolved momentum-space imaging spectroscopy, we completely map out the dispersion, lifetime and polarization of all radiative states at the visible wavelengths. The momentum space vortices were experimentally identified by their winding patterns in the polarization-resolved iso-frequency contours and their diverging radiative quality factors. Such polarization vortices can exist robustly on any periodic systems of vectorial fields, while they are not captured by the existing topological band theory developed for scaler fields. This work opens up a promising avenue for exploring topological photonics in the momentum space, studying bound states in continuum (BICs), as well as for rendering and steering vector beams and designing high-Q plasmonic resonances.

physics.optics↗

arXiv2014

A semi-empirical response function for Gamma-ray of Scintillation detector based on physical interaction mechanism

Scintillation detector has lower energy resolution for Gamma-ray as compared to semiconductor detector, better spectra analysis method is essential to traditional method. A model for describing the response function of scintillation detector over the range of incident Gamma-ray energies between 0.5 and 1.5 MeV has been established and applied to fitting radiation sources spectra. Each function form for describing the feature of Gamma-ray spectra are based on the analysis of fundamental interaction mechanism. These functions are combined to form a DRF model to fit experiment spectra by weighted least squares fitting method, parameters in this model are obtained simultaneously. Gaussian standard deviation can be calculated out by an individual procedure. Validity of the DRF model is demonstrated by fitting Co-60 and Cs-137 spectra measured by CsI(Tl) detector and comparing them to the normalized equivalent measured spectrum.

physics.ins-det↗