arXiv subjects

Peng Li

Publications and source records attributed to Peng Li.

At least 415 records · Page 23Linked to original sources

arXiv2020

Detector tilt considerations in high-energy Bragg coherent diffraction imaging: a simulation study

This paper addresses three-dimensional signal distortion and image reconstruction issues in x-ray Bragg coherent diffraction imaging (BCDI) in the event of a general non-orthogonal orientation of the area detector with respect to the diffracted beam. Growing interest in novel BCDI adaptations at fourth-generation synchrotron light sources has necessitated improvisations in the experimental configuration and the subsequent data analysis. One such possibly unavoidable improvisation that is envisioned in this paper is a photon-counting area detector whose face is tilted away from the perpendicular to the Bragg-diffracted beam during acquisition of the coherent diffraction signal. We describe a likely circumstance in which one would require such a detector configuration, along with experimental precedent at third generation synchrotrons. Using physically accurate diffraction simulations from synthetic scatterers in the presence of such tilted detectors, we analyze the general nature of the observed signal distortion qualitatively and quantitatively, and provide a prescription to correct for it during image reconstruction. Our simulations and reconstructions are based on an adaptation of the known theory of BCDI sampling geometry as well as recently developed projection-based methods of wavefield propagation. Such configurational modifications and their numerical remedies are potentially valuable in realizing unconventional coherent diffraction measurement geometries and eventually paving the way for the integration of BCDI into new materials characterization experiments at next-generation light sources.

physics.ins-det↗

arXiv2020

Learning from Context or Names? An Empirical Study on Neural Relation Extraction

Neural models have achieved remarkable success on relation extraction (RE) benchmarks. However, there is no clear understanding which type of information affects existing RE models to make decisions and how to further improve the performance of these models. To this end, we empirically study the effect of two main information sources in text: textual context and entity mentions (names). We find that (i) while context is the main source to support the predictions, RE models also heavily rely on the information from entity mentions, most of which is type information, and (ii) existing datasets may leak shallow heuristics via entity mentions and thus contribute to the high performance on RE benchmarks. Based on the analyses, we propose an entity-masked contrastive pre-training framework for RE to gain a deeper understanding on both textual context and type information while avoiding rote memorization of entities or use of superficial cues in mentions. We carry out extensive experiments to support our views, and show that our framework can improve the effectiveness and robustness of neural models in different RE scenarios. All the code and datasets are released at https://github.com/thunlp/RE-Context-or-Names.

cs.CL↗

arXiv2020

Disentangle-based Continual Graph Representation Learning

Graph embedding (GE) methods embed nodes (and/or edges) in graph into a low-dimensional semantic space, and have shown its effectiveness in modeling multi-relational data. However, existing GE models are not practical in real-world applications since it overlooked the streaming nature of incoming data. To address this issue, we study the problem of continual graph representation learning which aims to continually train a GE model on new data to learn incessantly emerging multi-relational data while avoiding catastrophically forgetting old learned knowledge. Moreover, we propose a disentangle-based continual graph representation learning (DiCGRL) framework inspired by the human's ability to learn procedural knowledge. The experimental results show that DiCGRL could effectively alleviate the catastrophic forgetting problem and outperform state-of-the-art continual learning models.

cs.LG↗

arXiv2020

Charge density wave and weak Kondo effect in a Dirac semimetal CeSbTe

Using angle-resolved photoemission spectroscopy (ARPES) and low-energy electron diffraction (LEED), together with density-functional theory (DFT) calculation, we report the formation of charge density wave (CDW) and its interplay with the Kondo effect and topological states in CeSbTe. The observed Fermi surface (FS) exhibits parallel segments that can be well connected by the observed CDW ordering vector, indicating that the CDW order is driven by the electron-phonon coupling (EPC) as a result of the nested FS. The CDW gap is large (~0.3 eV) and momentum-dependent, which naturally explains the robust CDW order up to high temperatures. The gap opening leads to a reduced density of states (DOS) near the Fermi level (EF), which correspondingly suppresses the many-body Kondo effect, leading to very localized 4f electrons at 20 K and above. The topological Dirac cone at the X point is found to remain gapless inside the CDW phase. Our results provide evidence for the competition between CDW and the Kondo effect in a Kondo lattice system. The robust CDW order in CeSbTe and related compounds provide an opportunity to search for the long-sought-after axionic insulator.

cond-mat.str-el↗

arXiv2020

Using simulation to incorporate dynamic criteria into multiple criteria decision-making

In this paper, we present a case study demonstrating how dynamic and uncertain criteria can be incorporated into a multicriteria analysis with the help of discrete event simulation. The simulation guided multicriteria analysis can include both monetary and non-monetary criteria that are static or dynamic, whereas standard multi criteria analysis only deals with static criteria and cost benefit analysis only deals with static monetary criteria. The dynamic and uncertain criteria are incorporated by using simulation to explore how the decision options perform. The results of the simulation are then fed into the multicriteria analysis. By enabling the incorporation of dynamic and uncertain criteria, the dynamic multiple criteria analysis was able to take a unique perspective of the problem. The highest ranked option returned by the dynamic multicriteria analysis differed from the other decision aid techniques.

cs.AI↗

arXiv2020

DisenE: Disentangling Knowledge Graph Embeddings

Knowledge graph embedding (KGE), aiming to embed entities and relations into low-dimensional vectors, has attracted wide attention recently. However, the existing research is mainly based on the black-box neural models, which makes it difficult to interpret the learned representation. In this paper, we introduce DisenE, an end-to-end framework to learn disentangled knowledge graph embeddings. Specially, we introduce an attention-based mechanism that enables the model to explicitly focus on relevant components of entity embeddings according to a given relation. Furthermore, we introduce two novel regularizers to encourage each component of the entity representation to independently reflect an isolated semantic aspect. Experimental results demonstrate that our proposed DisenE investigates a perspective to address the interpretability of KGE and is proved to be an effective way to improve the performance of link prediction tasks.

cs.CL↗

arXiv2020

Experimental parameters, combined dynamics, and nonlinearity of a Magnonic-Opto-Electronic Oscillator (MOEO)

We report the construction and characterization of a comprehensive magnonic-opto-electronic oscillator (MOEO) system based on 1550-nm photonics and yttirum iron garnet (YIG) magnonics. The system exhibits a rich and synergistic parameter space because of the ability to control individual photonic, electronic, and magnonic components. Taking advantage of the spin wave dispersion of YIG, the frequency self-generation as well as the related nonlinear processes become sensitive to the external magnetic field. Besides being known as a narrowband filter and a delay element, the YIG delayline possesses spin wave modes that can be controlled to mix with the optoelectronic modes to generate higher-order harmonic beating modes. With the high sensitivity and external tunability, the MOEO system may find usefulness in sensing applications in magnetism and spintronics beyond optoelectronics and photonics.

cond-mat.mes-hall↗

arXiv2020

Skip-Connected Self-Recurrent Spiking Neural Networks with Joint Intrinsic Parameter and Synaptic Weight Training

As an important class of spiking neural networks (SNNs), recurrent spiking neural networks (RSNNs) possess great computational power and have been widely used for processing sequential data like audio and text. However, most RSNNs suffer from two problems. 1. Due to a lack of architectural guidance, random recurrent connectivity is often adopted, which does not guarantee good performance. 2. Training of RSNNs is in general challenging, bottlenecking achievable model accuracy. To address these problems, we propose a new type of RSNNs called Skip-Connected Self-Recurrent SNNs (ScSr-SNNs). Recurrence in ScSr-SNNs is introduced in a stereotyped manner by adding self-recurrent connections to spiking neurons, which implements local memory. The network dynamics is enriched by skip connections between nonadjacent layers. Constructed by simplified self-recurrent and skip connections, ScSr-SNNs are able to realize recurrent behaviors similar to those of more complex RSNNs while the error gradients can be more straightforwardly calculated due to the mostly feedforward nature of the network. Moreover, we propose a new backpropagation (BP) method called backpropagated intrinsic plasticity (BIP) to further boost the performance of ScSr-SNNs by training intrinsic model parameters. Unlike standard intrinsic plasticity rules that adjust the neuron's intrinsic parameters according to neuronal activity, the proposed BIP methods optimize intrinsic parameters based on the backpropagated error gradient of a well-defined global loss function in addition to synaptic weight training. Based upon challenging speech and neuromorphic speech datasets including TI46-Alpha, TI46-Digits, and N-TIDIGITS, the proposed ScSr-SNNs can boost performance by up to 2.55% compared with other types of RSNNs trained by state-of-the-art BP methods.

cs.NE↗

arXiv2020

MS-Ranker: Accumulating Evidence from Potentially Correct Candidates for Answer Selection

As conventional answer selection (AS) methods generally match the question with each candidate answer independently, they suffer from the lack of matching information between the question and the candidate. To address this problem, we propose a novel reinforcement learning (RL) based multi-step ranking model, named MS-Ranker, which accumulates information from potentially correct candidate answers as extra evidence for matching the question with a candidate. In specific, we explicitly consider the potential correctness of candidates and update the evidence with a gating mechanism. Moreover, as we use a listwise ranking reward, our model learns to pay more attention to the overall performance. Experiments on two benchmarks, namely WikiQA and SemEval-2016 CQA, show that our model significantly outperforms existing methods that do not rely on external resources.

cs.CL↗

arXiv2020

Ring-Frustrated Non-Hermitian $XY$ Model

We study a non-Hermitian version of XY closed chain with odd number of lattice sites. We consider both anti-ferromagnetic coupling and also a symmetric non-collinear spin coupling. It is found that the energy spectrum is real in certain region of the parameter space. In contrast to previous non-Hermitian models, the ground state is a state with one mode occupied inside this real energy spectrum region, instead of the artificially identified vacuum state. At the same time, there appears a gapless excitation, which is made by kink like spin configurations. It is also found that this kink phase has non-trivial topological invariant.

quant-ph↗

arXiv2020

MAVEN: A Massive General Domain Event Detection Dataset

Event detection (ED), which means identifying event trigger words and classifying event types, is the first and most fundamental step for extracting event knowledge from plain text. Most existing datasets exhibit the following issues that limit further development of ED: (1) Data scarcity. Existing small-scale datasets are not sufficient for training and stably benchmarking increasingly sophisticated modern neural methods. (2) Low coverage. Limited event types of existing datasets cannot well cover general-domain events, which restricts the applications of ED models. To alleviate these problems, we present a MAssive eVENt detection dataset (MAVEN), which contains 4,480 Wikipedia documents, 118,732 event mention instances, and 168 event types. MAVEN alleviates the data scarcity problem and covers much more general event types. We reproduce the recent state-of-the-art ED models and conduct a thorough evaluation on MAVEN. The experimental results show that existing ED methods cannot achieve promising results on MAVEN as on the small datasets, which suggests that ED in the real world remains a challenging task and requires further research efforts. We also discuss further directions for general domain ED with empirical analyses. The source code and dataset can be obtained from https://github.com/THU-KEG/MAVEN-dataset.

cs.CL↗

arXiv2020

Coreferential Reasoning Learning for Language Representation

Language representation models such as BERT could effectively capture contextual semantic information from plain text, and have been proved to achieve promising results in lots of downstream NLP tasks with appropriate fine-tuning. However, most existing language representation models cannot explicitly handle coreference, which is essential to the coherent understanding of the whole discourse. To address this issue, we present CorefBERT, a novel language representation model that can capture the coreferential relations in context. The experimental results show that, compared with existing baseline models, CorefBERT can achieve significant improvements consistently on various downstream NLP tasks that require coreferential reasoning, while maintaining comparable performance to previous models on other common NLP tasks. The source code and experiment details of this paper can be obtained from https://github.com/thunlp/CorefBERT.

cs.CL↗

arXiv2020

WeChat Neural Machine Translation Systems for WMT20

We participate in the WMT 2020 shared news translation task on Chinese to English. Our system is based on the Transformer (Vaswani et al., 2017a) with effective variants and the DTMT (Meng and Zhang, 2019) architecture. In our experiments, we employ data selection, several synthetic data generation approaches (i.e., back-translation, knowledge distillation, and iterative in-domain knowledge transfer), advanced finetuning approaches and self-bleu based model ensemble. Our constrained Chinese to English system achieves 36.9 case-sensitive BLEU score, which is the highest among all submissions.

cs.CL↗

arXiv2020

Exact Solution to Sodium-Iridate-BCS-Hubbard Model along the Symmetric Line: Non-trivial topology in the ferromagnetic order

We study the sodium-iridates model on the honeycomb lattice with both BCS pairing potential and Hubbard interaction term. It is shown that this model can be exactly solved with appropriate choices of amplitude of pairing gaps, where the interacting terms are transformed to external field terms. The band structures of these exact solutions on both torus and cylinder geometry are discussed in great details. It is found that the ground state assumes an anti-ferromagnetic configuration, which breaks the time reversal symmetry spontaneously and renders the superconductor topologically trivial. On the other hand, the nontrivial topology is preserved with ferromagnetic configuration and can be characterized by the isospin Chern number.

cond-mat.str-el↗

arXiv2020

Exploring Adversarial Attack in Spiking Neural Networks with Spike-Compatible Gradient

Recently, backpropagation through time inspired learning algorithms are widely introduced into SNNs to improve the performance, which brings the possibility to attack the models accurately given Spatio-temporal gradient maps. We propose two approaches to address the challenges of gradient input incompatibility and gradient vanishing. Specifically, we design a gradient to spike converter to convert continuous gradients to ternary ones compatible with spike inputs. Then, we design a gradient trigger to construct ternary gradients that can randomly flip the spike inputs with a controllable turnover rate, when meeting all zero gradients. Putting these methods together, we build an adversarial attack methodology for SNNs trained by supervised algorithms. Moreover, we analyze the influence of the training loss function and the firing threshold of the penultimate layer, which indicates a "trap" region under the cross-entropy loss that can be escaped by threshold tuning. Extensive experiments are conducted to validate the effectiveness of our solution. Besides the quantitative analysis of the influence factors, we evidence that SNNs are more robust against adversarial attack than ANNs. This work can help reveal what happens in SNN attack and might stimulate more research on the security of SNN models and neuromorphic devices.

cs.NE↗

arXiv2020

More Data, More Relations, More Context and More Openness: A Review and Outlook for Relation Extraction

Relational facts are an important component of human knowledge, which are hidden in vast amounts of text. In order to extract these facts from text, people have been working on relation extraction (RE) for years. From early pattern matching to current neural networks, existing RE methods have achieved significant progress. Yet with explosion of Web text and emergence of new relations, human knowledge is increasing drastically, and we thus require "more" from RE: a more powerful RE system that can robustly utilize more data, efficiently learn more relations, easily handle more complicated context, and flexibly generalize to more open domains. In this paper, we look back at existing RE methods, analyze key challenges we are facing nowadays, and show promising directions towards more powerful RE. We hope our view can advance this field and inspire more efforts in the community.

cs.CL↗

arXiv2020

Impurity-driven transitions in frustrated quantum Ising ring

We study the quantum phase transitions driven by a point impurity in a chain seamed with ring frustration. Rich phases and quantum phase transitions are uncovered and characterized by both bulk and impurity correlation functions. Nonlocality of the correlation functions are emphasized in manifesting the novel features in the system. We demonstrate that the long-range correlation function can be factorized into local and nonlocal factors in the thermodynamic limit. The gapless topological extended-kink (TEK) phase is disclosed to exhibit long-range correlation but without long-range order, because its ground state is nondegenerate and thus immune to spontaneous symmetry breaking. This conclusion is also true in the classical impurity limit, which is significantly different from that for the open boundary chain without ring frustration. However, spontaneous symmetry breaking does occur in the gapped kink zero mode (KZM) phase and leads to the antiferromagnetic zero mode (AFZM), in which antiferromagnetic order develops in the bulk while entangled states persists locally around the impurity. And as a new feature of quantum phase transition induced by impurity, the transition from the TEK phase to the KZM-AFZM phase is reflected by a steplike nonlocal factor of the correlation function.

cond-mat.str-el↗

arXiv2020

Comprehensive SNN Compression Using ADMM Optimization and Activity Regularization

As well known, the huge memory and compute costs of both artificial neural networks (ANNs) and spiking neural networks (SNNs) greatly hinder their deployment on edge devices with high efficiency. Model compression has been proposed as a promising technique to improve the running efficiency via parameter and operation reduction. Whereas, this technique is mainly practiced in ANNs rather than SNNs. It is interesting to answer how much an SNN model can be compressed without compromising its functionality, where two challenges should be addressed: i) the accuracy of SNNs is usually sensitive to model compression, which requires an accurate compression methodology; ii) the computation of SNNs is event-driven rather than static, which produces an extra compression dimension on dynamic spikes. To this end, we realize a comprehensive SNN compression through three steps. First, we formulate the connection pruning and weight quantization as a constrained optimization problem. Second, we combine spatio-temporal backpropagation (STBP) and alternating direction method of multipliers (ADMM) to solve the problem with minimum accuracy loss. Third, we further propose activity regularization to reduce the spike events for fewer active operations. These methods can be applied in either a single way for moderate compression or a joint way for aggressive compression. We define several quantitative metrics to evaluation the compression performance for SNNs. Our methodology is validated in pattern recognition tasks over MNIST, N-MNIST, CIFAR10, and CIFAR100 datasets, where extensive comparisons, analyses, and insights are provided. To our best knowledge, this is the first work that studies SNN compression in a comprehensive manner by exploiting all compressible components and achieves better results.

cs.NE↗