arXiv Science⌕ Search

arXiv subjects

Yu Yan

Publications and source records attributed to Yu Yan.

89 records · Page 5Linked to original sources
arXiv2021

Multi-SQL: An extensible multi-model data query language

Big data management aims to establish data hubs that support data in multiple models and types in an all-around way. Thus, the multi-model database system is a promising architecture for building such a multi-model data store. For an integrated data hub, a unified and flexible query language is incredibly necessary. In this paper, an extensible and practical query language--Multi-SQL is proposed to realize the unified management of multi-model data considering the co-processing of multi-model data. To the best of our knowledge, Multi-SQL is the first query language based on various data models. Multi-SQL can also be expanded to suit more complicated scenarios as it is flexible to support other data models. Moreover, we provide a formal semantic definition of the core features of Multi-SQL, including the multi-model definition, multi-model filters, multi-model joins, etc. Furthermore, we propose a two-level query implementation method to totally exploit the existing query optimization capabilities of the underlying engines which could largely improve the query excution efficiency.

cs.DB↗
arXiv2020

Clinical Temporal Relation Extraction with Probabilistic Soft Logic Regularization and Global Inference

There has been a steady need in the medical community to precisely extract the temporal relations between clinical events. In particular, temporal information can facilitate a variety of downstream applications such as case report retrieval and medical question answering. Existing methods either require expensive feature engineering or are incapable of modeling the global relational dependencies among the events. In this paper, we propose a novel method, Clinical Temporal ReLation Exaction with Probabilistic Soft Logic Regularization and Global Inference (CTRL-PG) to tackle the problem at the document level. Extensive experiments on two benchmark datasets, I2B2-2012 and TB-Dense, demonstrate that CTRL-PG significantly outperforms baseline methods for temporal relation extraction.

cs.CL↗
arXiv2020

ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training

This paper presents a new sequence-to-sequence pre-training model called ProphetNet, which introduces a novel self-supervised objective named future n-gram prediction and the proposed n-stream self-attention mechanism. Instead of optimizing one-step-ahead prediction in the traditional sequence-to-sequence model, the ProphetNet is optimized by n-step ahead prediction that predicts the next n tokens simultaneously based on previous context tokens at each time step. The future n-gram prediction explicitly encourages the model to plan for the future tokens and prevent overfitting on strong local correlations. We pre-train ProphetNet using a base scale dataset (16GB) and a large-scale dataset (160GB), respectively. Then we conduct experiments on CNN/DailyMail, Gigaword, and SQuAD 1.1 benchmarks for abstractive summarization and question generation tasks. Experimental results show that ProphetNet achieves new state-of-the-art results on all these datasets compared to the models using the same scale pre-training corpus.

cs.CL↗
arXiv2020

ProphetNet-Ads: A Looking Ahead Strategy for Generative Retrieval Models in Sponsored Search Engine

In a sponsored search engine, generative retrieval models are recently proposed to mine relevant advertisement keywords for users' input queries. Generative retrieval models generate outputs token by token on a path of the target library prefix tree (Trie), which guarantees all of the generated outputs are legal and covered by the target library. In actual use, we found several typical problems caused by Trie-constrained searching length. In this paper, we analyze these problems and propose a looking ahead strategy for generative retrieval models named ProphetNet-Ads. ProphetNet-Ads improves the retrieval ability by directly optimizing the Trie-constrained searching space. We build a dataset from a real-word sponsored search engine and carry out experiments to analyze different generative retrieval models. Compared with Trie-based LSTM generative retrieval model proposed recently, our single model result and integrated result improve the recall by 15.58\% and 18.8\% respectively with beam size 5. Case studies further demonstrate how these problems are alleviated by ProphetNet-Ads clearly.

cs.IR↗
arXiv2020

Diverse, Controllable, and Keyphrase-Aware: A Corpus and Method for News Multi-Headline Generation

News headline generation aims to produce a short sentence to attract readers to read the news. One news article often contains multiple keyphrases that are of interest to different users, which can naturally have multiple reasonable headlines. However, most existing methods focus on the single headline generation. In this paper, we propose generating multiple headlines with keyphrases of user interests, whose main idea is to generate multiple keyphrases of interest to users for the news first, and then generate multiple keyphrase-relevant headlines. We propose a multi-source Transformer decoder, which takes three sources as inputs: (a) keyphrase, (b) keyphrase-filtered article, and (c) original article to generate keyphrase-relevant, high-quality, and diverse headlines. Furthermore, we propose a simple and effective method to mine the keyphrases of interest in the news article and build a first large-scale keyphrase-aware news headline corpus, which contains over 180K aligned triples of $<$news article, headline, keyphrase$>$. Extensive experimental comparisons on the real-world dataset show that the proposed method achieves state-of-the-art results in terms of quality and diversity

cs.CL↗
arXiv2020

Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space

In this paper, we propose a novel data augmentation method, referred to as Controllable Rewriting based Question Data Augmentation (CRQDA), for machine reading comprehension (MRC), question generation, and question-answering natural language inference tasks. We treat the question data augmentation task as a constrained question rewriting problem to generate context-relevant, high-quality, and diverse question data samples. CRQDA utilizes a Transformer autoencoder to map the original discrete question into a continuous embedding space. It then uses a pre-trained MRC model to revise the question representation iteratively with gradient-based optimization. Finally, the revised question representations are mapped back into the discrete space, which serve as additional question data. Comprehensive experiments on SQuAD 2.0, SQuAD 1.1 question generation, and QNLI tasks demonstrate the effectiveness of CRQDA

cs.CL↗
arXiv2020

S-DIGing: A Stochastic Gradient Tracking Algorithm for Distributed Optimization

In this paper, we study convex optimization problems where agents of a network cooperatively minimize the global objective function which consists of multiple local objective functions. Different from most of the existing works, the local objective function of each agent is presented as the average of finite instantaneous functions. The intention of this work is to solve large-scale optimization problems where the local objective function is complicated and numerous. Integrating the gradient tracking algorithm with stochastic averaging gradient technology, we propose a novel distributed stochastic gradient tracking (termed as S-DIGing) algorithm. At each time instant, only one randomly selected gradient of a instantaneous function is computed and applied to approximate the gradient of local objection function. Based on a primal-dual interpretation of the S-DIGing algorithm, we show that the S-DIGing algorithm linearly converges to the global optimal solution when step-size lies in an explicit internal under the assumptions that the instantaneous functions are strongly convex and have Lipschitz-continuous gradient. Numerical experiments on the logistic regression problem are presented to demonstrate the practicability of the algorithm and correctness of the theoretical results.

math.OC↗
arXiv2020

Index Selection for NoSQL Database with Deep Reinforcement Learning

We propose a new approach of NoSQL database index selection. For different workloads, we select different indexes and their different parameters to optimize the database performance. The approach builds a deep reinforcement learning model to select an optimal index for a given fixed workload and adapts to a changing workload. Experimental results show that, Deep Reinforcement Learning Index Selection Approach (DRLISA) has improved performance to varying degrees according to traditional single index structures.

cs.DB↗
arXiv2020

RikiNet: Reading Wikipedia Pages for Natural Question Answering

Reading long documents to answer open-domain questions remains challenging in natural language understanding. In this paper, we introduce a new model, called RikiNet, which reads Wikipedia pages for natural question answering. RikiNet contains a dynamic paragraph dual-attention reader and a multi-level cascaded answer predictor. The reader dynamically represents the document and question by utilizing a set of complementary attention mechanisms. The representations are then fed into the predictor to obtain the span of the short answer, the paragraph of the long answer, and the answer type in a cascaded manner. On the Natural Questions (NQ) dataset, a single RikiNet achieves 74.3 F1 and 57.9 F1 on long-answer and short-answer tasks. To our best knowledge, it is the first single model that outperforms the single human performance. Furthermore, an ensemble RikiNet obtains 76.1 F1 and 61.3 F1 on long-answer and short-answer tasks, achieving the best performance on the official NQ leaderboard

cs.CL↗
arXiv2019

Electrically Tunable Wafer-Sized Three-Dimensional Topological Insulator Thin Films Grown by Magnetron Sputtering

Three-dimensional (3D) topological insulators (TIs) are candidate materials for various electronic and spintronic devices due to their strong spin-orbit coupling and unique surface electronic structure. Rapid, low-cost preparation of large-area TI thin films compatible with conventional semiconductor technology is key to the practical applications of TIs. Here, we show that wafer-sized Bi2Te3 family TI and magnetic TI films with decent quality and well-controlled composition and properties can be prepared on amorphous SiO2/Si substrates by magnetron cosputtering. The SiO2/Si substrates enable us to electrically tune (Bi1-xSbx)2Te3 and Cr-doped (Bi1-xSbx)2Te3 TI films between p-type and n-type behavior and thus study the phenomena associated with topological surface states, such as the quantum anomalous Hall effect (QAHE). This work significantly facilitates the fabrication of TI-based devices for electronic and spintronic applications.

physics.app-ph↗
arXiv2017

Effect of Notch Structure on Magnetic Domain Movement in Planar Nanowires

We present the direct observation of magnetic domain motion in permalloy nanowires with notches using a wide-field Kerr microscopy technique. The domain wall motion can be modulated by the size and shape of the notch structure in the nanowires. It is demonstrated that the coercive fields can be tuned by modulating the notches. The experimental results are consistent with the micro-magnetic simulation results. The relationship between the notch angle and the domain nuclease are also studied. This work is useful for the design and development of the notch-based spintronic devices.

cond-mat.mes-hall↗
arXiv2016

Elementary specific spin and orbital moments of ultrathin CoFeB amorphous films on GaAs(100)

Nanoscale CoFeB amorphous films have been synthesized on GaAs(100) and studied with X-ray magnetic circular dichroism (XMCD) and transmission electron microscopy (TEM). We have found that the ratios of the orbital to spin magnetic moments of both the Co and Fe in the ultrathin amorphous film have been enhanced by more than 300% compared with those of the bulk crystalline Co and Fe, and in specifically, a large orbital moment of 0.56*10^-6 B from the Co atoms has been observed and at the same time the spin moment of the Co atoms remains comparable to that of the bulk hcp Co. The results indicate that the large uniaxial magnetic anisotropy (UMA) observed in the ultrathin CoFeB film on GaAs(100) is related to the enhanced spin-orbital coupling of the Co atoms in the CoFeB. This work offers experimental evidences of the correlation between the UMA and the elementary specific spin and orbital moments in the CoFeB amorphous film on the GaAs(100) substrate, which is significant for spintronics applications.

cond-mat.mtrl-sci↗
arXiv2007

The Scalar Curvature Deformation Equation on Locally Conformally Flat Manifolds

We study the equation $Δ_g u -\frac{n-2}{4(n-1)}R(g)u+Ku^p=0 (1+ζ\leq p \leq \frac{n+2}{n-2})$ on locally conformally flat compact manifolds $(M^n,g)$. We prove the following: (i) When the scalar curvature $R(g)>0$ and the dimension $n \geq 4$, under suitable conditions on $K$, all positive solutions $u$ have uniform upper and lower bounds; (ii) When the scalar curvature $R(g)\equiv 0$ and $n \geq 5$, under suitable conditions on $K$, all positive solutions $u$ with bounded energy have uniform upper and lower bounds. We also give an example to show that the energy bound condition for the uniform estimates in math.DG/0602636 is necessary.

math.DG↗
arXiv2006

Some Compactness Results Related to Scalar Curvature Deformation

Motivated by the prescribing scalar curvature problem, we study the equation $Δ_g u +Ku^p=0 (1+ζ\leq p \leq \frac{n+2}{n-2})$ on locally conformally flat manifolds $(M,g)$ with $R(g)=0$. We prove that when $K$ satisfies certain conditions and the dimension of $M$ is 3 or 4, any solution $u$ of this equation with bounded energy has uniform upper and lower bounds. Similar techniques can also be applied to prove that on 4-dimensional scalar positive manifolds the solutions of $Δ_gu-\frac{n-2}{4(n-1)}R(g)u+Ku^p=0, K>0, 1+ζ\leq p \leq \frac{n+2}{n-2}$ can only have simple blow-up points.

math.DG↗