arXiv subjects

Dongfang Li

Publications and source records attributed to Dongfang Li.

At least 55 records · Page 3Linked to original sources

arXiv2022

FusionFormer: Fusing Operations in Transformer for Efficient Streaming Speech Recognition

The recently proposed Conformer architecture which combines convolution with attention to capture both local and global dependencies has become the \textit{de facto} backbone model for Automatic Speech Recognition~(ASR). Inherited from the Natural Language Processing (NLP) tasks, the architecture takes Layer Normalization~(LN) as a default normalization technique. However, through a series of systematic studies, we find that LN might take 10\% of the inference time despite that it only contributes to 0.1\% of the FLOPs. This motivates us to replace LN with other normalization techniques, e.g., Batch Normalization~(BN), to speed up inference with the help of operator fusion methods and the avoidance of calculating the mean and variance statistics during inference. After examining several plain attempts which directly remove all LN layers or replace them with BN in the same place, we find that the divergence issue is mainly caused by the unstable layer output. We therefore propose to append a BN layer to each linear or convolution layer where stabilized training results are observed. We also propose to simplify the activations in Conformer, such as Swish and GLU, by replacing them with ReLU. All these exchanged modules can be fused into the weights of the adjacent linear/convolution layers and hence have zero inference cost. Therefore, we name it FusionFormer. Our experiments indicate that FusionFormer is as effective as the LN-based Conformer and is about 10\% faster.

cs.SD↗

arXiv2022

Data-driven method to learn the most probable transition pathway and stochastic differential equations

Transition phenomena between metastable states play an important role in complex systems due to noisy fluctuations. In this paper, the physics informed neural networks (PINNs) are presented to compute the most probable transition pathway. It is shown that the expected loss is bounded by the empirical loss. And the convergence result for the empirical loss is obtained. Then, a sampling method of rare events is presented to simulate the transition path by the Markovian bridge process. And we investigate the inverse problem to extract the stochastic differential equation from the most probable transition pathway data and the Markovian bridge process data, respectively. Finally, several numerical experiments are presented to verify the effectiveness of our methods.

math.NA↗

arXiv2022

A Survey on Table Question Answering: Recent Advances

Table Question Answering (Table QA) refers to providing precise answers from tables to answer a user's question. In recent years, there have been a lot of works on table QA, but there is a lack of comprehensive surveys on this research topic. Hence, we aim to provide an overview of available datasets and representative methods in table QA. We classify existing methods for table QA into five categories according to their techniques, which include semantic-parsing-based, generative, extractive, matching-based, and retriever-reader-based methods. Moreover, as table QA is still a challenging task for existing methods, we also identify and outline several key challenges and discuss the potential future directions of table QA.

cs.CL↗

arXiv2022

MSDF: A General Open-Domain Multi-Skill Dialog Framework

Dialog systems have achieved significant progress and have been widely used in various scenarios. The previous researches mainly focused on designing dialog generation models in a single scenario, while comprehensive abilities are required to handle tasks under various scenarios in the real world. In this paper, we propose a general Multi-Skill Dialog Framework, namely MSDF, which can be applied in different dialog tasks (e.g. knowledge grounded dialog and persona based dialog). Specifically, we propose a transferable response generator pre-trained on diverse large-scale dialog corpora as the backbone of MSDF, consisting of BERT-based encoders and a GPT-based decoder. To select the response consistent with dialog history, we propose a consistency selector trained through negative sampling. Moreover, the flexible copy mechanism of external knowledge is also employed to enhance the utilization of multiform knowledge in various scenarios. We conduct experiments on knowledge grounded dialog, recommendation dialog, and persona based dialog tasks. The experimental results indicate that our MSDF outperforms the baseline models with a large margin. In the Multi-skill Dialog of 2021 Language and Intelligence Challenge, our general MSDF won the 3rd prize, which proves our MSDF is effective and competitive.

cs.AI↗

arXiv2021

Unifying Model Explainability and Robustness for Joint Text Classification and Rationale Extraction

Recent works have shown explainability and robustness are two crucial ingredients of trustworthy and reliable text classification. However, previous works usually address one of two aspects: i) how to extract accurate rationales for explainability while being beneficial to prediction; ii) how to make the predictive model robust to different types of adversarial attacks. Intuitively, a model that produces helpful explanations should be more robust against adversarial attacks, because we cannot trust the model that outputs explanations but changes its prediction under small perturbations. To this end, we propose a joint classification and rationale extraction model named AT-BMC. It includes two key mechanisms: mixed Adversarial Training (AT) is designed to use various perturbations in discrete and embedding space to improve the model's robustness, and Boundary Match Constraint (BMC) helps to locate rationales more precisely with the guidance of boundary information. Performances on benchmark datasets demonstrate that the proposed AT-BMC outperforms baselines on both classification and rationale extraction by a large margin. Robustness analysis shows that the proposed AT-BMC decreases the attack success rate effectively by up to 69%. The empirical results indicate that there are connections between robust models and better explanations.

cs.CL↗

arXiv2021

Diaformer: Automatic Diagnosis via Symptoms Sequence Generation

Automatic diagnosis has attracted increasing attention but remains challenging due to multi-step reasoning. Recent works usually address it by reinforcement learning methods. However, these methods show low efficiency and require taskspecific reward functions. Considering the conversation between doctor and patient allows doctors to probe for symptoms and make diagnoses, the diagnosis process can be naturally seen as the generation of a sequence including symptoms and diagnoses. Inspired by this, we reformulate automatic diagnosis as a symptoms Sequence Generation (SG) task and propose a simple but effective automatic Diagnosis model based on Transformer (Diaformer). We firstly design the symptom attention framework to learn the generation of symptom inquiry and the disease diagnosis. To alleviate the discrepancy between sequential generation and disorder of implicit symptoms, we further design three orderless training mechanisms. Experiments on three public datasets show that our model outperforms baselines on disease diagnosis by 1%, 6% and 11.5% with the highest training efficiency. Detailed analysis on symptom inquiry prediction demonstrates that the potential of applying symptoms sequence generation for automatic diagnosis.

cs.AI↗

arXiv2021

You Can Do Better! If You Elaborate the Reason When Making Prediction

Neural predictive models have achieved remarkable performance improvements in various natural language processing tasks. However, most neural predictive models suffer from the lack of explainability of predictions, limiting their practical utility. This paper proposes a neural predictive approach to make a prediction and generate its corresponding explanation simultaneously. It leverages the knowledge entailed in explanations as an additional distillation signal for more efficient learning. We conduct a preliminary study on Chinese medical multiple-choice question answering, English natural language inference, and commonsense question answering tasks. The experimental results show that the proposed approach can generate reasonable explanations for its predictions even with a small-scale training corpus. The proposed method also achieves improved prediction accuracy on three datasets, which indicates that making predictions can benefit from generating the explanation in the decision process.

cs.CL↗

arXiv2021

Unconditionally optimal convergence of an energy-conserving and linearly implicit scheme for nonlinear wave equations

In this paper, we present and analyze an energy-conserving and linearly implicit scheme for solving the nonlinear wave equations. Optimal error estimates in time and superconvergent error estimates in space are established without time-step dependent on the spatial mesh size. The key is to estimate directly the solution bounds in the $H^2$-norm for both the nonlinear wave equation and the corresponding fully discrete scheme, while the previous investigations rely on the temporal-spatial error splitting approach. Numerical examples are presented to confirm energy-conserving properties, unconditional convergence, and optimal error estimates, respectively, of the proposed fully discrete schemes.

math.NA↗

arXiv2021

Sharp pointwise-in-time error estimate of L1 scheme for nonlinear subdiffusion equations

An essential feature of the subdiffusion equations with the $α$-order time fractional derivative is the weak singularity at the initial time. The weak regularity of the solution is usually characterized by a regularity parameter $σ\in (0,1)\cup(1,2)$. Under this general regularity assumption, we here obtain the pointwise-in-time error estimate of the widely used L1 scheme for nonlinear subdiffusion equations. To the end, we present a refined discrete fractional-type Grönwall inequality and a rigorous analysis for the truncation errors. Numerical experiments are provided to demonstrate the effectiveness of our theoretical analysis.

math.NA↗

arXiv2020

Integrating Coarse Granularity Part-level Features with Supervised Global-level Features for Person Re-identification

Holistic person re-identification (Re-ID) and partial person re-identification have achieved great progress respectively in recent years. However, scenarios in reality often include both holistic and partial pedestrian images, which makes single holistic or partial person Re-ID hard to work. In this paper, we propose a robust coarse granularity part-level person Re-ID network (CGPN), which not only extracts robust regional level body features, but also integrates supervised global features for both holistic and partial person images. CGPN gains two-fold benefit toward higher accuracy for person Re-ID. On one hand, CGPN learns to extract effective body part features for both holistic and partial person images. On the other hand, compared with extracting global features directly by backbone network, CGPN learns to extract more accurate global features with a supervision strategy. The single model trained on three Re-ID datasets including Market-1501, DukeMTMC-reID and CUHK03 achieves state-of-the-art performances and outperforms any existing approaches. Especially on CUHK03, which is the most challenging dataset for person Re-ID, in single query mode, we obtain a top result of Rank-1/mAP=87.1\%/83.6\% with this method without re-ranking, outperforming the current best method by +7.0\%/+6.7\%.

cs.CV↗

arXiv2020

Semi-supervised Visual Feature Integration for Pre-trained Language Models

Integrating visual features has been proved useful for natural language understanding tasks. Nevertheless, in most existing multimodal language models, the alignment of visual and textual data is expensive. In this paper, we propose a novel semi-supervised visual integration framework for pre-trained language models. In the framework, the visual features are obtained through a visualization and fusion mechanism. The uniqueness includes: 1) the integration is conducted via a semi-supervised approach, which does not require aligned images for every sentences 2) the visual features are integrated as an external component and can be directly used by pre-trained language models. To verify the efficacy of the proposed framework, we conduct the experiments on both natural language inference and reading comprehension tasks. The results demonstrate that our mechanism brings improvement to two strong baseline models. Considering that our framework only requires an image database, and no not requires further alignments, it provides an efficient and feasible way for multimodal language learning.

cs.CL↗

arXiv2019

BERTSel: Answer Selection with Pre-trained Models

Recently, pre-trained models have been the dominant paradigm in natural language processing. They achieved remarkable state-of-the-art performance across a wide range of related tasks, such as textual entailment, natural language inference, question answering, etc. BERT, proposed by Devlin et.al., has achieved a better marked result in GLUE leaderboard with a deep transformer architecture. Despite its soaring popularity, however, BERT has not yet been applied to answer selection. This task is different from others with a few nuances: first, modeling the relevance and correctness of candidates matters compared to semantic relatedness and syntactic structure; second, the length of an answer may be different from other candidates and questions. In this paper. we are the first to explore the performance of fine-tuning BERT for answer selection. We achieved STOA results across five popular datasets, demonstrating the success of pre-trained models in this task.

cs.CL↗

arXiv2018

Tailoring the Local Density of Optical States and directionality of light emission by symmetry-breaking

We present a method to simultaneously engineer the energy-momentum dispersion and the local density of optical states. Using vertical symmetry-breaking in high-contrast gratings, we enable the mixing of modes with different parities, thus producing hybridized modes with controlled dispersion. By tuning geometric parameters, we control the coupling between Bloch modes, leading to flatband, M- and W-shaped dispersion as well as Dirac dispersion. Such a platform opens up a new way to control the direction of emitted photons, and to enhance the spontaneous emission into desired modes. We then experimentally demonstrate that this method can be used to redirect light emission from weak emitters -- defects in Silicon -- to optical modes with adjustable density of states and angle of emission.

physics.optics↗

arXiv2016

Strong Amplitude and Phase Modulation of Optical Spatial Coherence with Surface Plasmon Polaritons

The degree of optical spatial coherence -a fundamental property of light that describes the mutual correlations between fluctuating electromagnetic fields- has proven challenging to control at the micrometer scale. Here we employ surface plasmon polaritons -evanescent waves excited on both surfaces of a thin metal film- as a means to entangle the random fluctuations of the incident electromagnetic fields at the slit locations of a Young's double-slit interferometer. Strong tunability of the complex degree of spatial coherence of light is achieved by finely varying the separation distance between the two slits. Continuous modulation of the degree of spatial coherence with amplitudes ranging from 0% up to 80% allows us to transform totally incoherent incident light into highly coherent light, and vice versa. These findings pave the way for alternative methods to engineer flat optical elements with multi-functional capabilities beyond conventional refractive- and diffractive-based photonic metasurfaces.

physics.optics↗

arXiv2016

A Novel Sufficient Condition for Generalized Orthogonal Matching Pursuit

Generalized orthogonal matching pursuit (gOMP), also called orthogonal multi-matching pursuit, is an extension of OMP in the sense that $N\geq1$ indices are identified per iteration. In this paper, we show that if the restricted isometry constant (RIC) $δ_{NK+1}$ of a sensing matrix $\A$ satisfies $δ_{NK+1} < 1/\sqrt {K/N+1}$, then under a condition on the signal-to-noise ratio, gOMP identifies at least one index in the support of any $K$-sparse signal $\x$ from $\y=\A\x+\v$ at each iteration, where $\v$ is a noise vector. Surprisingly, this condition does not require $N\leq K$ which is needed in Wang, \textit{et al} 2012 and Liu, \textit{et al} 2012. Thus, $N$ can have more choices. When $N=1$, it reduces to be a sufficient condition for OMP, which is less restrictive than that proposed in Wang 2015. Moreover, in the noise-free case, it is a sufficient condition for accurately recovering $\x$ in $K$ iterations which is less restrictive than the best known one. In particular, it reduces to the sharp condition proposed in Mo 2015 when $N=1$.

cs.IT↗

arXiv2016

Analysis of $L1$-Galerkin FEMs for time-fractional nonlinear parabolic problems

This paper is concerned with numerical solutions of time-fractional nonlinear parabolic problems by a class of $L1$-Galerkin finite element methods. The analysis of $L1$ methods for time-fractional nonlinear problems is limited mainly due to the lack of a fundamental Gronwall type inequality. In this paper, we establish such a fundamental inequality for the $L1$ approximation to the Caputo fractional derivative. In terms of the Gronwall type inequality, we provide optimal error estimates of several fully discrete linearized Galerkin finite element methods for nonlinear problems. The theoretical results are illustrated by applying our proposed methods to three examples: linear Fokker-Planck equation, nonlinear Huxley equation and Fisher equation.

math.NA↗

arXiv2014

Epidemic clones, oceanic gene pools and eco-LD in the free living marine pathogen Vibrio parahaemolyticus

We investigated global patterns of variation in 157 whole genome sequences of Vibrio parahaemolyticus, a free-living and seafood associated marine bacterium. Pandemic clones, responsible for recent outbreaks of gastroenteritis in humans have spread globally. However, there are oceanic gene pools, one located in the oceans surrounding Asia and another in the Mexican Gulf. Frequent recombination means that most isolates have acquired the genetic profile of their current location. We investigated the genetic structure in the Asian gene pool by calculating the effective population size in two different ways. Under standard neutral models, the two estimates should give similar answers but we found a thirty fold difference. We propose that this discrepancy is caused by the subdivision of the species into a hundred or more ecotypes which are maintained stably in the population. To investigate the genetic factors involved, we used 51 unrelated isolates to conduct a genome-wide scan for epistatically interacting loci. We found a single example of strong epistasis between distant genome regions. A majority of strains had a type VI secretion system associated with bacterial killing. The remaining strains had genes associated with biofilm formation and regulated by c-di-GMP signaling. All strains had one or other of the two systems and none of isolate had complete complements of both systems, although several strains had remnants. Further top-down analysis of patterns of linkage disequilibrium within frequently recombining species will allow a detailed understanding of how selection acts to structure the pattern of variation within natural bacterial populations.

q-bio.PE↗

arXiv2014

Stable Recovery of Sparse Signals via $l_p-$Minimization

In this paper, we show that, under the assumption that $\|\e\|_2\leq ε$, every $k-$sparse signal $\x\in \mathbb{R}^n$ can be stably ($ε\neq0$) or exactly recovered ($ε=0$) from $\y=\A\x+\e$ via $l_p-$mnimization with $p\in(0, \bar{p}]$, where \beqnn \bar{p}= \begin{cases} \frac{50}{31}(1-δ_{2k}), &δ_{2k}\in[\frac{\sqrt{2}}{2}, 0.7183)\cr 0.4541, &δ_{2k}\in[0.7183,0.7729)\cr 2(1-δ_{2k}), &δ_{2k}\in[0.7729,1) \end{cases}, \eeqnn even if the restricted isometry constant of $\A$ satisfies $δ_{2k}\in[\frac{\sqrt{2}}{2}, 1)$. Furthermore, under the assumption that $n\leq 4k$, we show that the range of $p$ can be further improved to $p\in(0,\frac{3+2\sqrt{2}}{2}(1-δ_{2k})]$. This not only extends some discussions of only the noiseless recovery (Lai et al. and Wu et al.) to the noise recovery, but also greatly improves the best existing results where $p\in(0,\min\{1, 1.0873(1-δ_{2k}) \})$ (Wu et al.).

cs.IT↗