arXiv subjects

Hui Liu

Publications and source records attributed to Hui Liu.

At least 505 records · Page 28Linked to original sources

arXiv2020

Mitigating Gender Bias for Neural Dialogue Generation with Adversarial Learning

Dialogue systems play an increasingly important role in various aspects of our daily life. It is evident from recent research that dialogue systems trained on human conversation data are biased. In particular, they can produce responses that reflect people's gender prejudice. Many debiasing methods have been developed for various NLP tasks, such as word embedding. However, they are not directly applicable to dialogue systems because they are likely to force dialogue models to generate similar responses for different genders. This greatly degrades the diversity of the generated responses and immensely hurts the performance of the dialogue models. In this paper, we propose a novel adversarial learning framework Debiased-Chat to train dialogue models free from gender bias while keeping their performance. Extensive experiments on two real-world conversation datasets show that our framework significantly reduces gender bias in dialogue models while maintaining the response quality. The implementation of the proposed framework is released.

cs.CL↗

arXiv2020

Geometry induced quantum Hall effect and Hall viscosity

For a particle confined to the two-dimensional helical surface embedded in four-dimensional (4D) Euclidean space, the effective Hamiltonian is deduced in the thin-layer quantization formalism. We find that the gauge structure of the effective dynamics is determined by torsion, which plays the role of U(1) gauge potential, and find that the topological structure of associated states is defined by orbital spin which originates from 4D space. Strikingly, the response to torsion contributes a quantum Hall effect, and the response to the deformation of torsion contributes Hall viscosity that is perfectly presented as a simultaneous occurrence of multiple channels for the quantum Hall effect. This result directly provides a way to probe Hall viscosity.

cond-mat.mes-hall↗

arXiv2020

Memory-efficient Embedding for Recommendations

Practical large-scale recommender systems usually contain thousands of feature fields from users, items, contextual information, and their interactions. Most of them empirically allocate a unified dimension to all feature fields, which is memory inefficient. Thus it is highly desired to assign different embedding dimensions to different feature fields according to their importance and predictability. Due to the large amounts of feature fields and the nuanced relationship between embedding dimensions with feature distributions and neural network architectures, manually allocating embedding dimensions in practical recommender systems can be very difficult. To this end, we propose an AutoML based framework (AutoDim) in this paper, which can automatically select dimensions for different feature fields in a data-driven fashion. Specifically, we first proposed an end-to-end differentiable framework that can calculate the weights over various dimensions for feature fields in a soft and continuous manner with an AutoML based optimization algorithm; then we derive a hard and discrete embedding component architecture according to the maximal weights and retrain the whole recommender framework. We conduct extensive experiments on benchmark datasets to validate the effectiveness of the AutoDim framework.

cs.IR↗

arXiv2020

Shallow-to-Deep Training for Neural Machine Translation

Deep encoders have been proven to be effective in improving neural machine translation (NMT) systems, but training an extremely deep encoder is time consuming. Moreover, why deep models help NMT is an open question. In this paper, we investigate the behavior of a well-tuned deep Transformer system. We find that stacking layers is helpful in improving the representation ability of NMT models and adjacent layers perform similarly. This inspires us to develop a shallow-to-deep training method that learns deep models by stacking shallow models. In this way, we successfully train a Transformer system with a 54-layer encoder. Experimental results on WMT'16 English-German and WMT'14 English-French translation tasks show that it is $1.4$ $\times$ faster than training from scratch, and achieves a BLEU score of $30.33$ and $43.29$ on two tasks. The code is publicly available at https://github.com/libeineu/SDT-Training/.

cs.CL↗

arXiv2020

Optimization of laser dynamics for active stabilization of DF--VECSELs dedicated to cesium CPT clocks

We report the implementation and performance of a double servo-loop for intensity and phase-difference active stabilization of a dual-frequency vertical external--cavity surface-emitting laser (DF-VECSEL) for coherent population trapping (CPT) of cesium atoms in the framework of compact atomic clocks. In--phase fully correlated pumping of the two laser modes is identified as the best scheme for intensity noise reduction, and an analytical model allows the optimization of the active stabilization strategy. Optical phase-locking the beat-note to a local oscillator leads to a phase noise level below -103~dBc/Hz at 100~Hz from the carrier. The laser contribution to the short-term frequency stability of the clock is predicted to be compatible with a targeted Allan deviation below $σ_y = 5\,\times 10^{-13}$ over one second.

physics.ins-det↗

arXiv2020

Effects of centrality fluctuation and deuteron formation on proton number cumulant in Au+Au collisions at $\sqrt{s_\mathrm{NN}}$ = 3 GeV from JAM model

We studied the effects of centrality fluctuation and deuteron formation on the cumulants ($C_n$) and correlation functions ($κ_n$) of protons up to sixth order in most central ($b<3$ fm) Au+Au collisions at $\sqrt{s_\mathrm{NN}}$ = 3 GeV from a microscopic transport model (JAM). The results are presented as a function of rapidity acceptance within transverse momentum $0.4<p_{T}<2 $ GeV/$c$. We compared the results obtained by centrality bin width correction (CBWC) using charged reference particle multiplicity with CBWC done using impact parameter bins. It was found that at low energies the centrality resolution for determining the collision centrality using charged particle multiplicities is not good enough to reduce the initial volume fluctuations effect for higher-order cumulant analysis. New methods need to be developed to classify events with high centrality resolution for heavy-ion collisions at low energies. Finally, we observed that the formation of deuteron will suppress the higher-order cumulants and correlation functions of protons and is found to be similar to the efficiency effect. This work can serve as a noncritical baseline for the QCD critical point search at the high baryon density region.

nucl-ex↗

arXiv2020

Yet Meta Learning Can Adapt Fast, It Can Also Break Easily

Meta learning algorithms have been widely applied in many tasks for efficient learning, such as few-shot image classification and fast reinforcement learning. During meta training, the meta learner develops a common learning strategy, or experience, from a variety of learning tasks. Therefore, during meta test, the meta learner can use the learned strategy to quickly adapt to new tasks even with a few training samples. However, there is still a dark side about meta learning in terms of reliability and robustness. In particular, is meta learning vulnerable to adversarial attacks? In other words, would a well-trained meta learner utilize its learned experience to build wrong or likely useless knowledge, if an adversary unnoticeably manipulates the given training set? Without the understanding of this problem, it is extremely risky to apply meta learning in safety-critical applications. Thus, in this paper, we perform the initial study about adversarial attacks on meta learning under the few-shot classification problem. In particular, we formally define key elements of adversarial attacks unique to meta learning and propose the first attacking algorithm against meta learning under various settings. We evaluate the effectiveness of the proposed attacking strategy as well as the robustness of several representative meta learning algorithms. Experimental results demonstrate that the proposed attacking strategy can easily break the meta learner and meta learning is vulnerable to adversarial attacks. The implementation of the proposed framework will be released upon the acceptance of this paper.

cs.LG↗

arXiv2020

Pion quasiparticles and QCD phase transitions at finite temperature and isospin density from holography

Spectra of pions, which are known as the pseudo-Goldstone bosons of spontaneous chiral symmetry breaking, as well as their relationship with chiral phase transition and pion superfluidity phase transition, have been investigated in the framework of soft-wall AdS/QCD. In chiral limit, it is proved both numerically and analytically that pions are massless Goldstone bosons even at finite temperature, which was usually considered as an assumption in soft-wall models. Above $T_c$, at which chiral condensate $\langle \bar{q}q\rangle$ vanishes, the spectra of pions and scalar mesons merge together, showing the evidence of the restored chiral symmetry in hadronic spectrum level. Extending to finite quark mass, pion masses increase with quark mass. Further, it is more interesting to observe that the pole masses of pions decrease with temperature below $T_c$, which agrees with the analysis in Phys.Rev.Lett.88(2002)202302. Meanwhile, symmetry restoration above $T_c$ could be seen in the spectra of scalar and pseudo-scalar mesons. With finite temperature and isospin chemical potential $μ_I$, it is shown that the masses of charged pions would split. The mass of positive charged pion $π^+$ decreases almost linearly to zero when $μ_I$ grows to $μ_{I}^c$, where pion condensation starts to form. This reveals the Goldstone nature of $π^+$ after pion superfluidity transition, which are closely related to the experimental observation.

hep-ph↗

arXiv2020

Multi-Scale One-Class Recurrent Neural Networks for Discrete Event Sequence Anomaly Detection

Discrete event sequences are ubiquitous, such as an ordered event series of process interactions in Information and Communication Technology systems. Recent years have witnessed increasing efforts in detecting anomalies with discrete-event sequences. However, it still remains an extremely difficult task due to several intrinsic challenges including data imbalance issues, the discrete property of the events, and sequential nature of the data. To address these challenges, in this paper, we propose OC4Seq, a multi-scale one-class recurrent neural network for detecting anomalies in discrete event sequences. Specifically, OC4Seq integrates the anomaly detection objective with recurrent neural networks (RNNs) to embed the discrete event sequences into latent spaces, where anomalies can be easily detected. In addition, given that an anomalous sequence could be caused by either individual events, subsequences of events, or the whole sequence, we design a multi-scale RNN framework to capture different levels of sequential patterns simultaneously. Experimental results on three benchmark datasets show that OC4Seq consistently outperforms various representative baselines by a large margin. Moreover, through both quantitative and qualitative analysis, the importance of capturing multi-scale sequential patterns for event anomaly detection is verified.

cs.LG↗

arXiv2020

Whole-Chain Recommendations

With the recent prevalence of Reinforcement Learning (RL), there have been tremendous interests in developing RL-based recommender systems. In practical recommendation sessions, users will sequentially access multiple scenarios, such as the entrance pages and the item detail pages, and each scenario has its specific characteristics. However, the majority of existing RL-based recommender systems focus on optimizing one strategy for all scenarios or separately optimizing each strategy, which could lead to sub-optimal overall performance. In this paper, we study the recommendation problem with multiple (consecutive) scenarios, i.e., whole-chain recommendations. We propose a multi-agent RL-based approach (DeepChain), which can capture the sequential correlation among different scenarios and jointly optimize multiple recommendation strategies. To be specific, all recommender agents (RAs) share the same memory of users' historical behaviors, and they work collaboratively to maximize the overall reward of a session. Note that optimizing multiple recommendation strategies jointly faces two challenges in the existing model-free RL model - (i) it requires huge amounts of user behavior data, and (ii) the distribution of reward (users' feedback) are extremely unbalanced. In this paper, we introduce model-based RL techniques to reduce the training data requirement and execute more accurate strategy updates. The experimental results based on a real e-commerce platform demonstrate the effectiveness of the proposed framework.

cs.IR↗

arXiv2020

An Overview on Evaluating and Predicting Scholarly Article Impact

Scholarly article impact reflects the significance of academic output recognised by academic peers, and it often plays a crucial role in assessing the scientific achievements of researchers, teams, institutions and countries. It is also used for addressing various needs in the academic and scientific arena, such as recruitment decisions, promotions, and funding allocations. This article provides a comprehensive review of recent progresses related to article impact assessment and prediction. The~review starts by sharing some insight into the article impact research and outlines current research status. Some core methods and recent progress are presented to outline how article impact metrics and prediction have evolved to consider integrating multiple networks. Key techniques, including statistical analysis, machine learning, data mining and network science, are discussed. In particular, we highlight important applications of each technique in article impact research. Subsequently, we discuss the open issues and challenges of article impact research. At the same time, this review points out some important research directions, including article impact evaluation by considering Conflict of Interest, time and location information, various distributions of scholarly entities, and rising stars.

cs.DL↗

arXiv2020

The End-of-End-to-End: A Video Understanding Pentathlon Challenge (2020)

We present a new video understanding pentathlon challenge, an open competition held in conjunction with the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020. The objective of the challenge was to explore and evaluate new methods for text-to-video retrieval-the task of searching for content within a corpus of videos using natural language queries. This report summarizes the results of the first edition of the challenge together with the findings of the participants.

cs.CV↗

arXiv2020

Multi-View Spectral Clustering Tailored Tensor Low-Rank Representation

This paper explores the problem of multi-view spectral clustering (MVSC) based on tensor low-rank modeling. Unlike the existing methods that all adopt an off-the-shelf tensor low-rank norm without considering the special characteristics of the tensor in MVSC, we design a novel structured tensor low-rank norm tailored to MVSC. Specifically, we explicitly impose a symmetric low-rank constraint and a structured sparse low-rank constraint on the frontal and horizontal slices of the tensor to characterize the intra-view and inter-view relationships, respectively. Moreover, the two constraints could be jointly optimized to achieve mutual refinement. On the basis of the novel tensor low-rank norm, we formulate MVSC as a convex low-rank tensor recovery problem, which is then efficiently solved with an augmented Lagrange multiplier based method iteratively. Extensive experimental results on five benchmark datasets show that the proposed method outperforms state-of-the-art methods to a significant extent. Impressively, our method is able to produce perfect clustering. In addition, the parameters of our method can be easily tuned, and the proposed model is robust to different datasets, demonstrating its potential in practice.

cs.LG↗

arXiv2020

Anomalous levitation and annihilation in Floquet topological insulators

Anderson localization in two-dimensional topological insulators takes place via the so-called levitation and pair annihilation process. As disorder is increased, extended bulk states carrying opposite topological invariants move towards each other in energy, reducing the size of the topological gap, eventually meeting and localizing. This results in a topologically trivial Anderson insulator. Here, we introduce the anomalous levitation and pair annihilation, a process unique to periodically-driven, or Floquet systems. Due to the periodicity of the quasienergy spectrum, we find it is possible for the topological gap to increase as a function of disorder strength. Thus, after all bulk states have localized, the system remains topologically nontrivial, forming an anomalous Floquet Anderson insulator (AFAI) phase. We show a concrete example for this process, adding disorder via onsite potential "kicks" to a Chern insulator model. By changing the period between kicks, we can tune which type of (conventional or anomalous) levitation-and-annihilation occurs in the system. We expect our results to be applicable to generic Floquet topological systems and to provide an accessible way to realize AFAIs experimentally, without the need for multi-step driving schemes.

cond-mat.mes-hall↗

arXiv2020

Sequence to Point Learning Based on Bidirectional Dilated Residual Network for Non Intrusive Load Monitoring

Non Intrusive Load Monitoring (NILM) or Energy Disaggregation (ED), seeks to save energy by decomposing corresponding appliances power reading from an aggregate power reading of the whole house. It is a single channel blind source separation problem (SCBSS) and difficult prediction problem because it is unidentifiable. Recent research shows that deep learning has become a growing popularity for NILM problem. The ability of neural networks to extract load features is closely related to its depth. However, deep neural network is difficult to train because of exploding gradient, vanishing gradient and network degradation. To solve these problems, we propose a sequence to point learning framework based on bidirectional (non-casual) dilated convolution for NILM. To be more convincing, we compare our method with the state of art method, Seq2point (Zhang) directly and compare with existing algorithms indirectly via two same datasets and metrics. Experiments based on REDD and UK-DALE data sets show that our proposed approach is far superior to existing approaches in all appliances.

eess.SP↗

arXiv2020

Does Multi-Encoder Help? A Case Study on Context-Aware Neural Machine Translation

In encoder-decoder neural models, multiple encoders are in general used to represent the contextual information in addition to the individual sentence. In this paper, we investigate multi-encoder approaches in documentlevel neural machine translation (NMT). Surprisingly, we find that the context encoder does not only encode the surrounding sentences but also behaves as a noise generator. This makes us rethink the real benefits of multi-encoder in context-aware translation - some of the improvements come from robust training. We compare several methods that introduce noise and/or well-tuned dropout setup into the training of these encoders. Experimental results show that noisy training plays an important role in multi-encoder-based NMT, especially when the training data is small. Also, we establish a new state-of-the-art on IWSLT Fr-En task by careful use of noise generation and dropout methods.

cs.CL↗

arXiv2020

Light Nuclei Production in Au+Au Collisions at $\sqrt{s_{\mathrm{NN}}}$ = 5-200 GeV from JAM model

Light nuclei production is sensitive to the baryon density fluctuations and can be used to probe the QCD phase transition in relativistic heavy-ion collisions. In this work, we studied the production of proton, deuteron, triton in central Au+Au collisions at $\sqrt{s_{\mathrm{NN}}}$ = 5, 7.7, 11.5, 14.5, 19.6, 27, 39, 54.4, 62.4 and 200 GeV from a transport model (JAM). Based on the coalescence production of light nuclei, we calculated the energy dependence of rapidity density $dN/dy$ and particle ratios ($d/p$, $t/p$, and $t/d$). More importantly, the yield ratio $N_{t} \times N_{p} / N_{d}^{2}$, which is sensitive to the neutron density fluctuations, shows a flat energy dependence and cannot describe the non-monotonic trend observed by the STAR experiment. Based on the nucleon coalescence, this work can provide constraint and reference to search for the QCD critical point and/or first order phase transition with light nuclei production in future heavy-ion collision experiments.

nucl-th↗

arXiv2020

Simulating quantum field theory in curved spacetime with quantum many-body systems

This paper proposes a new general framework to build a one-to-one correspondence between quantum field theories in static 1+1 dimensional curved spacetime and quantum many-body systems. We show that a massless scalar field in an arbitrary 2-dimensional static spacetime is always equivalent to a site-dependent bosonic hopping model, while a massless Dirac field is equivalent to a site-dependent free Hubbard model or a site-dependent isotropic XY model. A possible experimental realization for such a correspondence in trapped ions system is suggested. As applications of the analogue gravity model, we show that they can be used to simulate Hawking radiation of black hole and to study its entanglement. We also show in the analogue model that black holes are most chaotic systems and the fastest scramblers in nature. We also offer a concrete example about how to get some insights about quantum many-body systems from back hole physics.

gr-qc↗