arXiv subjects

Wei Wu

Publications and source records attributed to Wei Wu.

At least 487 records · Page 27Linked to original sources

arXiv2019

Dirichlet Depths for Point Process

Statistical depths have been well studied for multivariate and functional data over the past few decades, but remain under-explored for point processes. A first attempt on the notion of point process depth was conducted recently where the depth was defined as a weighted product of two terms: (1) the probability of the number of events in each process and (2) the depth of the event times conditioned on the number of events by using a Mahalanobis depth. We point out that multivariate depths such as the Mahalanobis depth cannot be directly used because they often neglect the important ordered property in the point process events. To deal with this problem, we propose a model-based approach for point processes systematically. In particular, we develop a Dirichlet-distribution-based framework on the conditional depth term, where the new methods are referred to as Dirichlet depths. We examine the mathematical properties of the new depths and conduct the asymptotic analysis. In addition, we illustrate the new methods using various simulated and real experiment data. It is found that the proposed framework provides a proper center-outward rank and the new methods have superior decoding performance to previous methods in two neural spike train datasets.

stat.ME↗

arXiv2019

Robust Multiple Kernel k-means Clustering using Min-Max Optimization

Multiple kernel learning is a type of multiview learning that combines different data modalities by capturing view-specific patterns using kernels. Although supervised multiple kernel learning has been extensively studied, until recently, only a few unsupervised approaches have been proposed. In the meanwhile, adversarial learning has recently received much attention. Many works have been proposed to defend against adversarial examples. However, little is known about the effect of adversarial perturbation in the context of multiview learning, and even less in the unsupervised case. In this study, we show that adversarial features added to a view can make the existing approaches with the min-max formulation in multiple kernel clustering yield unfavorable clusters. To address this problem and inspired by recent works in adversarial learning, we propose a multiple kernel clustering method with the min-max framework that aims to be robust to such adversarial perturbation. We evaluate the robustness of our method on simulation data under different types of adversarial perturbations and show that it outperforms several compared existing methods. In the real data analysis, We demonstrate the utility of our method on a real-world problem.

cs.LG↗

arXiv2019

Versatile surface ion trap for effective cooling and large-scale trapping of ions

Scaling up and effective cooling of ions in surface ion trap are central challenges in quantum computing and quantum simulation with trapped ions. In this theoretical study, we propose a versatile surface ion trap. In the manipulation zone of our trap, a symmetric seven-wire geometry enables innate principle-axes rotation of two parallel linear ion chains, which facilitates the cooling of ions along all principle trap axes. To alleviate contaminating the manipulation zone during ion loading, a symmetric five-wire geometry is designed as the loading zone. And a "fork junction" connects the loading and manipulation zones, which also enables the shuttling and reordering of ions. A multi-objective optimization procedure suitable for arbitrary junction designs is described in detail, and we present the corresponding optimal results for the key components of our trap. The proposed versatile trap can be used in the construction of large-scale ion quantum processors. The trap also can be used as the multi-ion-mixer or the efficient ion beam splitter, which has the potential applications in quantum simulation and quantum computing, the research of 2D dimensional ion crystals and the guides of quantum microscope, like an electron beam splitter used for quantum matter-wave optics experiments. Interesting topics involving the spin-spin interactions between two ion chains can also be simulated in our trap.

physics.atom-ph↗

arXiv2019

STM: SpatioTemporal and Motion Encoding for Action Recognition

Spatiotemporal and motion features are two complementary and crucial information for video action recognition. Recent state-of-the-art methods adopt a 3D CNN stream to learn spatiotemporal features and another flow stream to learn motion features. In this work, we aim to efficiently encode these two features in a unified 2D framework. To this end, we first propose an STM block, which contains a Channel-wise SpatioTemporal Module (CSTM) to present the spatiotemporal features and a Channel-wise Motion Module (CMM) to efficiently encode motion features. We then replace original residual blocks in the ResNet architecture with STM blcoks to form a simple yet effective STM network by introducing very limited extra computation cost. Extensive experiments demonstrate that the proposed STM network outperforms the state-of-the-art methods on both temporal-related datasets (i.e., Something-Something v1 & v2 and Jester) and scene-related datasets (i.e., Kinetics-400, UCF-101, and HMDB-51) with the help of encoding spatiotemporal and motion features together.

cs.CV↗

arXiv2019

Dynamic Curriculum Learning for Imbalanced Data Classification

Human attribute analysis is a challenging task in the field of computer vision, since the data is largely imbalance-distributed. Common techniques such as re-sampling and cost-sensitive learning require prior-knowledge to train the system. To address this problem, we propose a unified framework called Dynamic Curriculum Learning (DCL) to online adaptively adjust the sampling strategy and loss learning in single batch, which resulting in better generalization and discrimination. Inspired by the curriculum learning, DCL consists of two level curriculum schedulers: (1) sampling scheduler not only manages the data distribution from imbalanced to balanced but also from easy to hard; (2) loss scheduler controls the learning importance between classification and metric learning loss. Learning from these two schedulers, we demonstrate our DCL framework with the new state-of-the-art performance on the widely used face attribute dataset CelebA and pedestrian attribute dataset RAP.

cs.CV↗

arXiv2019

Online Hyper-parameter Learning for Auto-Augmentation Strategy

Data augmentation is critical to the success of modern deep learning techniques. In this paper, we propose Online Hyper-parameter Learning for Auto-Augmentation (OHL-Auto-Aug), an economical solution that learns the augmentation policy distribution along with network training. Unlike previous methods on auto-augmentation that search augmentation strategies in an offline manner, our method formulates the augmentation policy as a parameterized probability distribution, thus allowing its parameters to be optimized jointly with network parameters. Our proposed OHL-Auto-Aug eliminates the need of re-training and dramatically reduces the cost of the overall search process, while establishes significantly accuracy improvements over baseline models. On both CIFAR-10 and ImageNet, our method achieves remarkable on search accuracy, 60x faster on CIFAR-10 and 24x faster on ImageNet, while maintaining competitive accuracies.

cs.CV↗

arXiv2019

AM-LFS: AutoML for Loss Function Search

Designing an effective loss function plays an important role in visual analysis. Most existing loss function designs rely on hand-crafted heuristics that require domain experts to explore the large design space, which is usually sub-optimal and time-consuming. In this paper, we propose AutoML for Loss Function Search (AM-LFS) which leverages REINFORCE to search loss functions during the training process. The key contribution of this work is the design of search space which can guarantee the generalization and transferability on different vision tasks by including a bunch of existing prevailing loss functions in a unified formulation. We also propose an efficient optimization framework which can dynamically optimize the parameters of loss function's distribution during training. Extensive experimental results on four benchmark datasets show that, without any tricks, our method outperforms existing hand-crafted loss functions in various computer vision tasks.

cs.CV↗

arXiv2019

Feedback Network for Image Super-Resolution

Recent advances in image super-resolution (SR) explored the power of deep learning to achieve a better reconstruction performance. However, the feedback mechanism, which commonly exists in human visual system, has not been fully exploited in existing deep learning based image SR methods. In this paper, we propose an image super-resolution feedback network (SRFBN) to refine low-level representations with high-level information. Specifically, we use hidden states in an RNN with constraints to achieve such feedback manner. A feedback block is designed to handle the feedback connections and to generate powerful high-level representations. The proposed SRFBN comes with a strong early reconstruction ability and can create the final high-resolution image step by step. In addition, we introduce a curriculum learning strategy to make the network well suitable for more complicated tasks, where the low-resolution images are corrupted by multiple types of degradation. Extensive experimental results demonstrate the superiority of the proposed SRFBN in comparison with the state-of-the-art methods. Code is avaliable at https://github.com/Paper99/SRFBN_CVPR19.

cs.CV↗

arXiv2019

Maximum of the Ginzburg-Landau fields

We study two dimensional massless field in a box with potential $V\left( \nabla ϕ\left( \cdot \right) \right) $ and zero boundary condition, where $V$ is any symmetric and uniformly convex function. Naddaf-Spencer and Miller proved the macroscopic averages of this field converge to a continuum Gaussian free field. In this paper we prove the distribution of local marginal $ϕ\left( x\right) $, for any $x$ in the bulk, has a Gaussian tail. We further characterize the leading order of the maximum and dimension of high points of this field, thus generalize the results of Bolthausen-Deuschel-Giacomin and Daviaud for the discrete Gaussian free field.

math.PR↗

arXiv2019

Neural Response Generation with Meta-Words

We present open domain response generation with meta-words. A meta-word is a structured record that describes various attributes of a response, and thus allows us to explicitly model the one-to-many relationship within open domain dialogues and perform response generation in an explainable and controllable manner. To incorporate meta-words into generation, we enhance the sequence-to-sequence architecture with a goal tracking memory network that formalizes meta-word expression as a goal and manages the generation process to achieve the goal with a state memory panel and a state controller. Experimental results on two large-scale datasets indicate that our model can significantly outperform several state-of-the-art generation models in terms of response relevance, response diversity, accuracy of one-to-many modeling, accuracy of meta-word expression, and human evaluation.

cs.CL↗

arXiv2019

A Document-grounded Matching Network for Response Selection in Retrieval-based Chatbots

We present a document-grounded matching network (DGMN) for response selection that can power a knowledge-aware retrieval-based chatbot system. The challenges of building such a model lie in how to ground conversation contexts with background documents and how to recognize important information in the documents for matching. To overcome the challenges, DGMN fuses information in a document and a context into representations of each other, and dynamically determines if grounding is necessary and importance of different parts of the document and the context through hierarchical interaction with a response at the matching step. Empirical studies on two public data sets indicate that DGMN can significantly improve upon state-of-the-art methods and at the same time enjoys good interpretability.

cs.CL↗

arXiv2019

Learning a Matching Model with Co-teaching for Multi-turn Response Selection in Retrieval-based Dialogue Systems

We study learning of a matching model for response selection in retrieval-based dialogue systems. The problem is equally important with designing the architecture of a model, but is less explored in existing literature. To learn a robust matching model from noisy training data, we propose a general co-teaching framework with three specific teaching strategies that cover both teaching with loss functions and teaching with data curriculum. Under the framework, we simultaneously learn two matching models with independent training sets. In each iteration, one model transfers the knowledge learned from its training set to the other model, and at the same time receives the guide from the other model on how to overcome noise in training. Through being both a teacher and a student, the two models learn from each other and get improved together. Evaluation results on two public data sets indicate that the proposed learning approach can generally and significantly improve the performance of existing matching models.

cs.CL↗

arXiv2019

Improving Matching Models with Hierarchical Contextualized Representations for Multi-turn Response Selection

In this paper, we study context-response matching with pre-trained contextualized representations for multi-turn response selection in retrieval-based chatbots. Existing models, such as Cove and ELMo, are trained with limited context (often a single sentence or paragraph), and may not work well on multi-turn conversations, due to the hierarchical nature, informal language, and domain-specific words. To address the challenges, we propose pre-training hierarchical contextualized representations, including contextual word-level and sentence-level representations, by learning a dialogue generation model from large-scale conversations with a hierarchical encoder-decoder architecture. Then the two levels of representations are blended into the input and output layer of a matching model respectively. Experimental results on two benchmark conversation datasets indicate that the proposed hierarchical contextualized representations can bring significantly and consistently improvement to existing matching models for response selection.

cs.CL↗

arXiv2019

An analytical variational method for the biased quantum Rabi model in the ultra-strong coupling regime

An analytical variational method for the ground state of the biased quantum Rabi model in the ultra-strong coupling regime is presented. This analytical variational method can be obtained by a unitary transformation or alternatively by assuming the form of ground state wave function. The key point of the method is to introduce a variational parameter $λ$, which can be determined by minimizing the energy functional. Using this method, we calculate physical observables with high accuracy in comparison with the numerical exact one. Our method evidently improves the results from the widely used general rotating-wave approximation (GRWA) in both qualitative and quantitative ways.

quant-ph↗

arXiv2019

Variational generalized rotating-wave approximation in the two-qubit quantum Rabi model

We present an analytical method for the two-qubit quantum Rabi model. While still operating in the frame of the generalized rotating-wave approximation (GRWA), our method further embraces the idea of introducing variational parameters. The optimal value of the variational parameter is determined by minimizing the energy function of the ground state. Comparing with numerical exact results, we show that our method evidently improves the accuracy of the conventional GRWA in calculating fundamental physical quantities, such as energy spectra, mean photon number, and dynamics. Interestingly, the accuracy of our method allows us to reproduce the asymptotic behavior of mean photon number in large frequency ratio for the ground state and investigate the quasi-periodical structure of the time evolution, which are incapable of being predicted by the GRWA. The applicable parameter ranges cover the ultrastrong coupling regime, which will be helpful to recent experiments.

quant-ph↗

arXiv2019

Resource Allocation Algorithm for V2X communications based on SCMA

In this paper, we propose a resource allocation algorithm for V2X communications based on Sparse Code Multiple Access(SCMA). By analyzing the interference model in the V2X scenario, we formulate the problem which deals with resource allocation to maximize the system throughput. A graph color-based user cluster algorithm combined with resource allocation algorithm based on both result of clustering and SINR is presented to solve the problem. The simulation results indicate that the throughput performance of system based on SCMA is superior to which based on OFDMA, and the proposed algorithm can improve the system throughput and the number of access users.

eess.SP↗

arXiv2019

Quantum simulation of the Weyl equation with a trapped ion

The Weyl equation describes chiral massless relativistic particles, called Weyl fermions, which have important relations to neutrinos. A direct observation of the dynamics of Weyl fermions in an experiment is difficult to achieve. This study investigates a method of simulating the Weyl equation in 1+2-dimension by a single trapped ion. The predictions about a two-dimensional Zitterbewegung and an especially interesting phenomenon of Weyl fermions can be tested by the future trapped ion experiment, which might enhance our understanding of neutrinos.

quant-ph↗

arXiv2019

Steady-state entanglement and coherence of the coupled qubit system in equilibrium and nonequilibrium environments

We investigate analytically and numerically the steady-state entanglement and coherence of two coupled qubits each interacting with a local boson or fermion reservoir, based on the Bloch-Redfield master equation beyond the secular approximation. We find that there is non-vanishing steady-state coherence in the nonequilibrium scenario, which grows monotonically with the nonequilibrium condition quantified by the temperature difference or chemical potential difference of the two baths. The steady-state entanglement in general is a non-monotonic function of the nonequilibrium condition as well as the bath parameters in the equilibrium setting. We also find that weak inter-qubit coupling and high base temperature or chemical potential of the baths can strongly suppress the steady-state entanglement and coherence, regardless of the strength of the nonequilibrium condition. On the other hand, the energy detuning of the two qubits, when used in a compensatory way with the nonequilibrium condition, can lead to significant enhancement of the steady-state entanglement in some parameter regimes. In addition, the qubits typically have a stronger steady-state entanglement when coupled to fermion baths exchanging particle with the system than boson baths exchanging energy with the system under similar conditions. We also discussed the possible experimental realization of measuring the steady state entanglement and coherence for coupled qubits systems in nonequilibrium environments. These results offer some general guidelines for optimizing the steady-state entanglement and coherence in the coupled qubit system and may find potential applications in quantum information technology.

quant-ph↗