arXiv Science⌕ Search

arXiv subjects

Huan Wang

Publications and source records attributed to Huan Wang.

At least 271 records · Page 15Linked to original sources
arXiv2021

Use of NMR to Test Molecular Mobility during Chemical Reaction

We evaluate critically the use of pulsed gradient spin-echo nuclear magnetic resonance (PGSE NMR) to measure molecular mobility during chemical reactions. With raw NMR spectra available in a public depository, we confirm boosted mobility during the click chemical reaction (Science 2020, 369, 537) regardless of the order of magnetic field gradient (linearly-increasing, linearly-decreasing, random sequence). We also confirm boosted mobility for the Diels-Alder chemical reaction. The conceptual advantage of the former chemical system is that constant reaction rate implies constant catalyst concentration, whereas that of the latter is the absence of a paramagnetic catalyst, precluding paramagnetism as objection to the measurements. Data and discussion in this paper show the reliability of experiments when one avoids convection, allows decay of nuclear spin magnetization between successive pulses and recovery of its intensity between gradients, and satisfies quasi-steady state during the time window to acquire each datum. Especially important is to make comparisons on the time scale of actual chemical reaction kinetics. We discuss possible sources of mistaken conclusions that are desirable to avoid.

cond-mat.soft↗
arXiv2021

Automatic Segmentation of Organs-at-Risk from Head-and-Neck CT using Separable Convolutional Neural Network with Hard-Region-Weighted Loss

Nasopharyngeal Carcinoma (NPC) is a leading form of Head-and-Neck (HAN) cancer in the Arctic, China, Southeast Asia, and the Middle East/North Africa. Accurate segmentation of Organs-at-Risk (OAR) from Computed Tomography (CT) images with uncertainty information is critical for effective planning of radiation therapy for NPC treatment. Despite the stateof-the-art performance achieved by Convolutional Neural Networks (CNNs) for automatic segmentation of OARs, existing methods do not provide uncertainty estimation of the segmentation results for treatment planning, and their accuracy is still limited by several factors, including the low contrast of soft tissues in CT, highly imbalanced sizes of OARs and large inter-slice spacing. To address these problems, we propose a novel framework for accurate OAR segmentation with reliable uncertainty estimation. First, we propose a Segmental Linear Function (SLF) to transform the intensity of CT images to make multiple organs more distinguishable than existing methods based on a simple window width/level that often gives a better visibility of one organ while hiding the others. Second, to deal with the large inter-slice spacing, we introduce a novel 2.5D network (named as 3D-SepNet) specially designed for dealing with clinic HAN CT scans with anisotropic spacing. Thirdly, existing hardness-aware loss function often deal with class-level hardness, but our proposed attention to hard voxels (ATH) uses a voxel-level hardness strategy, which is more suitable to dealing with some hard regions despite that its corresponding class may be easy. Our code is now available at https://github.com/HiLab-git/SepNet.

eess.IV↗
arXiv2020

An Event Correlation Filtering Method for Fake News Detection

Nowadays, social network platforms have been the prime source for people to experience news and events due to their capacities to spread information rapidly, which inevitably provides a fertile ground for the dissemination of fake news. Thus, it is significant to detect fake news otherwise it could cause public misleading and panic. Existing deep learning models have achieved great progress to tackle the problem of fake news detection. However, training an effective deep learning model usually requires a large amount of labeled news, while it is expensive and time-consuming to provide sufficient labeled news in actual applications. To improve the detection performance of fake news, we take advantage of the event correlations of news and propose an event correlation filtering method (ECFM) for fake news detection, mainly consisting of the news characterizer, the pseudo label annotator, the event credibility updater, and the news entropy selector. The news characterizer is responsible for extracting textual features from news, which cooperates with the pseudo label annotator to assign pseudo labels for unlabeled news by fully exploiting the event correlations of news. In addition, the event credibility updater employs adaptive Kalman filter to weaken the credibility fluctuations of events. To further improve the detection performance, the news entropy selector automatically discovers high-quality samples from pseudo labeled news by quantifying their news entropy. Finally, ECFM is proposed to integrate them to detect fake news in an event correlation filtering manner. Extensive experiments prove that the explainable introduction of the event correlations of news is beneficial to improve the detection performance of fake news.

cs.CL↗
arXiv2020

Multi-head Knowledge Distillation for Model Compression

Several methods of knowledge distillation have been developed for neural network compression. While they all use the KL divergence loss to align the soft outputs of the student model more closely with that of the teacher, the various methods differ in how the intermediate features of the student are encouraged to match those of the teacher. In this paper, we propose a simple-to-implement method using auxiliary classifiers at intermediate layers for matching features, which we refer to as multi-head knowledge distillation (MHKD). We add loss terms for training the student that measure the dissimilarity between student and teacher outputs of the auxiliary classifiers. At the same time, the proposed method also provides a natural way to measure differences at the intermediate layers even though the dimensions of the internal teacher and student features may be different. Through several experiments in image classification on multiple datasets we show that the proposed method outperforms prior relevant approaches presented in the literature.

cs.CV↗
arXiv2020

Topological bands in two-dimensional orbital-active bipartite lattices

The search for large gap quantum spin Hall (QSH) and quantum anomalous Hall (QAH) insulators is important both for fundamental and practical interests. The degenerate multi-orbitals $p_x,p_y$ in honeycomb lattice provides a paradigm for QSH state with a boosted topological gap of the first order in atomic spin-orbit coupling. By using elementary band representation, we explore the feasibility of this mechanism for QSH in general two-dimensional lattices, and find that the biparticle lattices with $C_{3v}$ or $C_{4v}$ symmetry and degenerate multi-orbitals could work. We further provide concrete tight-binding models on honeycomb, kagome and square lattices to demonstrate the desired topological physics. By introducing ferromagnetism into QSH state, we extend the mechanism to QAH state with a boosted gap. The QSH and QAH states can be achieved when Fermi level is at integer filling only for honeycomb lattice, but at certain fractional filling for other lattices. We conclude with a brief discussion on the possible material venues for such mechanism.

cond-mat.mes-hall↗
arXiv2020

PLVER: Joint Stable Allocation and Content Replication for Edge-assisted Live Video Delivery

The live streaming services have gained extreme popularity in recent years. Due to the spiky traffic patterns of live videos, utilizing the distributed edge servers to improve viewers' quality of experience (QoE) has become a common practice nowadays. Nevertheless, current client-driven content caching mechanism does not support caching beforehand from the cloud to the edge, resulting in considerable cache missing in live video delivery. State-of-the-art research generally sacrifices the liveness of delivered videos in order to deal with the above problem. In this paper, by jointly considering the features of live videos and edge servers, we propose PLVER, a proactive live video push scheme to resolve the cache miss problem in live video delivery. Specifically, PLVER first conducts a one-tomultiple stable allocation between edge clusters and user groups, to balance the load of live traffic over the edge servers. Then it adopts proactive video replication algorithms to speed up the video replication among the edge servers. We conduct extensive trace-driven evaluations, covering 0.3 million Twitch viewers and more than 300 Twitch channels. The results demonstrate that with PLVER, edge servers can carry 28% and 82% more traffic than the auction-based replication method and the caching on requested time method, respectively.

cs.NI↗
arXiv2020

MKD: a Multi-Task Knowledge Distillation Approach for Pretrained Language Models

Pretrained language models have led to significant performance gains in many NLP tasks. However, the intensive computing resources to train such models remain an issue. Knowledge distillation alleviates this problem by learning a light-weight student model. So far the distillation approaches are all task-specific. In this paper, we explore knowledge distillation under the multi-task learning setting. The student is jointly distilled across different tasks. It acquires more general representation capacity through multi-tasking distillation and can be further fine-tuned to improve the model in the target domain. Unlike other BERT distillation methods which specifically designed for Transformer-based architectures, we provide a general learning framework. Our approach is model agnostic and can be easily applied on different future teacher model architectures. We evaluate our approach on a Transformer-based and LSTM based student model. Compared to a strong, similarly LSTM-based approach, we achieve better quality under the same computational constraints. Compared to the present state of the art, we reach comparable results with much faster inference speed.

cs.CL↗
arXiv2020

Quantum oscillations and electronic structure in the large-Chern number topological chiral semimetal PtGa

We report the magnetoresistance(MR), de Haas-van Alphen (dHvA) oscillations and the electronic structures of single crystal PtGa. The large unsaturated MR is observed with the magnetic field B//[111]. Evident dHvA oscillations with B//[001] configuration have been observed, from which twelve fundamental frequencies are extracted and the spin-orbit coupling effect (SOC) induced band splitting is revealed. The light cyclotron effective masses are extracted from the fitting by the thermal damping term of the Lifshitz-Kosevich (LK) formula. Combining with the calculated frequencies from the first-principles calculations, the dHvA frequencies F$_1$/F$_3$ and F$_{11}$/F$_{12}$ are confirmed to originate from the electron pockets at $Γ$ and R, respectively. The first-principles calculations also reveal the existence of spin-3/2 RSW fermion and time-reversal (TR) doubling of the spin-1 excitation at $Γ$ and R with large Chern number $\pm4$ when SOC is included.

cond-mat.mtrl-sci↗
arXiv2020

Collaborative Distillation for Ultra-Resolution Universal Style Transfer

Universal style transfer methods typically leverage rich representations from deep Convolutional Neural Network (CNN) models (e.g., VGG-19) pre-trained on large collections of images. Despite the effectiveness, its application is heavily constrained by the large model size to handle ultra-resolution images given limited memory. In this work, we present a new knowledge distillation method (named Collaborative Distillation) for encoder-decoder based neural style transfer to reduce the convolutional filters. The main idea is underpinned by a finding that the encoder-decoder pairs construct an exclusive collaborative relationship, which is regarded as a new kind of knowledge for style transfer models. Moreover, to overcome the feature size mismatch when applying collaborative distillation, a linear embedding loss is introduced to drive the student network to learn a linear embedding of the teacher's features. Extensive experiments show the effectiveness of our method when applied to different universal style transfer approaches (WCT and AdaIN), even if the model size is reduced by 15.5 times. Especially, on WCT with the compressed models, we achieve ultra-resolution (over 40 megapixels) universal style transfer on a 12GB GPU for the first time. Further experiments on optimization-based stylization scheme show the generality of our algorithm on different stylization paradigms. Our code and trained models are available at https://github.com/mingsun-tse/collaborative-distillation.

cs.CV↗
arXiv2020

MNN: A Universal and Efficient Inference Engine

Deploying deep learning models on mobile devices draws more and more attention recently. However, designing an efficient inference engine on devices is under the great challenges of model compatibility, device diversity, and resource limitation. To deal with these challenges, we propose Mobile Neural Network (MNN), a universal and efficient inference engine tailored to mobile applications. In this paper, the contributions of MNN include: (1) presenting a mechanism called pre-inference that manages to conduct runtime optimization; (2)deliveringthorough kernel optimization on operators to achieve optimal computation performance; (3) introducing backend abstraction module which enables hybrid scheduling and keeps the engine lightweight. Extensive benchmark experiments demonstrate that MNN performs favorably against other popular lightweight deep learning frameworks. MNN is available to public at: https://github.com/alibaba/MNN.

cs.CV↗
arXiv2020

Taylorized Training: Towards Better Approximation of Neural Network Training at Finite Width

We propose \emph{Taylorized training} as an initiative towards better understanding neural network training at finite width. Taylorized training involves training the $k$-th order Taylor expansion of the neural network at initialization, and is a principled extension of linearized training---a recently proposed theory for understanding the success of deep learning. We experiment with Taylorized training on modern neural network architectures, and show that Taylorized training (1) agrees with full neural network training increasingly better as we increase $k$, and (2) can significantly close the performance gap between linearized and full training. Compared with linearized training, higher-order training works in more realistic settings such as standard parameterization and large (initial) learning rate. We complement our experiments with theoretical results showing that the approximation error of $k$-th order Taylorized models decay exponentially over $k$ in wide neural networks.

cs.LG↗
arXiv2020

Neural Bayes: A Generic Parameterization Method for Unsupervised Representation Learning

We introduce a parameterization method called Neural Bayes which allows computing statistical quantities that are in general difficult to compute and opens avenues for formulating new objectives for unsupervised representation learning. Specifically, given an observed random variable $\mathbf{x}$ and a latent discrete variable $z$, we can express $p(\mathbf{x}|z)$, $p(z|\mathbf{x})$ and $p(z)$ in closed form in terms of a sufficiently expressive function (Eg. neural network) using our parameterization without restricting the class of these distributions. To demonstrate its usefulness, we develop two independent use cases for this parameterization: 1. Mutual Information Maximization (MIM): MIM has become a popular means for self-supervised representation learning. Neural Bayes allows us to compute mutual information between observed random variables $\mathbf{x}$ and latent discrete random variables $z$ in closed form. We use this for learning image representations and show its usefulness on downstream classification tasks. 2. Disjoint Manifold Labeling: Neural Bayes allows us to formulate an objective which can optimally label samples from disjoint manifolds present in the support of a continuous distribution. This can be seen as a specific form of clustering where each disjoint manifold in the support is a separate cluster. We design clustering tasks that obey this formulation and empirically show that the model optimally labels the disjoint manifolds. Our code is available at \url{https://github.com/salesforce/NeuralBayes}

stat.ML↗
arXiv2020

Effect of overlap on spreading dynamics on multiplex networks

In spite of the study of epidemic dynamics on single-layer networks has received considerable attention, the epidemic dynamics on multiplex networks is still limited and is facing many challenges. In this work, we consider the susceptible-infected-susceptible-type (SIS) epidemic model on multiplex networks and investigate the effect of overlap among layers on the spreading dynamics. To do so, we assume that the prerequisite of one $S$-node to be infected is that there is at least one infectious neighbor in each layer. A remarkable result is that the overlap can alter the nature of the phase transition for the onset of epidemic outbreak. Specifically speaking, the system undergoes a usual continuous phase transition when two layers are completely overlapped. Otherwise, a discontinuous phase transition is observed, accompanied by the occurrence of a bistable region in which a disease-free phase and an endemic phase are coexisting. As the degree of the overlap decreases, the bistable region is enlarged. The results are validated by both simulation and mean-field theory.

cond-mat.stat-mech↗
arXiv2019

Quantum oscillations and electronic structures in large Chern number semimetal RhSn

We report the magnetoresistance, Hall effect, de Haas-van Alphen (dHvA) oscillations and the electronic structures of single crystal RhSn, which is a typical material of CoSi family holding a large Chern number. The large unsaturated magnetoresistance is observed with B//[001]. The Hall resistivity curve indicates that RhSn is a multi-band system with high mobility. Evident quantum oscillations have been observed, from which the light effective masses are extracted. Ten fundamental frequencies are extracted after the fast Fourier transform analysis of the dHvA oscillations with B//[001] configuration. The two low frequencies F$_1$ and F$_2$ do not change obviously and the two high frequencies F$_9$ and F$_{10}$ evolve into four when B rotates from B//[001] to B//[110], which is consistent with the band structure in the first-principles calculations with spin-orbit coupling (SOC). The extracted Berry phases of the relative pockets show a good agreement with the Chern number $\pm4$ (with SOC) in the first-principles calculations. Above all, our studies indicate that RhSn is an ideal platform to study the unconventional chiral fermions and the surface states.

cond-mat.mes-hall↗
arXiv2019

Exploiting Color Name Space for Salient Object Detection

In this paper, we will investigate the contribution of color names for the task of salient object detection. An input image is first converted to color name space, which is consisted of 11 probabilistic channels. By exploiting a surroundedness cue, we obtain a saliency map through a linear combination of a set of sequential attention maps. To overcome the limitation of only using the surroundedness cue, two global cues with respect to color names are invoked to guide the computation of a weighted saliency map. Finally, we integrate the above two saliency maps into a unified framework to generate the final result. In addition, an improved post-processing procedure is introduced to effectively suppress image backgrounds while uniformly highlight salient objects. Experimental results show that the proposed model produces more accurate saliency maps and performs well against twenty-one saliency models in terms of three evaluation metrics on three public data sets.

cs.CV↗
arXiv2019

Topological defects of spin-orbit coupled Bose-Einstein condensates in a rotating anharmonic trap

We investigate the topological defects and spin structures of binary Bose-Einstein condensates (BECs) with Dresselhaus spin-orbit coupling (D-SOC) in a rotating anharmonic trap. Our results show that for initially mixed BECs without SOC the increasing rotation frequency can lead to the structural phase transition of the system. In the presence of isotropic D-SOC, the system sustains vortex pair,Anderson--Toulouse coreless vortices, circular vortex sheets, and combined vortex structures. In particular, when the rotation frequency is fixed above the radial trapping frequency the strong D-SOC results in a peculiar topological structure which is comprised of multi-layer visible vortex necklaces, hidden vortex necklaces and a hidden giant vortex. In addition, the system exhibits rich spin textures including basic skyrmion, meron cluster, skyrmion string and various skyrmion lattices. The skyrmions will be destroyed in the limit of large D-SOC or rotation frequency. Furthermore, the effects of anisotropic D-SOC and Rashba-Dresselhaus SOC on the topological structures of the system are discussed.

cond-mat.quant-gas↗
arXiv2019

Ground-state properties of spin-orbit-coupled dipolar Bose-Einstein condensates with in-plane gradient magnetic field

We investigate the ground-state properties of spin-orbit-coupled pseudo-spin-1/2 dipolar Bose-Einstein condensates (BECs) in a two-dimensional harmonic trap and an in-plane quadrupole field. The effects of spin-orbit coupling (SOC), dipole-dipole interaction (DDI) and the in-plane quadrupole field on the ground-state structures and spin textures of the system are systematically analyzed and discussed. For fixed SOC and DDI strengths, the system shows a quadrupole stripe phase with a half-quantum vortex, or a quadrupole Thomas-Fermi phase with a half-quantum antivortex for small quadrupole field strength, depending on the ratio between inter- and intraspecies interaction. As the quadrupole field strength enhances, the system realizes a ring mixed phase with a hidden vortex-antivortex cluster rather than an ordinary giant vortex in each component. Of particular interest, when the strengths of DDI and quadrupole field are fixed, strong SOC leads to the formation of criss-crossed vortex string structure. For given SOC and quadrupole field, the system for strong DDI displays a sandwich-like structure, or a special delaminated structure with a prolate antivortex in the spin-up component. In addition, typical spin textures for the ground states of the system are analyzed. It is shown that the system sustains exotic topological structures, such as a hyperbolic spin domain wall, skyrmion-half-antiskyrmion-antiskyrmion lattice, half-skyrmion-skyrmion-half-antiskyrmion lattice, and a drum-shaped antimeron.

cond-mat.quant-gas↗