arXiv subjects

Pengfei Zhang

Publications and source records attributed to Pengfei Zhang.

At least 289 records · Page 16Linked to original sources

arXiv2020

High Performance Depthwise and Pointwise Convolutions on Mobile Devices

Lightweight convolutional neural networks (e.g., MobileNets) are specifically designed to carry out inference directly on mobile devices. Among the various lightweight models, depthwise convolution (DWConv) and pointwise convolution (PWConv) are their key operations. In this paper, we observe that the existing implementations of DWConv and PWConv are not well utilizing the ARM processors in the mobile devices, and exhibit lots of cache misses under multi-core and poor data reuse at register level. We propose techniques to re-optimize the implementations of DWConv and PWConv based on ARM architecture. Experimental results show that our implementation can respectively achieve a speedup of up to 5.5x and 2.1x against TVM (Chen et al. 2018) on DWConv and PWConv.

cs.DC↗

arXiv2019

Colorectal Polyp Segmentation by U-Net with Dilation Convolution

Colorectal cancer (CRC) is one of the most commonly diagnosed cancers and a leading cause of cancer deaths in the United States. Colorectal polyps that grow on the intima of the colon or rectum is an important precursor for CRC. Currently, the most common way for colorectal polyp detection and precancerous pathology is the colonoscopy. Therefore, accurate colorectal polyp segmentation during the colonoscopy procedure has great clinical significance in CRC early detection and prevention. In this paper, we propose a novel end-to-end deep learning framework for the colorectal polyp segmentation. The model we design consists of an encoder to extract multi-scale semantic features and a decoder to expand the feature maps to a polyp segmentation map. We improve the feature representation ability of the encoder by introducing the dilated convolution to learn high-level semantic features without resolution reduction. We further design a simplified decoder which combines multi-scale semantic features with fewer parameters than the traditional architecture. Furthermore, we apply three post processing techniques on the output segmentation map to improve colorectal polyp detection performance. Our method achieves state-of-the-art results on CVC-ClinicDB and ETIS-Larib Polyp DB.

eess.IV↗

arXiv2019

Probing the dynamical phase transition with a superconducting quantum simulator

Non-equilibrium quantum many-body systems, which are difficult to study via classical computation, have attracted wide interest. Quantum simulation can provide insights into these problems. Here, using a programmable quantum simulator with 16 all-to-all connected superconducting qubits, we investigate the dynamical phase transition in the Lipkin-Meshkov-Glick model with a quenched transverse field. Clear signatures of the dynamical phase transition, merging different concepts of dynamical criticality, are observed by measuring the non-equilibrium order parameter, nonlocal correlations, and the Loschmidt echo. Moreover, near the dynamical critical point, we obtain the optimal spin squeezing of $-7.0\pm 0.8$ decibels, showing multipartite entanglement useful for measurements with precision five-fold beyond the standard quantum limit. Based on the capability of entangling qubits simultaneously and the accurate single-shot readout of multi-qubit states, this superconducting quantum simulator can be used to study other problems in non-equilibrium quantum many-body systems.

quant-ph↗

arXiv2019

High-numerical-aperture and long-working-distance objectives for single-atom experiments

We present two long-working-distance objective lenses with numerical apertures (NA) of 0.29 and 0.4 for single-atom experiments. The objective lenses are assembled entirely by the commercial on-catalog $Φ$1'' singlets. Both the objectives are capable to correct the spherical aberrations due to the standard flat vacuum glass windows with various thickness. The working distances of NA$=0.29$ and NA$=0.4$ objectives are 34.6 mm and 18.2 mm, respectively, at the design wavelength of 852 nm with 5-mm thick silica window. In addition, the objectives can also be optimized to work at diffraction limit at single wavelength in the entire visible and near infrared regions by slightly tuning the distance between the first two lenses. The diffraction limited fields of view for NA$=0.29$ and NA$=0.4$ objectives are 0.62 mm and 0.61 mm, and the spatial resolutions are 1.8 $μ$m and 1.3 $μ$m at the design wavelength. The performances are simulated by the commercial ray-tracing software and confirmed by imaging the resolution chart and a 1.18 $μ$m pinhole. The two objectives can be used for trapping and manipulating single atoms of various species.

physics.optics↗

arXiv2019

Realization of nonlinear optical nonreciprocity on a few-photon level based on atoms strongly coupled to an asymmetric cavity

Optical nonreciprocity is important in photonic information processing to route the optical signal or prevent the reverse flow of noise. By adopting the strong nonlinearity associated with a few atoms in a strongly coupled cavity QED system and an asymmetric cavity configuration, we experimentally demonstrate the nonreciprocal transmission between two counterpropagating light fields with extremely low power. This nonreciprocity can even occur on a few-photon level due to the high optical nonlinearity of the system. The working power can be flexibly tuned by changing the effective number of atoms strongly coupled to the cavity. The idea and result can be applied to optical chips as optical diodes by using fiber-based cavity QED systems. Our work opens up new perspectives for realizing optical nonreciprocity on a few-photon level based on the nonlinearities of atoms strongly coupled to an optical cavity.

quant-ph↗

arXiv2019

Realizing the Hayden-Preskill Protocol with Coupled Dicke Models

Hayden and Preskill proposed a thought experiment that Bob can recover the information Alice throws into a black hole if he has a quantum computer entangled with the black hole, and Yoshida and Kitaev recently proposed a concrete decoding scheme. The parallel question is that after a small system is thermalized with a large system, how one can decode the initial state information with the help of two entangled many-body systems. Here we propose to realize this protocol in a physical system of two Dicke models, with two cavity fields prepared in a thermofield double state. We show that the Yoshida-Kitaev protocol allows us to read out the initial spin information after it is scrambled into the cavity. We show that the readout efficiency reaches a maximum when the model parameter is tuned to the regime where the system is the most chaotic, characterized by the shortest scrambling time in the out-of-time-ordered correlation function. Our proposal opens up the possibility of discussing this profound thought experiment in a realistic setting.

cond-mat.quant-gas↗

arXiv2019

AFP-Net: Realtime Anchor-Free Polyp Detection in Colonoscopy

Colorectal cancer (CRC) is a common and lethal disease. Globally, CRC is the third most commonly diagnosed cancer in males and the second in females. For colorectal cancer, the best screening test available is the colonoscopy. During a colonoscopic procedure, a tiny camera at the tip of the endoscope generates a video of the internal mucosa of the colon. The video data are displayed on a monitor for the physician to examine the lining of the entire colon and check for colorectal polyps. Detection and removal of colorectal polyps are associated with a reduction in mortality from colorectal cancer. However, the miss rate of polyp detection during colonoscopy procedure is often high even for very experienced physicians. The reason lies in the high variation of polyp in terms of shape, size, textural, color and illumination. Though challenging, with the great advances in object detection techniques, automated polyp detection still demonstrates a great potential in reducing the false negative rate while maintaining a high precision. In this paper, we propose a novel anchor free polyp detector that can localize polyps without using predefined anchor boxes. To further strengthen the model, we leverage a Context Enhancement Module and Cosine Ground truth Projection. Our approach can respond in real time while achieving state-of-the-art performance with 99.36% precision and 96.44% recall.

eess.IV↗

arXiv2019

Evaporation dynamics of the Sachdev-Ye-Kitaev model

In this paper, we study the evaporation dynamics of the Sachdev-Ye-Kitaev (SYK) model, with an initial temperature $T_χ$, by coupling it to a thermal bath with lower temperature $T_ψ<T_χ$ modeled by a larger SYK model. The coupling between the small system and the bath is turned on at time $t=0$. Then the system begins to envolve and finally becomes thermalized. Using the Keldysh approach, we analyze the relaxation process of the system for different temperatures and couplings. For marginal or irrelevant coupling, after a short-time energy absorption, we find a smooth thermalization of the small system where the energy relaxes before the system become thermalized. The relaxation rate of effective temperature is found to be bounded by $T$, while the energy thermalization rate increases without saturation when increasing the coupling strength. On the contrary, for the relevant coupling case, both energy and effective temperature show oscillations. We find this oscillations frequency to be coincident with the excitation energy of a Majorana operator.

cond-mat.str-el↗

arXiv2019

Many-Body Echo

In this letter we propose a protocol to reverse a quantum many-body dynamical process. We name it "many-body echo" because the underlying physics is closely related to the spin echo effect in nuclear magnetic resonance systems. We consider a periodical modulation of the interaction strength in a weakly interacting Bose condensate, which resonantly excites quasi-particles from the condensate. A dramatic phenomenon is that, after pausing the interaction modulation for half a period and then continuing on with the same modulation, nearly all the excited quasi-particles in the resonance modes will be absorbed back into the condensate. During the intermediate half period, the free evolution introduces a $π$ phase, which plays a role reminiscent of that played by the $π$-pulse in the spin echo. Comparing our protocol with another one implemented by the Chicago group in a recent experiment, we find that ours is more effective at reversing the many-body process. The difference between these two schemes manifests the physical effect of the micro-motion in the Floquet theory. Our scheme can be generalised to other periodically driven many-body systems.

cond-mat.quant-gas↗

arXiv2019

View Adaptive Neural Networks for High Performance Skeleton-based Human Action Recognition

Skeleton-based human action recognition has recently attracted increasing attention thanks to the accessibility and the popularity of 3D skeleton data. One of the key challenges in skeleton-based action recognition lies in the large view variations when capturing data. In order to alleviate the effects of view variations, this paper introduces a novel view adaptation scheme, which automatically determines the virtual observation viewpoints in a learning based data driven manner. We design two view adaptive neural networks, i.e., VA-RNN based on RNN, and VA-CNN based on CNN. For each network, a novel view adaptation module learns and determines the most suitable observation viewpoints, and transforms the skeletons to those viewpoints for the end-to-end recognition with a main classification network. Ablation studies find that the proposed view adaptive models are capable of transforming the skeletons of various viewpoints to much more consistent virtual viewpoints which largely eliminates the viewpoint influence. In addition, we design a two-stream scheme (referred to as VA-fusion) that fuses the scores of the two networks to provide the fused prediction. Extensive experimental evaluations on five challenging benchmarks demonstrate that the effectiveness of the proposed view-adaptive networks and superior performance over state-of-the-art approaches. The source code is available at https://github.com/microsoft/View-Adaptive-Neural-Networks-for-Skeleton-based-Human-Action-Recognition.

cs.CV↗

arXiv2019

EleAtt-RNN: Adding Attentiveness to Neurons in Recurrent Neural Networks

Recurrent neural networks (RNNs) are capable of modeling temporal dependencies of complex sequential data. In general, current available structures of RNNs tend to concentrate on controlling the contributions of current and previous information. However, the exploration of different importance levels of different elements within an input vector is always ignored. We propose a simple yet effective Element-wise-Attention Gate (EleAttG), which can be easily added to an RNN block (e.g. all RNN neurons in an RNN layer), to empower the RNN neurons to have attentiveness capability. For an RNN block, an EleAttG is used for adaptively modulating the input by assigning different levels of importance, i.e., attention, to each element/dimension of the input. We refer to an RNN block equipped with an EleAttG as an EleAtt-RNN block. Instead of modulating the input as a whole, the EleAttG modulates the input at fine granularity, i.e., element-wise, and the modulation is content adaptive. The proposed EleAttG, as an additional fundamental unit, is general and can be applied to any RNN structures, e.g., standard RNN, Long Short-Term Memory (LSTM), or Gated Recurrent Unit (GRU). We demonstrate the effectiveness of the proposed EleAtt-RNN by applying it to different tasks including the action recognition, from both skeleton-based data and RGB videos, gesture recognition, and sequential MNIST classification. Experiments show that adding attentiveness through EleAttGs to RNN blocks significantly improves the power of RNNs.

cs.CV↗

arXiv2019

3D Anchor-Free Lesion Detector on Computed Tomography Scans

Lesions are injuries and abnormal tissues in the human body. Detecting lesions in 3D Computed Tomography (CT) scans can be time-consuming even for very experienced physicians and radiologists. In recent years, CNN based lesion detectors have demonstrated huge potentials. Most of current state-of-the-art lesion detectors employ anchors to enumerate all possible bounding boxes with respect to the dataset in process. This anchor mechanism greatly improves the detection performance while also constraining the generalization ability of detectors. In this paper, we propose an anchor-free lesion detector. The anchor mechanism is removed and lesions are formalized as single keypoints. By doing so, we witness a considerable performance gain in terms of both accuracy and inference speed compared with the anchor-based baseline

cs.CV↗

arXiv2019

Multi-Stream Single Shot Spatial-Temporal Action Detection

We present a 3D Convolutional Neural Networks (CNNs) based single shot detector for spatial-temporal action detection tasks. Our model includes: (1) two short-term appearance and motion streams, with single RGB and optical flow image input separately, in order to capture the spatial and temporal information for the current frame; (2) two long-term 3D ConvNet based stream, working on sequences of continuous RGB and optical flow images to capture the context from past frames. Our model achieves strong performance for action detection in video and can be easily integrated into any current two-stream action detection methods. We report a frame-mAP of 71.30% on the challenging UCF101-24 actions dataset, achieving the state-of-the-art result of the one-stage methods. To the best of our knowledge, our work is the first system that combined 3D CNN and SSD in action detection tasks.

cs.CV↗

arXiv2019

Statistical analysis on X-ray flares from the nucleus and HST-1 knot in the M87 jet

The statistical properties of X-ray flares from two separate locations (nucleus and HST-1) in the M87 jet are investigated to reveal the physical origin of the flares. We analyse the archival \textit{Chandra} data for M87, and identify 14 flares in the nucleus and 9 flares in HST-1. The peak intensity ($I_{\rm{P}}$) and the flaring duration time ($T_{\rm{fl}}$) for each flare are obtained. It is found that the distributions of both $I_{\rm{P}}$ and $T_{\rm{fl}}$ for the nucleus obey a power-law form with a similar index. A similar result is also obtained for HST-1, and no significant inconsistency between the nucleus and HST-1 is found for the indices. Similar to solar X-ray flares, the power-law distributions of the flare event parameters can be well explained by a self-organized criticality (SOC) system, which are triggered by magnetic reconnection. Our results suggest that the flares from nucleus and HST-1 are possibly triggered by magnetic reconnection process. The consistent indices for the distributions of $I_{\rm{P}}$ and $T_{\rm{fl}}$ in the CORE and HST-1 indicate that the dimensions of the energy dissipation of the magnetic reconnection is identical in the two regions. A strong correlation between the flares in the two regions also suggests a similar physical origin for the flares.

astro-ph.HE↗

arXiv2019

Multimodal Data Fusion of Non-Gaussian Spatial Fields in Sensor Networks

We develop a robust data fusion algorithm for field reconstruction of multiple physical phenomena. The contribution of this paper is twofold: First, we demonstrate how multi-spatial fields which can have any marginal distributions and exhibit complex dependence structures can be constructed. To this end we develop a model where a latent process of these physical phenomena is modelled as Multiple Gaussian Process (MGP), and the dependence structure between these phenomena is captured through a Copula process. This model has the advantage of allowing one to choose any marginal distributions for the physical phenomenon. Second, we develop an efficient and robust linear estimation algorithm to predict the mean behaviour of the physical phenomena using rank correlation instead of the conventional linear Pearson correlation. Our approach has the advantage of avoiding the need to derive intractable predictive posterior distribution and also has a tractable solution for the rank correlation values. We show that our model outperforms the model which uses the conventional linear Pearson correlation metric in terms of the prediction mean-squared-errors (MSE). This provides the motivation for using our models for multimodal data fusion.

stat.ME↗

arXiv2019

Entanglement Entropy of Two Coupled SYK Models and Eternal Traversable Wormhole

In this paper, we study the entanglement entropy between two SYK systems with bilinear coupling. We use the replica trick to calculate the entanglement entropy in the ground state. In parallel, we calculate the entanglement entropy through the Ryu-Takayanagi formula in gravity. For the ground state that is dual to an eternal traversable wormhole in AdS_2, the bulk quantum correction to the entanglement entropy is of the same order as the minimal surface area. The ground state of the coupled system is close to a thermofield double state with particular temperature and they have the same entanglement entropy. From the gravity point of view, we explain why the two states have the same entanglement entropy. We also study a case with time-dependent coupling, which involves finding the quantum extremal surface in the bulk.

hep-th↗

arXiv2019

SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Prediction

In crowd scenarios, reliable trajectory prediction of pedestrians requires insightful understanding of their social behaviors. These behaviors have been well investigated by plenty of studies, while it is hard to be fully expressed by hand-craft rules. Recent studies based on LSTM networks have shown great ability to learn social behaviors. However, many of these methods rely on previous neighboring hidden states but ignore the important current intention of the neighbors. In order to address this issue, we propose a data-driven state refinement module for LSTM network (SR-LSTM), which activates the utilization of the current intention of neighbors, and jointly and iteratively refines the current states of all participants in the crowd through a message passing mechanism. To effectively extract the social effect of neighbors, we further introduce a social-aware information selection mechanism consisting of an element-wise motion gate and a pedestrian-wise attention to select useful message from neighboring pedestrians. Experimental results on two public datasets, i.e. ETH and UCY, demonstrate the effectiveness of our proposed SR-LSTM and we achieves state-of-the-art results.

cs.CV↗

arXiv2019

Unsupervised Learning-based Depth Estimation aided Visual SLAM Approach

The RGB-D camera maintains a limited range for working and is hard to accurately measure the depth information in a far distance. Besides, the RGB-D camera will easily be influenced by strong lighting and other external factors, which will lead to a poor accuracy on the acquired environmental depth information. Recently, deep learning technologies have achieved great success in the visual SLAM area, which can directly learn high-level features from the visual inputs and improve the estimation accuracy of the depth information. Therefore, deep learning technologies maintain the potential to extend the source of the depth information and improve the performance of the SLAM system. However, the existing deep learning-based methods are mainly supervised and require a large amount of ground-truth depth data, which is hard to acquire because of the realistic constraints. In this paper, we first present an unsupervised learning framework, which not only uses image reconstruction for supervising but also exploits the pose estimation method to enhance the supervised signal and add training constraints for the task of monocular depth and camera motion estimation. Furthermore, we successfully exploit our unsupervised learning framework to assist the traditional ORB-SLAM system when the initialization module of ORB-SLAM method could not match enough features. Qualitative and quantitative experiments have shown that our unsupervised learning framework performs the depth estimation task comparable to the supervised methods and outperforms the previous state-of-the-art approach by $13.5\%$ on KITTI dataset. Besides, our unsupervised learning framework could significantly accelerate the initialization process of ORB-SLAM system and effectively improve the accuracy on environmental mapping in strong lighting and weak texture scenes.

cs.CV↗