arXiv subjects

Li Zhang

Publications and source records attributed to Li Zhang.

At least 811 records · Page 45Linked to original sources

arXiv2019

A cascaded dual-domain deep learning reconstruction method for sparsely spaced multidetector helical CT

Helical CT has been widely used in clinical diagnosis. Sparsely spaced multidetector in z direction can increase the coverage of the detector provided limited detector rows. It can speed up volumetric CT scan, lower the radiation dose and reduce motion artifacts. However, it leads to insufficient data for reconstruction. That means reconstructions from general analytical methods will have severe artifacts. Iterative reconstruction methods might be able to deal with this situation but with the cost of huge computational load. In this work, we propose a cascaded dual-domain deep learning method that completes both data transformation in projection domain and error reduction in image domain. First, a convolutional neural network (CNN) in projection domain is constructed to estimate missing helical projection data and converting helical projection data to 2D fan-beam projection data. This step is to suppress helical artifacts and reduce the following computational cost. Then, an analytical linear operator is followed to transfer the data from projection domain to image domain. Finally, an image domain CNN is added to improve image quality further. These three steps work as an entirety and can be trained end to end. The overall network is trained using a simulated lung CT dataset with Poisson noise from 25 patients. We evaluate the trained network on another three patients and obtain very encouraging results with both visual examination and quantitative comparison. The resulting RRMSE is 6.56% and the SSIM is 99.60%. In addition, we test the trained network on the lung CT dataset with different noise level and a new dental CT dataset to demonstrate the generalization and robustness of our method.

physics.med-ph↗

arXiv2019

A Model-based Deep Learning Reconstruction for X-ray CT

Low dose CT is of great interest in these days. Dose reduction raises noise level in projections and decrease image quality in reconstructions. Model based image reconstruction can combine statistical noise model together with prior knowledge into an Bayesian optimization problem so that significantly reduce noise and artefacts. In this work, we propose a model-base deep learning for CT reconstruction so that a reconstruction network can be trained with no ground-truth images needed. Instead of minimizing cost function for each image, the network learns to minimize an ensemble cost function for the whole training set. No iteration will be needed for real data reconstruction using such a trained network. We experimented with a penalized weighted least-squares (PWLS) cost function for low dose CT reconstruction and tested on data from a practical dental CT. Very encouraging results with great noise reductions are obtained.

physics.med-ph↗

arXiv2019

Soliton dynamics in a fractional complex Ginzburg-Landau model

The general objective of the work is to study dynamics of dissipative solitons in the framework of a one-dimensional complex Ginzburg-Landau equation (CGLE) of a fractional order. To estimate the shape of solitons in fractional models, we first develop the variational approximation for solitons of the fractional nonlinear Schrodinger equation (NLSE), and an analytical approximation for exponentially decaying tails of the solitons. Proceeding to numerical consideration of solitons in fractional CGLE, we study, in necessary detail, effects of the respective Levy index (LI) on the solitons' dynamics. In particular, dependence of stability domains in the model's parameter space on the LI is identified. Pairs of in-phase dissipative solitons merge into single pulses, with the respective merger distance also determined by LI.

physics.optics↗

arXiv2019

Efficient composite pulse sequences for arbitrarily accurate z-axis rotation gates

We propose various composite $π$-pulse sequences for implementing robust z-axis rotation gates widely used in quantum information processing (QIP) scenarios, and discuss their error tolerance of the pulse strength error (PSE) and off-resonance error (ORE), i.e., two typical systematic errors in NMR systems. Compared to existing composite gates, our designed composite pulses exhibit higher gate fidelity and shorter sequence time cost. Furthermore, such short pulse sequences are generalized by simple analytic formulas which can suppress these errors to any desired order simultaneously with linear length scaling, indicating an efficient construction of them with arbitrary accuracy.

quant-ph↗

arXiv2019

Transient solute transport with sorption in Poiseuille flow

Previous work on solute transport with sorption in Poiseuille flow has reached contradictory conclusions. Some have concluded that sorption increases mean solute transport velocity and decreases dispersion relative to a tracer, while others have concluded the opposite. Here we resolve this contradiction by deriving a series solution for the transient evolution that recovers previous results in the appropriate limits. This solution shows a transition in solute transport behavior from early to late time that is captured by the first- and zeroth-order terms. Mean solute transport velocity is increased at early times and reduced at late times, while solute dispersion is initially reduced, but shows a complex dependence on the partition coefficient $k$ at late times. In the equilibrium sorption model, the time scale of the early regime and the duration of the transition to the late regime both increase with $\text{ln} k$ for large $k$. The early regime is pronounced in strongly-sorbing systems ($k\gg 1$). The kinetic sorption model shows a similar transition from the early to the late transport regime and recovers the equilibrium results when adsorption and desorption rates are large. As the reaction rates slow down, the duration of the early regime increases, but the changes in transport velocity and dispersion relative to a tracer diminish. In general, if the partition coefficient $k$ is large, the early regime is well-developed and the behavior is well characterized by the analysis of the limiting case without desorption.

physics.flu-dyn↗

arXiv2019

Global Aggregation then Local Distribution in Fully Convolutional Networks

It has been widely proven that modelling long-range dependencies in fully convolutional networks (FCNs) via global aggregation modules is critical for complex scene understanding tasks such as semantic segmentation and object detection. However, global aggregation is often dominated by features of large patterns and tends to oversmooth regions that contain small patterns (e.g., boundaries and small objects). To resolve this problem, we propose to first use \emph{Global Aggregation} and then \emph{Local Distribution}, which is called GALD, where long-range dependencies are more confidently used inside large pattern regions and vice versa. The size of each pattern at each position is estimated in the network as a per-channel mask map. GALD is end-to-end trainable and can be easily plugged into existing FCNs with various global aggregation modules for a wide range of vision tasks, and consistently improves the performance of state-of-the-art object detection and instance segmentation approaches. In particular, GALD used in semantic segmentation achieves new state-of-the-art performance on Cityscapes test set with mIoU 83.3\%. Code is available at: \url{https://github.com/lxtGH/GALD-Net}

cs.CV↗

arXiv2019

Rényi Differential Privacy of the Sampled Gaussian Mechanism

The Sampled Gaussian Mechanism (SGM)---a composition of subsampling and the additive Gaussian noise---has been successfully used in a number of machine learning applications. The mechanism's unexpected power is derived from privacy amplification by sampling where the privacy cost of a single evaluation diminishes quadratically, rather than linearly, with the sampling rate. Characterizing the precise privacy properties of SGM motivated development of several relaxations of the notion of differential privacy. This work unifies and fills in gaps in published results on SGM. We describe a numerically stable procedure for precise computation of SGM's Rényi Differential Privacy and prove a nearly tight (within a small constant factor) closed-form bound.

cs.LG↗

arXiv2019

CAN: Constrained Attention Networks for Multi-Aspect Sentiment Analysis

Aspect level sentiment classification is a fine-grained sentiment analysis task. To detect the sentiment towards a particular aspect in a sentence, previous studies have developed various attention-based methods for generating aspect-specific sentence representations. However, the attention may inherently introduce noise and downgrade the performance. In this paper, we propose constrained attention networks (CAN), a simple yet effective solution, to regularize the attention for multi-aspect sentiment analysis, which alleviates the drawback of the attention mechanism. Specifically, we introduce orthogonal regularization on multiple aspects and sparse regularization on each single aspect. Experimental results on two public datasets demonstrate the effectiveness of our approach. We further extend our approach to multi-task settings and outperform the state-of-the-art methods.

cs.CL↗

arXiv2019

Statistical analysis on X-ray flares from the nucleus and HST-1 knot in the M87 jet

The statistical properties of X-ray flares from two separate locations (nucleus and HST-1) in the M87 jet are investigated to reveal the physical origin of the flares. We analyse the archival \textit{Chandra} data for M87, and identify 14 flares in the nucleus and 9 flares in HST-1. The peak intensity ($I_{\rm{P}}$) and the flaring duration time ($T_{\rm{fl}}$) for each flare are obtained. It is found that the distributions of both $I_{\rm{P}}$ and $T_{\rm{fl}}$ for the nucleus obey a power-law form with a similar index. A similar result is also obtained for HST-1, and no significant inconsistency between the nucleus and HST-1 is found for the indices. Similar to solar X-ray flares, the power-law distributions of the flare event parameters can be well explained by a self-organized criticality (SOC) system, which are triggered by magnetic reconnection. Our results suggest that the flares from nucleus and HST-1 are possibly triggered by magnetic reconnection process. The consistent indices for the distributions of $I_{\rm{P}}$ and $T_{\rm{fl}}$ in the CORE and HST-1 indicate that the dimensions of the energy dissipation of the magnetic reconnection is identical in the two regions. A strong correlation between the flares in the two regions also suggests a similar physical origin for the flares.

astro-ph.HE↗

arXiv2019

A Closed-form Solution to Universal Style Transfer

Universal style transfer tries to explicitly minimize the losses in feature space, thus it does not require training on any pre-defined styles. It usually uses different layers of VGG network as the encoders and trains several decoders to invert the features into images. Therefore, the effect of style transfer is achieved by feature transform. Although plenty of methods have been proposed, a theoretical analysis of feature transform is still missing. In this paper, we first propose a novel interpretation by treating it as the optimal transport problem. Then, we demonstrate the relations of our formulation with former works like Adaptive Instance Normalization (AdaIN) and Whitening and Coloring Transform (WCT). Finally, we derive a closed-form solution named Optimal Style Transfer (OST) under our formulation by additionally considering the content loss of Gatys. Comparatively, our solution can preserve better structure and achieve visually pleasing results. It is simple yet effective and we demonstrate its advantages both quantitatively and qualitatively. Besides, we hope our theoretical analysis can inspire future works in neural style transfer. Code is available at https://github.com/lu-m13/OptimalStyleTransfer.

cs.CV↗

arXiv2019

Multi-level Domain Adaptive learning for Cross-Domain Detection

In recent years, object detection has shown impressive results using supervised deep learning, but it remains challenging in a cross-domain environment. The variations of illumination, style, scale, and appearance in different domains can seriously affect the performance of detection models. Previous works use adversarial training to align global features across the domain shift and to achieve image information transfer. However, such methods do not effectively match the distribution of local features, resulting in limited improvement in cross-domain object detection. To solve this problem, we propose a multi-level domain adaptive model to simultaneously align the distributions of local-level features and global-level features. We evaluate our method with multiple experiments, including adverse weather adaptation, synthetic data adaptation, and cross camera adaptation. In most object categories, the proposed method achieves superior performance against state-of-the-art techniques, which demonstrates the effectiveness and robustness of our method.

cs.CV↗

arXiv2019

Magnetic phase transitions of insulating spin-orbit coupled Bose atoms in one-dimensional optical lattices

We consider the insulating spin-orbit coupled Bose atoms confined within one-dimensional optical lattices and explore their ground-state magnetic phase transitions. Under strong interactions, the charge degrees of atoms are frozen and the system can be described by an anisotropic XXZ Heisenberg chain with Dzyaloshinskii-Moriya interaction and transverse field. We apply the matrix product state method to obtain low-energy states and analyze the lowest energy gaps and the ground-state magnetization and correlations. We find when the transverse field is absent, the ground state is a gapped ferromagnetic phase with long-range correlation in the z direction if the interspin s-wave interacting strength is stronger than that of the intraspin one, otherwise it is a gapless Luttinger liquid (LL) phase with algebraic decaying correlation. When the transverse field is turned on, the gapless LL phase is broken, there emerges a long-range correlated phase with ferromagnetic, antiferromagnetic or spiral order, which depends on the DM interaction strength. We believe our study provides a complete understanding of the interplay between SOC and quantum magnetism of spinor atoms in optical lattices.

quant-ph↗

arXiv2019

MVB: A Large-Scale Dataset for Baggage Re-Identification and Merged Siamese Networks

In this paper, we present a novel dataset named MVB (Multi View Baggage) for baggage ReID task which has some essential differences from person ReID. The features of MVB are three-fold. First, MVB is the first publicly released large-scale dataset that contains 4519 baggage identities and 22660 annotated baggage images as well as its surface material labels. Second, all baggage images are captured by specially-designed multi-view camera system to handle pose variation and occlusion, in order to obtain the 3D information of baggage surface as complete as possible. Third, MVB has remarkable inter-class similarity and intra-class dissimilarity, considering the fact that baggage might have very similar appearance while the data is collected in two real airport environments, where imaging factors varies significantly from each other. Moreover, we proposed a merged Siamese network as baseline model and evaluated its performance. Experiments and case study are conducted on MVB.

cs.CV↗

arXiv2019

Annotation-Free Cardiac Vessel Segmentation via Knowledge Transfer from Retinal Images

Segmenting coronary arteries is challenging, as classic unsupervised methods fail to produce satisfactory results and modern supervised learning (deep learning) requires manual annotation which is often time-consuming and can some time be infeasible. To solve this problem, we propose a knowledge transfer based shape-consistent generative adversarial network (SC-GAN), which is an annotation-free approach that uses the knowledge from publicly available annotated fundus dataset to segment coronary arteries. The proposed network is trained in an end-to-end fashion, generating and segmenting synthetic images that maintain the background of coronary angiography and preserve the vascular structures of retinal vessels and coronary arteries. We train and evaluate the proposed model on a dataset of 1092 digital subtraction angiography images, and experiments demonstrate the supreme accuracy of the proposed method on coronary arteries segmentation.

eess.IV↗

arXiv2019

Learning a Deep Embedding Model for Zero-Shot Learning

Zero-shot learning (ZSL) models rely on learning a joint embedding space where both textual/semantic description of object classes and visual representation of object images can be projected to for nearest neighbour search. Despite the success of deep neural networks that learn an end-to-end model between text and images in other vision problems such as image captioning, very few deep ZSL model exists and they show little advantage over ZSL models that utilise deep feature representations but do not learn an end-to-end embedding. In this paper we argue that the key to make deep ZSL models succeed is to choose the right embedding space. Instead of embedding into a semantic space or an intermediate space, we propose to use the visual space as the embedding space. This is because that in this space, the subsequent nearest neighbour search would suffer much less from the hubness problem and thus become more effective. This model design also provides a natural mechanism for multiple semantic modalities (e.g., attributes and sentence descriptions) to be fused and optimised jointly in an end-to-end manner. Extensive experiments on four benchmarks show that our model significantly outperforms the existing models. Code is available at https://github.com/lzrobots/DeepEmbeddingModel_ZSL

cs.CV↗

arXiv2019

First-principles prediction of a new family of layered topological insulators

Dozens of layered V$_2$IV$_2$VI$_6$ (V=P, As, Sb, Bi, IV=Si, Ge, Sn, Pb, VI=S, Se, Te) materials are investigated, several of which have been successfully synthesized in experiment. Among them, we predict nine strong topological insulators (TIs), two strong topological metals (TMs) and nearly twenty trivial insulators at their equilibrium structures. The TIs are in the (1;111) topological class, with energy gaps ranging from 0.04 to 0.2 eV. The strong TMs and the trivial insulators belong to the (1;111) and (0;000) topological classes, respectively. Small compressive strains easily turn some of the trivial insulators into strong TIs. This study enriches not only the family of topological materials but also the family of van der Waals layered materials, providing promising candidates for the future spintronic devices.

cond-mat.mtrl-sci↗

arXiv2019

Transverse photon spin beyond interfaces

Photons possess spin degree of freedom, corresponding to clockwise and counter clockwise rotating direction of the fields. Photon spin plays an important role in various applications such as optical communications, information processing and sensing. In conventional isotropic media, photon spin is aligned with the propagation direction of light, obeying spin momentum locking. Interestingly, at certain interfaces, the surface waves decaying away from the interface possess a photon spin transverse to its propagation, opening exciting opportunities for observation of spin dependent unidirectional excitation in confined systems. Here we propose and realize transverse photon spin (T-spin) in the interior of a bulk medium, without relying on the presence of any interfaces. We show the complete mapping of the T-spin of surface modes to that of the bulk modes by introducing the coupling between electric and magnetic responses along orthogonal directions, i.e., the bianisotropy, into the medium. We further discover that an interface formed by two bianisotropic media of opposite orientations supports edge-dependent propagating modes with tunable cutoff frequencies. Our results provide a new platform for manipulating the spin orbit interaction of electromagnetic waves.

physics.optics↗

arXiv2019

Efficient Semantic Scene Completion Network with Spatial Group Convolution

We introduce Spatial Group Convolution (SGC) for accelerating the computation of 3D dense prediction tasks. SGC is orthogonal to group convolution, which works on spatial dimensions rather than feature channel dimension. It divides input voxels into different groups, then conducts 3D sparse convolution on these separated groups. As only valid voxels are considered when performing convolution, computation can be significantly reduced with a slight loss of accuracy. The proposed operations are validated on semantic scene completion task, which aims to predict a complete 3D volume with semantic labels from a single depth image. With SGC, we further present an efficient 3D sparse convolutional network, which harnesses a multiscale architecture and a coarse-to-fine prediction strategy. Evaluations are conducted on the SUNCG dataset, achieving state-of-the-art performance and fast speed. Code is available at https://github.com/zjhthu/SGC-Release.git

cs.CV↗