arXiv subjects

Zhen Zhao

Publications and source records attributed to Zhen Zhao.

119 records · Page 7Linked to original sources

arXiv2020

Ensemble Model with Batch Spectral Regularization and Data Blending for Cross-Domain Few-Shot Learning with Unlabeled Data

In this paper, we present our proposed ensemble model with batch spectral regularization and data blending mechanisms for the Track 2 problem of the cross-domain few-shot learning (CD-FSL) challenge. We build a multi-branch ensemble framework by using diverse feature transformation matrices, while deploying batch spectral feature regularization on each branch to improve the model's transferability. Moreover, we propose a data blending method to exploit the unlabeled data and augment the sparse support set in the target domain. Our proposed model demonstrates effective performance on the CD-FSL benchmark tasks.

cs.CV↗

arXiv2020

Feature Transformation Ensemble Model with Batch Spectral Regularization for Cross-Domain Few-Shot Classification

In this paper, we propose a feature transformation ensemble model with batch spectral regularization for the Cross-domain few-shot learning (CD-FSL) challenge. Specifically, we proposes to construct an ensemble prediction model by performing diverse feature transformations after a feature extraction network. On each branch prediction network of the model we use a batch spectral regularization term to suppress the singular values of the feature matrix during pre-training to improve the generalization ability of the model. The proposed model can then be fine tuned in the target domain to address few-shot classification. We also further apply label propagation, entropy minimization and data augmentation to mitigate the shortage of labeled data in target domains. Experiments are conducted on a number of CD-FSL benchmark tasks with four target domains and the results demonstrate the superiority of our proposed model.

cs.CV↗

arXiv2020

Mutual Learning Network for Multi-Source Domain Adaptation

Early Unsupervised Domain Adaptation (UDA) methods have mostly assumed the setting of a single source domain, where all the labeled source data come from the same distribution. However, in practice the labeled data can come from multiple source domains with different distributions. In such scenarios, the single source domain adaptation methods can fail due to the existence of domain shifts across different source domains and multi-source domain adaptation methods need to be designed. In this paper, we propose a novel multi-source domain adaptation method, Mutual Learning Network for Multiple Source Domain Adaptation (ML-MSDA). Under the framework of mutual learning, the proposed method pairs the target domain with each single source domain to train a conditional adversarial domain adaptation network as a branch network, while taking the pair of the combined multi-source domain and target domain to train a conditional adversarial adaptive network as the guidance network. The multiple branch networks are aligned with the guidance network to achieve mutual learning by enforcing JS-divergence regularization over their prediction probability distributions on the corresponding target data. We conduct extensive experiments on multiple multi-source domain adaptation benchmark datasets. The results show the proposed ML-MSDA method outperforms the comparison methods and achieves the state-of-the-art performance.

cs.LG↗

arXiv2019

Fast Inference in Capsule Networks Using Accumulated Routing Coefficients

We present a method for fast inference in Capsule Networks (CapsNets) by taking advantage of a key insight regarding the routing coefficients that link capsules between adjacent network layers. Since the routing coefficients are responsible for assigning object parts to wholes, and an object whole generally contains similar intra-class and dissimilar inter-class parts, the routing coefficients tend to form a unique signature for each object class. For fast inference, a network is first trained in the usual manner using examples from the training dataset. Afterward, the routing coefficients associated with the training examples are accumulated offline and used to create a set of "master" routing coefficients. During inference, these master routing coefficients are used in place of the dynamically calculated routing coefficients. Our method effectively replaces the for-loop iterations in the dynamic routing procedure with a single matrix multiply operation, providing a significant boost in inference speed. Compared with the dynamic routing procedure, fast inference decreases the test accuracy for the MNIST, Background MNIST, Fashion MNIST, and Rotated MNIST datasets by less than 0.5% and by approximately 5% for CIFAR10.

cs.CV↗

arXiv2019

Capsule Networks with Max-Min Normalization

Capsule Networks (CapsNet) use the Softmax function to convert the logits of the routing coefficients into a set of normalized values that signify the assignment probabilities between capsules in adjacent layers. We show that the use of Softmax prevents capsule layers from forming optimal couplings between lower and higher-level capsules. Softmax constrains the dynamic range of the routing coefficients and leads to probabilities that remain mostly uniform after several routing iterations. Instead, we propose the use of Max-Min normalization. Max-Min performs a scale-invariant normalization of the logits that allows each lower-level capsule to take on an independent value, constrained only by the bounds of normalization. Max-Min provides consistent improvement in test accuracy across five datasets and allows more routing iterations without a decrease in network performance. A single CapsNet trained using Max-Min achieves an improved test error of 0.20% on the MNIST dataset. With a simple 3-model majority vote, we achieve a test error of 0.17% on MNIST.

cs.CV↗

arXiv2019

A cosmic microscope to probe the Universe from Present to Cosmic Dawn - dual-element low-frequency space VLBI observatory

A space-based very long baseline interferometry (VLBI) programme, named as the Cosmic Microscope, is proposed to involve dual VLBI telescopes in the space working together with giant ground-based telescopes (e.g., Square Kilometre Array, FAST, Arecibo) to image the low radio frequency Universe with the purpose of unraveling the compact structure of cosmic constituents including supermassive black holes and binaries, pulsars, astronomical masers and the underlying source, and exoplanets amongst others. The operational frequency bands are 30, 74, 330 and 1670 MHz, supporting broad science areas. The mission plans to launch two 30-m-diameter radio telescopes into 2,000 km x 90,000 km elliptical orbits. The two telescopes can work in flexibly diverse modes: (i) space-ground VLBI. The maximum space-ground baseline length is about 100,000 km; it provides a high-dynamic-range imaging capacity with unprecedented high resolutions at low frequencies (0.4 mas at 1.67 GHz and 20 mas at 30 MHz) enabling studies of exoplanets and supermassive black hole binaries (which emit nanoHz gravitational waves); (ii) space-space single-baseline VLBI. This unique baseline enables the detection of flaring hydroxyl masers, and more precise position measurement of pulsars and radio transients at milli-arcsecond level; (iii) single dish mode, where each telescope can be used to monitor transient bursts and rapidly trigger follow-up VLBI observations. The large space telescope will also contribute in measuring and constraining the total angular power spectrum from the Epoch of Reionization. In short, the Cosmic Microscope offers astronomers the opportunity to conduct novel, frontier science.

astro-ph.IM↗

arXiv2018

CT Super-resolution GAN Constrained by the Identical, Residual, and Cycle Learning Ensemble(GAN-CIRCLE)

Computed tomography (CT) is widely used in screening, diagnosis, and image-guided therapy for both clinical and research purposes. Since CT involves ionizing radiation, an overarching thrust of related technical research is development of novel methods enabling ultrahigh quality imaging with fine structural details while reducing the X-ray radiation. In this paper, we present a semi-supervised deep learning approach to accurately recover high-resolution (HR) CT images from low-resolution (LR) counterparts. Specifically, with the generative adversarial network (GAN) as the building block, we enforce the cycle-consistency in terms of the Wasserstein distance to establish a nonlinear end-to-end mapping from noisy LR input images to denoised and deblurred HR outputs. We also include the joint constraints in the loss function to facilitate structural preservation. In this deep imaging process, we incorporate deep convolutional neural network (CNN), residual learning, and network in network techniques for feature extraction and restoration. In contrast to the current trend of increasing network depth and complexity to boost the CT imaging performance, which limit its real-world applications by imposing considerable computational and memory overheads, we apply a parallel $1\times1$ CNN to compress the output of the hidden layer and optimize the number of layers and the number of filters for each convolutional layer. Quantitative and qualitative evaluations demonstrate that our proposed model is accurate, efficient and robust for super-resolution (SR) image restoration from noisy LR input images. In particular, we validate our composite SR networks on three large-scale CT datasets, and obtain promising results as compared to the other state-of-the-art methods.

eess.IV↗

arXiv2018

VLBI Network SIMulator: An Integrated Simulation Tool for Radio Astronomers

In this paper we introduce a software package, the Very Long Baseline Interferometry Network SIMulator (VNSIM), which provides an integrated platform assisting radio astronomers to design the Very Long Baseline Interferometry (VLBI) experiments and evaluate the network performance with a user-friendly interface. Though VNSIM is motivated to be designed for the East Asia VLBI Network, it can also be expandable to other VLBI networks and generic interferometers. The software package not only integrates the functionality of plotting $(u,v)$ coverage, scheduling the observation, and displaying the dirty and CLEAN images, but also further extends to add new features such as the sensitivity calculation of a certain network and multiple-satellite space VLBI simulations which are useful for future space VLBI mission. In addition, VNSIM provides flexible interactions on both command line and graphical user interface and offers friendly support for log report and database management. VNSIM also supports multiprocessing accelerations, enabling to handle large survey data. To facilitate the future development and update, each simulation function is encapsulated in different Python module allowing for independently invoking and testing. In order to verify the performance of VNSIM, we have carried out various simulations and compared the results with other simulation tools. All tests show good consistency.

astro-ph.IM↗

arXiv2018

Structure-sensitive Multi-scale Deep Neural Network for Low-Dose CT Denoising

Computed tomography (CT) is a popular medical imaging modality in clinical applications. At the same time, the x-ray radiation dose associated with CT scans raises public concerns due to its potential risks to the patients. Over the past years, major efforts have been dedicated to the development of Low-Dose CT (LDCT) methods. However, the radiation dose reduction compromises the signal-to-noise ratio (SNR), leading to strong noise and artifacts that down-grade CT image quality. In this paper, we propose a novel 3D noise reduction method, called Structure-sensitive Multi-scale Generative Adversarial Net (SMGAN), to improve the LDCT image quality. Specifically, we incorporate three-dimensional (3D) volumetric information to improve the image quality. Also, different loss functions for training denoising models are investigated. Experiments show that the proposed method can effectively preserve structural and texture information from normal-dose CT (NDCT) images, and significantly suppress noise and artifacts. Qualitative visual assessments by three experienced radiologists demonstrate that the proposed method retrieves more detailed information, and outperforms competing methods.

cs.CV↗

arXiv2014

Controllable growth of 1-7 layers of graphene by chemical vapour deposition

We report that graphene films with thickness ranging from 1 to 7 layers can be controllably synthesized on the surface of polycrystalline copper by a chemical vapour deposition method. The number of layers of graphene is controlled precisely by regulating the flow ratio of CH4 and H2, the reaction pressure, the temperature and the reaction time. The synthesized graphene films were characterized by scanning electron microscopy, transmission electron microscopy, selected area electron diffraction, X-ray diffraction and Raman spectroscopy. In addition, the graphene films transferred from copper to other substrates are found to have a good optical transmittance that makes them suitable for transparent conductive materials.

cond-mat.mtrl-sci↗

arXiv2009

Polarization and Charge Transfer in the Hydration of Chloride Ions

A theoretical study of the structural and electronic properties of the chloride ion and water molecules in the first hydration shell is presented. The calculations are performed on an ensemble of configurations obtained from molecular dynamics simulations of a single chloride ion in bulk water. The simulations utilize the polarizable AMOEBA force field for trajectory generation, and MP2-level calculations are performed to examine the electronic structure properties of the ions and surrounding waters in the external field of more distant waters. The ChelpG method is employed to explore the effective charges and dipoles on the chloride ions and first-shell waters. The Quantum Theory of Atoms in Molecules (QTAIM) is further utilized to examine charge transfer from the anion to surrounding water molecules. From the QTAIM analysis, 0.2 elementary charges are transferred from the ion to the first-shell water molecules. The default AMOEBA model overestimates the average dipole moment magnitude of the ion compared with the estimated quantum mechanical value. The average magnitude of the dipole moment of the water molecules in the first shell treated at the MP2 level, with the more distant waters handled with an AMOEBA effective charge model, is 2.67 D. This value is close to the AMOEBA result for first-shell waters (2.72 D) and is slightly reduced from the bulk AMOEBA value (2.78 D). The magnitude of the dipole moment of the water molecules in the first solvation shell is most strongly affected by the local water-water interactions and hydrogen bonds with the second solvation shell, rather than by interactions with the ion.

cond-mat.soft↗