arXiv subjects

Ke Zhang

Publications and source records attributed to Ke Zhang.

At least 253 records · Page 14Linked to original sources

arXiv2022

ShapePU: A New PU Learning Framework Regularized by Global Consistency for Scribble Supervised Cardiac Segmentation

Cardiac segmentation is an essential step for the diagnosis of cardiovascular diseases. However, pixel-wise dense labeling is both costly and time-consuming. Scribble, as a form of sparse annotation, is more accessible than full annotations. However, it's particularly challenging to train a segmentation network with weak supervision from scribbles. To tackle this problem, we propose a new scribble-guided method for cardiac segmentation, based on the Positive-Unlabeled (PU) learning framework and global consistency regularization, and termed as ShapePU. To leverage unlabeled pixels via PU learning, we first present an Expectation-Maximization (EM) algorithm to estimate the proportion of each class in the unlabeled pixels. Given the estimated ratios, we then introduce the marginal probability maximization to identify the classes of unlabeled pixels. To exploit shape knowledge, we apply cutout operations to training images, and penalize the inconsistent segmentation results. Evaluated on two open datasets, i.e, ACDC and MSCMRseg, our scribble-supervised ShapePU surpassed the fully supervised approach respectively by 1.4% and 9.8% in average Dice, and outperformed the state-of-the-art weakly supervised and PU learning methods by large margins. Our code is available at https://github.com/BWGZK/ShapePU.

cs.CV↗

arXiv2022

Molecules with ALMA at Planet-forming Scales (MAPS) III: Characteristics of Radial Chemical Substructures

The Molecules with ALMA at Planet-forming Scales (MAPS) Large Program provides a detailed, high resolution (${\sim}$10-20 au) view of molecular line emission in five protoplanetary disks at spatial scales relevant for planet formation. Here, we present a systematic analysis of chemical substructures in 18 molecular lines toward the MAPS sources: IM Lup, GM Aur, AS 209, HD 163296, and MWC 480. We identify more than 200 chemical substructures, which are found at nearly all radii where line emission is detected. A wide diversity of radial morphologies - including rings, gaps, and plateaus - is observed both within each disk and across the MAPS sample. This diversity in line emission profiles is also present in the innermost 50 au. Overall, this suggests that planets form in varied chemical environments both across disks and at different radii within the same disk. Interior to 150 au, the majority of chemical substructures across the MAPS disks are spatially coincident with substructures in the millimeter continuum, indicative of physical and chemical links between the disk midplane and warm, elevated molecular emission layers. Some chemical substructures in the inner disk and most chemical substructures exterior to 150 au cannot be directly linked to dust substructure, however, which indicates that there are also other causes of chemical substructures, such as snowlines, gradients in UV photon fluxes, ionization, and radially-varying elemental ratios. This implies that chemical substructures could be developed into powerful probes of different disk characteristics, in addition to influencing the environments within which planets assemble. This paper is part of the MAPS special issue of the Astrophysical Journal Supplement.

astro-ph.EP↗

arXiv2022

Parallel Network with Channel Attention and Post-Processing for Carotid Arteries Vulnerable Plaque Segmentation in Ultrasound Images

Carotid arteries vulnerable plaques are a crucial factor in the screening of atherosclerosis by ultrasound technique. However, the plaques are contaminated by various noises such as artifact, speckle noise, and manual segmentation may be time-consuming. This paper proposes an automatic convolutional neural network (CNN) method for plaque segmentation in carotid ultrasound images using a small dataset. First, a parallel network with three independent scale decoders is utilized as our base segmentation network, pyramid dilation convolutions are used to enlarge receptive fields in the three segmentation sub-networks. Subsequently, the three decoders are merged to be rectified in channels by SENet. Thirdly, in test stage, the initially segmented plaque is refined by the max contour morphology post-processing to obtain the final plaque. Moreover, three loss function Dice loss, SSIM loss and cross-entropy loss are compared to segment plaques. Test results show that the proposed method with dice loss function yields a Dice value of 0.820, an IoU of 0.701, Acc of 0.969, and modified Hausdorff distance (MHD) of 1.43 for 30 vulnerable cases of plaques, it outperforms some of the conventional CNN-based methods on these metrics. Additionally, we apply an ablation experiment to show the validity of each proposed module. Our study provides some reference for similar researches and may be useful in actual applications for plaque segmentation of ultrasound carotid arteries.

eess.IV↗

arXiv2022

Recent advances and clinical applications of deep learning in medical image analysis

Deep learning has received extensive research interest in developing new medical image processing algorithms, and deep learning based models have been remarkably successful in a variety of medical imaging tasks to support disease detection and diagnosis. Despite the success, the further improvement of deep learning models in medical image analysis is majorly bottlenecked by the lack of large-sized and well-annotated datasets. In the past five years, many studies have focused on addressing this challenge. In this paper, we reviewed and summarized these recent studies to provide a comprehensive overview of applying deep learning methods in various medical image analysis tasks. Especially, we emphasize the latest progress and contributions of state-of-the-art unsupervised and semi-supervised deep learning in medical image analysis, which are summarized based on different application scenarios, including classification, segmentation, detection, and image registration. We also discuss the major technical challenges and suggest the possible solutions in future research efforts.

cs.CV↗

arXiv2022

InsCon:Instance Consistency Feature Representation via Self-Supervised Learning

Feature representation via self-supervised learning has reached remarkable success in image-level contrastive learning, which brings impressive performances on image classification tasks. While image-level feature representation mainly focuses on contrastive learning in single instance, it ignores the objective differences between pretext and downstream prediction tasks such as object detection and instance segmentation. In order to fully unleash the power of feature representation on downstream prediction tasks, we propose a new end-to-end self-supervised framework called InsCon, which is devoted to capturing multi-instance information and extracting cell-instance features for object recognition and localization. On the one hand, InsCon builds a targeted learning paradigm that applies multi-instance images as input, aligning the learned feature between corresponding instance views, which makes it more appropriate for multi-instance recognition tasks. On the other hand, InsCon introduces the pull and push of cell-instance, which utilizes cell consistency to enhance fine-grained feature representation for precise boundary localization. As a result, InsCon learns multi-instance consistency on semantic feature representation and cell-instance consistency on spatial feature representation. Experiments demonstrate the method we proposed surpasses MoCo v2 by 1.1% AP^{bb} on COCO object detection and 1.0% AP^{mk} on COCO instance segmentation using Mask R-CNN R50-FPN network structure with 90k iterations, 2.1% APbb on PASCAL VOC objection detection using Faster R-CNN R50-C4 network structure with 24k iterations.

cs.CV↗

arXiv2022

CEKD:Cross Ensemble Knowledge Distillation for Augmented Fine-grained Data

Data augmentation has been proved effective in training deep models. Existing data augmentation methods tackle the fine-grained problem by blending image pairs and fusing corresponding labels according to the statistics of mixed pixels, which produces additional noise harmful to the performance of networks. Motivated by this, we present a simple yet effective cross ensemble knowledge distillation (CEKD) model for fine-grained feature learning. We innovatively propose a cross distillation module to provide additional supervision to alleviate the noise problem, and propose a collaborative ensemble module to overcome the target conflict problem. The proposed model can be trained in an end-to-end manner, and only requires image-level label supervision. Extensive experiments on widely used fine-grained benchmarks demonstrate the effectiveness of our proposed model. Specifically, with the backbone of ResNet-101, CEKD obtains the accuracy of 89.59%, 95.96% and 94.56% in three datasets respectively, outperforming state-of-the-art API-Net by 0.99%, 1.06% and 1.16%.

cs.CV↗

arXiv2022

CycleMix: A Holistic Strategy for Medical Image Segmentation from Scribble Supervision

Curating a large set of fully annotated training data can be costly, especially for the tasks of medical image segmentation. Scribble, a weaker form of annotation, is more obtainable in practice, but training segmentation models from limited supervision of scribbles is still challenging. To address the difficulties, we propose a new framework for scribble learning-based medical image segmentation, which is composed of mix augmentation and cycle consistency and thus is referred to as CycleMix. For augmentation of supervision, CycleMix adopts the mixup strategy with a dedicated design of random occlusion, to perform increments and decrements of scribbles. For regularization of supervision, CycleMix intensifies the training objective with consistency losses to penalize inconsistent segmentation, which results in significant improvement of segmentation performance. Results on two open datasets, i.e., ACDC and MSCMRseg, showed that the proposed method achieved exhilarating performance, demonstrating comparable or even better accuracy than the fully-supervised methods. The code and expert-made scribble annotations for MSCMRseg are publicly available at https://github.com/BWGZK/CycleMix.

eess.IV↗

arXiv2022

Parallel Spatio-Temporal Attention-Based TCN for Multivariate Time Series Prediction

As industrial systems become more complex and monitoring sensors for everything from surveillance to our health become more ubiquitous, multivariate time series prediction is taking an important place in the smooth-running of our society. A recurrent neural network with attention to help extend the prediction windows is the current-state-of-the-art for this task. However, we argue that their vanishing gradients, short memories, and serial architecture make RNNs fundamentally unsuited to long-horizon forecasting with complex data. Temporal convolutional networks (TCNs) do not suffer from gradient problems and they support parallel calculations, making them a more appropriate choice. Additionally, they have longer memories than RNNs, albeit with some instability and efficiency problems. Hence, we propose a framework, called PSTA-TCN, that combines a parallel spatio-temporal attention mechanism to extract dynamic internal correlations with stacked TCN backbones to extract features from different window sizes. The framework makes full use parallel calculations to dramatically reduce training times, while substantially increasing accuracy with stable prediction windows up to 13 times longer than the status quo.

cs.LG↗

arXiv2022

Ultra-high-linearity integrated lithium niobate electro-optic modulators

Integrated lithium niobate (LN) photonics is a promising platform for future chip-scale microwave photonics systems owing to its unique electro-optic properties, low optical loss and excellent scalability. A key enabler for such systems is a highly linear electro-optic modulator that could faithfully covert analog electrical signals into optical signals. In this work, we demonstrate a monolithic integrated LN modulator with an ultrahigh spurious-free dynamic range (SFDR) of 120.04 dB Hz4/5 at 1 GHz, using a ring-assisted Mach-Zehnder interferometer configuration. The excellent synergy between the intrinsically linear electro-optic response of LN and an optimized linearization strategy allows us to fully suppress the cubic terms of third-order intermodulation distortions (IMD3) without active feedback controls, leading to ~ 20 dB improvement over previous results in the thin-film LN platform. Our ultra-high-linearity LN modulators could become a core building block for future large-scale functional microwave photonic integrated circuits, by further integration with other high-performance components like low-loss delay lines, tunable filters and phase shifters available on the LN platform.

physics.optics↗

arXiv2022

New Constraints on Protoplanetary Disk Gas Masses in Lupus

Gas mass is a fundamental quantity of protoplanetary disks that directly relates to their ability to form planets. Because we are unable to observe the bulk H$_2$ content of disks directly, we rely on indirect tracers to provide quantitative mass estimates. Current estimates for the gas masses of the observed disk population in the Lupus star-forming region are based on measurements of isotopologues of CO. However, without additional constraints, the degeneracy between H$_2$ mass and the elemental composition of the gas leads to large uncertainties in such estimates. Here we explore the gas compositions of seven disks from the Lupus sample representing a range of CO-to-dust ratios. With Band 6 and 7 ALMA observations, we measure line emission for HCO$^+$, HCN, and N$_2$H$^+$. We find a tentative correlation among the line fluxes for these three molecular species across the sample, but no correlation with $^{13}$CO or sub-mm continuum fluxes. For the three disks where N$_2$H$^+$ is detected, we find that a combination of high disk gas masses and sub-interstellar C/H and O/H are needed to reproduce the observed values. We find increases of $\sim$10-100$\times$ previous mass estimates are required to match the observed line fluxes. This study highlights how multi-molecular studies are essential for constraining the physical and chemical properties of the gas in populations of protoplanetary disks and that CO isotopologues alone are not sufficient for determining the mass of many observed disks.

astro-ph.EP↗

arXiv2022

Virtual Adversarial Training for Semi-supervised Breast Mass Classification

This study aims to develop a novel computer-aided diagnosis (CAD) scheme for mammographic breast mass classification using semi-supervised learning. Although supervised deep learning has achieved huge success across various medical image analysis tasks, its success relies on large amounts of high-quality annotations, which can be challenging to acquire in practice. To overcome this limitation, we propose employing a semi-supervised method, i.e., virtual adversarial training (VAT), to leverage and learn useful information underlying in unlabeled data for better classification of breast masses. Accordingly, our VAT-based models have two types of losses, namely supervised and virtual adversarial losses. The former loss acts as in supervised classification, while the latter loss aims at enhancing model robustness against virtual adversarial perturbation, thus improving model generalizability. To evaluate the performance of our VAT-based CAD scheme, we retrospectively assembled a total of 1024 breast mass images, with equal number of benign and malignant masses. A large CNN and a small CNN were used in this investigation, and both were trained with and without the adversarial loss. When the labeled ratios were 40% and 80%, VAT-based CNNs delivered the highest classification accuracy of 0.740 and 0.760, respectively. The experimental results suggest that the VAT-based CAD scheme can effectively utilize meaningful knowledge from unlabeled data to better classify mammographic breast mass images.

cs.CV↗

arXiv2021

The Smoothing Proximal Gradient Algorithm with Extrapolation for the Relaxation of $l_0$ Regularization Problem

In this paper, we consider the exact continuous relaxation model of $l_0$ regularization problem which was given by Bian and Chen (SIAM J. Numer. Anal 58(1): 858-883, 2020) and propose a smoothing proximal gradient algorithm with extrapolation (SPGE) for this kind of problem. We show that any accumulation point of the sequence generated by SPGE algorithm is a lifted stationary point of the relaxation model for a fairly general choice of extrapolation parameter. Moreover, it is shown that the whole sequence generated by SPGE algorithm converges to a lifted stationary point of the relaxation model. The convergence rate of $o(\frac{1}{k^{1-σ}})(σ\in(0,1))$ with respect to squared proximal residual is established. Finally, we conduct three important numerical experiments to illustrate the faster efficiency of the SPGE algorithm compared with the smoothing proximal gradient(SPG) algorithm proposed by Bian and Chen (SIAM J. Numer. Anal 58(1):858-883, 2020).

math.OC↗

arXiv2021

Effect of MHD wind-driven disk evolution on the observed sizes of protoplanetary disks

It is still unclear whether the evolution of protoplanetary disks, a key ingredient in the theory of planet formation, is driven by viscous turbulence or magnetic disk winds. As viscously evolving disks expand outward over time, the evolution of disk sizes is a discriminant test for studying disk evolution. However, it is unclear how the observed disk size changes over time if disk evolution is driven by magnetic disk winds. Combining the thermochemical code DALI with the analytical wind-driven disk evolution model presented in Tabone et al. (2021a), we study the time evolution of the observed gas outer radius as measured from CO rotational emission ($R_{\rm CO, 90\%}$). The evolution of $R_{\rm CO, 90\%}$ is driven by the evolution of the disk mass, as the physical radius stays constant over time. For a constant $α_{\rm DW}$, an extension of the $α-$Shakura-Sunyaev parameter to wind-driven accretion, $R_{\rm CO, 90\%}$ decreases linearly with time. Its initial size is set by the disk mass and the characteristic radius $R_c$, but only $R_c$ affects the evolution of $R_{\rm CO, 90\%}$, with a larger $R_c$ resulting in a steeper decrease of $R_{\rm CO, 90\%}$. For a time-dependent $α_{\rm DW}$ $R_{\rm CO, 90\%}$ stays approximately constant during most of the disk lifetime until $R_{\rm CO, 90\%}$ rapidly shrinks as the disk dissipates. The constant $α_{\rm DW}$-models are able to reproduce the observed gas disk sizes in the $\sim1-3$ Lupus and $\sim5-11$ Myr old Upper Sco star-forming regions. However, they likely overpredict the gas disk size of younger $(\lessapprox0.7\ \mathrm{Myr})$ disks.

astro-ph.EP↗

arXiv2021

Molecules with ALMA at Planet-forming Scales (MAPS). X. Studying deuteration at high angular resolution toward protoplanetary disks

Deuterium fractionation is dependent on various physical and chemical parameters. Thus, the formation location and thermal history of material in the solar system is often studied by measuring its D/H ratio. This requires knowledge about the deuteration processes operating during the planet formation era. We aim to study these processes by radially resolving the DCN/HCN (at 0.3" resolution) and N$_2$D$^+$/N$_2$H$^+$ (0.3 to 0.9") column density ratios toward the five protoplanetary disks observed by the Molecules with ALMA at Planet-forming scales (MAPS) Large Program. DCN is detected in all five sources, with one newly reported detection. N$_2$D$^+$ is detected in four sources, two of which are newly reported detections. We derive column density profiles that allow us to study the spatial variation of the DCN/HCN and N$_2$D$^+$/N$_2$H$^+$ ratios at high resolution. DCN/HCN varies considerably for different parts of the disks, ranging from $10^{-3}$ to $10^{-1}$. In particular, the inner disk regions generally show significantly lower HCN deuteration compared with the outer disk. In addition, our analysis confirms that two deuterium fractionation channels are active, which can alter the D/H ratio within the pool of organic molecules. N$_2$D$^+$ is found in the cold outer regions beyond $\sim$50 au, with N$_2$D$^+$/N$_2$H$^+$ ranging between $10^{-2}$ and 1 across the disk sample. This is consistent with the theoretical expectation that N$_2$H$^+$ deuteration proceeds via the low-temperature channel only. This paper is part of the MAPS special issue of the Astrophysical Journal Supplement.

astro-ph.SR↗

arXiv2021

Subgraph Federated Learning with Missing Neighbor Generation

Graphs have been widely used in data mining and machine learning due to their unique representation of real-world objects and their interactions. As graphs are getting bigger and bigger nowadays, it is common to see their subgraphs separately collected and stored in multiple local systems. Therefore, it is natural to consider the subgraph federated learning setting, where each local system holds a small subgraph that may be biased from the distribution of the whole graph. Hence, the subgraph federated learning aims to collaboratively train a powerful and generalizable graph mining model without directly sharing their graph data. In this work, towards the novel yet realistic setting of subgraph federated learning, we propose two major techniques: (1) FedSage, which trains a GraphSage model based on FedAvg to integrate node features, link structures, and task labels on multiple local subgraphs; (2) FedSage+, which trains a missing neighbor generator along FedSage to deal with missing links across local subgraphs. Empirical results on four real-world graph datasets with synthesized subgraph federated learning settings demonstrate the effectiveness and efficiency of our proposed techniques. At the same time, consistent theoretical implications are made towards their generalization ability on the global graphs.

cs.LG↗

arXiv2021

Maximize the Exploration of Congeneric Semantics for Weakly Supervised Semantic Segmentation

With the increase in the number of image data and the lack of corresponding labels, weakly supervised learning has drawn a lot of attention recently in computer vision tasks, especially in the fine-grained semantic segmentation problem. To alleviate human efforts from expensive pixel-by-pixel annotations, our method focuses on weakly supervised semantic segmentation (WSSS) with image-level tags, which are much easier to obtain. As a huge gap exists between pixel-level segmentation and image-level labels, how to reflect the image-level semantic information on each pixel is an important question. To explore the congeneric semantic regions from the same class to the maximum, we construct the patch-level graph neural network (P-GNN) based on the self-detected patches from different images that contain the same class labels. Patches can frame the objects as much as possible and include as little background as possible. The graph network that is established with patches as the nodes can maximize the mutual learning of similar objects. We regard the embedding vectors of patches as nodes, and use transformer-based complementary learning module to construct weighted edges according to the embedding similarity between different nodes. Moreover, to better supplement semantic information, we propose soft-complementary loss functions matched with the whole network structure. We conduct experiments on the popular PASCAL VOC 2012 benchmarks, and our model yields state-of-the-art performance.

cs.CV↗

arXiv2021

Molecules with ALMA at Planet-forming Scales (MAPS) II: CLEAN Strategies for Synthesizing Images of Molecular Line Emission in Protoplanetary Disks

The Molecules with ALMA at Planet-forming Scales large program (MAPS LP) surveyed the chemical structures of five protoplanetary disks across more than 40 different spectral lines at high angular resolution (0.15" and 0.30" beams for Bands 6 and 3, respectively) and sensitivity (spanning 0.3 - 1.3 mJy/beam and 0.4 - 1.9 mJy/beam for Bands 6 and 3, respectively). In this article, we describe our multi-stage workflow -- built around the CASA tclean image deconvolution procedure -- that we used to generate the core data product of the MAPS LP: the position-position-velocity image cubes for each spectral line. Owing to the expansive nature of the survey, we encountered a range of imaging challenges; some are familiar to the sub-mm protoplanetary disk community, like the benefits of using an accurate CLEAN mask, and others less well-known, like the incorrect default flux scaling of the CLEAN residual map first described in Jorsater & van Moorsel 1995 (the "JvM effect"). We distill lessons learned into recommended workflows for synthesizing image cubes of molecular emission. In particular, we describe how to produce image cubes with accurate fluxes via the "JvM correction," a procedure that is generally applicable to any image synthesized via CLEAN deconvolution but is especially critical for low S/N emission. We further explain how we used visibility tapering to promote a common, fiducial beam size and contextualize the interpretation of signal to noise ratio when detecting molecular emission from protoplanetary disks. This paper is part of the MAPS special issue of the Astrophysical Journal Supplement.

astro-ph.EP↗

arXiv2021

Molecules with ALMA at Planet-forming Scales (MAPS) XVII: Determining the 2D Thermal Structure of the HD 163296 Disk

Understanding the temperature structure of protoplanetary disks is key to interpreting observations, predicting the physical and chemical evolution of the disk, and modeling planet formation processes. In this study, we constrain the two-dimensional thermal structure of the disk around Herbig Ae star HD 163296. Using the thermo-chemical code RAC2D, we derive a thermal structure that reproduces spatially resolved ALMA observations (~0.12 arcsec (13 au) - 0.25 arcsec (26 au)) of CO J = 2-1, 13CO J = 1-0, 2-1, C18O J = 1-0, 2-1, and C17O J = 1-0, the HD J = 1-0 flux upper limit, the spectral energy distribution (SED), and continuum morphology. The final model incorporates both a radial depletion of CO motivated by a time scale shorter than typical CO gas-phase chemistry (0.01 Myr) and an enhanced temperature near the surface layer of the the inner disk (z/r <= 0.21). This model agrees with the majority of the empirically derived temperatures and observed emitting surfaces derived from the J = 2-1 CO observations. We find an upper limit for the disk mass of 0.35 Msun, using the upper limit of the HD J = 1-0 and J = 2-1 flux. With our final thermal structure, we explore the impact that gaps have on the temperature structure constrained by observations of the resolved gaps. Adding a large gap in the gas and small dust additionally increases gas temperature in the gap by only 5-10%. This paper is part of the MAPS special issue of the Astrophysical Journal Supplement.

astro-ph.EP↗