arXiv subjects

Hao Zheng

Publications and source records attributed to Hao Zheng.

At least 181 records · Page 10Linked to original sources

arXiv2022

Usable Region Estimate for Assessing Practical Usability of Medical Image Segmentation Models

We aim to quantitatively measure the practical usability of medical image segmentation models: to what extent, how often, and on which samples a model's predictions can be used/trusted. We first propose a measure, Correctness-Confidence Rank Correlation (CCRC), to capture how predictions' confidence estimates correlate with their correctness scores in rank. A model with a high value of CCRC means its prediction confidences reliably suggest which samples' predictions are more likely to be correct. Since CCRC does not capture the actual prediction correctness, it alone is insufficient to indicate whether a prediction model is both accurate and reliable to use in practice. Therefore, we further propose another method, Usable Region Estimate (URE), which simultaneously quantifies predictions' correctness and reliability of confidence assessments in one estimate. URE provides concrete information on to what extent a model's predictions are usable. In addition, the sizes of usable regions (UR) can be utilized to compare models: A model with a larger UR can be taken as a more usable and hence better model. Experiments on six datasets validate that the proposed evaluation methods perform well, providing a concrete and concise measure for the practical usability of medical image segmentation models. Code is made available at https://github.com/yizhezhang2000/ure.

eess.IV↗

arXiv2022

Disentangled Sequence to Sequence Learning for Compositional Generalization

There is mounting evidence that existing neural network models, in particular the very popular sequence-to-sequence architecture, struggle to systematically generalize to unseen compositions of seen components. We demonstrate that one of the reasons hindering compositional generalization relates to representations being entangled. We propose an extension to sequence-to-sequence models which encourages disentanglement by adaptively re-encoding (at each time step) the source input. Specifically, we condition the source representations on the newly decoded target context which makes it easier for the encoder to exploit specialized information for each prediction rather than capturing it all in a single forward pass. Experimental results on semantic parsing and machine translation empirically show that our proposal delivers more disentangled representations and better generalization.

cs.CL↗

arXiv2022

One dimensional gapped quantum phases and enriched fusion categories

In this work, we use Ising chain and Kitaev chain to check the validity of an earlier proposal in arXiv:2011.02859 that enriched fusion (higher) categories provide a unified categorical description of all gapped/gapless quantum liquid phases, including symmetry-breaking phases, topological orders, SPT/SET orders and certain gapless quantum phases. In particular, we show explicitly that, in each gapped phase realized by these two models, the spacetime observables form a fusion category enriched in a braided fusion category. We also study the categorical descriptions of the boundaries of these models. In the end, we provide a classification of and the categorical descriptions of all 1-dimensional (the spatial dimension) gapped quantum phases with a finite onsite symmetry.

cond-mat.str-el↗

arXiv2022

Deep Bidirectional Transformers for SoC Flow Specification Mining

High-quality system-level message flow specifications can lead to comprehensive validation of system-on-chip (SoC) designs. We propose a disruptive method that utilizes an attention mechanism to produce accurate flow specifications from SoC IP communication traces. The proposed method can overcome the inherent complexity of SoC traces induced by the concurrency and parallelism of multicore designs that existing flow specification mining tools often find extremely challenging. Experiments on highly interleaved traces show promising flow reconstruction compared to several tools dedicated to the flow specification mining problem.

cs.LG↗

arXiv2022

LTSP: Long-Term Slice Propagation for Accurate Airway Segmentation

Purpose: Bronchoscopic intervention is a widely-used clinical technique for pulmonary diseases, which requires an accurate and topological complete airway map for its localization and guidance. The airway map could be extracted from chest computed tomography (CT) scans automatically by airway segmentation methods. Due to the complex tree-like structure of the airway, preserving its topology completeness while maintaining the segmentation accuracy is a challenging task. Methods: In this paper, a long-term slice propagation (LTSP) method is proposed for accurate airway segmentation from pathological CT scans. We also design a two-stage end-to-end segmentation framework utilizing the LTSP method in the decoding process. Stage 1 is used to generate a coarse feature map by an encoder-decoder architecture. Stage 2 is to adopt the proposed LTSP method for exploiting the continuity information and enhancing the weak airway features in the coarse feature map. The final segmentation result is predicted from the refined feature map. Results: Extensive experiments were conducted to evaluate the performance of the proposed method on 70 clinical CT scans. The results demonstrate the considerable improvements of the proposed method compared to some state-of-the-art methods as most breakages are eliminated and more tiny bronchi are detected. The ablation studies further confirm the effectiveness of the constituents of the proposed method. Conclusion: Slice continuity information is beneficial to accurate airway segmentation. Furthermore, by propagating the long-term slice feature, the airway topology connectivity is preserved with overall segmentation accuracy maintained.

eess.IV↗

arXiv2022

Topological Defects Induced High-Spin Quartet State in Truxene-Based Molecular Graphenoids

Topological defects in graphene materials introduce exotic properties which are absent in their defect-free counterparts with both fundamental importance and technological implications. Although individual topological defects have been widely studied, collective magnetic behaviors originating from well-organized multiple topological defects remain a great challenge. Here, we studied the collective magnetic properties originating from three pentagon topological defects in truxene-based molecular graphenoids by using scanning tunneling microscopy and non-contact atomic force microscopy. Unpaired $π$ electrons are introduced into the aromatic topology of truxene molecular graphenoids one by one by dissociating hydrogen atoms at the pentagon defects via atom manipulation. Scanning tunneling spectroscopy measurements together with density functional theory calculations suggest that the unpaired electrons are ferromagnetically coupled, forming a collective high-spin quartet state of S=3/2. Our work demonstrates that the collective spin ordering can be realized through engineering regular patterned topological defects in molecular graphenoids, providing a new platform for designer one-dimensional ferromagnetic spin chains and two-dimensional ferromagnetic networks.

cond-mat.mes-hall↗

arXiv2022

Competing Charge/Spin-Stripe and Correlated Metal Phases in Trilayer Nickelates (Pr$_{1-x}$La$_x$)$_4$Ni$_3$O$_8$

Low-valent nickelates R$_{n+1}$Ni$_n$O$_{2n+2}$ (R = rare earth) containing Ni$^{1+}$ (d$^{9}$) with a quasi-two-dimensional (quasi-2D) square planar coordination geometry possess structural and electronic properties that are similar to those of high-Tc cuprates, including superconductivity itself in the doped infinite layer ($n = \infty$) RNiO$_2$ system. Within this R$_{n+1}$Ni$_n$O$_{2n+2}$ nickelate family, the crystallographic isomorphs Pr$_4$Ni$_3$O$_8$ and La$_4$Ni$_3$O$_8$ exhibit singularly different ground states: Pr$_4$Ni$_3$O$_8$ is metallic and La$_4$Ni$_3$O$_8$ is a charge- and spin-stripe ordered insulator. To explore and understand the ground state evolution from metallic Pr$_4$Ni$_3$O$_8$ to stripe-ordered La$_4$Ni$_3$O$_8$ in the R$_4$Ni$_3$O$_8$ family, we have grown a series of isovalent-substituted single crystals (Pr$_{1-x}$La$_x$)$_4$Ni$_3$O$_8$. Combining thermodynamic, transport, magnetic, and synchrotron X-ray single crystal diffraction measurements, we reveal a transition between metallic and stripe-insulator phase regions, with a putative quantum phase transition at x = 0.4. We propose two possible models for (Pr$_{1-x}$La$_x$)$_4$Ni$_3$O$_8$: an electronically inhomogeneous system that could serve as a candidate for exploring quantum Griffiths phase physics and a homogeneous system with a putative quantum critical point at the phase boundary.

cond-mat.str-el↗

arXiv2022

BREAK: Bronchi Reconstruction by gEodesic transformation And sKeleton embedding

Airway segmentation is critical for virtual bronchoscopy and computer-aided pulmonary disease analysis. In recent years, convolutional neural networks (CNNs) have been widely used to delineate the bronchial tree. However, the segmentation results of the CNN-based methods usually include many discontinuous branches, which need manual repair in clinical use. A major reason for the breakages is that the appearance of the airway wall can be affected by the lung disease as well as the adjacency of the vessels, while the network tends to overfit to these special patterns in the training set. To learn robust features for these areas, we design a multi-branch framework that adopts the geodesic distance transform to capture the intensity changes between airway lumen and wall. Another reason for the breakages is the intra-class imbalance. Since the volume of the peripheral bronchi may be much smaller than the large branches in an input patch, the common segmentation loss is not sensitive to the breakages among the distal branches. Therefore, in this paper, a breakage-sensitive regularization term is designed and can be easily combined with other loss functions. Extensive experiments are conducted on publicly available datasets. Compared with state-of-the-art methods, our framework can detect more branches while maintaining competitive segmentation performance.

eess.IV↗

arXiv2022

Categories of quantum liquids III

We continue our study of the categories of quantum liquids started in a previous work. We combine local quantum symmetries with topological skeletons into a single mathematical theory of topological nets and defect nets. In particular, we introduce the notion of a topological net, which is motivated from and generalizes that of a conformal net, and the notion of a defect net which generalizes that of a defect between conformal nets. We give explicit examples of them. Moreover, we construct the category of topological $n$-nets with $k$-morphisms defined by defect $n$-nets of codimension $k$, and show that the category of $n$D quantum liquids can be extracted from it and computed explicitly via the condensation theory of topological nets.

hep-th↗

arXiv2021

Compositional Generalization via Semantic Tagging

Although neural sequence-to-sequence models have been successfully applied to semantic parsing, they fail at compositional generalization, i.e., they are unable to systematically generalize to unseen compositions of seen components. Motivated by traditional semantic parsing where compositionality is explicitly accounted for by symbolic grammars, we propose a new decoding framework that preserves the expressivity and generality of sequence-to-sequence models while featuring lexicon-style alignments and disentangled information processing. Specifically, we decompose decoding into two phases where an input utterance is first tagged with semantic symbols representing the meaning of individual words, and then a sequence-to-sequence model is used to predict the final meaning representation conditioning on the utterance and the predicted tag sequence. Experimental results on three semantic parsing datasets show that the proposed approach consistently improves compositional generalization across model architectures, domains, and semantic formalisms.

cs.CL↗

arXiv2021

FDA: Feature Decomposition and Aggregation for Robust Airway Segmentation

3D Convolutional Neural Networks (CNNs) have been widely adopted for airway segmentation. The performance of 3D CNNs is greatly influenced by the dataset while the public airway datasets are mainly clean CT scans with coarse annotation, thus difficult to be generalized to noisy CT scans (e.g. COVID-19 CT scans). In this work, we proposed a new dual-stream network to address the variability between the clean domain and noisy domain, which utilizes the clean CT scans and a small amount of labeled noisy CT scans for airway segmentation. We designed two different encoders to extract the transferable clean features and the unique noisy features separately, followed by two independent decoders. Further on, the transferable features are refined by the channel-wise feature recalibration and Signed Distance Map (SDM) regression. The feature recalibration module emphasizes critical features and the SDM pays more attention to the bronchi, which is beneficial to extracting the transferable topological features robust to the coarse labels. Extensive experimental results demonstrated the obvious improvement brought by our proposed method. Compared to other state-of-the-art transfer learning methods, our method accurately segmented more bronchi in the noisy CT scans.

eess.IV↗

arXiv2021

Electronic nature of chiral charge order in the kagome superconductor CsV3Sb5

Kagome superconductors with Tc up to 7K have been discovered over 40 years. Recently, unconventional chiral charge order has been reported in kagome superconductor KV3Sb5, with an ordering temperature of one order of magnitude higher than the TC. However, the chirality of the charge order has not been reported in the cousin kagome superconductor CsV3Sb5, and the electronic nature of the chirality remains elusive. In this letter, we report the observation of electronic chiral charge order in CsV3Sb5 via scanning tunneling microscopy (STM). We observe a 2x2 charge modulation and a 1x4 superlattice in both topographic data and tunneling spectroscopy. 2x2 charge modulation is highly anticipated as a charge order by fundamental kagome lattice models at van Hove filling, and is shown to exhibit intrinsic chirality. We find that the 1x4 superlattices forms various small domain walls, and can be a surface effect as supported by our first-principles calculations. Crucially, we find that the amplitude of the energy gap opened by the charge order exhibits real space modulations, and features 2x2 wave vectors with chirality, highlighting the electronic nature of the chiral charge order. STM study at 0.4K reveals a superconducting energy gap with a gap size 2Δ=0.85meV, which estimates a moderate superconductivity coupling strength with 2Δ/kBTc=3.9. When further applying a c-axis magnetic field, vortex core bound states are observed within this gap, indicative of clean-limit superconductivity.

cond-mat.str-el↗

arXiv2021

Robust topological state against magnetic impurities observed in superconductor PbTaSe2

Magnetic impurities deposited on topological superconductor candidate PbTaSe2 can introduce a non-splitting zero-energy state inside the superconducting gap, which has been proposed as a field-free platform for topological zero modes. However, it is still unclear how robust the topological state in PbTaSe2 is against magnetic impurities, which is related to the topological nature of the zero-energy state as well as its potential for quantum computation. In this work, we use scanning tunneling microscopy (STM) to study the topological surface state in the normal state of PbTaSe2 under the perturbation of magnetic impurities. We visualize the quasi-particle interference (QPI) arising from the topological surface state. We then deposit Fe impurities on the surface to form atomic Fe adatoms. We find that each Fe adatom sits at a unique interstitial position on the surface and features a local state at high energies, both of which are consistent with our first-principles calculation that further reveals its large magnetic moment. Our systematic Fe deposition and subsequent measurements show that the arc-like QPI pattern at the Fermi energy is robust with up to 3% Fe coverage where the atomic nature of Fe adatoms still holds. Our results provide evidence that the topological surface state at the Fermi energy in PbTaSe2 is robust against dilute magnetic impurities.

cond-mat.supr-con↗

arXiv2021

The power of flexible lattice in Ca3Ru2O7: Exquisite control of the electrical transport via anisotropic magnetostriction

Ca3Ru2O7 is a correlated and spin-orbit-coupled system with an extraordinary anisotropy. It is both interesting and unique largely because this material exhibits conflicting phenomena that are often utterly inconsistent with traditional precedents, particularly, the quantum oscillations in the nonmetallic state and colossal magnetoresistivity achieved by avoiding a fully spin-polarized state. This work focuses on the relationship between the lattice and transport properties along each crystalline axis and reveals that application of magnetic field, H, along different crystalline axes readily stretches or shrinks the lattice in a uniaxial manner, resulting in distinct electronic states. Furthermore, application of modest pressure drastically amplifies the anisotropic magnetoelastic effect, leading to either an occurrence of a robust metallic state at H || hard axis or a reentrance of the nonmetallic state at H || easy axis. Ca3Ru2O7 presents a rare lattice-dependent magnetotransport mechanism, in which the extraordinary lattice flexibility enables an exquisite control of the electronic state via magnetically stretching or shrinking the crystalline axes, and the spin polarization plays an unconventional role unfavorable for maximizing conductivity. At the heart of the intriguing physics is the anisotropic magnetostriction that leads to exotic states.

cond-mat.str-el↗

arXiv2021

Hierarchical Self-Supervised Learning for Medical Image Segmentation Based on Multi-Domain Data Aggregation

A large labeled dataset is a key to the success of supervised deep learning, but for medical image segmentation, it is highly challenging to obtain sufficient annotated images for model training. In many scenarios, unannotated images are abundant and easy to acquire. Self-supervised learning (SSL) has shown great potentials in exploiting raw data information and representation learning. In this paper, we propose Hierarchical Self-Supervised Learning (HSSL), a new self-supervised framework that boosts medical image segmentation by making good use of unannotated data. Unlike the current literature on task-specific self-supervised pretraining followed by supervised fine-tuning, we utilize SSL to learn task-agnostic knowledge from heterogeneous data for various medical image segmentation tasks. Specifically, we first aggregate a dataset from several medical challenges, then pre-train the network in a self-supervised manner, and finally fine-tune on labeled data. We develop a new loss function by combining contrastive loss and classification loss and pretrain an encoder-decoder architecture for segmentation tasks. Our extensive experiments show that multi-domain joint pre-training benefits downstream segmentation tasks and outperforms single-domain pre-training significantly. Compared to learning from scratch, our new method yields better performance on various tasks (e.g., +0.69% to +18.60% in Dice scores with 5% of annotated data). With limited amounts of training data, our method can substantially bridge the performance gap w.r.t. denser annotations (e.g., 10% vs.~100% of annotated data).

cs.CV↗

arXiv2021

Brain-inspired global-local learning incorporated with neuromorphic computing

Two main routes of learning methods exist at present including error-driven global learning and neuroscience-oriented local learning. Integrating them into one network may provide complementary learning capabilities for versatile learning scenarios. At the same time, neuromorphic computing holds great promise, but still needs plenty of useful algorithms and algorithm-hardware co-designs for exploiting the advantages. Here, we report a neuromorphic hybrid learning model by introducing a brain-inspired meta-learning paradigm and a differentiable spiking model incorporating neuronal dynamics and synaptic plasticity. It can meta-learn local plasticity and receive top-down supervision information for multiscale synergic learning. We demonstrate the advantages of this model in multiple different tasks, including few-shot learning, continual learning, and fault-tolerance learning in neuromorphic vision sensors. It achieves significantly higher performance than single-learning methods, and shows promise in empowering neuromorphic applications revolution. We further implemented the hybrid model in the Tianjic neuromorphic platform by exploiting algorithm-hardware co-designs and proved that the model can fully utilize neuromorphic many-core architecture to develop hybrid computation paradigm.

cs.NE↗

arXiv2021

LenAtten: An Effective Length Controlling Unit For Text Summarization

Fixed length summarization aims at generating summaries with a preset number of words or characters. Most recent researches incorporate length information with word embeddings as the input to the recurrent decoding unit, causing a compromise between length controllability and summary quality. In this work, we present an effective length controlling unit Length Attention (LenAtten) to break this trade-off. Experimental results show that LenAtten not only brings improvements in length controllability and ROGUE scores but also has great generalization ability. In the task of generating a summary with the target length, our model is 732 times better than the best-performing length controllable summarizer in length controllability on the CNN/Daily Mail dataset.

cs.CL↗

arXiv2021

Alleviating Class-wise Gradient Imbalance for Pulmonary Airway Segmentation

Automated airway segmentation is a prerequisite for pre-operative diagnosis and intra-operative navigation for pulmonary intervention. Due to the small size and scattered spatial distribution of peripheral bronchi, this is hampered by severe class imbalance between foreground and background regions, which makes it challenging for CNN-based methods to parse distal small airways. In this paper, we demonstrate that this problem is arisen by gradient erosion and dilation of the neighborhood voxels. During back-propagation, if the ratio of the foreground gradient to background gradient is small while the class imbalance is local, the foreground gradients can be eroded by their neighborhoods. This process cumulatively increases the noise information included in the gradient flow from top layers to the bottom ones, limiting the learning of small structures in CNNs. To alleviate this problem, we use group supervision and the corresponding WingsNet to provide complementary gradient flows to enhance the training of shallow layers. To further address the intra-class imbalance between large and small airways, we design a General Union loss function which obviates the impact of airway size by distance-based weights and adaptively tunes the gradient ratio based on the learning process. Extensive experiments on public datasets demonstrate that the proposed method can predict the airway structures with higher accuracy and better morphological completeness than the baselines.

eess.IV↗