arXiv Science⌕ Search

arXiv subjects

Jie Yang

Publications and source records attributed to Jie Yang.

At least 451 records · Page 25Linked to original sources
arXiv2022

BREAK: Bronchi Reconstruction by gEodesic transformation And sKeleton embedding

Airway segmentation is critical for virtual bronchoscopy and computer-aided pulmonary disease analysis. In recent years, convolutional neural networks (CNNs) have been widely used to delineate the bronchial tree. However, the segmentation results of the CNN-based methods usually include many discontinuous branches, which need manual repair in clinical use. A major reason for the breakages is that the appearance of the airway wall can be affected by the lung disease as well as the adjacency of the vessels, while the network tends to overfit to these special patterns in the training set. To learn robust features for these areas, we design a multi-branch framework that adopts the geodesic distance transform to capture the intensity changes between airway lumen and wall. Another reason for the breakages is the intra-class imbalance. Since the volume of the peripheral bronchi may be much smaller than the large branches in an input patch, the common segmentation loss is not sensitive to the breakages among the distal branches. Therefore, in this paper, a breakage-sensitive regularization term is designed and can be easily combined with other loss functions. Extensive experiments are conducted on publicly available datasets. Compared with state-of-the-art methods, our framework can detect more branches while maintaining competitive segmentation performance.

eess.IV↗
arXiv2021

Generalized higher connections and Yang-Mills

We first extend Generalized Differential Calculus (GDC) to higher structures and create generalized G-invariant bilinear forms. In addition, we also focus on developing generalized 2- and 3-connection theories in the framework of GDC. Then, we derive the higher Bianchi-Identities and study the gauge transformations for those generalized higher connections. Finally, we establish the generalized 2- and 3-form Yang-Mills theories based on GDC and obtain the corresponding fields equations.

hep-th↗
arXiv2021

Modeling Sparse Data Using MLE with Applications to Microbiome Data

Modeling sparse data such as microbiome and transcriptomics (RNA-seq) data is very challenging due to the exceeded number of zeros and skewness of the distribution. Many probabilistic models have been used for modeling sparse data, including Poisson, negative binomial, zero-inflated Poisson, and zero-inflated negative binomial models. One way to identify the most appropriate probabilistic models for zero-inflated or hurdle models is based on the p-value of the Kolmogorov-Smirnov (KS) test. The main challenge for identifying the probabilistic model is that the model parameters are typically unknown in practice. This paper derives the maximum likelihood estimator (MLE) for a general class of zero-inflated and hurdle models. We also derive the corresponding Fisher information matrices for exploring the estimator's asymptotic properties. We include new probabilistic models such as zero-inflated beta binomial and zero-inflated beta negative binomial models. Our application to microbiome data shows that our new models are more appropriate for modeling microbiome data than commonly used models in the literature.

stat.ME↗
arXiv2021

Score-Matching Representative Approach for Big Data Analysis with Generalized Linear Models

We propose a fast and efficient strategy, called the representative approach, for big data analysis with generalized linear models, especially for distributed data with localization requirements or limited network bandwidth. With a given partition of massive dataset, this approach constructs a representative data point for each data block and fits the target model using the representative dataset. In terms of time complexity, it is as fast as the subsampling approaches in the literature. As for efficiency, its accuracy in estimating parameters given a homogeneous partition is comparable with the divide-and-conquer method. Supported by comprehensive simulation studies and theoretical justifications, we conclude that mean representatives (MR) work fine for linear models or generalized linear models with a flat inverse link function and moderate coefficients of continuous predictors. For general cases, we recommend the proposed score-matching representatives (SMR), which may improve the accuracy of estimators significantly by matching the score function values. As an illustrative application to the Airline on-time performance data, we show that the MR and SMR estimates are as good as the full data estimate when available.

stat.ME↗
arXiv2021

Better Pay Attention Whilst Fuzzing

Fuzzing is one of the prevailing methods for vulnerability detection. However, even state-of-the-art fuzzing methods become ineffective after some period of time, i.e., the coverage hardly improves as existing methods are ineffective to focus the attention of fuzzing on covering the hard-to-trigger program paths. In other words, they cannot generate inputs that can break the bottleneck due to the fundamental difficulty in capturing the complex relations between the test inputs and program coverage. In particular, existing fuzzers suffer from the following main limitations: 1) lacking an overall analysis of the program to identify the most "rewarding" seeds, and 2) lacking an effective mutation strategy which could continuously select and mutates the more relevant "bytes" of the seeds. In this work, we propose an approach called ATTuzz to address these two issues systematically. First, we propose a lightweight dynamic analysis technique which estimates the "reward" of covering each basic block and selects the most rewarding seeds accordingly. Second, we mutate the selected seeds according to a neural network model which predicts whether a certain "rewarding" block will be covered given certain mutation on certain bytes of a seed. The model is a deep learning model equipped with attention mechanism which is learned and updated periodically whilst fuzzing. Our evaluation shows that ATTuzz significantly outperforms 5 state-of-the-art grey-box fuzzers on 13 popular real-world programs at achieving higher edge coverage and finding new bugs. In particular, ATTuzz achieved 2X edge coverage and 4X bugs detected than AFL over 24-hour runs. Moreover, ATTuzz persistently improves the edge coverage in the long run, i.e., achieving 50% more coverage than AFL in 5 days.

cs.CR↗
arXiv2021

On the Value of ML Models

We argue that, when establishing and benchmarking Machine Learning (ML) models, the research community should favour evaluation metrics that better capture the value delivered by their model in practical applications. For a specific class of use cases -- selective classification -- we show that not only can it be simple enough to do, but that it has import consequences and provides insights what to look for in a ``good'' ML model.

cs.LG↗
arXiv2021

Relationship between pulmonary nodule malignancy and surrounding pleurae, airways and vessels: a quantitative study using the public LIDC-IDRI dataset

To investigate whether the pleurae, airways and vessels surrounding a nodule on non-contrast computed tomography (CT) can discriminate benign and malignant pulmonary nodules. The LIDC-IDRI dataset, one of the largest publicly available CT database, was exploited for study. A total of 1556 nodules from 694 patients were involved in statistical analysis, where nodules with average scorings <3 and >3 were respectively denoted as benign and malignant. Besides, 339 nodules from 113 patients with diagnosis ground-truth were independently evaluated. Computer algorithms were developed to segment pulmonary structures and quantify the distances to pleural surface, airways and vessels, as well as the counting number and normalized volume of airways and vessels near a nodule. Odds ratio (OR) and Chi-square (χ^2) testing were performed to demonstrate the correlation between features of surrounding structures and nodule malignancy. A non-parametric receiver operating characteristic (ROC) analysis was conducted in logistic regression to evaluate discrimination ability of each structure. For benign and malignant groups, the average distances from nodules to pleural surface, airways and vessels are respectively (6.56, 5.19), (37.08, 26.43) and (1.42, 1.07) mm. The correlation between nodules and the counting number of airways and vessels that contact or project towards nodules are respectively (OR=22.96, χ^2=105.04) and (OR=7.06, χ^2=290.11). The correlation between nodules and the volume of airways and vessels are (OR=9.19, χ^2=159.02) and (OR=2.29, χ^2=55.89). The areas-under-curves (AUCs) for pleurae, airways and vessels are respectively 0.5202, 0.6943 and 0.6529. Our results show that malignant nodules are often surrounded by more pulmonary structures compared with benign ones, suggesting that features of these structures could be viewed as lung cancer biomarkers.

cs.CV↗
arXiv2021

Sliding Ferroelectric Tunnel Junctions

Very recently, ferroelectric polarization in staggered bilayer hexagonal boron nitride (BBN) and its novel sliding inversion mechanism was reported experimentally (Science 2021, 372, 1458; 2021, 372, 1462), which paves a new way to realize van der Waals (vdW) ferroelectric devices with new functionalities. Here, we develop vdW sliding ferroelectric tunnel junctions (FTJs) using the sliding ferroelectric BBN unit as ultrathin barriers and explore their transport properties with different ferroelectric states and metal contacts via the first principles. It is found that the electrode/BBN contact electric field quenches the ferroelectricity in the staggered BBN, resulting a very small tunnelling electroresistance (TER). Inserting high-mobility 2D materials between Au and BN can restore the BBN ferroelectricity, reaching a giant TER of ~10,000% in sliding FTJs. We finally investigate the metal-contact and thickness effect on the tunnelling property of sliding FTJs. The giant TER and multiple non-volatile resistance states in vdW sliding FTJs show the promising applications in voltage-controlled nano-memories with ultrahigh storage density.

cond-mat.mtrl-sci↗
arXiv2021

Ultrafast formation of transient 2D diamond-like structure in twisted bilayer graphene

Due to the absence of matching carbon atoms at honeycomb centers with carbon atoms in adjacent graphene sheets, theorists predicted that a sliding process is needed to form AA, AB, or ABC stacking when directly converting graphite into sp3 bonded diamond. Here, using twisted bilayer graphene, which naturally provides AA and AB stacking configurations, we report the ultrafast formation of a transient 2D diamond-like structure (which is not observed in aligned graphene) under femtosecond laser irradiation. This photo-induced phase transition is evidenced by the appearance of new bond lengths of 1.94A and 3.14A in the time-dependent differential pair distribution function using MeV ultrafast electron diffraction. Molecular dynamics and first principles calculation indicate that sp3 bonds nucleate at AA and AB stacked areas in moire pattern. This work sheds light on the direct graphite-to-diamond transformation mechanism, which has not been fully understood for more than 60 years.

cond-mat.mtrl-sci↗
arXiv2021

One-shot Distributed Algorithm for Generalized Eigenvalue Problem

Nowadays, more and more datasets are stored in a distributed way for the sake of memory storage or data privacy. The generalized eigenvalue problem (GEP) plays a vital role in a large family of high-dimensional statistical models. However, the existing distributed method for eigenvalue decomposition cannot be applied in GEP for the divergence of the empirical covariance matrix. Here we propose a general distributed GEP framework with one-shot communication for GEP. If the symmetric data covariance has repeated eigenvalues, e.g., in canonical component analysis, we further modify the method for better convergence. The theoretical analysis on approximation error is conducted and the relation to the divergence of the data covariance, the eigenvalues of the empirical data covariance, and the number of local servers is analyzed. Numerical experiments also show the effectiveness of the proposed algorithms.

cs.LG↗
arXiv2021

Structural Origin of Boson Peak in Glasses

Boson peak, the excess low energy excitations in the terahertz regime, is one of the most unique features of disordered systems and has been linked to many anomalous properties of glass materials. The nature and structural origin of the boson peak remain elusive and have been debated for more than a half century mainly due to the lack of real-time and real-space experimental insights of the dynamic phenomenon. In this work we employed femtosecond MeV ultrafast electron diffraction to characterize the atomic dynamics of metallic glasses in real time. The experiment reveals collective atomic oscillations, presented in elastic electron scattering and atomic pair distribution functions, within the boson peak frequency range of 1.0-1.8 THz in both reciprocal and real space. It was found that the oscillation frequency has reciprocal dependence on interatomic pair distances and the corresponding wave velocity experimentally affirms the transverse acoustic wave nature of the boson peak. The observed strong correlation between THz acoustic vibrations and coherent electron scattering provides compelling evidence that the boson peak originates from the collective transverse vibrational modes of structurally ordered atoms in the disordered system.

cond-mat.dis-nn↗
arXiv2021

Sub-Gbps key rate four-state continuous-variable quantum key distribution within metropolitan area

Continuous-variable quantum key distribution (CVQKD) has potential advantages of high secret key rate, which is very suitable for high-speed metropolitan network application. However, the reported highest secret key rates of the CVQKD systems up to now are limited in a few Mbps. Here, we address the fundamental experimental problems and demonstrate a single-carrier four-state CVQKD with sub-Gbps key rate within metropolitan area. In the demonstrated four-state CVQKD using local local oscillator, an ultra-low level of excess noise is obtained and a high efficient post-processing setup is designed for practically extracting the final secure keys. Thus, the achieved secure key rates are 190.54 Mbps and 137.76 Mbps and 52.48 Mbps using linear channel assuming security analysis method and 233.87 Mbps, 133.6 Mbps and 21.53 Mbps using semidefinite programming security analysis method over transmission distances of 5 km, 10 km and 25 km, respectively. This record-breaking result increases the previous secret key rate record by an order of magnitude, which is sufficient to achieve the one-time pad cryptographic task. Our work shows the road for future high-rate and large-scale CVQKD deployment in secure broadband metropolitan and access networks.

quant-ph↗
arXiv2021

Symmetry-protected Spoof Localized Surface Plasmonic Skyrmion

Electromagnetic (EM) skyrmions are an EM analogue of the skyrmions in condensed matter physics, which offer new degrees of freedom to structure light and manipulate light matter interactions and thus promise various groundbreaking applications in optics and photonics. Recently, there is a growing interest in composing EM skyrmions based on different field vectors of EM waves. Here, we realize an EM skyrmion, i.e., a spoof plasmonic skyrmion, using the electric field vectors of spoof localized surface plasmons (spoof LSPs) in a planar microwave resonator with rotational and mirroring symmetries. We construct the spoof plasmonic skyrmion, which holds a hedgehog-like configuration in its electric field vectors, by synthesizing a scalar vortex with a topological charge 0 in the out-of-plane component of the fields, and a polarization vortex with a topological charge 1 in the in-plane component of the fields. Besides an experimental demonstration of this skyrmion, we employ group representation theory and pinpoint the symmetry origin of the skyrmion. Such an investigation demonstrates the ubiquity of the existence of the skyrmion in any planar EM resonator holding rotational and mirroring symmetries, regardless the dimensions and the operating frequencies. The designed skyrmion not only promises novel microwave applications for sensing, processing, storing and transferring information, but also lays down a general guideline for devising skyrmions operating over a broad range in the EM spectra owing to the fact that the conducted symmetry investigation is independent of specific dimension or frequency.

physics.app-ph↗
arXiv2021

A Survey on Extraction of Causal Relations from Natural Language Text

As an essential component of human cognition, cause-effect relations appear frequently in text, and curating cause-effect relations from text helps in building causal networks for predictive tasks. Existing causality extraction techniques include knowledge-based, statistical machine learning(ML)-based, and deep learning-based approaches. Each method has its advantages and weaknesses. For example, knowledge-based methods are understandable but require extensive manual domain knowledge and have poor cross-domain applicability. Statistical machine learning methods are more automated because of natural language processing (NLP) toolkits. However, feature engineering is labor-intensive, and toolkits may lead to error propagation. In the past few years, deep learning techniques attract substantial attention from NLP researchers because of its' powerful representation learning ability and the rapid increase in computational resources. Their limitations include high computational costs and a lack of adequate annotated training data. In this paper, we conduct a comprehensive survey of causality extraction. We initially introduce primary forms existing in the causality extraction: explicit intra-sentential causality, implicit causality, and inter-sentential causality. Next, we list benchmark datasets and modeling assessment methods for causal relation extraction. Then, we present a structured overview of the three techniques with their representative systems. Lastly, we highlight existing open challenges with their potential directions.

cs.IR↗
arXiv2021

OctField: Hierarchical Implicit Functions for 3D Modeling

Recent advances in localized implicit functions have enabled neural implicit representation to be scalable to large scenes. However, the regular subdivision of 3D space employed by these approaches fails to take into account the sparsity of the surface occupancy and the varying granularities of geometric details. As a result, its memory footprint grows cubically with the input volume, leading to a prohibitive computational cost even at a moderately dense decomposition. In this work, we present a learnable hierarchical implicit representation for 3D surfaces, coded OctField, that allows high-precision encoding of intricate surfaces with low memory and computational budget. The key to our approach is an adaptive decomposition of 3D scenes that only distributes local implicit functions around the surface of interest. We achieve this goal by introducing a hierarchical octree structure to adaptively subdivide the 3D space according to the surface occupancy and the richness of part geometry. As octree is discrete and non-differentiable, we further propose a novel hierarchical network that models the subdivision of octree cells as a probabilistic process and recursively encodes and decodes both octree structure and surface geometry in a differentiable manner. We demonstrate the value of OctField for a range of shape modeling and reconstruction tasks, showing superiority over alternative approaches.

cs.GR↗
arXiv2021

Deep Learning for Distinguishing Normal versus Abnormal Chest Radiographs and Generalization to Unseen Diseases

Chest radiography (CXR) is the most widely-used thoracic clinical imaging modality and is crucial for guiding the management of cardiothoracic conditions. The detection of specific CXR findings has been the main focus of several artificial intelligence (AI) systems. However, the wide range of possible CXR abnormalities makes it impractical to build specific systems to detect every possible condition. In this work, we developed and evaluated an AI system to classify CXRs as normal or abnormal. For development, we used a de-identified dataset of 248,445 patients from a multi-city hospital network in India. To assess generalizability, we evaluated our system using 6 international datasets from India, China, and the United States. Of these datasets, 4 focused on diseases that the AI was not trained to detect: 2 datasets with tuberculosis and 2 datasets with coronavirus disease 2019. Our results suggest that the AI system generalizes to new patient populations and abnormalities. In a simulated workflow where the AI system prioritized abnormal cases, the turnaround time for abnormal cases reduced by 7-28%. These results represent an important step towards evaluating whether AI can be safely used to flag cases in a general setting where previously unseen abnormalities exist.

eess.IV↗