arXiv subjects

Weiwei Sun

Publications and source records attributed to Weiwei Sun.

At least 109 records · Page 6Linked to original sources

arXiv2020

Large-scale Gastric Cancer Screening and Localization Using Multi-task Deep Neural Network

Gastric cancer is one of the most common cancers, which ranks third among the leading causes of cancer death. Biopsy of gastric mucosa is a standard procedure in gastric cancer screening test. However, manual pathological inspection is labor-intensive and time-consuming. Besides, it is challenging for an automated algorithm to locate the small lesion regions in the gigapixel whole-slide image and make the decision correctly.To tackle these issues, we collected large-scale whole-slide image dataset with detailed lesion region annotation and designed a whole-slide image analyzing framework consisting of 3 networks which could not only determine the screening result but also present the suspicious areas to the pathologist for reference. Experiments demonstrated that our proposed framework achieves sensitivity of 97.05% and specificity of 92.72% in screening task and Dice coefficient of 0.8331 in segmentation task. Furthermore, we tested our best model in real-world scenario on 10,315 whole-slide images collected from 4 medical centers.

eess.IV↗

arXiv2020

Constructing a Family Tree of Ten Indo-European Languages with Delexicalized Cross-linguistic Transfer Patterns

It is reasonable to hypothesize that the divergence patterns formulated by historical linguists and typologists reflect constraints on human languages, and are thus consistent with Second Language Acquisition (SLA) in a certain way. In this paper, we validate this hypothesis on ten Indo-European languages. We formalize the delexicalized transfer as interpretable tree-to-string and tree-to-tree patterns which can be automatically induced from web data by applying neural syntactic parsing and grammar induction technologies. This allows us to quantitatively probe cross-linguistic transfer and extend inquiries of SLA. We extend existing works which utilize mixed features and support the agreement between delexicalized cross-linguistic transfer and the phylogenetic structure resulting from the historical-comparative paradigm.

cs.CL↗

arXiv2020

Vehicle Re-ID for Surround-view Camera System

The vehicle re-identification (ReID) plays a critical role in the perception system of autonomous driving, which attracts more and more attention in recent years. However, to our best knowledge, there is no existing complete solution for the surround-view system mounted on the vehicle. In this paper, we argue two main challenges in above scenario: i) In single camera view, it is difficult to recognize the same vehicle from the past image frames due to the fisheye distortion, occlusion, truncation, etc. ii) In multi-camera view, the appearance of the same vehicle varies greatly from different camera's viewpoints. Thus, we present an integral vehicle Re-ID solution to address these problems. Specifically, we propose a novel quality evaluation mechanism to balance the effect of tracking box's drift and target's consistency. Besides, we take advantage of the Re-ID network based on attention mechanism, then combined with a spatial constraint strategy to further boost the performance between different cameras. The experiments demonstrate that our solution achieves state-of-the-art accuracy while being real-time in practice. Besides, we will release the code and annotated fisheye dataset for the benefit of community.

cs.CV↗

arXiv2020

Optimizing Through Learned Errors for Accurate Sports Field Registration

We propose an optimization-based framework to register sports field templates onto broadcast videos. For accurate registration we go beyond the prevalent feed-forward paradigm. Instead, we propose to train a deep network that regresses the registration error, and then register images by finding the registration parameters that minimize the regressed error. We demonstrate the effectiveness of our method by applying it to real-world sports broadcast videos, outperforming the state of the art. We further apply our method on a synthetic toy example and demonstrate that our method brings significant gains even when the problem is simplified and unlimited training data is available.

cs.CV↗

arXiv2020

PSDet: Efficient and Universal Parking Slot Detection

While real-time parking slot detection plays a critical role in valet parking systems, existing methods have limited success in real-world applications. We argue two reasons accounting for the unsatisfactory performance: \romannumeral1, The available datasets have limited diversity, which causes the low generalization ability. \romannumeral2, Expert knowledge for parking slot detection is under-estimated. Thus, we annotate a large-scale benchmark for training the network and release it for the benefit of community. Driven by the observation of various parking lots in our benchmark, we propose the circular descriptor to regress the coordinates of parking slot vertexes and accordingly localize slots accurately. To further boost the performance, we develop a two-stage deep architecture to localize vertexes in the coarse-to-fine manner. In our benchmark and other datasets, it achieves the state-of-the-art accuracy while being real-time in practice. Benchmark is available at: https://github.com/wuzzh/Parking-slot-dataset

cs.CV↗

arXiv2020

DeepDualMapper: A Gated Fusion Network for Automatic Map Extraction using Aerial Images and Trajectories

Automatic map extraction is of great importance to urban computing and location-based services. Aerial image and GPS trajectory data refer to two different data sources that could be leveraged to generate the map, although they carry different types of information. Most previous works on data fusion between aerial images and data from auxiliary sensors do not fully utilize the information of both modalities and hence suffer from the issue of information loss. We propose a deep convolutional neural network called DeepDualMapper which fuses the aerial image and trajectory data in a more seamless manner to extract the digital map. We design a gated fusion module to explicitly control the information flows from both modalities in a complementary-aware manner. Moreover, we propose a novel densely supervised refinement decoder to generate the prediction in a coarse-to-fine way. Our comprehensive experiments demonstrate that DeepDualMapper can fuse the information of images and trajectories much more effectively than existing approaches, and is able to generate maps with higher accuracy.

cs.CV↗

arXiv2020

New analysis of Galerkin-mixed FEMs for incompressible miscible flow in porous media

Analysis of Galerkin-mixed FEMs for incompressible miscible flow in porous media has been investigated extensively in the last several decades. Of particular interest in practical applications is the lowest-order Galerkin-mixed method, { in which a linear Lagrange FE approximation is used for the concentration and the lowest-order Raviart-Thomas FE approximation is used for the velocity/pressure. The previous works only showed the first-order accuracy of the method in $L^2$-norm in spatial direction,} which however is not optimal and valid only under certain extra restrictions on both time step and spatial mesh. In this paper, we provide new and optimal $L^2$-norm error estimates of Galerkin-mixed FEMs for all three components in a general case. In particular, for the lowest-order Galerkin-mixed FEM, we show unconditionally the second-order { accuracy in $L^2$-norm} for the concentration. Numerical results for both two and three-dimensional models are presented to confirm our theoretical analysis. More important is that our approach can be extended to the analysis of mixed FEMs for many strongly coupled systems to obtain optimal error estimates for all components.

math.NA↗

arXiv2019

Linearized Multi-Sampling for Differentiable Image Transformation

We propose a novel image sampling method for differentiable image transformation in deep neural networks. The sampling schemes currently used in deep learning, such as Spatial Transformer Networks, rely on bilinear interpolation, which performs poorly under severe scale changes, and more importantly, results in poor gradient propagation. This is due to their strict reliance on direct neighbors. Instead, we propose to generate random auxiliary samples in the vicinity of each pixel in the sampled image, and create a linear approximation with their intensity values. We then use this approximation as a differentiable formula for the transformed image. We demonstrate that our approach produces more representative gradients with a wider basin of convergence for image alignment, which leads to considerable performance improvements when training networks for classification tasks. This is not only true under large downsampling, but also when there are no scale changes. We compare our approach with multi-scale sampling and show that we outperform it. We then demonstrate that our improvements to the sampler are compatible with other tangential improvements to Spatial Transformer Networks and that it further improves their performance.

cs.CV↗

arXiv2019

UniVSE: Robust Visual Semantic Embeddings via Structured Semantic Representations

We propose Unified Visual-Semantic Embeddings (UniVSE) for learning a joint space of visual and textual concepts. The space unifies the concepts at different levels, including objects, attributes, relations, and full scenes. A contrastive learning approach is proposed for the fine-grained alignment from only image-caption pairs. Moreover, we present an effective approach for enforcing the coverage of semantic components that appear in the sentence. We demonstrate the robustness of Unified VSE in defending text-domain adversarial attacks on cross-modal retrieval tasks. Such robustness also empowers the use of visual cues to resolve word dependencies in novel sentences.

cs.CV↗

arXiv2019

Interfacial and Electronic Properties of Heterostructures of MXene and Graphene

MXene-based heterostructures have received considerable interest owing to their unique properties. Herein, we examine various heterostructures of a prototypical MXene and graphene using density functional theory. We find that the adhesion energy, charge transfer, and band structure of these heterostructures are sensitive not only to the surface functional group, but also to the stacking order. Difference in work function dictates the direction and amount of electron transfer across the interface, which causes a shift in the Dirac point of the graphene bands in the heterostructures of monolayer graphene and monolayer MXene. In the heterostructures of bilayer graphene and monolayer MXene, the interface breaks the symmetry of the bilayer graphene; in the case of the AB-stacking bilayer, the electron transfer leads to an interfacial electric field that opens up a gap in the graphene bands at the K point. This internal polarization strengthens both the interfacial adhesions and the cohesion between the two graphene layers. The MXene-graphene-MXene and graphene-MXene-graphene sandwich structures behave as two mirror-symmetric MXene-graphene interfaces. Our first principles studies provide a comprehensive understanding for the interaction between a typical MXene and graphene.

cond-mat.mes-hall↗

arXiv2018

Coherent Single Photon Emission from Colloidal Lead Halide Perovskite Quantum Dots

Chemically prepared colloidal semiconductor quantum dots have long been proposed as scalable and color-tunable single emitters in quantum optics, but they have typically suffered from prohibitively incoherent emission. We now demonstrate that individual colloidal lead halide perovskite quantum dots (PQDs) display highly efficient single photon emission with optical coherence times as long as 80 ps, an appreciable fraction of their 210 ps radiative lifetimes. These measurements suggest that PQDs should be explored as building blocks in sources of indistinguishable single photons and entangled photon pairs. Our results present a starting point for the rational design of lead halide perovskite-based quantum emitters with fast emission, wide spectral-tunability, scalable production, and which benefit from the hybrid-integration with nano-photonic components that has been demonstrated for colloidal materials.

cond-mat.mes-hall↗

arXiv2018

Ineffectiveness of Dictionary Coding to Infer Predictability Limits of Human Mobility

Recently, a series of models have been proposed to predict future movements of people. Meanwhile, dictionary coding algorithms are used to estimate the predictability limit of human mobility. Although dictionary coding is optimal, it takes long time to converge. Consequently, it is ineffective to infer predictability through dictionary coding algorithms. In this report, we illustrate this ineffectiveness on the basis of human movements in urban space.

cs.IT↗

arXiv2018

Analysis of fully discrete FEM for miscible displacement in porous media with Bear--Scheidegger diffusion tensor

Fully discrete Galerkin finite element methods are studied for the equations of miscible displacement in porous media with the commonly-used Bear--Scheidegger diffusion-dispersion tensor: $$ D({\bf u}) = γd_m I + |{\bf u}|\bigg( α_T I + (α_L - α_T) \frac{{\bf u} \otimes {\bf u}}{|{\bf u}|^2}\bigg) \, . $$ Previous works on optimal-order $L^\infty(0,T;L^2)$-norm error estimate required the regularity assumption $\nabla_x\partial_tD({\bf u}(x,t)) \in L^\infty(0,T;L^\infty(Ω))$, while the Bear--Scheidegger diffusion-dispersion tensor is only Lipschitz continuous even for a smooth velocity field ${\bf u}$. In terms of the maximal $L^p$-regularity of fully discrete finite element solutions of parabolic equations, optimal error estimate in $L^p(0,T;L^q)$-norm and almost optimal error estimate in $L^\infty(0,T;L^q)$-norm are established under the assumption of $D({\bf u})$ being Lipschitz continuous with respect to ${\bf u}$.

math.NA↗

arXiv2018

Semantic Role Labeling for Learner Chinese: the Importance of Syntactic Parsing and L2-L1 Parallel Data

This paper studies semantic parsing for interlanguage (L2), taking semantic role labeling (SRL) as a case task and learner Chinese as a case language. We first manually annotate the semantic roles for a set of learner texts to derive a gold standard for automatic SRL. Based on the new data, we then evaluate three off-the-shelf SRL systems, i.e., the PCFGLA-parser-based, neural-parser-based and neural-syntax-agnostic systems, to gauge how successful SRL for learner Chinese can be. We find two non-obvious facts: 1) the L1-sentence-trained systems performs rather badly on the L2 data; 2) the performance drop from the L1 data to the L2 data of the two parser-based systems is much smaller, indicating the importance of syntactic parsing in SRL for interlanguages. Finally, the paper introduces a new agreement-based model to explore the semantic coherency information in the large-scale L2-L1 parallel data. We then show such information is very effective to enhance SRL for learner texts. Our model achieves an F-score of 72.06, which is a 2.02 point improvement over the best baseline.

cs.CL↗

arXiv2018

DeepTravel: a Neural Network Based Travel Time Estimation Model with Auxiliary Supervision

Estimating the travel time of a path is of great importance to smart urban mobility. Existing approaches are either based on estimating the time cost of each road segment which are not able to capture many cross-segment complex factors, or designed heuristically in a non-learning-based way which fail to utilize the existing abundant temporal labels of the data, i.e., the time stamp of each trajectory point. In this paper, we leverage on new development of deep neural networks and propose a novel auxiliary supervision model, namely DeepTravel, that can automatically and effectively extract different features, as well as make full use of the temporal labels of the trajectory data. We have conducted comprehensive experiments on real datasets to demonstrate the out-performance of DeepTravel over existing approaches.

cs.LG↗

arXiv2017

Complex Structure Leads to Overfitting: A Structure Regularization Decoding Method for Natural Language Processing

Recent systems on structured prediction focus on increasing the level of structural dependencies within the model. However, our study suggests that complex structures entail high overfitting risks. To control the structure-based overfitting, we propose to conduct structure regularization decoding (SR decoding). The decoding of the complex structure model is regularized by the additionally trained simple structure model. We theoretically analyze the quantitative relations between the structural complexity and the overfitting risk. The analysis shows that complex structure models are prone to the structure-based overfitting. Empirical evaluations show that the proposed method improves the performance of the complex structure models by reducing the structure-based overfitting. On the sequence labeling tasks, the proposed method substantially improves the performance of the complex neural network models. The maximum F1 error rate reduction is 36.4% for the third-order model. The proposed method also works for the parsing task. The maximum UAS improvement is 5.5% for the tri-sibling model. The results are competitive with or better than the state-of-the-art results.

cs.LG↗

arXiv2016

Analysis of $L1$-Galerkin FEMs for time-fractional nonlinear parabolic problems

This paper is concerned with numerical solutions of time-fractional nonlinear parabolic problems by a class of $L1$-Galerkin finite element methods. The analysis of $L1$ methods for time-fractional nonlinear problems is limited mainly due to the lack of a fundamental Gronwall type inequality. In this paper, we establish such a fundamental inequality for the $L1$ approximation to the Caputo fractional derivative. In terms of the Gronwall type inequality, we provide optimal error estimates of several fully discrete linearized Galerkin finite element methods for nonlinear problems. The theoretical results are illustrated by applying our proposed methods to three examples: linear Fokker-Planck equation, nonlinear Huxley equation and Fisher equation.

math.NA↗

arXiv2016

A new 2D monolayer BiXene, M2C (M=Mo, Tc, Os)

Note this is a rather coarse version of our manuscript since uploading tex files are necessary (we are not willing to upload all tex files). The existence of BiXenes, a new family of 2D monolayers is here predicted. Theoretically, BiXenes have 1H symmetry (P-6m2) and can be formed from the 4d/5d binary carbides. As the name suggests, they are close relatives of MXenes, which instead have 1T symmetry (P-3m1). The newly found BiXenes, as well as some new MXenes, are shown to have formation energies close to that of germanene, which suggests that these materials should be possible to be synthesised. Among them, we illustrate that 1H-Tc2C and 1T-Mo2C are dynamically stable at 0 K, while 1H-Mo2C, 1TTc2C, 1H-Tc2C, and 1T-Rh2C are likely to be stabilised via strain or temperature. In addition, the nature of the chemical bonding is analysed, emphasizing that the covalency between the transition metal ions and carbon is much stronger in BiXenes than in MXenes. The emergence of BiXenes can not only open up a new era of conducting 2D monolayers, but also provide good candidates for carrier materials aimed at energy storage and spintronic devices that have already been unveiled in MXenes.

cond-mat.mtrl-sci↗