arXiv Science⌕ Search

arXiv subjects

Yi Zhu

Publications and source records attributed to Yi Zhu.

At least 217 records · Page 12Linked to original sources
arXiv2020

Improving Semantic Segmentation via Self-Training

Deep learning usually achieves the best results with complete supervision. In the case of semantic segmentation, this means that large amounts of pixelwise annotations are required to learn accurate models. In this paper, we show that we can obtain state-of-the-art results using a semi-supervised approach, specifically a self-training paradigm. We first train a teacher model on labeled data, and then generate pseudo labels on a large set of unlabeled data. Our robust training framework can digest human-annotated and pseudo labels jointly and achieve top performances on Cityscapes, CamVid and KITTI datasets while requiring significantly less supervision. We also demonstrate the effectiveness of self-training on a challenging cross-domain generalization task, outperforming conventional finetuning method by a large margin. Lastly, to alleviate the computational burden caused by the large amount of pseudo labels, we propose a fast training schedule to accelerate the training of segmentation models by up to 2x without performance degradation.

cs.CV↗
arXiv2020

Testing kinetically coupled inflation models with CMB distortions

Inflation scenarios kinetically coupled with the Einstein tensor have been widely studied. They can be consistent with current observational data. Future experiments on the measurement on CMB distortions will potentially extend information about the scalar spectrum to small scales $1 \Mpc^{-1} \lesssim k \lesssim 2 \times 10^4 \Mpc^{-1}$. By taking the sensitivity of the PIXIE experiment as the criterion, we perform a model-oriented analysis of the observational prospects of spectral distortions for kinetically coupled inflation. There are five models that possibly generate a detectable level of distortions, among the 49 single-field inflation models listed in Ref. \cite{Martin2013a}. These models are: hybrid inflation in the valley (VHI), non-canonical Kähler inflation (NCKI), generalized MSSM inflation (GMSSMI), generalized renormalization point inflation (GRIPI), and running-mass inflation (RMI). Each of these models can satisfy the Planck constraints on spectral tilt and lead to increase power on scales relevant for CMB distortions in a tuned region of their parameter space. The existence of kinetic coupling suppresses the value of the model parameters with mass dimension for VHI, GMSSMI, and GRIPI, such that these three models can be in agreement with their theoretical considerations. However, the tuned regions for all these models fail to satisfy the constraints on tensor modes.

astro-ph.CO↗
arXiv2020

Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Tasks

Vision-Language Navigation (VLN) is a task where agents learn to navigate following natural language instructions. The key to this task is to perceive both the visual scene and natural language sequentially. Conventional approaches exploit the vision and language features in cross-modal grounding. However, the VLN task remains challenging, since previous works have neglected the rich semantic information contained in the environment (such as implicit navigation graphs or sub-trajectory semantics). In this paper, we introduce Auxiliary Reasoning Navigation (AuxRN), a framework with four self-supervised auxiliary reasoning tasks to take advantage of the additional training signals derived from the semantic information. The auxiliary tasks have four reasoning objectives: explaining the previous actions, estimating the navigation progress, predicting the next orientation, and evaluating the trajectory consistency. As a result, these additional training signals help the agent to acquire knowledge of semantic representations in order to reason about its activity and build a thorough perception of the environment. Our experiments indicate that auxiliary reasoning tasks improve both the performance of the main task and the model generalizability by a large margin. Empirically, we demonstrate that an agent trained with self-supervised auxiliary reasoning tasks substantially outperforms the previous state-of-the-art method, being the best existing approach on the standard benchmark.

cs.CV↗
arXiv2020

Global existence in critical spaces for non Newtonian compressible viscoelastic flows

We are interested in the multi-dimentional compressible viscoelastic flows of Oldroyd type, which is one of non-Newtonian fluids exhibiting the elastic behavior. In order to capture the damping effect of the additional deformation tensor, to the best of our knowledge, the "div-curl" structural condition plays a key role in previous efforts. Our aim of this paper is to remove the structural condition and prove a global existence of strong solutions to compressible viscoelastic flows in critical spaces. The new ingredient lies in the introduction of effective flux $(θ,\mathcal{G})$, which enables us to capture the dissipation arising from \textit{combination} of density and deformation tensor. In absence of compatible conditions, the partial dissipation is found in non-Newtonian compressible fluids, which is weaker than that of usual Navier-Stokes equations.

math.AP↗
arXiv2020

Vision-Dialog Navigation by Exploring Cross-modal Memory

Vision-dialog navigation posed as a new holy-grail task in vision-language disciplinary targets at learning an agent endowed with the capability of constant conversation for help with natural language and navigating according to human responses. Besides the common challenges faced in visual language navigation, vision-dialog navigation also requires to handle well with the language intentions of a series of questions about the temporal context from dialogue history and co-reasoning both dialogs and visual scenes. In this paper, we propose the Cross-modal Memory Network (CMN) for remembering and understanding the rich information relevant to historical navigation actions. Our CMN consists of two memory modules, the language memory module (L-mem) and the visual memory module (V-mem). Specifically, L-mem learns latent relationships between the current language interaction and a dialog history by employing a multi-head attention mechanism. V-mem learns to associate the current visual views and the cross-modal memory about the previous navigation actions. The cross-modal memory is generated via a vision-to-language attention and a language-to-vision attention. Benefiting from the collaborative learning of the L-mem and the V-mem, our CMN is able to explore the memory about the decision making of historical navigation actions which is for the current step. Experiments on the CVDN dataset show that our CMN outperforms the previous state-of-the-art model by a significant margin on both seen and unseen environments.

cs.CV↗
arXiv2020

GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing

We present GluonCV and GluonNLP, the deep learning toolkits for computer vision and natural language processing based on Apache MXNet (incubating). These toolkits provide state-of-the-art pre-trained models, training scripts, and training logs, to facilitate rapid prototyping and promote reproducible research. We also provide modular APIs with flexible building blocks to enable efficient customization. Leveraging the MXNet ecosystem, the deep learning models in GluonCV and GluonNLP can be deployed onto a variety of platforms with different programming languages. The Apache 2.0 license has been adopted by GluonCV and GluonNLP to allow for software distribution, modification, and usage.

cs.LG↗
arXiv2020

Direct Measurement of Folding Angle and Strain Vector in Atomically thin WS$_2$ using Second Harmonic Generation

Structural engineering techniques such as local strain engineering and folding provide functional control over critical optoelectronic properties of 2D materials. Accurate monitoring of local strain vector (both strain amplitude and direction) and folding angle in 2D materials is important to optimize the device performance. Conventionally, the accurate measurement of both strain amplitude and direction requires the combined usage of multiple tools, such as atomic force microscopy (AFM), electron microscopy, Raman spectroscopy, etc. Here, we demonstrated the usage of a single tool, polarization-dependent second harmonic generation (SHG) imaging, to determine the folding angle and strain vector accurately in atomically thin tungsten disulfide (WS2). We find that trilayer WS2 folds with folding angle of 600 show 9 times SHG enhancement due to vector superposition of SH wave vectors coming from the individual folding layers. Strain dependent SHG quenching and enhancement is found parallel and perpendicular respectively to the direction of the compressive strain vector. However, despite a variation in strain angle, the total SHG remains constant which allows us to determine the local strain vector accurately using photoelastic approach. We also demonstrate that band-nesting induced transition (C peak) can highly enhance SHG, which can be significantly modulated by strain. Our results would pave the way to enable novel applications of the TMDs in nonlinear optical device.

physics.optics↗
arXiv2020

Super-transport of Excitons in Atomically Thin Organic Semiconductors at the 2D Quantum Limit

Long-range and fast transport of coherent excitons is important for development of high-speed excitonic circuits and quantum computing applications. However, most of these coherent excitons have only been observed in some low-dimensional semiconductors when coupled with cavities, as there are large inhomogeneous broadening and dephasing effects on the exciton transport in their native states of the materials. Here, by confining coherent excitons at the 2D quantum limit, we firstly observed molecular aggregation enabled super-transport of excitons in atomically thin two-dimensional (2D) organic semiconductors between coherent states, with a measured a high effective exciton diffusion coefficient of 346.9 cm2/sec at room temperature. This value is one to several orders of magnitude higher than the reported values from other organic molecular aggregates and low-dimensional inorganic materials. Without coupling to any optical cavities, the monolayer pentacene sample, a very clean 2D quantum system (1.2 nm thick) with high crystallinity (J type aggregation) and minimal interfacial states, showed superradiant emissions from the Frenkel excitons, which was experimentally confirmed by the temperature-dependent photoluminescence (PL) emission, highly enhanced radiative decay rate, significantly narrowed PL peak width and strongly directional in-plane emission. The coherence in monolayer pentacene samples was observed to be delocalized over 135 molecules, which is significantly larger than the values (a few molecules) observed from other organic thin films. In addition, the super-transport of excitons in monolayer pentacene samples showed highly anisotropic behaviour. Our results pave the way for the development of future high-speed excitonic circuits, fast OLEDs, and other opto-electronic devices.

cond-mat.mtrl-sci↗
arXiv2020

On Constructing Confidence Region for Model Parameters in Stochastic Gradient Descent via Batch Means

In this paper, we study a simple algorithm to construct asymptotically valid confidence regions for model parameters using the batch means method. The main idea is to cancel out the covariance matrix which is hard/costly to estimate. In the process of developing the algorithm, we establish process-level functional central limit theorem for Polyak-Ruppert averaging based stochastic gradient descent estimators. We also extend the batch means method to accommodate more general batch size specifications.

stat.ML↗
arXiv2019

Generalizing Deep Models for Overhead Image Segmentation Through Getis-Ord Gi* Pooling

That most deep learning models are purely data driven is both a strength and a weakness. Given sufficient training data, the optimal model for a particular problem can be learned. However, this is usually not the case and so instead the model is either learned from scratch from a limited amount of training data or pre-trained on a different problem and then fine-tuned. Both of these situations are potentially suboptimal and limit the generalizability of the model. Inspired by this, we investigate methods to inform or guide deep learning models for geospatial image analysis to increase their performance when a limited amount of training data is available or when they are applied to scenarios other than which they were trained on. In particular, we exploit the fact that there are certain fundamental rules as to how things are distributed on the surface of the Earth and these rules do not vary substantially between locations. Based on this, we develop a novel feature pooling method for convolutional neural networks using Getis-Ord Gi* analysis from geostatistics. Experimental results show our proposed pooling function has significantly better generalization performance compared to a standard data-driven approach when applied to overhead image segmentation.

cs.CV↗
arXiv2019

Semi-supervised representation learning via dual autoencoders for domain adaptation

Domain adaptation aims to exploit the knowledge in source domain to promote the learning tasks in target domain, which plays a critical role in real-world applications. Recently, lots of deep learning approaches based on autoencoders have achieved a significance performance in domain adaptation. However, most existing methods focus on minimizing the distribution divergence by putting the source and target data together to learn global feature representations, while they do not consider the local relationship between instances in the same category from different domains. To address this problem, we propose a novel Semi-Supervised Representation Learning framework via Dual Autoencoders for domain adaptation, named SSRLDA. More specifically, we extract richer feature representations by learning the global and local feature representations simultaneously using two novel autoencoders, which are referred to as marginalized denoising autoencoder with adaptation distribution (MDAad) and multi-class marginalized denoising autoencoder (MMDA) respectively. Meanwhile, we make full use of label information to optimize feature representations. Experimental results show that our proposed approach outperforms several state-of-the-art baseline methods.

cs.LG↗
arXiv2019

On the Importance of Subword Information for Morphological Tasks in Truly Low-Resource Languages

Recent work has validated the importance of subword information for word representation learning. Since subwords increase parameter sharing ability in neural models, their value should be even more pronounced in low-data regimes. In this work, we therefore provide a comprehensive analysis focused on the usefulness of subwords for word representation learning in truly low-resource scenarios and for three representative morphological tasks: fine-grained entity typing, morphological tagging, and named entity recognition. We conduct a systematic study that spans several dimensions of comparison: 1) type of data scarcity which can stem from the lack of task-specific training data, or even from the lack of unannotated data required to train word embeddings, or both; 2) language type by working with a sample of 16 typologically diverse languages including some truly low-resource ones (e.g. Rusyn, Buryat, and Zulu); 3) the choice of the subword-informed word representation method. Our main results show that subword-informed models are universally useful across all language types, with large gains over subword-agnostic embeddings. They also suggest that the effective use of subwords largely depends on the language (type) and the task at hand, as well as on the amount of available data for training the embeddings and task-based models, where having sufficient in-task data is a more critical requirement.

cs.CL↗
arXiv2019

Linear and nonlinear electromagnetic waves in modulated honeycomb media

Wave dynamics in topological materials has been widely studied recently. A striking feature is the existence of robust and chiral wave propagations that have potential applications in many fields. A common way to realize such wave patterns is to utilize Dirac points which carry topological indices and is supported by the symmetries of the media. In this work, we investigate these phenomena in photonic media. Starting with Maxwell's equations with a honeycomb material weight as well as the nonlinear Kerr effect, we first prove the existence of Dirac points in the dispersion surfaces of transverse electric and magnetic Maxwell operators under very general assumptions of the material weight. Our assumptions on the material weight are almost the minimal requirements to ensure the existence of Dirac points in a general hexagonal photonic crystal. We then derive the associated wave packet dynamics in the scenario where the honeycomb structure is weakly modulated. It turns out the reduced envelope equation is generally a two-dimensional nonlinear Dirac equation with a spatially varying mass. By studying the reduced envelope equation with a domain-wall-like mass term, we realize the subtle wave motions which are chiral and immune to local defects. The underlying mechanism is the existence of topologically protected linear line modes, also referred to as edge states. However, we show that these robust linear modes do not survive with nonlinearity. We demonstrate the existence of nonlinear line modes, which can propagate in the nonlinear media based on high-accuracy numerical computations. Moreover, we also report a new type of nonlinear modes which are localized in both directions.

math-ph↗
arXiv2019

Motion-Aware Feature for Improved Video Anomaly Detection

Motivated by our observation that motion information is the key to good anomaly detection performance in video, we propose a temporal augmented network to learn a motion-aware feature. This feature alone can achieve competitive performance with previous state-of-the-art methods, and when combined with them, can achieve significant performance improvements. Furthermore, we incorporate temporal context into the Multiple Instance Learning (MIL) ranking model by using an attention block. The learned attention weights can help to differentiate between anomalous and normal video segments better. With the proposed motion-aware feature and the temporal MIL ranking model, we outperform previous approaches by a large margin on both anomaly detection and anomalous action recognition tasks in the UCF Crime dataset.

cs.CV↗
arXiv2019

Improving Semantic Segmentation via Video Propagation and Label Relaxation

Semantic segmentation requires large amounts of pixel-wise annotations to learn accurate models. In this paper, we present a video prediction-based methodology to scale up training sets by synthesizing new training samples in order to improve the accuracy of semantic segmentation networks. We exploit video prediction models' ability to predict future frames in order to also predict future labels. A joint propagation strategy is also proposed to alleviate mis-alignments in synthesized samples. We demonstrate that training segmentation models on datasets augmented by the synthesized samples leads to significant improvements in accuracy. Furthermore, we introduce a novel boundary label relaxation technique that makes training robust to annotation noise and propagation artifacts along object boundaries. Our proposed methods achieve state-of-the-art mIoUs of 83.5% on Cityscapes and 82.9% on CamVid. Our single model, without model ensembles, achieves 72.8% mIoU on the KITTI semantic segmentation test set, which surpasses the winning entry of the ROB challenge 2018. Our code and videos can be found at https://nv-adlr.github.io/publication/2018-Segmentation.

cs.CV↗
arXiv2019

Global solutions of 3D incompressible MHD system with mixed partial dissipation and magnetic diffusion near an equilibrium

This paper focuses on the 3D incompressible magnetohydrodynamic (MHD) equations with mixed partial dissipation and magnetic diffusion. Our main result assesses the global stability of perturbations near the steady solution given by a background magnetic field. The stability problem on the MHD equations with partial or no dissipation has attracted considerable interests recently and there are substantial developments. The new stability result presented here is among the very few stability conclusions currently available for ideal or partially dissipated MHD equations. As a special consequence of the techniques introduced in this paper, we obtain the small data global well-posedness for the 3D incompressible Navier-Stokes equations without vertical dissipation.

math.AP↗
arXiv2019

Exploring Temporal Information for Improved Video Understanding

In this dissertation, I present my work towards exploring temporal information for better video understanding. Specifically, I have worked on two problems: action recognition and semantic segmentation. For action recognition, I have proposed a framework, termed hidden two-stream networks, to learn an optimal motion representation that does not require the computation of optical flow. My framework alleviates several challenges faced in video classification, such as learning motion representations, real-time inference, multi-framerate handling, generalizability to unseen actions, etc. For semantic segmentation, I have introduced a general framework that uses video prediction models to synthesize new training samples. By scaling up the training dataset, my trained models are more accurate and robust than previous models even without modifications to the network architectures or objective functions. I believe videos have much more potential to be mined, and temporal information is one of the most important cues for machines to perceive the visual world better.

cs.CV↗