arXiv subjects

Yi Wang

Publications and source records attributed to Yi Wang.

At least 739 records · Page 41Linked to original sources

arXiv2021

Training BatchNorm Only in Neural Architecture Search and Beyond

This work investigates the usage of batch normalization in neural architecture search (NAS). Specifically, Frankle et al. find that training BatchNorm only can achieve nontrivial performance. Furthermore, Chen et al. claim that training BatchNorm only can speed up the training of the one-shot NAS supernet over ten times. Critically, there is no effort to understand 1) why training BatchNorm only can find the perform-well architectures with the reduced supernet-training time, and 2) what is the difference between the train-BN-only supernet and the standard-train supernet. We begin by showing that the train-BN-only networks converge to the neural tangent kernel regime, obtain the same training dynamics as train all parameters theoretically. Our proof supports the claim to train BatchNorm only on supernet with less training time. Then, we empirically disclose that train-BN-only supernet provides an advantage on convolutions over other operators, cause unfair competition between architectures. This is due to only the convolution operator being attached with BatchNorm. Through experiments, we show that such unfairness makes the search algorithm prone to select models with convolutions. To solve this issue, we introduce fairness in the search space by placing a BatchNorm layer on every operator. However, we observe that the performance predictor in Chen et al. is inapplicable on the new search space. To this end, we propose a novel composite performance indicator to evaluate networks from three perspectives: expressivity, trainability, and uncertainty, derived from the theoretical property of BatchNorm. We demonstrate the effectiveness of our approach on multiple NAS-benchmarks (NAS-Bench101, NAS-Bench-201) and search spaces (DARTS search space and MobileNet search space).

cs.LG↗

arXiv2021

Learning Ultrasound Scanning Skills from Human Demonstrations

Recently, the robotic ultrasound system has become an emerging topic owing to the widespread use of medical ultrasound. However, it is still a challenging task to model and to transfer the ultrasound skill from an ultrasound physician. In this paper, we propose a learning-based framework to acquire ultrasound scanning skills from human demonstrations. First, the ultrasound scanning skills are encapsulated into a high-dimensional multi-modal model in terms of interactions among ultrasound images, the probe pose and the contact force. The parameters of the model are learned using the data collected from skilled sonographers' demonstrations. Second, a sampling-based strategy is proposed with the learned model to adjust the extracorporeal ultrasound scanning process to guide a newbie sonographer or a robot arm. Finally, the robustness of the proposed framework is validated with the experiments on real data from sonographers.

cs.AI↗

arXiv2021

Numerical Simulation of a Fundamental Mechanism of Solar Eruption with Different Magnetic Flux Distributions

Solar eruptions are explosive release of coronal magnetic field energy as manifested in solar flares and coronal mass ejection. Observations have shown that the core of eruption-productive regions are often a sheared magnetic arcade, i.e., a single bipolar configuration, and, particularly, the corresponding magnetic polarities at the photosphere are elongated along a strong-gradient polarity inversion line (PIL). It remains unclear what mechanism triggers the eruption in a single bipolar field and why the one with a strong PIL is eruption-productive. Recently, using high accuracy simulations, we have established a fundamental mechanism of solar eruption initiation that a bipolar field as driven by quasi-static shearing motion at the photosphere can form an internal current sheet, and then fast magnetic reconnection triggers and drives the eruption. Here we investigate the behavior of the fundamental mechanism with different photospheric magnetic flux distributions, i.e., magnetograms, by combining theoretical analysis and numerical simulation. Our study shows that the bipolar fields of different magnetograms, as sheared continually, all exhibit similar evolutions from the slow storage to fast release of magnetic energy in accordance with the fundamental mechanism, which demonstrates the robustness of the mechanism. We further found that the magnetograms with stronger PIL produce larger eruptions, and the key reason is that the sheared bipolar fields with stronger PIL can achieve more non-potentiality, and their internal current sheet can form at a lower height and with a larger current density, by which the reconnection can be more efficient. This also provides a viable trigger mechanism for the observed eruptions in active region with strong PIL.

astro-ph.SR↗

arXiv2021

Remote Sensing Image Super-resolution and Object Detection: Benchmark and State of the Art

For the past two decades, there have been significant efforts to develop methods for object detection in Remote Sensing (RS) images. In most cases, the datasets for small object detection in remote sensing images are inadequate. Many researchers used scene classification datasets for object detection, which has its limitations; for example, the large-sized objects outnumber the small objects in object categories. Thus, they lack diversity; this further affects the detection performance of small object detectors in RS images. This paper reviews current datasets and object detection methods (deep learning-based) for remote sensing images. We also propose a large-scale, publicly available benchmark Remote Sensing Super-resolution Object Detection (RSSOD) dataset. The RSSOD dataset consists of 1,759 hand-annotated images with 22,091 instances of very high resolution (VHR) images with a spatial resolution of ~0.05 m. There are five classes with varying frequencies of labels per class. The image patches are extracted from satellite images, including real image distortions such as tangential scale distortion and skew distortion. We also propose a novel Multi-class Cyclic super-resolution Generative adversarial network with Residual feature aggregation (MCGR) and auxiliary YOLOv5 detector to benchmark image super-resolution-based object detection and compare with the existing state-of-the-art methods based on image super-resolution (SR). The proposed MCGR achieved state-of-the-art performance for image SR with an improvement of 1.2dB PSNR compared to the current state-of-the-art NLSN method. MCGR achieved best object detection mAPs of 0.758, 0.881, 0.841, and 0.983, respectively, for five-class, four-class, two-class, and single classes, respectively surpassing the performance of the state-of-the-art object detectors YOLOv5, EfficientDet, Faster RCNN, SSD, and RetinaNet.

cs.CV↗

arXiv2021

Quantum Signatures of Gravity from Superpositions of Primordial Massive Particles

We study the superposition of primordial massive particles and compute the associated decoherence time scale in the radiation dominated universe. We observe that for lighter primordial particles with masses up to $10^7\,\rm{kg}$, the corresponding decoherence time scale is significantly larger than the age of the observable universe, demonstrating that a primordial particle would persist in a pure quantum state, with its wavefunction spreading freely. For heavier particles, they can still be in a quantum state while their position uncertainties are limited by the wavelength of background photons. We then discuss three observational signatures that may arise from a quantum superposition of primordial particles such as primordial black holes and other heavy dark matter candidates, namely, interference effects due to superpositions of the metric, transition lines in the gravitational wave spectrum due to gravitationally bound states indicating the existence of gravitons, and witnesses of quantum entanglement between massive particles and of the gravitational field.

quant-ph↗

arXiv2021

Time-asymptotic stability of composite waves of viscous shock and rarefaction for barotropic Navier-Stokes equations

We prove the time-asymptotic stability of composite waves consisting of the superposition of a viscous shock and a rarefaction for the one-dimensional compressible barotropic Navier-Stokes equations. Our result solves a long-standing problem first mentioned in 1986 by Matsumura and Nishihara in [25]. The same authors introduced it officially as an open problem in 1992 in [26] and it was again described as very challenging open problem in 2018 in the survey paper [23]. The main difficulty is due to the incompatibility of the standard anti-derivative method, used to study the stability of viscous shocks, and the energy method used for the stability of rarefactions. Instead of the anti-derivative method, our proof uses the $a$-contraction with shifts theory recently developed by two of the authors. This method is energy based, and can seamlessly handle the superposition of waves of different kinds.

math.AP↗

arXiv2021

Multi-Layer Pseudo-Supervision for Histopathology Tissue Semantic Segmentation using Patch-level Classification Labels

Tissue-level semantic segmentation is a vital step in computational pathology. Fully-supervised models have already achieved outstanding performance with dense pixel-level annotations. However, drawing such labels on the giga-pixel whole slide images is extremely expensive and time-consuming. In this paper, we use only patch-level classification labels to achieve tissue semantic segmentation on histopathology images, finally reducing the annotation efforts. We proposed a two-step model including a classification and a segmentation phases. In the classification phase, we proposed a CAM-based model to generate pseudo masks by patch-level labels. In the segmentation phase, we achieved tissue semantic segmentation by our proposed Multi-Layer Pseudo-Supervision. Several technical novelties have been proposed to reduce the information gap between pixel-level and patch-level annotations. As a part of this paper, we introduced a new weakly-supervised semantic segmentation (WSSS) dataset for lung adenocarcinoma (LUAD-HistoSeg). We conducted several experiments to evaluate our proposed model on two datasets. Our proposed model outperforms two state-of-the-art WSSS approaches. Note that we can achieve comparable quantitative and qualitative results with the fully-supervised model, with only around a 2\% gap for MIoU and FwIoU. By comparing with manual labeling, our model can greatly save the annotation time from hours to minutes. The source code is available at: \url{https://github.com/ChuHan89/WSSS-Tissue}.

eess.IV↗

arXiv2021

Learning Friction Model for Magnet-actuated Tethered Capsule Robot

The potential diagnostic applications of magnet-actuated capsules have been greatly increased in recent years. For most of these potential applications, accurate position control of the capsule have been highly demanding. However, the friction between the robot and the environment as well as the drag force from the tether play a significant role during the motion control of the capsule. Moreover, these forces especially the friction force are typically hard to model beforehand. In this paper, we first designed a magnet-actuated tethered capsule robot, where the driving magnet is mounted on the end of a robotic arm. Then, we proposed a learning-based approach to model the friction force between the capsule and the environment, with the goal of increasing the control accuracy of the whole system. Finally, several real robot experiments are demonstrated to showcase the effectiveness of our proposed approach.

cs.RO↗

arXiv2021

Sharpened dynamics alternative and its $C^1$-robustness for strongly monotone discrete dynamical systems

For strongly monotone dynamical systems, the dynamics alternative for smooth discrete-time systems turns out to be a perfect analogy of the celebrated Hirsch's limit-set dichotomy for continuous-time semiflows. In this paper, we first present a sharpened dynamics alternative for $C^1$-smooth strongly monotone discrete-time dissipative system $\{F_0^n\}_{n\in \mathbb{N}}$ (with an attractor $A$), which concludes that there is a positive integer $m$ such that any orbit is either manifestly unstable; or asymptotic to a linearly stable cycle whose minimal period is bounded by $m$. Furthermore, we show the $C^1$-robustness of the sharpened dynamics alternative, that is, for any $C^1$-perturbed system $\{F_ε^n\}_{n\in \mathbb{N}}$ ($F_ε$ not necessarily monotone), any orbit initiated nearby $A$ will admit the sharpened dynamics alternative with the same $m$. The improved generic convergence to cycles for the $C^1$-system $\{F_0^n\}_{n\in \mathbb{N}}$, as well as for the perturbed system $\{F_ε^n\}_{n\in \mathbb{N}}$, is thus obtained as by-products of the sharpened dynamics alternative and its $C^1$-robustness. The results are applied to nonlocal $C^1$-perturbations of a time-periodic parabolic equations and give typical convergence to periodic solutions whose minimal periods are uniformly bounded.

math.DS↗

arXiv2021

Audio-Visual Grounding Referring Expression for Robotic Manipulation

Referring expressions are commonly used when referring to a specific target in people's daily dialogue. In this paper, we develop a novel task of audio-visual grounding referring expression for robotic manipulation. The robot leverages both the audio and visual information to understand the referring expression in the given manipulation instruction and the corresponding manipulations are implemented. To solve the proposed task, an audio-visual framework is proposed for visual localization and sound recognition. We have also established a dataset which contains visual data, auditory data and manipulation instructions for evaluation. Finally, extensive experiments are conducted both offline and online to verify the effectiveness of the proposed audio-visual framework. And it is demonstrated that the robot performs better with the audio-visual data than with only the visual data.

cs.RO↗

arXiv2021

DFTTK: Density Functional Theory ToolKit for High-throughput Lattice Dynamics Calculations

In this work, we present a software package in Python for high-throughput first-principles calculations of thermodynamic properties at finite temperatures, which we refer to as DFTTK (Density Functional Theory Tool Kit). DFTTK is based on the atomate package and integrates our experiences in the last decades on the development of theoretical methods and computational software. It includes task submissions on all major operating systems and task execution on high-performance computing environments. The distribution of the DFTTK package comes with examples of calculations of phonon density of states, heat capacity, entropy, enthalpy, and free energy under the quasi-harmonic phonon scheme for the stoichiometric phases of Al, Ni, Al3Ni, AlNi, AlNi3, Al3Ni4, and Al3Ni5, and the fcc solution phases treated using the special quasirandom structures at the compositions of Al3Ni, AlNi, and AlNi3.

cond-mat.mtrl-sci↗

arXiv2021

Neural network--featured timing systems for radiation detectors: performance evaluation based on bound analysis

Waveform sampling systems are used pervasively in the design of front end electronics for radiation detection. The introduction of new feature extraction algorithms (eg. neural networks) to waveform sampling has the great potential to substantially improve the performance and enrich the capability. To analyze the limits of such algorithms and thus illuminate the direction of resolution optimization, in this paper we systematically simulate the detection procedure of contemporary radiation detectors with an emphasis on pulse timing. Neural networks and variants of constant fraction discrimination are studied in a wide range of analog channel frequency and noise level. Furthermore, we propose an estimation of multivariate Cramér Rao lower bound within the model using intrinsic-extrinsic parametrization and prior information. Two case studies (single photon detection and shashlik-type calorimeter) verify the reliability of the proposed method and show it works as a useful guideline when assessing the abilities of various feature extraction algorithms.

physics.data-an↗

arXiv2021

Image Synthesis via Semantic Composition

In this paper, we present a novel approach to synthesize realistic images based on their semantic layouts. It hypothesizes that for objects with similar appearance, they share similar representation. Our method establishes dependencies between regions according to their appearance correlation, yielding both spatially variant and associated representations. Conditioning on these features, we propose a dynamic weighted network constructed by spatially conditional computation (with both convolution and normalization). More than preserving semantic distinctions, the given dynamic network strengthens semantic relevance, benefiting global structure and detail synthesis. We demonstrate that our method gives the compelling generation performance qualitatively and quantitatively with extensive experiments on benchmarks.

cs.CV↗

arXiv2021

Multi-Scale Aligned Distillation for Low-Resolution Detection

In instance-level detection tasks (e.g., object detection), reducing input resolution is an easy option to improve runtime efficiency. However, this option traditionally hurts the detection performance much. This paper focuses on boosting the performance of low-resolution models by distilling knowledge from a high- or multi-resolution model. We first identify the challenge of applying knowledge distillation (KD) to teacher and student networks that act on different input resolutions. To tackle it, we explore the idea of spatially aligning feature maps between models of varying input resolutions by shifting feature pyramid positions and introduce aligned multi-scale training to train a multi-scale teacher that can distill its knowledge to a low-resolution student. Further, we propose crossing feature-level fusion to dynamically fuse teacher's multi-resolution features to guide the student better. On several instance-level detection tasks and datasets, the low-resolution models trained via our approach perform competitively with high-resolution models trained via conventional multi-scale training, while outperforming the latter's low-resolution models by 2.1% to 3.6% in terms of mAP. Our code is made publicly available at https://github.com/dvlab-research/MSAD.

cs.CV↗

arXiv2021

Learning Friction Model for Tethered Capsule Robot

With the potential applications of capsule robots in medical endoscopy, accurate dynamic control of the capsule robot is becoming more and more important. In the scale of a capsule robot, the friction between capsule and the environment plays an essential role in the dynamic model, which is usually difficult to model beforehand. In the paper, a tethered capsule robot system driven by a robot manipulator is built, where a strong magnetic Halbach array is mounted on the robot's end-effector to adjust the state of the capsule. To increase the control accuracy, the friction between capsule and the environment is learned with demonstrated trajectories. With the learned friction model, experimental results demonstrate an improvement of 5.6% in terms of tracking error.

cs.RO↗

arXiv2021

Ab initio simulations on the pure Cr lattice stability at 0K: Verification with the Fe-Cr and Ni-Cr binary systems

Significant discrepancies have been observed and discussed on the lattice stability of Cr between the predictions from the ab initio calculations and the CALPHAD approach. In the current work, we carefully examined the possible structures for pure Cr and reviewed the history back from how Kaufman originally determined the Gibbs energy of FCC-Cr in the 1970s. The reliability of Cr lattice stability derived by the CALPHAD and ab initio approaches was systematically discussed. It is concluded that the Cr lattice stability based on the CALPHAD approach has large uncertainty. Meanwhile, we cannot claim that the ab initio HFCC-Cr is error-free as FCC-Cr is an unstable phase under ambient conditions. The present work shows that the ab initio HFCC-Cr can be a viable scientific approach. As both approaches have their limitations, the present work propose to integrate the ab initio results into the CALPHAD platform for the development of the next generation CALPHAD database. The Fe-Cr and Ni-Cr binary systems were chosen as two case studies demonstrating the capability to adopt the ab initio Cr lattice stability directly into the current CALPHAD database framework.

cond-mat.mtrl-sci↗

arXiv2021

Conditional Temporal Variational AutoEncoder for Action Video Prediction

To synthesize a realistic action sequence based on a single human image, it is crucial to model both motion patterns and diversity in the action video. This paper proposes an Action Conditional Temporal Variational AutoEncoder (ACT-VAE) to improve motion prediction accuracy and capture movement diversity. ACT-VAE predicts pose sequences for an action clips from a single input image. It is implemented as a deep generative model that maintains temporal coherence according to the action category with a novel temporal modeling on latent space. Further, ACT-VAE is a general action sequence prediction framework. When connected with a plug-and-play Pose-to-Image (P2I) network, ACT-VAE can synthesize image sequences. Extensive experiments bear out our approach can predict accurate pose and synthesize realistic image sequences, surpassing state-of-the-art approaches. Compared to existing methods, ACT-VAE improves model accuracy and preserves diversity.

cs.CV↗

arXiv2021

Essential Commutants on Strongly Pseudo-convex Domains

Consider a bounded strongly pseudo-convex domain $Ω$ with a smooth boundary in $\mathbb{C}^n$. Let $\mathcal{T}$ be the Toeplitz algebra on the Bergman space $L^2_a(Ω)$. That is, $\mathcal{T}$ is the $C^\ast $-algebra generated by the Toeplitz operators $\{T_f : f \in L^\infty (Ω)\}$. Extending previous work in the special case of the unit ball, we show that on any such $Ω$, $\mathcal{T}$ and $\{T_f : f \in {\text{VO}}_{\text{bdd}}\} + \mathcal{K}$ are essential commutants of each other. On a general $Ω$ considered in this paper, the proofs require many new ideas and techniques. These same techniques also enable us to show that for $A \in \mathcal{T}$, if $\langle Ak_z,k_z\rangle \rightarrow 0$ as $z \rightarrow \partial Ω$, then $A$ is a compact operator.

math.FA↗