arXiv subjects

Ming Sun

Publications and source records attributed to Ming Sun.

At least 163 records · Page 9Linked to original sources

arXiv2019

Improving One-shot NAS by Suppressing the Posterior Fading

There is a growing interest in automated neural architecture search (NAS). To improve the efficiency of NAS, previous approaches adopt weight sharing method to force all models share the same set of weights. However, it has been observed that a model performing better with shared weights does not necessarily perform better when trained alone. In this paper, we analyse existing weight sharing one-shot NAS approaches from a Bayesian point of view and identify the posterior fading problem, which compromises the effectiveness of shared weights. To alleviate this problem, we present a practical approach to guide the parameter posterior towards its true distribution. Moreover, a hard latency constraint is introduced during the search so that the desired latency can be achieved. The resulted method, namely Posterior Convergent NAS (PC-NAS), achieves state-of-the-art performance under standard GPU latency constraint on ImageNet. In our small search space, our model PC-NAS-S attains 76.8 % top-1 accuracy, 2.1% higher than MobileNetV2 (1.4x) with the same latency. When adopted to the large search space, PC-NAS-L achieves 78.1 % top-1 accuracy within 11ms. The discovered architecture also transfers well to other computer vision applications such as object detection and person re-identification.

cs.CV↗

arXiv2019

Acoustic scene analysis with multi-head attention networks

Acoustic Scene Classification (ASC) is a challenging task, as a single scene may involve multiple events that contain complex sound patterns. For example, a cooking scene may contain several sound sources including silverware clinking, chopping, frying, etc. What complicates ASC more is that classes of different activities could have overlapping sounds patterns (e.g. both cooking and dishwashing could have silverware clinking sound). In this paper, we propose a multi-head attention network to model the complex temporal input structures for ASC. The proposed network takes the audio's time-frequency representation as input, and it leverages standard VGG plus LSTM layers to extract high-level feature representation. Further more, it applies multiple attention heads to summarize various patterns of sound events into fixed dimensional representation, for the purpose of final scene classification. The whole network is trained in an end-to-end fashion with back-propagation. Experimental results confirm that our model discovers meaningful sound patterns through the attention mechanism, without using explicit supervision in the alignment. We evaluated our proposed model using DCASE 2018 Task 5 dataset, and achieved competitive performance on par with previous winner's results.

eess.AS↗

arXiv2019

POD: Practical Object Detection with Scale-Sensitive Network

Scale-sensitive object detection remains a challenging task, where most of the existing methods could not learn it explicitly and are not robust to scale variance. In addition, the most existing methods are less efficient during training or slow during inference, which are not friendly to real-time applications. In this paper, we propose a practical object detection method with scale-sensitive network.Our method first predicts a global continuous scale ,which is shared by all position, for each convolution filter of each network stage. To effectively learn the scale, we average the spatial features and distill the scale from channels. For fast-deployment, we propose a scale decomposition method that transfers the robust fractional scale into combination of fixed integral scales for each convolution filter, which exploits the dilated convolution. We demonstrate it on one-stage and two-stage algorithms under different configurations. For practical applications, training of our method is of efficiency and simplicity which gets rid of complex data sampling or optimize strategy. During test-ing, the proposed method requires no extra operation and is very supportive of hardware acceleration like TensorRT and TVM. On the COCO test-dev, our model could achieve a 41.5 mAP on one-stage detector and 42.1 mAP on two-stage detectors based on ResNet-101, outperforming base-lines by 2.4 and 2.1 respectively without extra FLOPS.

cs.CV↗

arXiv2019

Efficient Neural Architecture Transformation Searchin Channel-Level for Object Detection

Recently, Neural Architecture Search has achieved great success in large-scale image classification. In contrast, there have been limited works focusing on architecture search for object detection, mainly because the costly ImageNet pre-training is always required for detectors. Training from scratch, as a substitute, demands more epochs to converge and brings no computation saving. To overcome this obstacle, we introduce a practical neural architecture transformation search(NATS)algorithm for object detection in this paper. Instead of searching and constructing an entire network, NATS explores the architecture space on the base of existing network and reusing its weights. We propose a novel neural architecture search strategy in channel-level instead of path-level and devise a search space specially targeting at object detection. With the combination of these two designs, an architecture transformation scheme could be discovered to adapt a network designed for image classification to task of object detection. Since our method is gradient-based and only searches for a transformation scheme, the weights of models pretrained inImageNet could be utilized in both searching and retraining stage, which makes the whole process very efficient. The transformed network requires no extra parameters and FLOPs, and is friendly to hardware optimization, which is practical to use in real-time application. In experiments, we demonstrate the effectiveness of NATSon networks like ResNet and ResNeXt. Our transformed networks, combined with various detection frameworks, achieve significant improvements on the COCO dataset while keeping fast.

cs.CV↗

arXiv2019

Building a cluster: shocks, cavities, and cooling filaments in the group-group merger NGC 6338

We present deep Chandra, XMM-Newton, Giant Metrewave Radio Telescope and Halpha observations of the group-group merger NGC 6338. X-ray imaging and spectral mapping show that as well as trailing tails of cool, enriched gas, the two cool cores are embedded in an extensive region of shock heated gas with temperatures rising to ~5 keV. The velocity distribution of the member galaxies show that the merger is occurring primarily along the line of sight, and we estimate that the collision has produced shocks of Mach number M=2.3 or greater, making this one of the most violent mergers yet observed between galaxy groups. Both cool cores host potential AGN cavities and Halpha nebulae, indicating rapid radiative cooling. In the southern cool core around NGC 6338, we find that the X-ray filaments associated with the Halpha nebula have low entropies (<10 kev cm^2) and short cooling times (~200-300 Myr). In the northern core we identify an Halpha cloud associated with a bar of dense, cool X-ray gas offset from the dominant galaxy. We find no evidence of current jet activity in either core. We estimate the total mass of the system and find that the product of this group-group merger will likely be a galaxy cluster.

astro-ph.GA↗

arXiv2019

Sub-band Convolutional Neural Networks for Small-footprint Spoken Term Classification

This paper proposes a Sub-band Convolutional Neural Network for spoken term classification. Convolutional neural networks (CNNs) have proven to be very effective in acoustic applications such as spoken term classification, keyword spotting, speaker identification, acoustic event detection, etc. Unlike applications in computer vision, the spatial invariance property of 2D convolutional kernels does not fit acoustic applications well since the meaning of a specific 2D kernel varies a lot along the feature axis in an input feature map. We propose a sub-band CNN architecture to apply different convolutional kernels on each feature sub-band, which makes the overall computation more efficient. Experimental results show that the computational efficiency brought by sub-band CNN is more beneficial for small-footprint models. Compared to a baseline full band CNN for spoken term classification on a publicly available Speech Commands dataset, the proposed sub-band CNN architecture reduces the computation by 39.7% on commands classification, and 49.3% on digits classification with accuracy maintained.

eess.AS↗

arXiv2019

Compression of Acoustic Event Detection Models With Quantized Distillation

Acoustic Event Detection (AED), aiming at detecting categories of events based on audio signals, has found application in many intelligent systems. Recently deep neural network significantly advances this field and reduces detection errors to a large scale. However how to efficiently execute deep models in AED has received much less attention. Meanwhile state-of-the-art AED models are based on large deep models, which are computational demanding and challenging to deploy on devices with constrained computational resources. In this paper, we present a simple yet effective compression approach which jointly leverages knowledge distillation and quantization to compress larger network (teacher model) into compact network (student model). Experimental results show proposed technique not only lowers error rate of original compact network by 15% through distillation but also further reduces its model size to a large extent (2% of teacher, 12% of full-precision student) through quantization.

eess.AS↗

arXiv2019

ALMA unveils widespread molecular gas clumps in the ram pressure stripped tail of the Norma jellyfish galaxy

We present the first high-resolution map of the cold molecular gas distribution, as traced by CO(2-1) emission with ALMA, in a prominent ram pressure stripped tail. The Norma cluster galaxy ESO 137-001 is undergoing a strong interaction with the surrounding intra-cluster medium and is one of the nearest jellyfish galaxies with a long multi-phase tail. We have mapped the full extent of the tail at 1" (350 pc) angular resolution and found a rich distribution of mostly compact CO regions extending to nearly 60 kpc in length and 25 kpc in width. In total about 10^9 M_sun of molecular gas was detected. The CO features are found predominantly at the heads of numerous small-scale (~ 1.5 kpc) fireballs (i.e., star-forming clouds with linear streams of young stars extending toward the galaxy) but also of large-scale (~ 8 kpc) super-fireballs, and double-sided fireballs that have additional diffuse ionized gas tails extending in the direction opposite to the stellar tails. The new data help to shed light on the origin of the molecular tail - CO filaments oriented in the direction of the tail with only diffuse associated Halpha emission are likely young molecular features formed in situ, whereas other large CO features tilted with respect to the tail may have originated from the densest gas complexes that were pushed gradually away from the disk. The ALMA observations of ESO 137-001, together with observations from HST, Chandra and VLT/MUSE, offer the most complete view of a spectacular ram pressure stripped tail to date.

astro-ph.GA↗

arXiv2019

Compression of Acoustic Event Detection Models with Low-rank Matrix Factorization and Quantization Training

In this paper, we present a compression approach based on the combination of low-rank matrix factorization and quantization training, to reduce complexity for neural network based acoustic event detection (AED) models. Our experimental results show this combined compression approach is very effective. For a three-layer long short-term memory (LSTM) based AED model, the original model size can be reduced to 1% with negligible loss of accuracy. Our approach enables the feasibility of deploying AED for resource-constraint applications.

eess.AS↗

arXiv2019

Semi-supervised Acoustic Event Detection based on tri-training

This paper presents our work of training acoustic event detection (AED) models using unlabeled dataset. Recent acoustic event detectors are based on large-scale neural networks, which are typically trained with huge amounts of labeled data. Labels for acoustic events are expensive to obtain, and relevant acoustic event audios can be limited, especially for rare events. In this paper we leverage an Internet-scale unlabeled dataset with potential domain shift to improve the detection of acoustic events. Based on the classic tri-training approach, our proposed method shows accuracy improvement over both the supervised training baseline, and semisupervised self-training set-up, in all pre-defined acoustic event detection tasks. As our approach relies on ensemble models, we further show the improvements can be distilled to a single model via knowledge distillation, with the resulting single student model maintaining high accuracy of teacher ensemble models.

eess.AS↗

arXiv2019

A merger shock in Abell 1367

Multi-wavelength observations show that Abell 1367 (A1367) is a dynamically young cluster, with at least two subclusters merging along the SE-NW direction. With the wide-field XMM-Newton mosaic of A1367, we discover a previously unknown merger shock at the NW edge of the cluster. We estimate the shock Mach number from the density and temperature jumps as $M_ρ=1.21\pm0.08$ and $M_T=1.60\pm0.07$, respectively. This shock region also corresponds to a radio relic discovered with the VLA and GBT, which could be produced by the shock re-acceleration of pre-existing seed relativistic electrons. We suggest that some of the seed relativistic electrons originate from late-type, star-forming galaxies in this region.

astro-ph.GA↗

arXiv2019

AGN Feedback in Galaxy Group 3C 88: Cavities, Shock and Jet Reorientation

We present results from the deep Chandra observation (105 ksec), together with new Giant Metrewave Radio Telescope and Very Large Array data of the AGN outburst in the radio-loud galaxy group 3C 88. The system shows a prominent X-ray cavity on the eastern side with a diameter of $\sim$50 kpc at $\sim28$ kpc from the nucleus. The total enthalpy of the cavity is $3.8\times10^{58}$ erg and the average power required to inflate the X-ray bubble is $\sim2.0\times10^{43}$ erg s^-1. From surface brightness profiles we detect a shock with a Mach number of $M=1.4\pm0.2$, consistent with the value obtained from temperature jump. The shock energy is estimated to be $1.9\times10^{59}$ erg. The size and total enthalpy of the cavity in 3C 88 are the largest known in galaxy groups, as well as the shock energy. The eastern X-ray cavity is not aligned with the radio jet axis. This factor, combined with the radio morphology, strongly suggests jet reorientation in the last tens of million years. The bright rim and arm features surrounding the cavity show metallicity enhancement, suggesting they originated as high metallicity gas from the group center, lifted by the rising X-ray bubbles. Our Chandra study of 3C 88 also reveals that galaxy groups with powerful radio AGN can have high cavity power, although deep X-ray observations are typically required to confirm the cavities in galaxy groups.

astro-ph.HE↗

arXiv2019

Secrecy Outage Analysis of Non-Orthogonal Spectrum Sharing for Heterogeneous Cellular Networks

In this paper, we investigate physical-layer security for a heterogeneous cellular network consisting of a macro cell and a small cell in the presence of a passive eavesdropper that intends to tap both the macro-cell and small-cell transmissions. Both the orthogonal spectrum sharing (OSS) and non-orthogonal spectrum sharing (NOSS) are considered for the heterogeneous cellular network. The OSS allows the macro cell and small cell to access a given spectrum band in an orthogonal manner, whereas the NOSS enables them to access the same spectrum simultaneously and mutual interference exits. As a consequence, we present two NOSS schemes, namely the interference-limited NOSS (IL-NOSS) and interference-canceled NOSS (IC-NOSS), where the mutual interference is constrained below a tolerable level in the IL-NOSS through power control and the IC-NOSS scheme exploits a specially-designed signal for canceling out the interference received a legitimate cellular user while confusing the passive eavesdropper. We derive closed-form expressions for an overall secrecy outage probability of the OSS, IL-NOSS, and IC-NOSS schemes, which take into account the transmission secrecy of both the macro cell and small cell. We further characterize the secrecy diversity of OSS, IL-NOSS and IC-NOSS schemes through an asymptotic secrecy outage analysis in the high signal-to-noise ratio region. It is shown that the OSS and IL-NOSS methods obtain the same secrecy diversity gain of zero only, and a higher secrecy diversity gain of one is achieved by the IC-NOSS scheme. Additionally, numerical results demonstrate that the IC-NOSS scheme significantly performs better than the OSS and IL-NOSS methods in terms of the overall secrecy outage probability.

cs.IT↗

arXiv2019

X-ray scaling relations from a complete sample of the richest maxBCG clusters

We use a complete sample of 38 richest maxBCG clusters to study the ICM-galaxy scaling relations and the halo mass selection properties of the maxBCG algorithm, based on X-ray and optical observations. The clusters are selected from the two largest bins of optical richness in the Planck stacking work with the maxBCG richness $N_{200} \geq 78$. We analyze their Chandra and XMM-Newton data to derive the X-ray properties of the ICM. We then use the distribution of $P(X|N)$, $X=T_X,\ L_X,\ Y_X$, to study the mass selection $P(M|N)$ of maxBCG. Compared with previous works based on the whole richness sample, a significant fraction of blended systems with boosted richness is skewed into this richest sample. Parts of the blended halos are picked apart by the redMaPPer, an updated red-sequence cluster finding algorithm with lower mass scatter. Moreover, all the optical blended halos are resolved as individual X-ray halos, following the established $L_X-T_X$ and $L_X-Y_X$ relations. We further discuss that the discrepancy between ICM-galaxy scaling relations, especially for future blind stacking, can come from several factors, including miscentering, projection, contamination of low mass systems, mass bias and covariance bias. We also evaluate the fractions of relaxed and cool core clusters in our sample. Both are smaller than those from SZ or X-ray selected samples. Moreover, disturbed clusters show a higher level of mass bias than relaxed clusters.

astro-ph.GA↗

arXiv2019

Spectacular HST observations of the Coma galaxy D100 and star formation in its ram pressure stripped tail

We present new HST F275W, F475W, and F814W imaging of the region of the Coma cluster around D100, a spiral galaxy with a remarkably long and narrow ($60 \times 1.5$ kpc) ram pressure stripped gas tail. We find blue sources coincident with the H$α$ tail, which we identify as young stars formed in the tail. We also determine they are likely to be unbound stellar complexes with sizes of $\sim$ $50-100$ pc, likely to disperse as they age. From a comparison of the colors and magnitudes of the young stellar complexes with simple stellar population models, we find ages ranging from $\sim$ $1-50$ Myr, and masses ranging from $10^3$ to $\sim$ $10^5$ M$_{\odot}$. We find the overall rate and efficiency of star formation are low, $\sim$ $6.0 \times \, 10^{-3}$ $M_{\odot}$ yr$^{-1}$ and $\sim$ $6 \, \times$ 10$^{-12}$ yr$^{-1}$ respectively. The total H$α$ flux of the tail would correspond to a star formation rate $7$ times higher, indicating some other mechanism for H$α$ excitation is dominant. From analysis of colors, we track the progression of outside-in star formation quenching in the main body of D100, as well as its apparent companion the S0 D99. Finally, we observe the dust extinction in the base of the tail has an outer envelope with remarkably smooth and straight edges, and linear filamentary substructure strongly suggestive of magnetic fields. These features and the small amount of tail broadening strongly suggest gas cooling restricting broadening, and the influence of magnetic fields inhibiting turbulence.

astro-ph.GA↗

arXiv2019

MUSE sneaks a peek at extreme ram-pressure stripping events - IV. Hydrodynamic and gravitational interactions in the Blue Infalling Group

We report new wide-field (~ 4 x 4 square arcmin) MUSE observations of the Blue Infalling Group (BIG), a compact group of galaxies located at a projected distance of ~ 150 kpc from the X-Ray centre of the A1367 cluster at z = 0.021. Our MUSE observations map in detail the extended ionized gas, primarily traced by H$α$ emission, in between the members of the group. The gas morphology and its kinematics appear consistent with a tidal origin due to galaxy encounters, as also supported by the disturbed kinematics visible in one of the group members and the presence of tidal dwarf systems. A diffuse tail extending in the direction opposite to the cluster centre is also detected, hinting at a global ram-pressure stripping of the intra-group material as BIG falls inside A1367. Based on the analysis of spatially-resolved emission line maps, we identify multiple ionization mechanisms for the diffuse gas filaments, including in situ photoionization from embedded HII regions and shocks. Combining spatially resolved kinematics and line ratios, we rule out the association of the most massive galaxy, CGCG097-120, with the group as this system appears to be decoupled from the intragroup medium and subject to strong ram pressure as it falls into A1367. Through our new analysis, we conclude that BIG is shaped by pre-processing produced by gravitational interactions in the local group environment combined with ram pressure stripping by the global cluster halo.

astro-ph.GA↗

arXiv2018

Compact Generalized Non-local Network

The non-local module is designed for capturing long-range spatio-temporal dependencies in images and videos. Although having shown excellent performance, it lacks the mechanism to model the interactions between positions across channels, which are of vital importance in recognizing fine-grained objects and actions. To address this limitation, we generalize the non-local module and take the correlations between the positions of any two channels into account. This extension utilizes the compact representation for multiple kernel functions with Taylor expansion that makes the generalized non-local module in a fast and low-complexity computation flow. Moreover, we implement our generalized non-local method within channel groups to ease the optimization. Experimental results illustrate the clear-cut improvements and practical applicability of the generalized non-local module on both fine-grained object recognition and video classification. Code is available at: https://github.com/KaiyuYue/cgnl-network.pytorch.

cs.CV↗

arXiv2018

Security-Reliability Tradeoff for Distributed Antenna Systems in Heterogeneous Cellular Networks

In this paper, we investigate physical-layer security for a spectrum-sharing heterogeneous cellular network comprised of a macro cell and a small cell, where a passive eavesdropper is assumed to tap the transmissions of both the macro cell and small cell. In the macro cell, a macro base station (MBS) equipped with multiple distributed antennas sends its confidential information to a macro user (MU) through an opportunistic transmit antenna. Meanwhile, in the small cell, a small base station (SBS) transmits to a small user (SU) over the same spectrum used by MBS. We propose an interference-canceled opportunistic antenna selection (IC-OAS) scheme to enhance physical-layer security for the heterogeneous network. To be specific, when MBS sends its confidential message to MU through an opportunistic distributed antenna, a special signal is artificially designed and emitted at MBS to ensure that the received interference at MU from SBS is canceled out. For comparison, the conventional interference-limited opportunistic antenna selection (IL-OAS) is considered as a benchmark. We characterize the security-reliability tradeoff (SRT) for the proposed IC-OAS and conventional IL-OAS schemes in terms of deriving their closed-form expressions of intercept probability and outage probability. Numerical results show that compared with the conventional IL-OAS, the proposed IC-OAS scheme not only brings SRT benefits to the macro cell, but also has the potential of improving the SRT of small cell by increasing the number of distributed antennas. Additionally, by jointly taking into account the macro cell and small cell, an overall SRT of the proposed IC-OAS scheme is shown to be significantly better than that of the conventional IL-OAS approach in terms of a sum intercept probability versus sum outage probability.

cs.IT↗