arXiv subjects

Ming Sun

Publications and source records attributed to Ming Sun.

At least 145 records · Page 8Linked to original sources

arXiv2021

DETR for Crowd Pedestrian Detection

Pedestrian detection in crowd scenes poses a challenging problem due to the heuristic defined mapping from anchors to pedestrians and the conflict between NMS and highly overlapped pedestrians. The recently proposed end-to-end detectors(ED), DETR and deformable DETR, replace hand designed components such as NMS and anchors using the transformer architecture, which gets rid of duplicate predictions by computing all pairwise interactions between queries. Inspired by these works, we explore their performance on crowd pedestrian detection. Surprisingly, compared to Faster-RCNN with FPN, the results are opposite to those obtained on COCO. Furthermore, the bipartite match of ED harms the training efficiency due to the large ground truth number in crowd scenes. In this work, we identify the underlying motives driving ED's poor performance and propose a new decoder to address them. Moreover, we design a mechanism to leverage the less occluded visible parts of pedestrian specifically for ED, and achieve further improvements. A faster bipartite match algorithm is also introduced to make ED training on crowd dataset more practical. The proposed detector PED(Pedestrian End-to-end Detector) outperforms both previous EDs and the baseline Faster-RCNN on CityPersons and CrowdHuman. It also achieves comparable performance with state-of-the-art pedestrian detection methods. Code will be released soon.

cs.CV↗

arXiv2021

Multi-Task Self-Supervised Pre-Training for Music Classification

Deep learning is very data hungry, and supervised learning especially requires massive labeled data to work well. Machine listening research often suffers from limited labeled data problem, as human annotations are costly to acquire, and annotations for audio are time consuming and less intuitive. Besides, models learned from labeled dataset often embed biases specific to that particular dataset. Therefore, unsupervised learning techniques become popular approaches in solving machine listening problems. Particularly, a self-supervised learning technique utilizing reconstructions of multiple hand-crafted audio features has shown promising results when it is applied to speech domain such as emotion recognition and automatic speech recognition (ASR). In this paper, we apply self-supervised and multi-task learning methods for pre-training music encoders, and explore various design choices including encoder architectures, weighting mechanisms to combine losses from multiple tasks, and worker selections of pretext tasks. We investigate how these design choices interact with various downstream music classification tasks. We find that using various music specific workers altogether with weighting mechanisms to balance the losses during pre-training helps improve and generalize to the downstream tasks.

cs.SD↗

arXiv2020

Suzaku Measurements of Hot Halo Emission at Outskirts for Two Poor Galaxy Groups: NGC 3402 and NGC 5129

We present Suzaku off-center observations of two poor galaxy groups, NGC 3402 and NGC 5129, with temperatures below 1 keV. Through spectral decomposition, we measured their surface brightnesses and temperatures out to 530 and 1430 times the critical density of the universe for NGC 3402 and NGC 5129, respectively. These quantities are consistent with extrapolations from existing inner measurements of the two groups. With the refined bolometric X-ray luminosities, both groups prefer $L_X$-$T$ relations without a break in the group regime. Furthermore, we have determined the electron number densities and hydrostatic masses at these radii. We found that the surface brightness and electron number density profiles require two $β$ model components, as well as the indication that a third $β$ model may be needed for NGC 3402. Adding the gas mass measured from the X-ray data and stellar mass from group galaxy members, we computed baryon fractions of $f_b$ = 0.0693 $\pm$ 0.0068 and $f_b$ = 0.095 $\pm$ 0.014 for NGC 3402 and NGC 5129, respectively. Combining other poor groups with well-measured X-ray emission to the outskirts, we found an average baryon fraction extrapolated to $r_{500}$ of $\overline{f_{b,500}}$ = 0.0912 $\pm$ 0.0050 for X-ray-bright groups with temperatures between 0.8 and 1.3 keV, extending existing constraints to lower-mass systems and indicating that significant baryon losses exist below approximately $r_{500}$.

astro-ph.GA↗

arXiv2020

Improving Auto-Augment via Augmentation-Wise Weight Sharing

The recent progress on automatically searching augmentation policies has boosted the performance substantially for various tasks. A key component of automatic augmentation search is the evaluation process for a particular augmentation policy, which is utilized to return reward and usually runs thousands of times. A plain evaluation process, which includes full model training and validation, would be time-consuming. To achieve efficiency, many choose to sacrifice evaluation reliability for speed. In this paper, we dive into the dynamics of augmented training of the model. This inspires us to design a powerful and efficient proxy task based on the Augmentation-Wise Weight Sharing (AWS) to form a fast yet accurate evaluation process in an elegant way. Comprehensive analysis verifies the superiority of this approach in terms of effectiveness and efficiency. The augmentation policies found by our method achieve superior accuracies compared with existing auto-augmentation search methods. On CIFAR-10, we achieve a top-1 error rate of 1.24%, which is currently the best performing single model without extra training data. On ImageNet, we get a top-1 error rate of 20.36% for ResNet-50, which leads to 3.34% absolute error rate reduction over the baseline augmentation.

cs.LG↗

arXiv2020

Adaptive Gradient Method with Resilience and Momentum

Several variants of stochastic gradient descent (SGD) have been proposed to improve the learning effectiveness and efficiency when training deep neural networks, among which some recent influential attempts would like to adaptively control the parameter-wise learning rate (e.g., Adam and RMSProp). Although they show a large improvement in convergence speed, most adaptive learning rate methods suffer from compromised generalization compared with SGD. In this paper, we proposed an Adaptive Gradient Method with Resilience and Momentum (AdaRem), motivated by the observation that the oscillations of network parameters slow the training, and give a theoretical proof of convergence. For each parameter, AdaRem adjusts the parameter-wise learning rate according to whether the direction of one parameter changes in the past is aligned with the direction of the current gradient, and thus encourages long-term consistent parameter updating with much fewer oscillations. Comprehensive experiments have been conducted to verify the effectiveness of AdaRem when training various models on a large-scale image recognition dataset, e.g., ImageNet, which also demonstrate that our method outperforms previous adaptive learning rate-based algorithms in terms of the training speed and the test error, respectively.

cs.LG↗

arXiv2020

On Front-end Gain Invariant Modeling for Wake Word Spotting

Wake word (WW) spotting is challenging in far-field due to the complexities and variations in acoustic conditions and the environmental interference in signal transmission. A suite of carefully designed and optimized audio front-end (AFE) algorithms help mitigate these challenges and provide better quality audio signals to the downstream modules such as WW spotter. Since the WW model is trained with the AFE-processed audio data, its performance is sensitive to AFE variations, such as gain changes. In addition, when deploying to new devices, the WW performance is not guaranteed because the AFE is unknown to the WW model. To address these issues, we propose a novel approach to use a new feature called $Δ$LFBE to decouple the AFE gain variations from the WW model. We modified the neural network architectures to accommodate the delta computation, with the feature extraction module unchanged. We evaluate our WW models using data collected from real household settings and showed the models with the $Δ$LFBE is robust to AFE gain changes. Specifically, when AFE gain changes up to $\pm$12dB, the baseline CNN model lost up to relative 19.0% in false alarm rate or 34.3% in false reject rate, while the model with $Δ$LFBE demonstrates no performance loss.

eess.AS↗

arXiv2020

Intra-Utterance Similarity Preserving Knowledge Distillation for Audio Tagging

Knowledge Distillation (KD) is a popular area of research for reducing the size of large models while still maintaining good performance. The outputs of larger teacher models are used to guide the training of smaller student models. Given the repetitive nature of acoustic events, we propose to leverage this information to regulate the KD training for Audio Tagging. This novel KD method, "Intra-Utterance Similarity Preserving KD" (IUSP), shows promising results for the audio tagging task. It is motivated by the previously published KD method: "Similarity Preserving KD" (SP). However, instead of preserving the pairwise similarities between inputs within a mini-batch, our method preserves the pairwise similarities between the frames of a single input utterance. Our proposed KD method, IUSP, shows consistent improvements over SP across student models of different sizes on the DCASE 2019 Task 5 dataset for audio tagging. There is a 27.1% to 122.4% percent increase in improvement of micro AUPRC over the baseline relative to SP's improvement of over the baseline.

eess.AS↗

arXiv2020

Chandra and XMM-Newton observations of A2256: cold fronts, merger shocks, and constraint on the IC emission

We present the results of deep Chandra and XMM-Newton observations of a complex merging galaxy cluster Abell 2256 (A2256) that hosts a spectacular radio relic (RR). The temperature and metallicity maps show clear evidence of a merger between the western subcluster (SC) and the primary cluster (PC). We detect five X-ray surface brightness edges. Three of them near the cluster center are cold fronts (CFs): CF1 is associated with the infalling SC; CF2 is located in the east of the PC; and CF3 is to the west of the PC core. The other two edges at cluster outskirts are shock fronts (SFs): SF1 near the RR in the NW has Mach numbers derived from the temperature and the density jumps, respectively, of $M_T=1.62\pm0.12$ and $M_ρ=1.23\pm0.06$; SF2 in the SE has $M_T=1.54\pm0.05$ and $M_ρ=1.16\pm0.13$. In the region of the RR, there is no evidence for the correlation between X-ray and radio substructures, from which we estimate an upper limit for the inverse-Compton emission, and therefore set a lower limit on the magnetic field ($\sim$ 450 kpc from PC center) of $B>1.0\ μ$G for a single power-law electron spectrum or $B>0.4\ μ$G for a broken power-law electron spectrum. We propose a merger scenario including a PC, an SC, and a group. Our merger scenario accounts for the X-ray edges, diffuse radio features, and galaxy kinematics, as well as projection effects.

astro-ph.GA↗

arXiv2020

A Joint Framework for Audio Tagging and Weakly Supervised Acoustic Event Detection Using DenseNet with Global Average Pooling

This paper proposes a network architecture mainly designed for audio tagging, which can also be used for weakly supervised acoustic event detection (AED). The proposed network consists of a modified DenseNet as the feature extractor, and a global average pooling (GAP) layer to predict frame-level labels at inference time. This architecture is inspired by the work proposed by Zhou et al., a well-known framework using GAP to localize visual objects given image-level labels. While most of the previous works on weakly supervised AED used recurrent layers with attention-based mechanism to localize acoustic events, the proposed network directly localizes events using the feature map extracted by DenseNet without any recurrent layers. In the audio tagging task of DCASE 2017, our method significantly outperforms the state-of-the-art method in F1 score by 5.3% on the dev set, and 6.0% on the eval set in terms of absolute values. For weakly supervised AED task in DCASE 2018, our model outperforms the state-of-the-art method in event-based F1 by 8.1% on the dev set, and 0.5% on the eval set in terms of absolute values, by using data augmentation and tri-training to leverage unlabeled data.

eess.AS↗

arXiv2020

Properties of the Hot Ambient Medium of Early-type Galaxies Hosting Powerful Radio Sources

We present an archival analysis of Chandra X-ray observations for twelve nearby early-type galaxies hosting radio sources with radio power $>10^{23} \, \rm{W}~\rm{Hz}^{-1}$ at 1.4 GHz, similar to the radio power of the radio source in NGC 4261. Previously, in a similar analysis of eight nearby X-ray and optically-bright elliptical galaxies, Werner et al. 2012, found that NGC 4261 exhibited unusually low central gas entropy compared to the full sample. In the central 0.3 kpc of NGC 4261, the ratio of cooling time to freefall time ($t_{\rm{cool}}/t_{\rm ff}$) is less than $10$, indicating that cold clouds may be precipitating out of the hot ambient medium and providing fuel for accretion in the central region. NGC 4261 also hosts the most powerful radio source in the original sample. Because NGC 4261 may represent an important phase during which powerful feedback from a central active galactic nucleus (AGN) is fueled by multiphase condensation in the central kpc, we searched the Chandra archive for analogs to NGC 4261. We present entropy profiles of those galaxies as well as profiles of $t_{\rm{cool}}/t_{\rm ff}$. We find that one of them, IC 4296, exhibits properties similar to NGC 4261, including the presence of only single phase gas outside of $r \sim 2$ kpc and a similar central velocity dispersion. We compare the properties of NGC 4261 and IC 4296 to hydrodynamic simulations of AGN feedback fueled by precipitation. Over the course of those simulations, the single phase galaxy has an entropy gradient that remains similar to the entropy profiles inferred from our observations.

astro-ph.GA↗

arXiv2020

The ram pressure stripped radio tails of galaxies in the Coma cluster

Previous studies have revealed a population of galaxies in galaxy clusters with ram pressure stripped (RPS) tails of gas and embedded young stars. We observed 1.4 GHz continuum and HI emission with the Very Large Array in its B-configuration in two fields of the Coma cluster to study the radio properties of RPS galaxies. The best continuum sensitivities in the two fields are 6 and 8 $μ$Jy per 4'' beam respectively, which are 4 and 3 times deeper than those previously published. Radio continuum tails are found in 10 (8 are new) out of 20 RPS galaxies, unambiguously revealing the presence of relativistic electrons and magnetic fields in the stripped tails. Our results also hint that the tail has a steeper spectrum than the galaxy. The 1.4 GHz continuum in the tails is enhanced relative to their H$α$ emission by a factor of $\sim$7 compared to the main bodies of the RPS galaxies. The 1.4 GHz continuum of the RPS galaxies is also enhanced relative to their IR emission by a factor of $\sim$2 compared to star-forming galaxies. The enhancement is likely related to ram pressure and turbulence in the tail. We furthermore present HI detections in three RPS galaxies and upper limits for the other RPS galaxies. The cold gas in D100's stripped tail is dominated by molecular gas, which is likely a consequence of the high ambient pressure. No evidence of radio emission associated with ultra-diffuse galaxies is found in our data.

astro-ph.GA↗

arXiv2020

Powering One-shot Topological NAS with Stabilized Share-parameter Proxy

One-shot NAS method has attracted much interest from the research community due to its remarkable training efficiency and capacity to discover high performance models. However, the search spaces of previous one-shot based works usually relied on hand-craft design and were short for flexibility on the network topology. In this work, we try to enhance the one-shot NAS by exploring high-performing network architectures in our large-scale Topology Augmented Search Space (i.e., over 3.4*10^10 different topological structures). Specifically, the difficulties for architecture searching in such a complex space has been eliminated by the proposed stabilized share-parameter proxy, which employs Stochastic Gradient Langevin Dynamics to enable fast shared parameter sampling, so as to achieve stabilized measurement of architecture performance even in search space with complex topological structures. The proposed method, namely Stablized Topological Neural Architecture Search (ST-NAS), achieves state-of-the-art performance under Multiply-Adds (MAdds) constraint on ImageNet. Our lite model ST-NAS-A achieves 76.4% top-1 accuracy with only 326M MAdds. Our moderate model ST-NAS-B achieves 77.9% top-1 accuracy just required 503M MAdds. Both of our models offer superior performances in comparison to other concurrent works on one-shot NAS.

cs.CV↗

arXiv2020

Large-Scale Object Detection in the Wild from Imbalanced Multi-Labels

Training with more data has always been the most stable and effective way of improving performance in deep learning era. As the largest object detection dataset so far, Open Images brings great opportunities and challenges for object detection in general and sophisticated scenarios. However, owing to its semi-automatic collecting and labeling pipeline to deal with the huge data scale, Open Images dataset suffers from label-related problems that objects may explicitly or implicitly have multiple labels and the label distribution is extremely imbalanced. In this work, we quantitatively analyze these label problems and provide a simple but effective solution. We design a concurrent softmax to handle the multi-label problems in object detection and propose a soft-sampling methods with hybrid training scheduler to deal with the label imbalance. Overall, our method yields a dramatic improvement of 3.34 points, leading to the best single model with 60.90 mAP on the public object detection test set of Open Images. And our ensembling result achieves 67.17 mAP, which is 4.29 points higher than the best result of Open Images public test 2018.

cs.CV↗

arXiv2020

Atacama Compact Array Measurements of the Molecular Mass in the NGC 5044 Cooling Flow Group

The fate of cooling gas in the centers of galaxy clusters and groups is still not well understood, as is also the case for the complex processes of triggering star formation in central dominant galaxies (CDGs), re-heating of cooled gas by AGN, and the triggering/feeding of supermassive black hole outbursts. We present CO observations of the early type galaxy NGC 5044, which resides at the center of an X-ray bright group with a moderate cooling flow. For our analysis we combine CO(2-1) data from the 7m antennae of the Atacama Compact Array (ACA), and the ACA total power array (TP). We demonstrate, using the 7m array data, that we can recover the total flux inferred from IRAM 30m single dish observations, which corresponds to a total molecular mass of about 4x10^7 Msun. Most of the recovered flux is blueshifted with respect to the galaxy rest frame and is extended on kpc-scales, suggesting low filling factor dispersed clouds. We find 8 concentrations of molecular gas out to a radius of 10 arcsec (1.5 kpc), which we identify with giant molecular clouds. The total molecular gas mass is more centrally concentrated than the X-ray emitting gas, but extended in the north-east/south-west direction beyond the IRAM 30m beam. We also compare the spatial extent of the molecular gas to the Halpha emission: The CO emission coincides with the very bright Halpha region in the center. We do not detect CO emission in the fainter Halpha regions. Furthermore, we find two CO absorption features spatially located at the center of the galaxy, within 5 pc projected distance of the AGN, infalling at 255 and 265 km/s relative to the AGN. This indicates that the two giant molecular clouds seen in absorption are most likely within the sphere of influence of the supermassive black hole.

astro-ph.GA↗

arXiv2020

Few-shot acoustic event detection via meta-learning

We study few-shot acoustic event detection (AED) in this paper. Few-shot learning enables detection of new events with very limited labeled data. Compared to other research areas like computer vision, few-shot learning for audio recognition has been under-studied. We formulate few-shot AED problem and explore different ways of utilizing traditional supervised methods for this setting as well as a variety of meta-learning approaches, which are conventionally used to solve few-shot classification problem. Compared to supervised baselines, meta-learning models achieve superior performance, thus showing its effectiveness on generalization to new audio events. Our analysis including impact of initialization and domain discrepancy further validate the advantage of meta-learning approaches in few-shot AED.

cs.LG↗

arXiv2020

A Comparison of Pooling Methods on LSTM Models for Rare Acoustic Event Classification

Acoustic event classification (AEC) and acoustic event detection (AED) refer to the task of detecting whether specific target events occur in audios. As long short-term memory (LSTM) leads to state-of-the-art results in various speech related tasks, it is employed as a popular solution for AEC as well. This paper focuses on investigating the dynamics of LSTM model on AEC tasks. It includes a detailed analysis on LSTM memory retaining, and a benchmarking of nine different pooling methods on LSTM models using 1.7M generated mixture clips of multiple events with different signal-to-noise ratios. This paper focuses on understanding: 1) utterance-level classification accuracy; 2) sensitivity to event position within an utterance. The analysis is done on the dataset for the detection of rare sound events from DCASE 2017 Challenge. We find max pooling on the prediction level to perform the best among the nine pooling approaches in terms of classification accuracy and insensitivity to event position within an utterance. To authors' best knowledge, this is the first kind of such work focused on LSTM dynamics for AEC tasks.

eess.AS↗

arXiv2020

AGN feedback in the FR II galaxy 3C 220.1

We present results from a deep (174 ks) Chandra observation of the FR-II radio galaxy 3C 220.1, the central brightest cluster galaxy (BCG) of a $kT \sim$ 4 keV cluster at $z=0.61$. The temperature of the hot cluster medium drops from $\sim5.9$ keV to $\sim3.9$ keV at $\sim$ 35 kpc radius, while the temperature at smaller radii may be substantially lower. The central active galactic nucleus (AGN) outshines the whole cluster in X-rays, with a bolometric luminosity of $2.0\times10^{46}$ erg s$^{-1}$ ($\sim10$% of the Eddington rate). The system shows a pair of potential X-ray cavities $\sim35$ kpc east and west of the nucleus. The cavity power is estimated within the range of $1.0\times10^{44}$ erg s$^{-1}$ and $1.7\times10^{45}$ erg s$^{-1}$, from different methods. The X-ray enhancements in the radio lobes could be due to inverse Compton emission, with a total 2-10 keV luminosity of $\sim8.0\times10^{42}$ erg s$^{-1}$. We compare 3C 220.1 with other cluster BCGs, including Cygnus A, as there are few BCGs in rich clusters hosting an FR-II galaxy. We also summarize the jet power of FR-II galaxies from different methods. The comparison suggests that the cavity power of FR-II galaxies likely under-estimates the jet power. The properties of 3C 220.1 suggest that it is at the transition stage from quasar-mode feedback to radio-mode feedback.

astro-ph.HE↗

arXiv2019

Computation Reallocation for Object Detection

The allocation of computation resources in the backbone is a crucial issue in object detection. However, classification allocation pattern is usually adopted directly to object detector, which is proved to be sub-optimal. In order to reallocate the engaged computation resources in a more efficient way, we present CR-NAS (Computation Reallocation Neural Architecture Search) that can learn computation reallocation strategies across different feature resolution and spatial position diectly on the target detection dataset. A two-level reallocation space is proposed for both stage and spatial reallocation. A novel hierarchical search procedure is adopted to cope with the complex search space. We apply CR-NAS to multiple backbones and achieve consistent improvements. Our CR-ResNet50 and CR-MobileNetV2 outperforms the baseline by 1.9% and 1.7% COCO AP respectively without any additional computation budget. The models discovered by CR-NAS can be equiped to other powerful detection neck/head and be easily transferred to other dataset, e.g. PASCAL VOC, and other vision tasks, e.g. instance segmentation. Our CR-NAS can be used as a plugin to improve the performance of various networks, which is demanding.

cs.CV↗