arXiv subjects

Ming Sun

Publications and source records attributed to Ming Sun.

At least 127 records · Page 7Linked to original sources

arXiv2022

NTIRE 2022 Challenge on High Dynamic Range Imaging: Methods and Results

This paper reviews the challenge on constrained high dynamic range (HDR) imaging that was part of the New Trends in Image Restoration and Enhancement (NTIRE) workshop, held in conjunction with CVPR 2022. This manuscript focuses on the competition set-up, datasets, the proposed methods and their results. The challenge aims at estimating an HDR image from multiple respective low dynamic range (LDR) observations, which might suffer from under- or over-exposed regions and different sources of noise. The challenge is composed of two tracks with an emphasis on fidelity and complexity constraints: In Track 1, participants are asked to optimize objective fidelity scores while imposing a low-complexity constraint (i.e. solutions can not exceed a given number of operations). In Track 2, participants are asked to minimize the complexity of their solutions while imposing a constraint on fidelity scores (i.e. solutions are required to obtain a higher fidelity score than the prescribed baseline). Both tracks use the same data and metrics: Fidelity is measured by means of PSNR with respect to a ground-truth HDR image (computed both directly and with a canonical tonemapping operation), while complexity metrics include the number of Multiply-Accumulate (MAC) operations and runtime (in seconds).

cs.CV↗

arXiv2022

Federated Self-Supervised Learning for Acoustic Event Classification

Standard acoustic event classification (AEC) solutions require large-scale collection of data from client devices for model optimization. Federated learning (FL) is a compelling framework that decouples data collection and model training to enhance customer privacy. In this work, we investigate the feasibility of applying FL to improve AEC performance while no customer data can be directly uploaded to the server. We assume no pseudo labels can be inferred from on-device user inputs, aligning with the typical use cases of AEC. We adapt self-supervised learning to the FL framework for on-device continual learning of representations, and it results in improved performance of the downstream AEC classifiers without labeled/pseudo-labeled data available. Compared to the baseline w/o FL, the proposed method improves precision up to 20.3\% relatively while maintaining the recall. Our work differs from prior work in FL in that our approach does not require user-generated learning targets, and the data we use is collected from our Beta program and is de-identified, to maximally simulate the production settings.

cs.SD↗

arXiv2022

Chandra view of Abell 407: the central compact group of galaxies and the interaction between the radio AGN and the ICM

Abell 407 (A407) is a unique galaxy cluster hosting a central compact group of nine galaxies (named as 'Zwicky's Nonet'; G1 - G9 in this work) within a 30 kpc radius region. The cluster core also hosts a luminous radio active galactic nucleus (AGN), 4C 35.06 with helically twisted jets extending over 200 kpc. With a 44 ks Chandra observation of A407, we characterize the X-ray properties of its intracluster medium (ICM) and central galaxies. The mean X-ray temperature of A407 is 2.7 keV and the $M_{200}$ is $1.9 \times 10^{14} {M_{\odot}}$. We suggest that A407 has a weak cool core at $r < 60$ kpc scales and at its very center, $< 1$-2 kpc radius, a small galaxy corona associated with the strong radio AGN. We also conclude that the AGN 4C 35.06 host galaxy is most likely G3. We suggest that the central group of galaxies is undergoing a `slow merge' procedure. The range of the merging time-scale is $0.3\sim2.3$ Gyr and the stellar mass of the future brightest cluster galaxy (BCG) will be $7.4\times10^{11} M_{\odot}$. We find that the regions which overlap with the radio jets have higher temperature and metallicity. This is consistent with AGN feedback activity. The central entropy is higher than that for other clusters, which may be due to the AGN feedback and/or merging activity. With all these facts, we suggest that A407 is a unique and rare system in the local universe that could help us to understand the formation of a massive BCG.

astro-ph.GA↗

arXiv2022

MUSE sneaks a peek at extreme ram-pressure stripping events -- V. Towards a complete view of the galaxy cluster A1367

We present an analysis of the kinematics and ionization conditions in a sample composed of seven star-forming galaxies undergoing ram-pressure stripping in the A1367 cluster, and the galaxy ESO137-001 in the Norma cluster. MUSE observations of two new galaxies in this sample, CGCG097-073 and CGCG097-079, are also presented. This sample is characterized by homogeneous integral field spectroscopy with MUSE and by a consistent selection based on the presence of ionised gas tails. The ratio [OI]/H$α$ is consistently elevated in the tails of these objects compared to what observed in unperturbed galaxy disks, an ubiquitous feature which we attribute to shocks or turbulent phenomena in the stripped gas. Compact star-forming regions are observed in only $\approx$ 50% of the tails, implying that specific (currently unknown) conditions are needed to trigger star formation inside the stripped gas. Focusing on the interface regions between the interstellar and intracluster medium, we observe different line ratios that we associate to different stages of the stripping process, with galaxies at an early stage of perturbation showing more prominent signatures of elevated star formation. Our analysis thus demonstrates the power of a well selected and homogeneous sample to infer general properties arising from ram-pressure stripping inside local clusters.

astro-ph.GA↗

arXiv2022

Non-star-forming molecular gas in the Abell 1367 intra-cluster multiphase orphan cloud

We report the detection of CO emission in the recently discovered multiphase isolated gas cloud in the nearby galaxy cluster Abell 1367. The cloud is located about 800 kpc in projection from the center of the cluster and at a projected distance of > 80 kpc from any galaxy. It is the first and the only known isolated intra-cluster cloud detected in X-ray, H$α$, and CO emission. We found a total of about $2.2\times 10^8 M_\odot$ of H$_2$ with the IRAM 30-m telescope in two regions, one associated with the peak of H$α$ emission and another with the peak of X-ray emission surrounded by weak H$α$ filaments. The velocity of the molecular gas is offset from the underlying H$α$ emission by > 100 km s$^{-1}$ in the region where the X-ray peaks. The molecular gas may account for about 10% of the total cloud's mass, which is dominated by the hot X-ray component. The previously measured upper limit on the star formation rate in the cloud indicates that the molecular component is in a non-star-forming state, possibly due to a combination of low density of the gas and the observed level of velocity dispersion. The presence of the three gas phases associated with the cloud suggests that gas phase mixing with the surrounding intra-cluster medium is taking place. The possible origin of the orphan cloud is a late evolutionary stage of a ram pressure stripping event. In contrast, the nearby ram pressure stripped galaxy 2MASX J11443212+2006238 is in an early phase of stripping and we detected about $2.4\times 10^9 M_\odot$ of H$_2$ in its main body.

astro-ph.GA↗

arXiv2021

A universal correlation between warm and hot gas in the stripped tails of cluster galaxies

The impact of ram pressure stripping on galaxy evolution is well known. Recent multi-wavelength data have revealed many examples of galaxies undergoing stripping, often accompanied with multi-phase tails. As energy transfer in the multi-phase medium is an outstanding question in astrophysics, galaxies in stripping are great objects to study. Despite the recent burst of observational evidence, the relationship between gas in different phases in the tails is poorly known. Here we report a strong linear correlation between the X-ray surface brightness and the H$α$ surface brightness of the diffuse gas in the stripped tails at $\sim$ 10 - 40 kpc scales, with a slope of $\sim$ 3.5. This discovery provides evidence for the mixing of the stripped interstellar medium with the hot intracluster medium as the origin of the multi-phase tails. The established relation in stripped tails, also in comparison with the likely related correlations in similar environments like galactic winds and X-ray cool cores, provides an important test for models of energy transfer in the multi-phase gas. It also indicates the importance of the H$α$ data to study clumping and turbulence in the intracluster medium.

astro-ph.GA↗

arXiv2021

GATER: Learning Grasp-Action-Target Embeddings and Relations for Task-Specific Grasping

Intelligent service robots require the ability to perform a variety of tasks in dynamic environments. Despite the significant progress in robotic grasping, it is still a challenge for robots to decide grasping position when given different tasks in unstructured real life environments. In order to overcome this challenge, creating a proper knowledge representation framework is the key. Unlike the previous work, in this paper, task is defined as a triplet including grasping tool, desired action and target object. Our proposed algorithm GATER (Grasp--Action--Target Embeddings and Relations) models the relationship among grasping tools--action--target objects in embedding space. To validate our method, a novel dataset is created for task-specific grasping. GATER is trained on the new dataset and achieve task-specific grasping inference with 94.6\% success rate. Finally, the effectiveness of GATER algorithm is tested on a real service robot platform. GATER algorithm has its potential in human behavior prediction and human-robot interaction.

cs.RO↗

arXiv2021

ESO 137-002: a large spiral undergoing edge-on ram-pressure stripping with little star formation in the tail

Ram pressure stripping (RPS) is an important mechanism for galaxy evolution. In this work, we present results from HST and APEX observations of one RPS galaxy, ESO 137-002 in the closest rich cluster Abell 3627. The galaxy is known to host prominent X-ray and H$α$ tails. The HST data reveal significant features indicative of RPS in the galaxy, including asymmetric distribution of dust in the galaxy, dust filaments and dust clouds in ablation generally aligned with the direction of ram pressure, and young star clusters immediately upstream of the residual dust clouds that suggest star formation (SF) triggered by RPS. The distribution of the molecular gas is asymmetric in the galaxy, with no CO upstream and abundant CO downstream and in the inner tail region. A total amount of $\sim 5.5 \times 10^{9}$ M$_\odot$ of molecular gas is detected in the galaxy and its tail. On the other hand, we do not detect any active SF in the X-ray and H$α$ tails of ESO 137-002 with the HST data and place a limit on the SF efficiency in the tail. Hence, if selected by SF behind the galaxy in the optical or UV (e.g., surveys like GASP or using the Galex data), ESO 137-002 will not be considered a ``jellyfish'' galaxy. Thus, galaxies like ESO 137-002 are important for our comprehensive understanding of RPS galaxies and the evolution of the stripped material. ESO 137-002 also presents a great example of an edge-on galaxy experiencing a nearly edge-on RPS wind.

astro-ph.GA↗

arXiv2021

The BIG X-ray tail

Galaxy clusters grow primarily through the continuous accretion of group-scale haloes. Group galaxies experience preprocessing during their journey into clusters. A star-bursting compact group, the Blue Infalling Group (BIG), is plunging into the nearby cluster A1367. Previous optical observations reveal rich tidal features in the BIG members, and a long H$α$ trail behind. Here we report the discovery of a projected $\sim 250$ kpc X-ray tail behind the BIG using Chandra and XMM-Newton observations. The total hot gas mass in the tail is $\sim 7\times 10^{10}\ {\rm M}_\odot$ with an X-ray bolometric luminosity of $\sim 3.8\times 10^{41}$ erg s$^{-1}$. The temperature along the tail is $\sim 1$ keV, but the apparent metallicity is very low, an indication of the multi-$T$ nature of the gas. The X-ray and H$α$ surface brightnesses in the front part of the BIG tail follow the tight correlation established from a sample of stripped tails in nearby clusters, which suggests the multiphase gas originates from the mixing of the stripped interstellar medium (ISM) with the hot intracluster medium (ICM). Because thermal conduction and hydrodynamic instabilities are significantly suppressed, the stripped ISM can be long lived and produce ICM clumps. The BIG provides us a rare laboratory to study galaxy transformation and preprocessing.

astro-ph.GA↗

arXiv2021

Evolving Search Space for Neural Architecture Search

The automation of neural architecture design has been a coveted alternative to human experts. Recent works have small search space, which is easier to optimize but has a limited upper bound of the optimal solution. Extra human design is needed for those methods to propose a more suitable space with respect to the specific task and algorithm capacity. To further enhance the degree of automation for neural architecture search, we present a Neural Search-space Evolution (NSE) scheme that iteratively amplifies the results from the previous effort by maintaining an optimized search space subset. This design minimizes the necessity of a well-designed search space. We further extend the flexibility of obtainable architectures by introducing a learnable multi-branch setting. By employing the proposed method, a consistent performance gain is achieved during a progressive search over upcoming search spaces. We achieve 77.3% top-1 retrain accuracy on ImageNet with 333M FLOPs, which yielded a state-of-the-art performance among previous auto-generated architectures that do not involve knowledge distillation or weight pruning. When the latency constraint is adopted, our result also performs better than the previous best-performing mobile models with a 77.9% Top-1 retrain accuracy.

cs.CV↗

arXiv2021

GLiT: Neural Architecture Search for Global and Local Image Transformer

We introduce the first Neural Architecture Search (NAS) method to find a better transformer architecture for image recognition. Recently, transformers without CNN-based backbones are found to achieve impressive performance for image recognition. However, the transformer is designed for NLP tasks and thus could be sub-optimal when directly used for image recognition. In order to improve the visual representation ability for transformers, we propose a new search space and searching algorithm. Specifically, we introduce a locality module that models the local correlations in images explicitly with fewer computational cost. With the locality module, our search space is defined to let the search algorithm freely trade off between global and local information as well as optimizing the low-level design choice in each module. To tackle the problem caused by huge search space, a hierarchical neural architecture search method is proposed to search the optimal vision transformer from two levels separately with the evolutionary algorithm. Extensive experiments on the ImageNet dataset demonstrate that our method can find more discriminative and efficient transformer variants than the ResNet family (e.g., ResNet101) and the baseline ViT for image classification.

cs.CV↗

arXiv2021

BN-NAS: Neural Architecture Search with Batch Normalization

We present BN-NAS, neural architecture search with Batch Normalization (BN-NAS), to accelerate neural architecture search (NAS). BN-NAS can significantly reduce the time required by model training and evaluation in NAS. Specifically, for fast evaluation, we propose a BN-based indicator for predicting subnet performance at a very early training stage. The BN-based indicator further facilitates us to improve the training efficiency by only training the BN parameters during the supernet training. This is based on our observation that training the whole supernet is not necessary while training only BN parameters accelerates network convergence for network architecture search. Extensive experiments show that our method can significantly shorten the time of training supernet by more than 10 times and shorten the time of evaluating subnets by more than 600,000 times without losing accuracy.

cs.CV↗

arXiv2021

PSViT: Better Vision Transformer via Token Pooling and Attention Sharing

In this paper, we observe two levels of redundancies when applying vision transformers (ViT) for image recognition. First, fixing the number of tokens through the whole network produces redundant features at the spatial level. Second, the attention maps among different transformer layers are redundant. Based on the observations above, we propose a PSViT: a ViT with token Pooling and attention Sharing to reduce the redundancy, effectively enhancing the feature representation ability, and achieving a better speed-accuracy trade-off. Specifically, in our PSViT, token pooling can be defined as the operation that decreases the number of tokens at the spatial level. Besides, attention sharing will be built between the neighboring transformer layers for reusing the attention maps having a strong correlation among adjacent layers. Then, a compact set of the possible combinations for different token pooling and attention sharing mechanisms are constructed. Based on the proposed compact set, the number of tokens in each layer and the choices of layers sharing attention can be treated as hyper-parameters that are learned from data automatically. Experimental results show that the proposed scheme can achieve up to 6.6% accuracy improvement in ImageNet classification compared with the DeiT.

cs.CV↗

arXiv2021

An H$α$/X-ray orphan cloud as a signpost of the intracluster medium clumping

Recent studies have highlighted the potential significance of intracluster medium (ICM) clumping and its important implications for cluster cosmology and baryon physics. Many of the ICM clumps can originate from infalling galaxies, as stripped interstellar medium (ISM) mixing into the hot ICM. However, a direct connection between ICM clumping and stripped ISM has not been unambiguously established before. Here we present the discovery of the first and still the only known isolated cloud (or orphan cloud, OC) detected in both X-rays and H$α$ in the nearby cluster Abell 1367. With an effective radius of 30 kpc, this cloud has an average X-ray temperature of 1.6 keV, a bolometric X-ray luminosity of $\sim 3.1\times 10^{41}$ erg s$^{-1}$ and a hot gas mass of $\sim 10^{10}\ {\rm M}_\odot$. From the MUSE data, the OC shows an interesting velocity gradient nearly along the east-west direction with a low level of velocity dispersion of $\sim 80$ km/s, which may suggest a low level of the ICM turbulence. The emission line diagnostics suggest little star formation in the main H$α$ cloud and a LI(N)ER-like spectrum, but the excitation mechanism remain unclear. This example shows that the stripped ISM, even long time after the initial removal from the galaxy, can still induce the ICM inhomogeneities. We suggest that magnetic field can stabilize the OC by suppressing hydrodynamic instabilities and thermal conduction. This example also suggests that at least some ICM clumps are multi-phase in nature and implies that the ICM clumps can also be traced in H$α$. Thus, future deep and wide-field H$α$ survey can be used to probe the ICM clumping and turbulence.

astro-ph.GA↗

arXiv2021

AutoSampling: Search for Effective Data Sampling Schedules

Data sampling acts as a pivotal role in training deep learning models. However, an effective sampling schedule is difficult to learn due to the inherently high dimension of parameters in learning the sampling schedule. In this paper, we propose an AutoSampling method to automatically learn sampling schedules for model training, which consists of the multi-exploitation step aiming for optimal local sampling schedules and the exploration step for the ideal sampling distribution. More specifically, we achieve sampling schedule search with shortened exploitation cycle to provide enough supervision. In addition, we periodically estimate the sampling distribution from the learned sampling schedules and perturb it to search in the distribution space. The combination of two searches allows us to learn a robust sampling schedule. We apply our AutoSampling method to a variety of image classification tasks illustrating the effectiveness of the proposed method.

cs.CV↗

arXiv2021

Interaction of the massive cluster system Abell 3016/3017 embedded in a cosmic filament

The galaxy cluster system RXCJ0225.9-4154 with the two sub-clusters A3016 and A3017 is embedded in a large-scale structure filament with signatures of filamentary accretion. A Chandra observation of this system shows the two clusters as well as a filament of X-ray emission connecting them and a galaxy group therein. The main cluster, A3017, shows indications of shocks most probably from a recent interaction with cluster components along the filament axis as well as a cold front. The filament between the two clusters is likely to be heated by the accretion shocks of the clusters and we discuss two scenarios for the origin of this X-ray filament. The paper describes many properties of the components of the cluster merger system that are used to assist the interpretation of the observed configuration.

astro-ph.CO↗

arXiv2021

Efficient Transfer Learning via Joint Adaptation of Network Architecture and Weight

Transfer learning can boost the performance on the targettask by leveraging the knowledge of the source domain. Recent worksin neural architecture search (NAS), especially one-shot NAS, can aidtransfer learning by establishing sufficient network search space. How-ever, existing NAS methods tend to approximate huge search spaces byexplicitly building giant super-networks with multiple sub-paths, anddiscard super-network weights after a child structure is found. Both thecharacteristics of existing approaches causes repetitive network trainingon source tasks in transfer learning. To remedy the above issues, we re-duce the super-network size by randomly dropping connection betweennetwork blocks while embedding a larger search space. Moreover, wereuse super-network weights to avoid redundant training by proposinga novel framework consisting of two modules, the neural architecturesearch module for architecture transfer and the neural weight searchmodule for weight transfer. These two modules conduct search on thetarget task based on a reduced super-networks, so we only need to trainonce on the source task. We experiment our framework on both MS-COCO and CUB-200 for the object detection and fine-grained imageclassification tasks, and show promising improvements with onlyO(CN)super-network complexity.

cs.CV↗

arXiv2021

Inception Convolution with Efficient Dilation Search

As a variant of standard convolution, a dilated convolution can control effective receptive fields and handle large scale variance of objects without introducing additional computational costs. To fully explore the potential of dilated convolution, we proposed a new type of dilated convolution (referred to as inception convolution), where the convolution operations have independent dilation patterns among different axes, channels and layers. To develop a practical method for learning complex inception convolution based on the data, a simple but effective search algorithm, referred to as efficient dilation optimization (EDO), is developed. Based on statistical optimization, the EDO method operates in a low-cost manner and is extremely fast when it is applied on large scale datasets. Empirical results validate that our method achieves consistent performance gains for image recognition, object detection, instance segmentation, human detection, and human pose estimation. For instance, by simply replacing the 3x3 standard convolution in the ResNet-50 backbone with inception convolution, we significantly improve the AP of Faster R-CNN from 36.4% to 39.2% on MS COCO.

cs.CV↗