arXiv subjects

Tao Wang

Publications and source records attributed to Tao Wang.

At least 577 records · Page 32Linked to original sources

arXiv2022

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts

Scaling language models with more data, compute and parameters has driven significant progress in natural language processing. For example, thanks to scaling, GPT-3 was able to achieve strong results on in-context learning tasks. However, training these large dense models requires significant amounts of computing resources. In this paper, we propose and develop a family of language models named GLaM (Generalist Language Model), which uses a sparsely activated mixture-of-experts architecture to scale the model capacity while also incurring substantially less training cost compared to dense variants. The largest GLaM has 1.2 trillion parameters, which is approximately 7x larger than GPT-3. It consumes only 1/3 of the energy used to train GPT-3 and requires half of the computation flops for inference, while still achieving better overall zero-shot and one-shot performance across 29 NLP tasks.

cs.CL↗

arXiv2022

Dense Gas and Star Formation in Nearby Infrared Bright Galaxies: APEX survey of HCN and HCO+ J=2-1

Both Galactic and extragalactic studies on star formation suggest that stars form directly from dense molecular gas. To trace such high volume density gas, HCN and HCO+ J=1-0 have been widely used for their high dipole moments, relatively high abundances, and often being the strongest lines after CO. However, HCN and HCO+ J=1-0 emission could be arguably dominated by the gas components at low volume densities. HCN J=2-1 and HCO+ J=2-1, with more suitable critical densities and excitation requirements, would trace typical dense gas closely related to star formation. Here we report new observations of HCN J=2-1 and HCO+ J=2-1 towards 17 nearby infrared-bright galaxies with the APEX 12-m telescope. The correlation slopes between luminosities of HCN J=2-1, and HCO+ J=2-1 and total infrared emission are 1.03 +- 0.05 and 1.00 +- 0.05, respectively. The correlations of their surface densities, normalised with the area of radio/sub-millimeter continuum, show even tighter relations (Slopes: 0.99 +- 0.03 and 1.02 +- 0.03). The eight AGN-dominated galaxies show no significant difference from the eleven star-formation dominated galaxies in above relations. The average HCN/HCO+ ratios are 1.15 +- 0.26 and 0.98 +- 0.42 for AGN-dominated and star-formation dominated galaxies, respectively, without obvious dependencies on infrared luminosity, dust temperature, or infrared pumping. The Magellanic Clouds roughly follow the same correlations, expanding to eight orders of magnitude. On the other hand, ultra-luminous infrared galaxies with active galactic nucleus (AGN) systematically lay above the correlations, indicating potential biases introduced by AGNs.

astro-ph.GA↗

arXiv2022

On Mitigating Hard Clusters for Face Clustering

Face clustering is a promising way to scale up face recognition systems using large-scale unlabeled face images. It remains challenging to identify small or sparse face image clusters that we call hard clusters, which is caused by the heterogeneity, \ie, high variations in size and sparsity, of the clusters. Consequently, the conventional way of using a uniform threshold (to identify clusters) often leads to a terrible misclassification for the samples that should belong to hard clusters. We tackle this problem by leveraging the neighborhood information of samples and inferring the cluster memberships (of samples) in a probabilistic way. We introduce two novel modules, Neighborhood-Diffusion-based Density (NDDe) and Transition-Probability-based Distance (TPDi), based on which we can simply apply the standard Density Peak Clustering algorithm with a uniform threshold. Our experiments on multiple benchmarks show that each module contributes to the final performance of our method, and by incorporating them into other advanced face clustering methods, these two modules can boost the performance of these methods to a new state-of-the-art. Code is available at: https://github.com/echoanran/On-Mitigating-Hard-Clusters.

cs.CV↗

arXiv2022

Variable degeneracy of graphs with restricted structures

Bernshteyn and Lee defined a new notion, weak degeneracy, which is slightly weaker than the ordinary degeneracy. It is proved that strictly $f$-degenerate transversal is a common generalization of list coloring, $L$-forested-coloring and DP-coloring. In this paper, we consider three classes of graphs, including planar graphs without any configuration in Fig. 2, toroidal graphs without any configuration in Fig. 5, and planar graphs without intersecting $5$-cycles. We give structural results for each class of graphs, and prove each structure is reducible for weakly $3$-degenerate and the existence of strictly $f$-degenerate transversals. As consequences, these three classes of graphs are weakly $3$-degenerate, and have a strictly $f$-degenerate transversal. Then these three classes of graph have DP-paint number at most four, and have list vertex arboricity at most two. This greatly improve all the results in [2-4, 11-13, 16-18, 22, 25, 32, 34]. Furthermore, the first and the third classes of graphs have Alon-Tarsi number at most four.

math.CO↗

arXiv2022

Low star-formation activity and low gas content of quiescent galaxies at $z=$ 3.5-4.0 constrained with ALMA

The discovery in deep near-infrared surveys of a population of massive quiescent galaxies at $z>3$ has given rise to the question of how they came to be quenched so early in the history of the Universe. Measuring their molecular gas properties can distinguish between physical processes where they stop forming stars due to a lack of fuel versus those where star-formation efficiency is reduced and the gas is retained. We conducted Atacama Large Millimeter/sub-millimeter Array (ALMA) observations of four quiescent galaxies at $z=$ 3.5-4.0 found by the Fourstar Galaxy Evolution Survey (ZFOURGE) and a serendipitous optically dark galaxy at $z=3.71$. We aim to investigate the presence of dust-obscured star-formation and their gas content by observing the dust continuum emission at Band-7 and the atomic carbon [C I]($^3P_1$-$^3P_0$) line at 492.16 GHz. Among the four quiescent galaxies, only one source is detected in the dust continuum at $λ_{\rm obs} = 870 {\rm μm}$. The sub-mm observations confirm their passive nature, and all of them are located more than four times below the main sequence of star-forming galaxies at $z=3.7$. None of the targets are detected in [C I], constraining their gas mass fractions to be $<$ 20%. These gas mass fractions are more than three times lower than the scaling relation for star-forming galaxies at $z=3.7$. These results support scenarios where massive galaxies at $z=$ 3.5-4.0 quench by consuming/expelling all the gas rather than by reducing the efficiency of the conversion of their gas into stars.

astro-ph.GA↗

arXiv2022

DAMO-NLP at SemEval-2022 Task 11: A Knowledge-based System for Multilingual Named Entity Recognition

The MultiCoNER shared task aims at detecting semantically ambiguous and complex named entities in short and low-context settings for multiple languages. The lack of contexts makes the recognition of ambiguous named entities challenging. To alleviate this issue, our team DAMO-NLP proposes a knowledge-based system, where we build a multilingual knowledge base based on Wikipedia to provide related context information to the named entity recognition (NER) model. Given an input sentence, our system effectively retrieves related contexts from the knowledge base. The original input sentences are then augmented with such context information, allowing significantly better contextualized token representations to be captured. Our system wins 10 out of 13 tracks in the MultiCoNER shared task.

cs.CL↗

arXiv2022

Theoretical and experimental study on Noise Equivalent Power of X-ray semiconductor ultra-fast response material based on the rad-optic effect

Semiconductor material based on the rad-optic effect enables ultra-fast detection of X-rays and plays an important role in fusion diagnostics. Obtaining the accurate noise equivalent power (NEP) of the semiconductor ultrafast response material is the key to detecting X-rays. In this paper, the refractive index change mechanism of the semiconductor under X-ray irradiation was analyzed, and the quantitative relationship between the diffraction efficiency and the X-ray photon energy was established through the LT-AlGaAs diffraction imaging experiments. The impulse responses of LT-AlGaAs under 1 KeV-10 KeV X-ray radiation were calculated, revealing the variation of NEP density with radiated photon energy. In the case of bombarding the Al target to generate 1.5 KeV X-rays, the imaging experiments of LT-AlGaAs were performed. The diffraction image of LT-AlGaAs has a linear relationship with the radiation intensity, and the NEP density of LT-AlGaAs reaches 4.80*105W/cm2. This study has reference significance for the development of ultra-fast X-ray imaging systems based on the rad-optic effect.

physics.ins-det↗

arXiv2022

Dirichlet eigenvalues and exit time moments for symmetric Markov processes

We give some relationships between the first Dirichlet eigenvalues and the exit time moments for the general symmetric Markov processes. As applications, we present some examples, including symmetric diffusions and $α$-stable processes, and provide the estimates of their first Dirichlet eigenvalues and the exit time moments.

math.PR↗

arXiv2022

Subjective Quality Assessment for Images Generated by Computer Graphics

With the development of rendering techniques, computer graphics generated images (CGIs) have been widely used in practical application scenarios such as architecture design, video games, simulators, movies, etc. Different from natural scene images (NSIs), the distortions of CGIs are usually caused by poor rending settings and limited computation resources. What's more, some CGIs may also suffer from compression distortions in transmission systems like cloud gaming and stream media. However, limited work has been put forward to tackle the problem of computer graphics generated images' quality assessment (CG-IQA). Therefore, in this paper, we establish a large-scale subjective CG-IQA database to deal with the challenge of CG-IQA tasks. We collect 25,454 in-the-wild CGIs through previous databases and personal collection. After data cleaning, we carefully select 1,200 CGIs to conduct the subjective experiment. Several popular no-reference image quality assessment (NR-IQA) methods are tested on our database. The experimental results show that the handcrafted-based methods achieve low correlation with subjective judgment and deep learning based methods obtain relatively better performance, which demonstrates that the current NR-IQA models are not suitable for CG-IQA tasks and more effective models are urgently needed.

cs.GR↗

arXiv2022

Planar graphs without normally adjacent short cycles

Let $\mathscr{G}$ be the class of plane graphs without triangles normally adjacent to $8^{-}$-cycles, without $4$-cycles normally adjacent to $6^{-}$-cycles, and without normally adjacent $5$-cycles. In this paper, it is shown that every graph in $\mathscr{G}$ is $3$-choosable. Instead of proving this result, we directly prove a stronger result in the form of ``weakly'' DP-$3$-coloring. The main theorem improves the results in [J. Combin. Theory Ser. B 129 (2018) 38--54; European J. Combin. 82 (2019) 102995]. Consequently, every planar graph without $4$-, $6$-, $8$-cycles is $3$-choosable, and every planar graph without $4$-, $5$-, $7$-, $8$-cycles is $3$-choosable. In the third section, using almost the same technique, we prove that the vertex set of every graph in $\mathscr{G}$ can be partitioned into an independent set and a set that induces a forest, which strengthens the result in [Discrete Appl. Math. 284 (2020) 626--630]. In the final section, tightness is discussed.

math.CO↗

arXiv2022

A No-Reference Deep Learning Quality Assessment Method for Super-resolution Images Based on Frequency Maps

To support the application scenarios where high-resolution (HR) images are urgently needed, various single image super-resolution (SISR) algorithms are developed. However, SISR is an ill-posed inverse problem, which may bring artifacts like texture shift, blur, etc. to the reconstructed images, thus it is necessary to evaluate the quality of super-resolution images (SRIs). Note that most existing image quality assessment (IQA) methods were developed for synthetically distorted images, which may not work for SRIs since their distortions are more diverse and complicated. Therefore, in this paper, we propose a no-reference deep-learning image quality assessment method based on frequency maps because the artifacts caused by SISR algorithms are quite sensitive to frequency information. Specifically, we first obtain the high-frequency map (HM) and low-frequency map (LM) of SRI by using Sobel operator and piecewise smooth image approximation. Then, a two-stream network is employed to extract the quality-aware features of both frequency maps. Finally, the features are regressed into a single quality value using fully connected layers. The experimental results show that our method outperforms all compared IQA models on the selected three super-resolution quality assessment (SRQA) databases.

eess.IV↗

arXiv2022

Blind Surveillance Image Quality Assessment via Deep Neural Network Combined with the Visual Saliency

The intelligent video surveillance system (IVSS) can automatically analyze the content of the surveillance image (SI) and reduce the burden of the manual labour. However, the SIs may suffer quality degradations in the procedure of acquisition, compression, and transmission, which makes IVSS hard to understand the content of SIs. In this paper, we first conduct an example experiment (i.e. the face detection task) to demonstrate that the quality of the SIs has a crucial impact on the performance of the IVSS, and then propose a saliency-based deep neural network for the blind quality assessment of the SIs, which helps IVSS to filter the low-quality SIs and improve the detection and recognition performance. Specifically, we first compute the saliency map of the SI to select the most salient local region since the salient regions usually contain rich semantic information for machine vision and thus have a great impact on the overall quality of the SIs. Next, the convolutional neural network (CNN) is adopted to extract quality-aware features for the whole image and local region, which are then mapped into the global and local quality scores through the fully connected (FC) network respectively. Finally, the overall quality score is computed as the weighted sum of the global and local quality scores. Experimental results on the SI quality database (SIQD) show that the proposed method outperforms all compared state-of-the-art BIQA methods.

cs.MM↗

arXiv2022

Deep Neural Network for Blind Visual Quality Assessment of 4K Content

The 4K content can deliver a more immersive visual experience to consumers due to the huge improvement of spatial resolution. However, existing blind image quality assessment (BIQA) methods are not suitable for the original and upscaled 4K contents due to the expanded resolution and specific distortions. In this paper, we propose a deep learning-based BIQA model for 4K content, which on one hand can recognize true and pseudo 4K content and on the other hand can evaluate their perceptual visual quality. Considering the characteristic that high spatial resolution can represent more abundant high-frequency information, we first propose a Grey-level Co-occurrence Matrix (GLCM) based texture complexity measure to select three representative image patches from a 4K image, which can reduce the computational complexity and is proven to be very effective for the overall quality prediction through experiments. Then we extract different kinds of visual features from the intermediate layers of the convolutional neural network (CNN) and integrate them into the quality-aware feature representation. Finally, two multilayer perception (MLP) networks are utilized to map the quality-aware features into the class probability and the quality score for each patch respectively. The overall quality index is obtained through the average pooling of patch results. The proposed model is trained through the multi-task learning manner and we introduce an uncertainty principle to balance the losses of the classification and regression tasks. The experimental results show that the proposed model outperforms all compared BIQA metrics on four 4K content quality assessment databases.

cs.MM↗

arXiv2022

Quantum phase diagram for two species hardcore bosons in one-dimensional optical lattices with the resonantly driven Rabi frequency

We propose an experimental realization of the time-periodically modulated Rabi frequency and suggest density-dependent hoppings of two species hardcore bosons in a one-dimensional optical lattice. Distinct from the previous work [Phys. Rev. Research {\bf 2}, 013275 (2020)], we study effects in the first resonance region. In the effective Hamiltonian, the intra-species hopping occurs only if the density discrepancy of the other species on these sites is zero, while the inter-species one is allowed once the relevant density discrepancy becomes nonzero. At integer-$1$ filling, the quantum phase diagram of the effective Hamiltonian is determined by the perturbation analysis together with numerical calculations. We find that in the limit of dominant $J_{1}$, the system becomes a double-degenerate dimerized state, with spontaneously breaking the translation symmetry. The interplay of $J_{0}$, $J_{1}$ and the fixed ${\bar U}=1$ leads to three BKT transition lines and a tricritical BKT point. Exact transition lines are obtained by the level spectroscopic technique. Besides, general physical properties, including the charge gap, neutral gap, superfluid density and dimerization strength, are investigated as well.

cond-mat.quant-gas↗

arXiv2022

Topological and Algebraic Structures of Atanassov's Intuitionistic Fuzzy-Values Space

We prove that the space of intuitionistic fuzzy values (IFVs) with a linear order based on a score function and an accuracy function has the same algebraic structure as the one induced by a linear order based on a similarity function and an accuracy function. By introducing a new operator for IFVs via the linear order based on a score function and an accuracy function, we show that such an operator is a strong negation on IFVs. Moreover, we observe that the space of IFVs is a complete lattice and a Kleene algebra with the new operator. We also demonstrate that the topological space of IFVs with the order topology induced by the above two linear orders is not separable and metrizable but compact and connected. From some new perspectives,our results partially answer three open problems posed by Atanassov [Intuitionistic Fuzzy Sets: Theory and Applications, Springer, 1999] and [On Intuitionistic Fuzzy Sets Theory, Springer, 2012]. Furthermore, we construct an isomorphism between the spaces of IFVs and q-rung orthopedic fuzzy values (q-ROFVs) under the corresponding linear orders. To this end, we introduce the concept of admissible similarity measures with particular orders for IFSs, extending the existing definition of the similarity measure for IFSs, and construct an admissible similarity measure with a linear order based on a score function and an accuracy function, which is effectively applied to a pattern recognition problem about the classification of building materials.

cs.AI↗

arXiv2022

Uncertainty-based Network for Few-shot Image Classification

The transductive inference is an effective technique in the few-shot learning task, where query sets update prototypes to improve themselves. However, these methods optimize the model by considering only the classification scores of the query instances as confidence while ignoring the uncertainty of these classification scores. In this paper, we propose a novel method called Uncertainty-Based Network, which models the uncertainty of classification results with the help of mutual information. Specifically, we first data augment and classify the query instance and calculate the mutual information of these classification scores. Then, mutual information is used as uncertainty to assign weights to classification scores, and the iterative update strategy based on classification scores and uncertainties assigns the optimal weights to query instances in prototype optimization. Extensive results on four benchmarks show that Uncertainty-Based Network achieves comparable performance in classification accuracy compared to state-of-the-art method.

cs.CV↗

arXiv2022

Starbursts with suppressed velocity dispersion revealed in a forming cluster at z=2.51

One of the most prominent features of galaxy clusters is the presence of a dominant population of massive ellipticals in their cores. Stellar archaeology suggests that these gigantic beasts assembled most of their stars in the early Universe via starbursts. However, the role of dense environments and their detailed physical mechanisms in triggering starburst activities remain unknown. Here we report spatially resolved Atacama Large Millimeter/submillimeter Array (ALMA) observations of the CO $J= 3-2$ emission line, with a resolution of about 2.5 kiloparsecs, toward a forming galaxy cluster core with starburst galaxies at $z=2.51$. In contrast to starburst galaxies in the field often associated with galaxy mergers or highly turbulent gaseous disks, our observations show that the two starbursts in the cluster exhibit dynamically cold (rotation-dominated) gas-rich disks. Their gas disks have extremely low velocity dispersion ($σ_{\mathrm{0}} \sim 20-30$ km s$^{-1}$), which is three times lower than their field counterparts at similar redshifts. The high gas fraction and suppressed velocity dispersion yield gravitationally unstable gas disks, which enables highly efficient star formation. The suppressed velocity dispersion, likely induced by the accretion of corotating and coplanar cold gas, might serve as an essential avenue to trigger starbursts in massive halos at high redshifts.

astro-ph.GA↗

arXiv2022

FRIH: Fine-grained Region-aware Image Harmonization

Image harmonization aims to generate a more realistic appearance of foreground and background for a composite image. Existing methods perform the same harmonization process for the whole foreground. However, the implanted foreground always contains different appearance patterns. All the existing solutions ignore the difference of each color block and losing some specific details. Therefore, we propose a novel global-local two stages framework for Fine-grained Region-aware Image Harmonization (FRIH), which is trained end-to-end. In the first stage, the whole input foreground mask is used to make a global coarse-grained harmonization. In the second stage, we adaptively cluster the input foreground mask into several submasks by the corresponding pixel RGB values in the composite image. Each submask and the coarsely adjusted image are concatenated respectively and fed into a lightweight cascaded module, adjusting the global harmonization performance according to the region-aware local feature. Moreover, we further designed a fusion prediction module by fusing features from all the cascaded decoder layers together to generate the final result, which could utilize the different degrees of harmonization results comprehensively. Without bells and whistles, our FRIH algorithm achieves the best performance on iHarmony4 dataset (PSNR is 38.19 dB) with a lightweight model. The parameters for our model are only 11.98 M, far below the existing methods.

cs.CV↗