arXiv Science⌕ Search

arXiv subjects

Tao Wang

Publications and source records attributed to Tao Wang.

At least 631 records · Page 35Linked to original sources
arXiv2021

GSPMD: General and Scalable Parallelization for ML Computation Graphs

We present GSPMD, an automatic, compiler-based parallelization system for common machine learning computations. It allows users to write programs in the same way as for a single device, then give hints through a few annotations on how to distribute tensors, based on which GSPMD will parallelize the computation. Its representation of partitioning is simple yet general, allowing it to express different or mixed paradigms of parallelism on a wide variety of models. GSPMD infers the partitioning for every operator based on limited user annotations, making it convenient to scale existing single-device programs. It solves several technical challenges for production usage, allowing GSPMD to achieve 50% to 62% compute utilization on up to 2048 Cloud TPUv3 cores for models with up to one trillion parameters.

cs.DC↗
arXiv2021

Camera-aware Style Separation and Contrastive Learning for Unsupervised Person Re-identification

Unsupervised person re-identification (ReID) is a challenging task without data annotation to guide discriminative learning. Existing methods attempt to solve this problem by clustering extracted embeddings to generate pseudo labels. However, most methods ignore the intra-class gap caused by camera style variance, and some methods are relatively complex and indirect although they try to solve the negative impact of the camera style on feature distribution. To solve this problem, we propose a camera-aware style separation and contrastive learning method (CA-UReID), which directly separates camera styles in the feature space with the designed camera-aware attention module. It can explicitly divide the learnable feature into camera-specific and camera-agnostic parts, reducing the influence of different cameras. Moreover, to further narrow the gap across cameras, we design a camera-aware contrastive center loss to learn more discriminative embedding for each identity. Extensive experiments demonstrate the superiority of our method over the state-of-the-art methods on the unsupervised person ReID task.

cs.CV↗
arXiv2021

A duality of scaffolds for translation association schemes

Scaffolds are certain tensors arising in the study of association schemes, and have been (implicitly) understood diagrammatically as digraphs with distinguished "root" nodes and with matrix edge weights, often taken from Bose-Mesner algebras. In this paper, we first present a slight modification of Martin's conjecture (2021) concerning a duality of scaffolds whose digraphs are embedded in a closed disk in the plane with root nodes all lying on the boundary circle, and then show that this modified conjecture holds true if we restrict ourselves to the class of translation association schemes, i.e., those association schemes that admit abelian regular automorphism groups.

math.CO↗
arXiv2021

Pose-guided Feature Disentangling for Occluded Person Re-identification Based on Transformer

Occluded person re-identification is a challenging task as human body parts could be occluded by some obstacles (e.g. trees, cars, and pedestrians) in certain scenes. Some existing pose-guided methods solve this problem by aligning body parts according to graph matching, but these graph-based methods are not intuitive and complicated. Therefore, we propose a transformer-based Pose-guided Feature Disentangling (PFD) method by utilizing pose information to clearly disentangle semantic components (e.g. human body or joint parts) and selectively match non-occluded parts correspondingly. First, Vision Transformer (ViT) is used to extract the patch features with its strong capability. Second, to preliminarily disentangle the pose information from patch information, the matching and distributing mechanism is leveraged in Pose-guided Feature Aggregation (PFA) module. Third, a set of learnable semantic views are introduced in transformer decoder to implicitly enhance the disentangled body part features. However, those semantic views are not guaranteed to be related to the body without additional supervision. Therefore, Pose-View Matching (PVM) module is proposed to explicitly match visible body parts and automatically separate occlusion features. Fourth, to better prevent the interference of occlusions, we design a Pose-guided Push Loss to emphasize the features of visible body parts. Extensive experiments over five challenging datasets for two tasks (occluded and holistic Re-ID) demonstrate that our proposed PFD is superior promising, which performs favorably against state-of-the-art methods. Code is available at https://github.com/WangTaoAs/PFD_Net

cs.CV↗
arXiv2021

Contrastive Learning from Extremely Augmented Skeleton Sequences for Self-supervised Action Recognition

In recent years, self-supervised representation learning for skeleton-based action recognition has been developed with the advance of contrastive learning methods. The existing contrastive learning methods use normal augmentations to construct similar positive samples, which limits the ability to explore novel movement patterns. In this paper, to make better use of the movement patterns introduced by extreme augmentations, a Contrastive Learning framework utilizing Abundant Information Mining for self-supervised action Representation (AimCLR) is proposed. First, the extreme augmentations and the Energy-based Attention-guided Drop Module (EADM) are proposed to obtain diverse positive samples, which bring novel movement patterns to improve the universality of the learned representations. Second, since directly using extreme augmentations may not be able to boost the performance due to the drastic changes in original identity, the Dual Distributional Divergence Minimization Loss (D$^3$M Loss) is proposed to minimize the distribution divergence in a more gentle way. Third, the Nearest Neighbors Mining (NNM) is proposed to further expand positive samples to make the abundant information mining process more reasonable. Exhaustive experiments on NTU RGB+D 60, PKU-MMD, NTU RGB+D 120 datasets have verified that our AimCLR can significantly perform favorably against state-of-the-art methods under a variety of evaluation protocols with observed higher quality action representations. Our code is available at https://github.com/Levigty/AimCLR.

cs.CV↗
arXiv2021

Search for topological defect dark matter with a global network of optical magnetometers

Ultralight bosons such as axion-like particles are viable candidates for dark matter. They can form stable, macroscopic field configurations in the form of topological defects that could concentrate the dark matter density into many distinct, compact spatial regions that are small compared to the galaxy but much larger than the Earth. Here, we report the results of a search for transient signals from axion-like particle domain walls with the Global Network of Optical Magnetometers for Exotic physics searches (GNOME). We search the data, consisting of correlated measurements from optical atomic magnetometers located in laboratories all over the world, for patterns of signals propagating through the network consistent with domain walls. The analysis of data from a continuous month-long operation of the GNOME finds no statistically significant signals, thus placing experimental constraints on such dark matter scenarios.

astro-ph.CO↗
arXiv2021

A census of optically dark massive galaxies in the early Universe from magnification by lensing galaxy clusters

We present ALMA 870um and JCMT SCUBA2 850um dust continuum observations of a sample of optically dark and strongly lensed galaxies in the cluster fields. The ALMA and SCUBA2 observations reach a median rms of about 0.11 mJy and 0.44 mJy, respectively, with the latter close to the confusion limit of the data at 850um. This represents one of the most sensitive searches for dust emission in optically dark galaxies. We detect the dust emission in 12 out of 15 galaxies at >3.8 sigma, corresponding to a detection rate of 80 per cent. Thanks to the gravitational lensing, our observations reach a deeper limiting flux than previous surveys in blank fields by a factor of 3. We estimate delensed infrared luminosities in the range log(LIR)=11.5-12.7 Lsun, which correspond to dust-obscured star formation rates (SFRs) of 30 to 520 Msun per year. Stellar population fits to the optical-to-NIR photometric data yield a median redshift z=4.26 and de-lensed stellar mass log(Mstar)=10.78 Msun. They contribute a lensing-corrected star-formation rate density at least an order of magnitude higher than that of equivalently massive UV-selected galaxies at z>3. The results suggest that there is a missing population of massive star-forming galaxies in the early Universe, which may dominate the SFR density at the massive end. Five optically dark galaxies are located within r<50 arcsec in one cluster field, representing a potential overdensity structure that has a physical origin at a confidence level >99.974% from Poisson statistics. Follow-up spectroscopic observations with ALMA and JWST are crucial to confirm whether it is associated with a protocluster at similar redshifts.

astro-ph.GA↗
arXiv2021

Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet

Transformers, which are popular for language modeling, have been explored for solving vision tasks recently, e.g., the Vision Transformer (ViT) for image classification. The ViT model splits each image into a sequence of tokens with fixed length and then applies multiple Transformer layers to model their global relation for classification. However, ViT achieves inferior performance to CNNs when trained from scratch on a midsize dataset like ImageNet. We find it is because: 1) the simple tokenization of input images fails to model the important local structure such as edges and lines among neighboring pixels, leading to low training sample efficiency; 2) the redundant attention backbone design of ViT leads to limited feature richness for fixed computation budgets and limited training samples. To overcome such limitations, we propose a new Tokens-To-Token Vision Transformer (T2T-ViT), which incorporates 1) a layer-wise Tokens-to-Token (T2T) transformation to progressively structurize the image to tokens by recursively aggregating neighboring Tokens into one Token (Tokens-to-Token), such that local structure represented by surrounding tokens can be modeled and tokens length can be reduced; 2) an efficient backbone with a deep-narrow structure for vision transformer motivated by CNN architecture design after empirical study. Notably, T2T-ViT reduces the parameter count and MACs of vanilla ViT by half, while achieving more than 3.0\% improvement when trained from scratch on ImageNet. It also outperforms ResNets and achieves comparable performance with MobileNets by directly training on ImageNet. For example, T2T-ViT with comparable size to ResNet50 (21.5M parameters) can achieve 83.3\% top1 accuracy in image resolution 384$\times$384 on ImageNet. (Code: https://github.com/yitu-opensource/T2T-ViT)

cs.CV↗
arXiv2021

Aza-Triangulene: On-Surface Synthesis, Electronic and Magnetic Properties

Nitrogen heteroatom doping into a triangulene molecule allows tuning its magnetic state. However, the synthesis of the nitrogen-doped triangulene (aza-triangulene) has been challenging. Herein, we report the successful synthesis of aza-triangulene on the Au(111) and Ag(111) surfaces, along with their characterizations by scanning tunneling microscopy and spectroscopy in combination with density functional theory (DFT) calculations. Aza-triangulenes were obtained by reducing ketone-substituted precursors. Exposure to atomic hydrogen followed by thermal annealing and, when necessary, manipulations with the scanning probe, afforded the target product. We demonstrate that on Au(111) aza-triangulene donates an electron to the substrate and exhibits an open-shell triplet ground state. This is derived from the different Kondo resonances of the final aza-triangulene product and a series of intermediates on Au(111). Experimentally mapped molecular orbitals match perfectly with DFT calculated counterparts for a positively charged aza-triangulene. In contrast, aza-triangulene on Ag(111) receives an extra electron from the substrate and displays a closed-shell character. Our study reveals the electronic properties of aza-triangulene on different metal surfaces and offers an efficient approach for the fabrication of new hydrocarbon structures, including reactive open-shell molecules.

cond-mat.mtrl-sci↗
arXiv2021

Direct Multi-view Multi-person 3D Pose Estimation

We present Multi-view Pose transformer (MvP) for estimating multi-person 3D poses from multi-view images. Instead of estimating 3D joint locations from costly volumetric representation or reconstructing the per-person 3D pose from multiple detected 2D poses as in previous methods, MvP directly regresses the multi-person 3D poses in a clean and efficient way, without relying on intermediate tasks. Specifically, MvP represents skeleton joints as learnable query embeddings and let them progressively attend to and reason over the multi-view information from the input images to directly regress the actual 3D joint locations. To improve the accuracy of such a simple pipeline, MvP presents a hierarchical scheme to concisely represent query embeddings of multi-person skeleton joints and introduces an input-dependent query adaptation approach. Further, MvP designs a novel geometrically guided attention mechanism, called projective attention, to more precisely fuse the cross-view information for each joint. MvP also introduces a RayConv operation to integrate the view-dependent camera geometry into the feature representations for augmenting the projective attention. We show experimentally that our MvP model outperforms the state-of-the-art methods on several benchmarks while being much more efficient. Notably, it achieves 92.3% AP25 on the challenging Panoptic dataset, improving upon the previous best approach [36] by 9.8%. MvP is general and also extendable to recovering human mesh represented by the SMPL model, thus useful for modeling multi-person body shapes. Code and models are available at https://github.com/sail-sg/mvp.

cs.CV↗
arXiv2021

Drive high power UVC-LED wafer into low-cost 4-inch era: effect of strain modulation

Ultraviolet-C light-emitting diodes (UVC-LEDs) have great application in pathogen inactivation under various kinds of situations, especially in the fight against the COVID-19. Unfortunately, its epitaxial wafers are so far limited to 2-inch size, which greatly increases the cost of massive production. In this work, we report the 4-inch crack-free high-power UVC-LED wafer. This achievement relies on a proposed strain-tailored strategy, where a three-dimensional to two-dimensional (3D-2D) transition layer is introduced during the homo-epitaxy of AlN on high temperature annealed (HTA)-AlN template, which successfully drives the original compressive strain into tensile one and thus solves the challenge of realizing high quality Al$_{0.6}$Ga$_{0.4}$N layer with a flat surface. This smooth Al$_{0.6}$Ga$_{0.4}$N layer is nearly pseudomorphically grown on the strain-tailored HTA-AlN template, leading to 4-inch UVC-LED wafers with outstanding performances. Our strategy succeeds in compromising the bottlenecked contradictory in producing large-sized UVC-LED wafer on pronounced crystalline AlN template: The compressive strain in HTA-AlN allows for crack-free 4-inch wafer, but at the same time leads to a deterioration of the AlGaN morphology and crystal quality. The launch of 4-inch wafers makes the chip fabrication process of UVC-LEDs matches the mature blue one, and will definitely speed up the universal of UVC-LED in daily life.

cond-mat.mtrl-sci↗
arXiv2021

Variational formulas for the exit time of Hunt processes generated by semi-Dirichlet forms

Variational formulas for the Laplace transform of the exit time from an open set of a Hunt process generated by a regular lower bounded semi-Dirichlet form are established. While for symmetric Markov processes, variational formulas are derived for the exponential moments of the exit time. As applications, we provide some comparison theorems and quantitative relations of the exponential moments and Poincaré inequalities.

math.PR↗
arXiv2021

Who, What, Why and How? Towards the Monetary Incentive in Crowd Collaboration: A Case Study of Github's Sponsor Mechanism

While many forms of financial support are currently available, there are still many complaints about inadequate financing from software maintainers. In May 2019, GitHub, the world's most active social coding platform, launched the Sponsor mechanism as a step toward more deeply integrating open source development and financial support. This paper collects data on 8,028 maintainers, 13,555 sponsors, and 22,515 sponsorships and conducts a comprehensive analysis. We explore the relationship between the Sponsor mechanism and developers along four dimensions using a combination of qualitative and quantitative analysis, examining why developers participate, how the mechanism affects developer activity, who obtains more sponsorships, and what mechanism flaws developers have encountered in the process of using it. We find a long-tail effect in the act of sponsorship, with most maintainers' expectations remaining unmet, and sponsorship has only a short-term, slightly positive impact on development activity but is not sustainable. While sponsors participate in this mechanism mainly as a means of thanking the developers of OSS that they use, in practice, the social status of developers is the primary influence on the number of sponsorships. We find that both the Sponsor mechanism and open source donations have certain shortcomings and need further improvements to attract more participants.

cs.HC↗
arXiv2021

WFDefProxy: Modularly Implementing and Empirically Evaluating Website Fingerprinting Defenses

Tor, an onion-routing anonymity network, has been shown to be vulnerable to Website Fingerprinting (WF), which de-anonymizes web browsing by analyzing the unique characteristics of the encrypted network traffic. Although many defenses have been proposed, few have been implemented and tested in the real world; others were only simulated. Due to its synthetic nature, simulation may fail to capture the real performance of these defenses. To figure out how these defenses perform in the real world, we propose WFDefProxy, a general platform for WF defense implementation on Tor using pluggable transports. We create the first full implementation of three WF defenses: FRONT, Tamaraw and Random-WT. We evaluate each defense in both simulation and implementation to compare their results, and we find that simulation correctly captures the strength of each defense against attacks. In addition, we confirm that Random-WT is not effective in both simulation and implementation, reducing the strongest attacker's accuracy by only 7%. We also found a minor difference in overhead between simulation and implementation. We analyze how this may be due to assumptions made in simulation regarding packet delays and queuing, or the soft stop condition we implemented in WFDefProxy to detect the end of a page load. The implementation of FRONT cost about 23% more data overhead than simulation, while the implementation of Tamaraw cost about 28% - 45% less data overhead. In addition, the implementation of Tamaraw incurred only 21% time overhead, compared to 51% - 242% estimated by simulation in previous work.

cs.CR↗
arXiv2021

Joint Graph Learning and Matching for Semantic Feature Correspondence

In recent years, powered by the learned discriminative representation via graph neural network (GNN) models, deep graph matching methods have made great progresses in the task of matching semantic features. However, these methods usually rely on heuristically generated graph patterns, which may introduce unreliable relationships to hurt the matching performance. In this paper, we propose a joint \emph{graph learning and matching} network, named GLAM, to explore reliable graph structures for boosting graph matching. GLAM adopts a pure attention-based framework for both graph learning and graph matching. Specifically, it employs two types of attention mechanisms, self-attention and cross-attention for the task. The self-attention discovers the relationships between features and to further update feature representations over the learnt structures; and the cross-attention computes cross-graph correlations between the two feature sets to be matched for feature reconstruction. Moreover, the final matching solution is directly derived from the output of the cross-attention layer, without employing a specific matching decision module. The proposed method is evaluated on three popular visual matching benchmarks (Pascal VOC, Willow Object and SPair-71k), and it outperforms previous state-of-the-art graph matching methods by significant margins on all benchmarks. Furthermore, the graph patterns learnt by our model are validated to be able to remarkably enhance previous deep graph matching methods by replacing their handcrafted graph structures with the learnt ones.

cs.CV↗
arXiv2021

Learning to Navigate in a VUCA Environment: Hierarchical Multi-expert Approach

Despite decades of efforts, robot navigation in a real scenario with volatility, uncertainty, complexity, and ambiguity (VUCA for short), remains a challenging topic. Inspired by the central nervous system (CNS), we propose a hierarchical multi-expert learning framework for autonomous navigation in a VUCA environment. With a heuristic exploration mechanism considering target location, path cost, and safety level, the upper layer performs simultaneous map exploration and route-planning to avoid trapping in a blind alley, similar to the cerebrum in the CNS. Using a local adaptive model fusing multiple discrepant strategies, the lower layer pursuits a balance between collision-avoidance and go-straight strategies, acting as the cerebellum in the CNS. We conduct simulation and real-world experiments on multiple platforms, including legged and wheeled robots. Experimental results demonstrate our algorithm outperforms the existing methods in terms of task achievement, time efficiency, and security.

cs.RO↗
arXiv2021

PoDT: A Secure Multi-chains Consensus Scheme Against Diverse Miners Behaviors Attacks in Blockchain Networks

As cross-chain technologies make the interactions among different blockchains (hereinafter "chains") possible, multi-chains consensus is becoming more and more important in blockchain networks. However, more attention has been paid to the single-chain consensus schemes. The multi-chains consensus with trusted miners participation has been not considered, thus offering opportunities for malicious users to launch Diverse Miners Behaviors (DMB) attacks on different chains. DMB attackers can be friendly in the consensus process of some chains called mask-chains to enhance trust value, while on other chains called kill-chains they engage in destructive behaviors of network. In this paper, we propose a multi-chains consensus scheme named as Proof-of-DiscTrust (PoDT) to defend against DMB attacks. Distinctive trust idea (DiscTrust) is introduced to evaluate the trust value of each user concerning different chains. A dynamic behaviors prediction scheme is designed to strengthen DiscTrust to prevent intensive DMB attackers who maintain high trust by alternately creating true or false blocks on kill-chains. On this basis, a trusted miners selection algorithm for multi-chains can be achieved at a round of block creation. Experimental results show that PoDT is secure against DMB attacks and more effective than traditional consensus schemes in multi-chains environments.

cs.CR↗