arXiv subjects

Cheng Tan

Publications and source records attributed to Cheng Tan.

At least 181 records · Page 10Linked to original sources

arXiv2022

SemiRetro: Semi-template framework boosts deep retrosynthesis prediction

Recently, template-based (TB) and template-free (TF) molecule graph learning methods have shown promising results to retrosynthesis. TB methods are more accurate using pre-encoded reaction templates, and TF methods are more scalable by decomposing retrosynthesis into subproblems, i.e., center identification and synthon completion. To combine both advantages of TB and TF, we suggest breaking a full-template into several semi-templates and embedding them into the two-step TF framework. Since many semi-templates are reduplicative, the template redundancy can be reduced while the essential chemical knowledge is still preserved to facilitate synthon completion. We call our method SemiRetro, introduce a new GNN layer (DRGAT) to enhance center identification, and propose a novel self-correcting module to improve semi-template classification. Experimental results show that SemiRetro significantly outperforms both existing TB and TF methods. In scalability, SemiRetro covers 98.9\% data using 150 semi-templates, while previous template-based GLN requires 11,647 templates to cover 93.3\% data. In top-1 accuracy, SemiRetro exceeds template-free G2G 4.8\% (class known) and 6.0\% (class unknown). Besides, SemiRetro has better training efficiency than existing methods.

cs.LG↗

arXiv2022

Prediction of GPU Failures Under Deep Learning Workloads

Graphics processing units (GPUs) are the de facto standard for processing deep learning (DL) tasks. Meanwhile, GPU failures, which are inevitable, cause severe consequences in DL tasks: they disrupt distributed trainings, crash inference services, and result in service level agreement violations. To mitigate the problem caused by GPU failures, we propose to predict failures by using ML models. This paper is the first to study prediction models of GPU failures under large-scale production deep learning workloads. As a starting point, we evaluate classic prediction models and observe that predictions of these models are both inaccurate and unstable. To improve the precision and stability of predictions, we propose several techniques, including parallel and cascade model-ensemble mechanisms and a sliding training method. We evaluate the performances of our various techniques on a four-month production dataset including 350 million entries. The results show that our proposed techniques improve the prediction precision from 46.3\% to 84.0\%.

cs.LG↗

arXiv2021

Co-learning: Learning from Noisy Labels with Self-supervision

Noisy labels, resulting from mistakes in manual labeling or webly data collecting for supervised learning, can cause neural networks to overfit the misleading information and degrade the generalization performance. Self-supervised learning works in the absence of labels and thus eliminates the negative impact of noisy labels. Motivated by co-training with both supervised learning view and self-supervised learning view, we propose a simple yet effective method called Co-learning for learning with noisy labels. Co-learning performs supervised learning and self-supervised learning in a cooperative way. The constraints of intrinsic similarity with the self-supervised module and the structural similarity with the noisily-supervised module are imposed on a shared common feature encoder to regularize the network to maximize the agreement between the two constraints. Co-learning is compared with peer methods on corrupted data from benchmark datasets fairly, and extensive results are provided which demonstrate that Co-learning is superior to many state-of-the-art approaches.

cs.LG↗

arXiv2021

Git: Clustering Based on Graph of Intensity Topology

\textbf{A}ccuracy, \textbf{R}obustness to noises and scales, \textbf{I}nterpretability, \textbf{S}peed, and \textbf{E}asy to use (ARISE) are crucial requirements of a good clustering algorithm. However, achieving these goals simultaneously is challenging, and most advanced approaches only focus on parts of them. Towards an overall consideration of these aspects, we propose a novel clustering algorithm, namely GIT (Clustering Based on \textbf{G}raph of \textbf{I}ntensity \textbf{T}opology). GIT considers both local and global data structures: firstly forming local clusters based on intensity peaks of samples, and then estimating the global topological graph (topo-graph) between these local clusters. We use the Wasserstein Distance between the predicted and prior class proportions to automatically cut noisy edges in the topo-graph and merge connected local clusters as final clusters. Then, we compare GIT with seven competing algorithms on five synthetic datasets and nine real-world datasets. With fast local cluster detection, robust topo-graph construction and accurate edge-cutting, GIT shows attractive ARISE performance and significantly exceeds other non-convex clustering methods. For example, GIT outperforms its counterparts about $10\%$ (F1-score) on MNIST and FashionMNIST. Code is available at \color{red}{https://github.com/gaozhangyang/GIT}.

cs.LG↗

arXiv2021

Self-supervised Learning on Graphs: Contrastive, Generative,or Predictive

Deep learning on graphs has recently achieved remarkable success on a variety of tasks, while such success relies heavily on the massive and carefully labeled data. However, precise annotations are generally very expensive and time-consuming. To address this problem, self-supervised learning (SSL) is emerging as a new paradigm for extracting informative knowledge through well-designed pretext tasks without relying on manual labels. In this survey, we extend the concept of SSL, which first emerged in the fields of computer vision and natural language processing, to present a timely and comprehensive review of existing SSL techniques for graph data. Specifically, we divide existing graph SSL methods into three categories: contrastive, generative, and predictive. More importantly, unlike other surveys that only provide a high-level description of published research, we present an additional mathematical summary of existing works in a unified framework. Furthermore, to facilitate methodological development and empirical comparisons, we also summarize the commonly used datasets, evaluation metrics, downstream tasks, open-source implementations, and experimental study of various algorithms. Finally, we discuss the technical challenges and potential future directions for improving graph self-supervised learning. Latest advances in graph SSL are summarized in a GitHub repository https://github.com/LirongWu/awesome-graph-self-supervised-learning.

cs.LG↗

arXiv2021

Serving DNN Models with Multi-Instance GPUs: A Case of the Reconfigurable Machine Scheduling Problem

Multi-Instance GPU (MIG) is a new feature introduced by NVIDIA A100 GPUs that partitions one physical GPU into multiple GPU instances. With MIG, A100 can be the most cost-efficient GPU ever for serving Deep Neural Networks (DNNs). However, discovering the most efficient GPU partitions is challenging. The underlying problem is NP-hard; moreover, it is a new abstract problem, which we define as the Reconfigurable Machine Scheduling Problem (RMS). This paper studies serving DNNs with MIG, a new case of RMS. We further propose a solution, MIG-serving. MIG- serving is an algorithm pipeline that blends a variety of newly designed algorithms and customized classic algorithms, including a heuristic greedy algorithm, Genetic Algorithm (GA), and Monte Carlo Tree Search algorithm (MCTS). We implement MIG-serving on Kubernetes. Our experiments show that compared to using A100 as-is, MIG-serving can save up to 40% of GPUs while providing the same throughput.

cs.DC↗

arXiv2021

GraphMixup: Improving Class-Imbalanced Node Classification on Graphs by Self-supervised Context Prediction

Recent years have witnessed great success in handling node classification tasks with Graph Neural Networks (GNNs). However, most existing GNNs are based on the assumption that node samples for different classes are balanced, while for many real-world graphs, there exists the problem of class imbalance, i.e., some classes may have much fewer samples than others. In this case, directly training a GNN classifier with raw data would under-represent samples from those minority classes and result in sub-optimal performance. This paper presents GraphMixup, a novel mixup-based framework for improving class-imbalanced node classification on graphs. However, directly performing mixup in the input space or embedding space may produce out-of-domain samples due to the extreme sparsity of minority classes; hence we construct semantic relation spaces that allows the Feature Mixup to be performed at the semantic level. Moreover, we apply two context-based self-supervised techniques to capture both local and global information in the graph structure and then propose Edge Mixup specifically for graph data. Finally, we develop a \emph{Reinforcement Mixup} mechanism to adaptively determine how many samples are to be generated by mixup for those minority classes. Extensive experiments on three real-world datasets show that GraphMixup yields truly encouraging results for class-imbalanced node classification tasks.

cs.LG↗

arXiv2021

Tailoring Dzyaloshinskii-Moriya interaction in a transition metal dichalcogenide by dual-intercalation

Dzyaloshinskii-Moriya interaction (DMI) is vital to form various chiral spin textures, novel behaviors of magnons and permits their potential applications in energy-efficient spintronic devices. Here, we realize a sizable bulk DMI in a transition metal dichalcogenide (TMD) 2H-TaS2 by intercalating Fe atoms, which form the chiral supercells with broken spatial inversion symmetry and also act as the source of magnetic orderings. Using a newly developed protonic gate technology, gate-controlled protons intercalation could further change the carrier density and intensely tune DMI via the Ruderman-Kittel-Kasuya-Yosida mechanism. The resultant giant topological Hall resistivity of 1.4 uohm.cm at -5.2V (about 460% of the zero-bias value) is larger than most of the known magnetic materials. Theoretical analysis indicates that such a large topological Hall effect originates from the two-dimensional Bloch-type chiral spin textures stabilized by DMI, while the large anomalous Hall effect comes from the gapped Dirac nodal lines by spin-orbit interaction. Dual-intercalation in 2HTaS2 provides a model system to reveal the nature of DMI in the large family of TMDs and a promising way of gate tuning of DMI, which further enables an electrical control of the chiral spin textures and related electromagnetic phenomena.

cond-mat.mes-hall↗

arXiv2021

ARENA: Asynchronous Reconfigurable Accelerator Ring to Enable Data-Centric Parallel Computing

The next generation HPC and data centers are likely to be reconfigurable and data-centric due to the trend of hardware specialization and the emergence of data-driven applications. In this paper, we propose ARENA -- an asynchronous reconfigurable accelerator ring architecture as a potential scenario on how the future HPC and data centers will be like. Despite using the coarse-grained reconfigurable arrays (CGRAs) as the substrate platform, our key contribution is not only the CGRA-cluster design itself, but also the ensemble of a new architecture and programming model that enables asynchronous tasking across a cluster of reconfigurable nodes, so as to bring specialized computation to the data rather than the reverse. We presume distributed data storage without asserting any prior knowledge on the data distribution. Hardware specialization occurs at runtime when a task finds the majority of data it requires are available at the present node. In other words, we dynamically generate specialized CGRA accelerators where the data reside. The asynchronous tasking for bringing computation to data is achieved by circulating the task token, which describes the data-flow graphs to be executed for a task, among the CGRA cluster connected by a fast ring network. Evaluations on a set of HPC and data-driven applications across different domains show that ARENA can provide better parallel scalability with reduced data movement (53.9%). Compared with contemporary compute-centric parallel models, ARENA can bring on average 4.37x speedup. The synthesized CGRAs and their task-dispatchers only occupy 2.93mm^2 chip area under 45nm process technology and can run at 800MHz with on average 759.8mW power consumption. ARENA also supports the concurrent execution of multi-applications, offering ideal architectural support for future high-performance parallel computing and data analytics systems.

cs.DC↗

arXiv2021

Dual-gated graphene devices for near-field nano-imaging

Graphene-based heterostructures display a variety of phenomena that are strongly tunable by electrostatic local gates. Monolayer graphene (MLG) exhibits tunable surface plasmon polaritons, as revealed by scanning nano-infrared experiments. In bilayer graphene (BLG), an electronic gap is induced by a perpendicular displacement field. Gapped BLG is predicted to display unusual effects such as plasmon amplification and domain wall plasmons with significantly larger lifetime than MLG. Furthermore, a variety of correlated electronic phases highly sensitive to displacement fields have been observed in twisted graphene structures. However, applying perpendicular displacement fields in nano-infrared experiments has only recently become possible (Ref. 1). In this work, we fully characterize two approaches to realizing nano-optics compatible top-gates: bilayer $\text{MoS}_2$ and MLG. We perform nano-infrared imaging on both types of structures and evaluate their strengths and weaknesses. Our work paves the way for comprehensive near-field experiments of correlated phenomena and plasmonic effects in graphene-based heterostructures.

cond-mat.mes-hall↗

arXiv2020

Gate-controlled magnetic phase transition in a van der Waals magnet Fe$_5$GeTe$_2$

Magnetic van der Waals (vdW) materials, including ferromagnets (FM) and antiferromagnets (AFM), have given access to the investigation of magnetism in two-dimensional (2D) limit and attracted broad interests recently. However, most of them are semiconducting or insulating and the vdW itinerant magnets, especially vdW itinerant AFM, are very rare. Here, we studied the anomalous Hall effect of a vdW itinerant magnet Fe$_5$GeTe$_2$ (F5GT) with various thicknesses down to 6.8 nm (two unit cells). Despite the robust ferromagnetic ground state in thin-layer F5GT, however, we show that the electron doping implemented by a protonic gate can eventually induce a magnetic phase transition from FM to AFM. Realization of an antiferromagnetic phase in F5GT highlights its promising applications in high-temperature antiferromagnetic vdW devices and heterostructures.

cond-mat.mtrl-sci↗

arXiv2020

Determination of the spin orientation of helical electrons in monolayer WTe2

Monolayer WTe2 is predicted to be a quantum spin Hall insulator (QSHI) and electron transport along its edges has been experimentally observed. However, the 'smoking gun' of QSHI, spin momentum locking of the edge electrons, has not been experimentally demonstrated. We propose a model to establish the relationship between the anisotropic magnetoresistance (AMR) and spin orientation of the helical electrons in WTe2. Based on the predictions of the model, angular dependent magnetoresistance measurements were carried out. The experimental results fully supported the model and the spin orientation of the helical edge electrons was determined. Our results not only demonstrate that WTe2 is indeed a QSHI, but also suggest a convenient method to determine the spin orientation of other QSHIs.

cond-mat.mes-hall↗

arXiv2020

Evidence for the topological order in a kagome antiferromagnet

A Z2 quantum spin liquid hosts one of the simplest topological orders and exhibits many exotic properties due to long-range quantum entanglements. Its elementary excitations are anyons such as spinons carrying fractionalized spin quantum number and visons carrying emergent Z2 gauge flux. However, experimental detection of these anyons remains elusive. The difficulties lie not only in the fact that there exists few candidates for Z2 quantum spin liquids but also in that visons are magnetically inert hence immune to available experimental techniques. Here we have studied the spin excitations and specific heats of kagome-lattice antiferromagnet Cu$_4$(OH)$_6$FBr and Cu$_3$Zn(OH)$_6$FBr, which consists of two-dimensional Cu$^{2+}$ kagome layers with either Cu$^{2+}$ or Zn$^{2+}$ ions in between. By combining the first principle calculations and inelastic neutron scattering data in the former, we show that the dominate couplings in Cu$_4$(OH)$_6$FBr are between the nearest neighbor spins within the kagome planes, and the kagome and interlayer spin systems are essentially decoupled above the antiferromagnetic transition temperature. The intrinsic spin excitations and specific heats of the kagome layers for Cu$_3$Zn(OH)$_6$FBr are thus derived by removing the contributions from the residual interlayer Cu$^{2+}$ magnetic impurities. Accordingly, the kagome spin system exhibits spin continuum with momentum-dependent spin gap and a large magnetic entropy at low temperature that is insensitive to magnetic field, which can be understood as the evidences of spinons and visons in this kagome quantum spin liquid candidate. Our results suggest the existence of the Z2 anyons in the material, and therefore provide a comprehensive set of evidences for the Z2 topological order in kagome quantum spin liquid and bring their choreographed entanglement dances to the stage of real materials.

cond-mat.str-el↗

arXiv2020

Weak localization and anti-localization in rare earth doped topological insulators

We study magneto-transport phenomena in two rare-earth doped topological insulators, SmxFexSb2-2xTe3 and SmxBi2-xTe2Se single crystals. The magneto-transport behaviours in both compounds exhibit a systematic crossover between weak anti-localization (positive magnetoresistance) and weak localization (negative magnetoresistance) with changes in temperatures and magnetic fields. The weak localization is caused by rare-earth-doping induced magnetization, and the weak anti-localization originates from topologically protected surface states. The transition between weak localization and weak anti-localization demonstrates a gap opening at the Dirac point of surface states in the quantum diffusive regime. This work demonstrates an effective way to manipulate the magneto-transport properties of the topological insulators by rare-earth element doping. Magnetometry measurements indicate that the Sm-dopant alone is paramagnetic, whereas the co-doped Fe-Sm state has short-range antiferromagnetic order. Our results hold potential for the realization of exotic topological effects in gapped topological insulator surface states.

cond-mat.mtrl-sci↗

arXiv2020

Muon Spin Relaxation and fluctuating magnetism in the pseudogap phase of YBa$_{2}$Cu$_{3}$O$_{y}$

We report results of a muon spin relaxation study of slow magnetic fluctuations in the pseudogap phase of underdoped single-crystalline YBa$_{2}$Cu$_{3}$O$_{y}$, $y = 6.77$ and 6.83. The dependence of the dynamic muon spin relaxation rate on applied magnetic field yields the rms magnitude~$B\mathrm{_{loc}^{rms}}$ and correlation time~$τ_c$ of fluctuating local fields at muon sites. The observed relaxation rates do not decrease with decreasing temperature~$T$ below the pseudogap onset at $T^\ast$, as would be expected for a conventional magnetic transition; both $B\mathrm{_{loc}^{rms}}$ and $τ_c$ are roughly constant in the pseudogap phase down to the superconducting transition. Corresponding NMR relaxation rates are estimated to be too small to be observable. Our results put strong constraints on theories of the anomalous pseudogap magnetism in YBa$_{2}$Cu$_{3}$O$_{y}$.

cond-mat.str-el↗

arXiv2020

Gate-Tuned Interlayer Coupling in van der Waals Ferromagnet Fe$_3$GeTe$_2$ Nanoflakes

The weak interlayer coupling in van der Waals (vdW) magnets has confined their application to two dimensional (2D) spintronic devices. Here, we demonstrate that the interlayer coupling in a vdW magnet Fe$_3$GeTe$_2$ (FGT) can be largely modulated by a protonic gate.With the increase of the protons intercalated among vdW layers,interlayer magnetic coupling increases.Because of the existence of antiferromagnetic layers in FGT nanoflakes, the increasing interlayer magnetic coupling induces exchange bias in protonated FGT nanoflakes. Most strikingly, a rarely seen zero-field cooled (ZFC) exchange bias with very large values (maximally up to 1.2 kOe) has been observed when higher positive voltages (Vg>4.36 V) are applied to the protonic gate, which clearly demonstrates that a strong interlayer coupling is realized by proton intercalation. Such strong interlayer coupling will enable a wider range of applications for vdW magnets.

cond-mat.mtrl-sci↗

arXiv2020

Persistent spin dynamics and absence of spin freezing in the $H$-$T$ phase diagram of the 2D triangular antiferromagnet YbMgGaO$_4$

We report results of muon spin relaxation and rotation ($μ$SR) experiments on the spin-liquid candidate~YbMgGaO$_{4}$. No static magnetism $\gtrsim 0.003μ_B$ per Yb ion, ordered or disordered, is observed down to 22~mK, a factor of two lower in temperature than previous measurements. Persistent (temperature-independent) spin dynamics are observed up to 0.20~K and at least 1~kOe, thus extending previous zero-field $μ$SR results over a substantial region of the $H$-$T$ phase diagram. Knight shift measurements in a 10-kOe transverse field reveal two lines with nearly equal amplitudes. Inhomogeneous muon depolarization in a longitudinal field, previously characterized by stretched-exponential relaxation due to spatial inhomogeneity, is fit equally well with two exponentials, also of equal amplitudes. We attribute these results to two interstitial muon sites in the unit cell, rather than disorder or other spatial distribution. Further evidence for this attribution is found from agreement between the ratio of the two measured relaxation rates and calculated mean-square local Yb$^{3+}$ dipolar fields at candidate muon sites. Zero-field data can be understood as a combination of two-exponential dynamic relaxation and quasistatic nuclear dipolar fields.

cond-mat.str-el↗

arXiv2020

Detecting Incorrect Behavior of Cloud Databases as an Outsider

Cloud DBs offer strong properties, including serializability, sometimes called the gold standard database correctness property. But cloud DBs are complicated black boxes, running in a different administrative domain from their clients; thus, clients might like to know whether the DBs are meeting their contract. A core difficulty is that the underlying problem here, namely verifying serializability, is NP-complete. Nevertheless, we hypothesize that on real-world workloads, verifying serializability is tractable, and we treat the question as a systems problem, for the first time. We build Cobra, which tames the underlying search problem by blending a new encoding of the problem, hardware acceleration, and a careful choice of a suitable SMT solver. cobra also introduces a technique to address the challenge of garbage collection in this context. cobra improves over natural baselines by at least 10x in the problem size it can handle, while imposing modest overhead on clients.

cs.DB↗