arXiv Science⌕ Search

arXiv subjects

Yu Yang

Publications and source records attributed to Yu Yang.

At least 289 records · Page 16Linked to original sources
arXiv2019

Interpreting CNNs via Decision Trees

This paper aims to quantitatively explain rationales of each prediction that is made by a pre-trained convolutional neural network (CNN). We propose to learn a decision tree, which clarifies the specific reason for each prediction made by the CNN at the semantic level. I.e., the decision tree decomposes feature representations in high conv-layers of the CNN into elementary concepts of object parts. In this way, the decision tree tells people which object parts activate which filters for the prediction and how much they contribute to the prediction score. Such semantic and quantitative explanations for CNN predictions have specific values beyond the traditional pixel-level analysis of CNNs. More specifically, our method mines all potential decision modes of the CNN, where each mode represents a common case of how the CNN uses object parts for prediction. The decision tree organizes all potential decision modes in a coarse-to-fine manner to explain CNN predictions at different fine-grained levels. Experiments have demonstrated the effectiveness of the proposed method.

cs.CV↗
arXiv2019

Raman spectrum of 1T'-WTe2 under tensile strain: A first-principles prediction

Monolayer WTe2 attracts rapidly growing interests for its large-gap quantum spin Hall effect,which enables promising apllications in flexible logic devices. Due to one-dimensional W-W chains,1T'-WTe2 exhibits unique anisotropic structure and promising properties, which can be modified by simply applying strains. Based on the first-principles simulations, we show that phonon branch undergoes soft down to negative frequency at special q points under different critical strains, i.e., epsilon_a = 11.55 percent along a-axis (with W-W chains) direction, epsilon_b = 7.0 percent along b-axis direction and epsilon_ab = 8.44 percent along biaxial direction. Before each critical strain, the Raman-shift of A1_g, A3_g, and A4_g modes, corresponding to the main peaks in Raman spectra of 1T'-WTe2 , shows anisotropic response to uniaxial strain but most sensitive to biaxial strain. Interestingly, we find that the frequency shift of A3_g mode show parabolic characters of strained 1T'-WTe2, then we split it into two parts and it shows a Raman-shift transition at about 5 percent strains. While for the A1_g and A4_g modes,the frequencies change linearly. Through careful structure and vibration analysis, we try to explain these Raman irregularity in strained 1T'-WTe2.

cond-mat.mtrl-sci↗
arXiv2019

Network Transplanting (extended abstract)

This paper focuses on a new task, i.e., transplanting a category-and-task-specific neural network to a generic, modular network without strong supervision. We design a functionally interpretable structure for the generic network. Like building LEGO blocks, we teach the generic network a new category by directly transplanting the module corresponding to the category from a pre-trained network with a few or even without sample annotations. Our method incrementally adds new categories to the generic network but does not affect representations of existing categories. In this way, our method breaks the typical bottleneck of learning a net for massive tasks and categories, i.e., the requirement of collecting samples for all tasks and categories at the same time before the learning begins. Thus, we use a new distillation algorithm, namely back-distillation, to overcome specific challenges of network transplanting. Our method without training samples even outperformed the baseline with 100 training samples.

cs.LG↗
arXiv2019

Unsupervised Learning of Neural Networks to Explain Neural Networks (extended abstract)

This paper presents an unsupervised method to learn a neural network, namely an explainer, to interpret a pre-trained convolutional neural network (CNN), i.e., the explainer uses interpretable visual concepts to explain features in middle conv-layers of a CNN. Given feature maps of a conv-layer of the CNN, the explainer performs like an auto-encoder, which decomposes the feature maps into object-part features. The object-part features are learned to reconstruct CNN features without much loss of information. We can consider the disentangled representations of object parts a paraphrase of CNN features, which help people understand the knowledge encoded by the CNN. More crucially, we learn the explainer via knowledge distillation without using any annotations of object parts or textures for supervision. In experiments, our method was widely used to interpret features of different benchmark CNNs, and explainers significantly boosted the feature interpretability without hurting the discrimination power of the CNNs.

cs.LG↗
arXiv2019

Explaining AlphaGo: Interpreting Contextual Effects in Neural Networks

In this paper, we propose to disentangle and interpret contextual effects that are encoded in a pre-trained deep neural network. We use our method to explain the gaming strategy of the alphaGo Zero model. Unlike previous studies that visualized image appearances corresponding to the network output or a neural activation only from a global perspective, our research aims to clarify how a certain input unit (dimension) collaborates with other units (dimensions) to constitute inference patterns of the neural network and thus contribute to the network output. The analysis of local contextual effects w.r.t. certain input units is of special values in real applications. Explaining the logic of the alphaGo Zero model is a typical application. In experiments, our method successfully disentangled the rationale of each move during the Go game.

cs.CV↗
arXiv2018

VeMo: Enabling Transparent Vehicular Mobility Modeling at Individual Levels with Full Penetration

Understanding and predicting real-time vehicle mobility patterns on highways are essential to address traffic congestion and respond to the emergency. However, almost all existing works (e.g., based on cellphones, onboard devices, or traffic cameras) suffer from high costs, low penetration rates, or only aggregate results. To address these drawbacks, we utilize Electric Toll Collection systems (ETC) as a large-scale sensor network and design a system called VeMo to transparently model and predict vehicle mobility at the individual level with a full penetration rate. Our novelty is how we address uncertainty issues (i.e., unknown routes and speeds) due to sparse implicit ETC data based on a key data-driven insight, i.e., individual driving behaviors are strongly correlated with crowds of drivers under certain spatiotemporal contexts and can be predicted by combining both personal habits and context information. More importantly, we evaluate VeMo with (i) a large-scale ETC system with tracking devices at 773 highway entrances and exits capturing more than 2 million vehicles every day; (ii) a fleet consisting of 114 thousand vehicles with GPS data as ground truth. We compared VeMo with state-of-the-art benchmark mobility models, and the experimental results show that VeMo outperforms them by average 10% in terms of accuracy.

cs.NI↗
arXiv2018

Network Transplanting

This paper focuses on a new task, i.e., transplanting a category-and-task-specific neural network to a generic, modular network without strong supervision. We design an functionally interpretable structure for the generic network. Like building LEGO blocks, we teach the generic network a new category by directly transplanting the module corresponding to the category from a pre-trained network with a few or even without sample annotations. Our method incrementally adds new categories to the generic network but does not affect representations of existing categories. In this way, our method breaks the typical bottleneck of learning a net for massive tasks and categories, i.e. the requirement of collecting samples for all tasks and categories at the same time before the learning begins. Thus, we use a new distillation algorithm, namely back-distillation, to overcome specific challenges of network transplanting. Our method without training samples even outperformed the baseline with 100 training samples.

cs.LG↗
arXiv2018

Eddy-current imaging with nitrogen-vacancy centers in diamond

We demonstrate microwave-free eddy-current imaging using nitrogen-vacancy centers in diamond. By detecting the eddy-current induced magnetic field of conductive samples, we can distinguish between different materials and shapes and identify structural defects. Our technique allows for the discrimination of different materials according to their conductivity. The sensitivity of the measurements is calculated as 8$\times 10 ^{5}$\,S/m\,$\sqrt[]{\textrm{Hz}}$ at 3.5\,MHz, for a cylindrical sample with radius $r_0$\,=\,1\,mm and height $h$\,=\,0.1\,mm (volume $\sim$\,0.3\,mm$^3$), at a distance of 0.5\,mm. In comparison with existing technologies, the diamond-based device exhibits a superior bandwidth and spatial resolution. In particular, we demonstrate a flat frequency response from DC to 3.5 MHz and a spatial resolution of 348\,$\pm$\,2\,$μ$m.

quant-ph↗
arXiv2018

The positive partial transpose conjecture for n=3

We present the PPT square conjecture introduced by M. Christandl. We prove the conjecture in the case $n=3$ as a consequence of the fact that two-qutrit PPT states have Schmidt at most two. Our result in Lemma 3 is independent from the proof found Müller-Hermes. Müller-Hermes announced that this conjecture is true for the states on $\mathbb{C}_3\otimes\mathbb{C}_3$ \cite{hermes} recently. The PPT square conjecture in the case $n\ge4$ is still open.

quant-ph↗
arXiv2018

Slender Origami with Complex 3D Folding Shapes

One-dimensional slender bodies can be deformed or shaped into spatially complex curves relatively easily due to their inherent compliance. However, traditional methods of fabricating complex spatial shapes are cumbersome, prone to error accumulation and not amenable to elegant programmability. In this letter, we introduce a one-dimensional origami based on attaching Miura-ori that can fold into various programmed two or three-dimensional shapes. We study the out-of-plane displacement characteristics of this origami and demonstrate with examples, design of slender bodies that conform to programmed complex spatial curves. Our study provides a new, accurate, and single actuation solution of shape programmability.

physics.app-ph↗
arXiv2018

Unsupervised Learning of Neural Networks to Explain Neural Networks

This paper presents an unsupervised method to learn a neural network, namely an explainer, to interpret a pre-trained convolutional neural network (CNN), i.e., explaining knowledge representations hidden in middle conv-layers of the CNN. Given feature maps of a certain conv-layer of the CNN, the explainer performs like an auto-encoder, which first disentangles the feature maps into object-part features and then inverts object-part features back to features of higher conv-layers of the CNN. More specifically, the explainer contains interpretable conv-layers, where each filter disentangles the representation of a specific object part from chaotic input feature maps. As a paraphrase of CNN features, the disentangled representations of object parts help people understand the logic inside the CNN. We also learn the explainer to use object-part features to reconstruct features of higher CNN layers, in order to minimize loss of information during the feature disentanglement. More crucially, we learn the explainer via network distillation without using any annotations of sample labels, object parts, or textures for supervision. We have applied our method to different types of CNNs for evaluation, and explainers have significantly boosted the interpretability of CNN features.

cs.CV↗
arXiv2018

Mesoscopic magnetic resonance spectroscopy with a remote spin sensor

Quantum sensing based on nitrogen-vacancy (NV) centers in diamond has been developed as a powerful tool for microscopic magnetic resonance. However, the reported sensor-to-sample distance is limited within tens of nanometers because the signal of spin fluctuation decreases cubically with the increasing distance. Here we extend the sensing distance to tens of micrometers by detecting spin polarization rather than spin fluctuation. We detected the mesoscopic magnetic resonance spectra of polarized electrons of a pentacene-doped crystal, measured its two typical decay times and observed the optically enhanced spin polarization. This work paves the way for the NV-based mesoscopic magnetic resonance spectroscopy and imaging at ambient conditions.

quant-ph↗
arXiv2018

Spontaneous Repairing Liquid Metal/Si Nanocomposite as a Smart Conductive-Additive-Free Anode for Lithium-ion Battery

Silicon is a promising candidate for negative electrodes due to its high theoretical specific capacity (~3579 mAh g-1) and low lithiation potential (~0.40 V vs Li). However, its practical applications in battery have been inhibited by the large volume change (~400%) induced by Li+-insertion into Si lattices. Here, we attempt to resolve this issue at a fundamental level, and report for the first time a novel liquid metal (LM)-mediated spontaneous repairing conductive-additive-free Si anode for Li-ion battery. The fluidity of LM ensures the eternal contact between Si and the conducting-network during its repeated electrochemical reactions. The as-prepared nano-composite of LM/Si leads to superior performances as characterized by high capacity utilization (2300 mAh g-1 at 500 mA g-1), long-term stability (968 mAh g-1 after 1500 charge-discharge cycles at 8 A g-1 with 81.3% retention), high rate capability (360 mAh g-1 at 20 A g-1, equivalence of 55 C, or full charge/discharge in 65 seconds), and, in particular, an extra-ordinarily high initial coulombic efficiency (95.92%), which is not only the highest reported for Si to the best of our knowledge, but also higher than the mature graphitic carbon anodes. The unique approach described in this work not only resolves the basic stress challenges faced by the promising but often problematic alloy-type materials; in broader context it also provides a universal inspiration to all electrode materials whose electric properties suffer from extreme mechanic upheavals induced by the electrochemical strains during the cell reactions.

physics.app-ph↗
arXiv2018

Tracking Top-K Influential Vertices in Dynamic Networks

Influence propagation in networks has enjoyed fruitful applications and has been extensively studied in literature. However, only very limited preliminary studies tackled the challenges in handling highly dynamic changes in real networks. In this paper, we tackle the problem of tracking top-$k$ influential vertices in dynamic networks, where the dynamic changes are modeled as a stream of edge weight updates. Under the popularly adopted linear threshold (LT) model and the independent cascade (IC) model, we address two essential versions of the problem: tracking the top-$k$ influential individuals and finding the best $k$-seed set to maximize the influence spread (Influence Maximization). We adopt the polling-based method and maintain a sample of random RR sets so that we can approximate the influence of vertices with provable quality guarantees. It is known that updating RR sets over dynamic changes of a network can be easily done by a reservoir sampling method, so the key challenge is to efficiently decide how many RR sets are needed to achieve good quality guarantees. We use two simple signals, which both can be accessed in $O(1)$ time, to decide a proper number of RR sets. We prove the effectiveness of our methods. For both tasks the error incurred in our method is only a multiplicative factor to the ground truth. For influence maximization, we also propose an efficient query algorithm for finding the $k$ seeds, which is one order of magnitude faster than the state-of-the-art query algorithm in practice. In addition to the thorough theoretical results, our experimental results on large real networks clearly demonstrate the effectiveness and efficiency of our algorithms.

cs.SI↗
arXiv2018

Mining Density Contrast Subgraphs

Dense subgraph discovery is a key primitive in many graph mining applications, such as detecting communities in social networks and mining gene correlation from biological data. Most studies on dense subgraph mining only deal with one graph. However, in many applications, we have more than one graph describing relations among a same group of entities. In this paper, given two graphs sharing the same set of vertices, we investigate the problem of detecting subgraphs that contrast the most with respect to density. We call such subgraphs Density Contrast Subgraphs, or DCS in short. Two widely used graph density measures, average degree and graph affinity, are considered. For both density measures, mining DCS is equivalent to mining the densest subgraph from a "difference" graph, which may have both positive and negative edge weights. Due to the existence of negative edge weights, existing dense subgraph detection algorithms cannot identify the subgraph we need. We prove the computational hardness of mining DCS under the two graph density measures and develop efficient algorithms to find DCS. We also conduct extensive experiments on several real-world datasets to evaluate our algorithms. The experimental results show that our algorithms are both effective and efficient.

cs.SI↗
arXiv2017

Mapping electronic states of dual-parallel and symmetric zigzag grain boundaries of graphene on highly oriented pyrolytic graphite

The grain boundaries (GBs) of a graphene surface were extensively studied because GBs with specific defect configurations result in the formation of new curved structures, which can be treated as new carbon allotropes. We studied the structures and electronic spectra of two periodic GBs in graphene on highly oriented pyrolytic graphite (HOPG) surfaces using scanning tunneling microscopy and spectroscopy (STM/S). Our results demonstrated that a GB consisting of dual parallel periodic dislocation cores of pentagonal-heptagonal (5-7) carbon rings gives rise to an enhanced localized state at 0.45 eV above the Dirac point in graphene surfaces, which is attributed to van Hove singularities (VHSs). Moreover, the energy positions of the localized states are varied between 0.40 and 0.47 eV depending on the site and eventually decayed to 0.36 eV. The variation of the energy positions is induced by two parallel GBs because of the higher electron density at the GB as a defect center and the lower electron away from the GB. Another periodic GB with a symmetric zigzag structural feature induced VHSs at -0.038 and 0.12 eV near the Fermi level. Moreover, intervalley scattering was observed on both these GBs. This means that carrier concentration and thus, the conductance around the periodic GBs can be significantly enhanced by localized density of states. This finding suggests that graphene with a properly embedded ordered GB is promising for improving the performance of graphene-based electronic devices.

cond-mat.mtrl-sci↗
arXiv2017

Tracking Influential Nodes in Dynamic Networks

In this paper, we tackle a challenging problem inherent in a series of applications: tracking the influential nodes in dynamic networks. Specifically, we model a dynamic network as a stream of edge weight updates. This general model embraces many practical scenarios as special cases, such as edge and node insertions, deletions as well as evolving weighted graphs. Under the popularly adopted linear threshold model and independent cascade model, we consider two essential versions of the problem: finding the nodes whose influences passing a user specified threshold and finding the top-$k$ most influential nodes. Our key idea is to use the polling-based methods and maintain a sample of random RR sets so that we can approximate the influence of nodes with provable quality guarantees. We develop an efficient algorithm that incrementally updates the sample random RR sets against network changes. We also design methods to determine the proper sample sizes for the two versions of the problem so that we can provide strong quality guarantees and, at the same time, be efficient in both space and time. In addition to the thorough theoretical results, our experimental results on $5$ real network data sets clearly demonstrate the effectiveness and efficiency of our algorithms.

cs.SI↗