arXiv Science⌕ Search

arXiv subjects

Jian Zhang

Publications and source records attributed to Jian Zhang.

At least 685 records · Page 38Linked to original sources
arXiv2018

YellowFin and the Art of Momentum Tuning

Hyperparameter tuning is one of the most time-consuming workloads in deep learning. State-of-the-art optimizers, such as AdaGrad, RMSProp and Adam, reduce this labor by adaptively tuning an individual learning rate for each variable. Recently researchers have shown renewed interest in simpler methods like momentum SGD as they may yield better test metrics. Motivated by this trend, we ask: can simple adaptive methods based on SGD perform as well or better? We revisit the momentum SGD algorithm and show that hand-tuning a single learning rate and momentum makes it competitive with Adam. We then analyze its robustness to learning rate misspecification and objective curvature variation. Based on these insights, we design YellowFin, an automatic tuner for momentum and learning rate in SGD. YellowFin optionally uses a negative-feedback loop to compensate for the momentum dynamics in asynchronous settings on the fly. We empirically show that YellowFin can converge in fewer iterations than Adam on ResNets and LSTMs for image recognition, language modeling and constituency parsing, with a speedup of up to 3.28x in synchronous and up to 2.69x in asynchronous settings.

stat.ML↗
arXiv2018

Anomalous quantum-critical spin dynamics in YFe2Al10

We report results of a muon spin relaxation ($μ$SR) study of YFe$_2$Al$_{10}$, a quasi-2D nearly-ferromagnetic metal in which unconventional quantum critical behavior is observed. No static Fe$^{2+}$ magnetism, with or without long-range order, is found down to 19~mK\@. The dynamic muon spin relaxation rate~$λ$ exhibits power-law divergences in temperature and magnetic field, the latter for fields that are too weak to affect the electronic spin dynamics directly. We attribute this to the proportionality of $λ(ω_μ,T)$ to the dynamic structure factor~$S(ω_μ,T)$, where $ω_μ\approx 10^5$--$10^7~\mathrm{s}^{-1}$ is the muon Zeeman frequency. These results suggest critical divergences of $S(ω_μ,T)$ in both temperature and frequency. Power-law scaling and a 2D dissipative quantum XY (2D-DQXY) model both yield forms for $S(ω,T)$ that agree with neutron scattering data ($ω\approx 10^{12}~\mathrm{s}^{-1}$). Extrapolation to $μ$SR frequencies agrees semi-quantitatively with the observed temperature dependence of $λ(ω_μ,T)$, but predicts frequency independence for $ω_μ\ll T$ in extreme disagreement with experiment. We conclude that the quantum critical spin dynamics of YFe$_2$Al$_{10}$ are not well understood at low frequencies.

cond-mat.str-el↗
arXiv2018

Generalized Verma modules over U_q(sl_n(C))

We construct realizations of quantum generalized Verma modules for U_q(sl_n(C)) by quan- tum differential operators. Taking the classical limit q ! 1 provides a realization of classical generalized Verma modules for sl_n(C) by differential operators.

math.QA↗
arXiv2018

SCH-GAN: Semi-supervised Cross-modal Hashing by Generative Adversarial Network

Cross-modal hashing aims to map heterogeneous multimedia data into a common Hamming space, which can realize fast and flexible retrieval across different modalities. Supervised cross-modal hashing methods have achieved considerable progress by incorporating semantic side information. However, they mainly have two limitations: (1) Heavily rely on large-scale labeled cross-modal training data which are labor intensive and hard to obtain. (2) Ignore the rich information contained in the large amount of unlabeled data across different modalities, especially the margin examples that are easily to be incorrectly retrieved, which can help to model the correlations. To address these problems, in this paper we propose a novel Semi-supervised Cross-Modal Hashing approach by Generative Adversarial Network (SCH-GAN). We aim to take advantage of GAN's ability for modeling data distributions to promote cross-modal hashing learning in an adversarial way. The main contributions can be summarized as follows: (1) We propose a novel generative adversarial network for cross-modal hashing. In our proposed SCH-GAN, the generative model tries to select margin examples of one modality from unlabeled data when giving a query of another modality. While the discriminative model tries to distinguish the selected examples and true positive examples of the query. These two models play a minimax game so that the generative model can promote the hashing performance of discriminative model. (2) We propose a reinforcement learning based algorithm to drive the training of proposed SCH-GAN. The generative model takes the correlation score predicted by discriminative model as a reward, and tries to select the examples close to the margin to promote discriminative model by maximizing the margin between positive and negative data. Experiments on 3 widely-used datasets verify the effectiveness of our proposed approach.

cs.CV↗
arXiv2018

Nodal superconductivity coexists with low-moment static magnetism in single-crystalline tetragonal FeS: A muon spin relaxation and rotation study

We report muon spin relaxation and rotation ($μ$SR) measurements on hydrothermally-grown single crystals of the tetragonal superconductor~FeS, which help to clarify the controversial magnetic state and superconducting gap symmetry of this compound. $μ$SR time spectra were obtained from 280~K down to 0.025~K in zero field (ZF) and applied fields up to 20 mT. In ZF the observed loss of initial asymmetry (signal amplitude) and increase of depolarization rate~$Λ_\mathrm{ZF}$ below 10~K indicate the onset of static magnetism, which coexists with superconductivity below $T_c$. Transverse-field $μ$SR yields a muon depolarization rate $σ_\mathrm{sc} \propto λ_{ab}^{-2}$ that clearly shows a linear dependence at low temperature, consistent with nodal superconductivity. The $s{+}d$-wave model gives the best fit to the observed temperature and field dependencies. The normalized superfluid densities versus normalized temperature for different fields collapse onto the same curve, indicating the superconducting gap structure is independent of field. The $T=0$ in-plane penetration depth $λ_{ab}$(0) = 198(3) nm.

cond-mat.supr-con↗
arXiv2017

Capelli identity on multiparameter quantum linear groups

A quantum Capelli identity is given on the multiparameter quantum general linear group based on the $(p_{ij}, u)$-condition. The multiparameter quantum Pfaffian of the $(p_{ij}, u)$-quantum group is also introduced and the transformation under the congruent action is given. Generalization to the multiparameter hyper-Pfaffian and relationship with the quantum minors are also investigated.

math.QA↗
arXiv2017

Unsupervised Generative Adversarial Cross-modal Hashing

Cross-modal hashing aims to map heterogeneous multimedia data into a common Hamming space, which can realize fast and flexible retrieval across different modalities. Unsupervised cross-modal hashing is more flexible and applicable than supervised methods, since no intensive labeling work is involved. However, existing unsupervised methods learn hashing functions by preserving inter and intra correlations, while ignoring the underlying manifold structure across different modalities, which is extremely helpful to capture meaningful nearest neighbors of different modalities for cross-modal retrieval. To address the above problem, in this paper we propose an Unsupervised Generative Adversarial Cross-modal Hashing approach (UGACH), which makes full use of GAN's ability for unsupervised representation learning to exploit the underlying manifold structure of cross-modal data. The main contributions can be summarized as follows: (1) We propose a generative adversarial network to model cross-modal hashing in an unsupervised fashion. In the proposed UGACH, given a data of one modality, the generative model tries to fit the distribution over the manifold structure, and select informative data of another modality to challenge the discriminative model. The discriminative model learns to distinguish the generated data and the true positive data sampled from correlation graph to achieve better retrieval accuracy. These two models are trained in an adversarial way to improve each other and promote hashing function learning. (2) We propose a correlation graph based approach to capture the underlying manifold structure across different modalities, so that data of different modalities but within the same manifold can have smaller Hamming distance and promote retrieval accuracy. Extensive experiments compared with 6 state-of-the-art methods verify the effectiveness of our proposed approach.

cs.CV↗
arXiv2017

Asking the Difficult Questions: Goal-Oriented Visual Question Generation via Intermediate Rewards

Despite significant progress in a variety of vision-and-language problems, developing a method capable of asking intelligent, goal-oriented questions about images is proven to be an inscrutable challenge. Towards this end, we propose a Deep Reinforcement Learning framework based on three new intermediate rewards, namely goal-achieved, progressive and informativeness that encourage the generation of succinct questions, which in turn uncover valuable information towards the overall goal. By directly optimizing for questions that work quickly towards fulfilling the overall goal, we avoid the tendency of existing methods to generate long series of insane queries that add little value. We evaluate our model on the GuessWhat?! dataset and show that the resulting questions can help a standard Guesser identify a specific object in an image at a much higher success rate.

cs.CV↗
arXiv2017

Kill Two Birds with One Stone: Weakly-Supervised Neural Network for Image Annotation and Tag Refinement

The number of social images has exploded by the wide adoption of social networks, and people like to share their comments about them. These comments can be a description of the image, or some objects, attributes, scenes in it, which are normally used as the user-provided tags. However, it is well-known that user-provided tags are incomplete and imprecise to some extent. Directly using them can damage the performance of related applications, such as the image annotation and retrieval. In this paper, we propose to learn an image annotation model and refine the user-provided tags simultaneously in a weakly-supervised manner. The deep neural network is utilized as the image feature learning and backbone annotation model, while visual consistency, semantic dependency, and user-error sparsity are introduced as the constraints at the batch level to alleviate the tag noise. Therefore, our model is highly flexible and stable to handle large-scale image sets. Experimental results on two benchmark datasets indicate that our proposed model achieves the best performance compared to the state-of-the-art methods.

cs.CV↗
arXiv2017

Atomistic simulation of the Coupled adsorption and unfolding of protein GB1 on the polystyrenes nanoparticle surface

Protein adsorption/desorption upon nanoparticle surfaces is an important process to understand for developing new nanotechnology involving biomaterials, while atomistic picture of the process and its coupling with protein conformational change is lacking. Here we report our study on the adsorption of protein GB1 upon a polystyrene nanoparticle surface using atomistic molecular dynamic simulations. Enabled by metadynamics, we explored the relevant phase space and identified three protein states; each protein state involved both the adsorbed and desorbed states. We also studied the change of secondary and tertiary structures of GB1 during adsorption, and the dominant interactions between protein and surface in different adsorbing stages. From the simulation results we obtained a scenario that is more rational and complete than the conventional one. We believe the new scenario is more appropriate as a theoretical model in understanding and explaining experimental signals. Introduction

physics.bio-ph↗
arXiv2017

SSDH: Semi-supervised Deep Hashing for Large Scale Image Retrieval

Hashing methods have been widely used for efficient similarity retrieval on large scale image database. Traditional hashing methods learn hash functions to generate binary codes from hand-crafted features, which achieve limited accuracy since the hand-crafted features cannot optimally represent the image content and preserve the semantic similarity. Recently, several deep hashing methods have shown better performance because the deep architectures generate more discriminative feature representations. However, these deep hashing methods are mainly designed for supervised scenarios, which only exploit the semantic similarity information, but ignore the underlying data structures. In this paper, we propose the semi-supervised deep hashing (SSDH) approach, to perform more effective hash function learning by simultaneously preserving semantic similarity and underlying data structures. The main contributions are as follows: (1) We propose a semi-supervised loss to jointly minimize the empirical error on labeled data, as well as the embedding error on both labeled and unlabeled data, which can preserve the semantic similarity and capture the meaningful neighbors on the underlying data structures for effective hashing. (2) A semi-supervised deep hashing network is designed to extensively exploit both labeled and unlabeled data, in which we propose an online graph construction method to benefit from the evolving deep features during training to better capture semantic neighbors. To the best of our knowledge, the proposed deep network is the first deep hashing method that can perform hash code learning and feature learning simultaneously in a semi-supervised fashion. Experimental results on 5 widely-used datasets show that our proposed approach outperforms the state-of-the-art hashing methods.

cs.CV↗
arXiv2017

In situ high resolution real-time quantum efficiency imaging for photocathodes

Aspects of the preparation process and performance degradation are two major problems of photocathodes. The lack of a means for dynamic quantum efficiency measurements results in the inability to observe the inhomogeneity of the cathode surface by fine structural analysis and in real time.Here we present a simple and scalable technique for in situ real-time quantum efficiency diagnosis. An incoherent light source provides uniform illumination on the cathode surface, and solenoid magnets are used as lens for focusing and imaging the emitted electron beam on a downstream scintillator screen, which converts the quantum efficiency information into fluorescence intensity distribution. The microscopic discontinuity and the dynamic changes of the quantum efficiency of a gallium arsenide photocathode are observed at a resolution of a few microns. An unexpected uneven decrease of the quantum efficiency is also recorded. The work demonstrates a new observation method for photoemission materials research.

physics.app-ph↗
arXiv2017

Depth dependent decoherence caused by surface and external spins for NV centers in diamond

By efficient nanoscale plasma etching, the nitrogen-vacancy (NV) centers in diamond were brought to the sample surface step by step successfully. At each depth, we used the relative ratios of spin coherence times before and after applying external spins on the surface to present the decoherence, and investigated the relationships between depth and ratios. The values of relative ratios declined and then rised with the decreasing depth, which was attributed to the decoherence influenced by external spins, surface spins, discrete surface spin effects and electric field noise. Moreover, our work revealed a characteristic depth at which the NV center would experience relatively the strongest decoherence caused by external spins in consideration of inevitable surface spins. And the characteristic depth was found depending on the adjacent environments of NV centers and the density of surface spins.

cond-mat.mes-hall↗
arXiv2017

Ultra-low Power Nanoelectromechanical Memory Based on Location-controllable Nanogap System

Nanogap engineering of low-dimensional nanomaterials, has received considerable interest in a variety of fields, ranging from molecular electronics to memories. Creating nanogaps at a certain position is of vital importance for the repeatable fabrication of the devices. In this work, we report a rational design of non-volatile memories based on sub-5 nm nanogaped single-walled carbon nanotubes (SWNTs) via the electromechanical motion. The nanogaps are readily realized by electroburning in a partially suspended SWNTs device with nanoscale region. The SWNT memory devices are applicable for both metallic and semiconducting SWNTs, resolving the challenge of separation of semiconducting SWNTs from metallic ones. Meanwhile, the memory devices exhibit excellent performance: ultra-low writing energy (4.1*10-19 J per bit), ON/OFF ratio of 105, stable switching ON operations and over 30 hours retention time in ambient conditions, which are of great potential for applications.

cond-mat.mes-hall↗
arXiv2017

Target Directed Event Sequence Generation for Android Applications

Testing is a commonly used approach to ensure the quality of software, of which model-based testing is a hot topic to test GUI programs such as Android applications (apps). Existing approaches mainly either dynamically construct a model that only contains the GUI information, or build a model in the view of code that may fail to describe the changes of GUI widgets during runtime. Besides, most of these models do not support back stack that is a particular mechanism of Android. Therefore, this paper proposes a model LATTE that is constructed dynamically with consideration of the view information in the widgets as well as the back stack, to describe the transition between GUI widgets. We also propose a label set to link the elements of the LATTE model to program snippets. The user can define a subset of the label set as a target for the testing requirements that need to cover some specific parts of the code. To avoid the state explosion problem during model construction, we introduce a definition "state similarity" to balance the model accuracy and analysis cost. Based on this model, a target directed test generation method is presented to generate event sequences to effectively cover the target. The experiments on several real-world apps indicate that the generated test cases based on LATTE can reach a high coverage, and with the model we can generate the event sequences to cover a given target with short event sequences.

cs.SE↗
arXiv2017

Deep Learning at 15PF: Supervised and Semi-Supervised Classification for Scientific Data

This paper presents the first, 15-PetaFLOP Deep Learning system for solving scientific pattern classification problems on contemporary HPC architectures. We develop supervised convolutional architectures for discriminating signals in high-energy physics data as well as semi-supervised architectures for localizing and classifying extreme weather in climate data. Our Intelcaffe-based implementation obtains $\sim$2TFLOP/s on a single Cori Phase-II Xeon-Phi node. We use a hybrid strategy employing synchronous node-groups, while using asynchronous communication across groups. We use this strategy to scale training of a single model to $\sim$9600 Xeon-Phi nodes; obtaining peak performance of 11.73-15.07 PFLOP/s and sustained performance of 11.41-13.27 PFLOP/s. At scale, our HEP architecture produces state-of-the-art classification accuracy on a dataset with 10M images, exceeding that achieved by selections on high-level physics-motivated features. Our semi-supervised architecture successfully extracts weather patterns in a 15TB climate dataset. Our results demonstrate that Deep Learning can be optimized and scaled effectively on many-core, HPC systems.

cs.PF↗
arXiv2017

Gelfand-Tsetlin modules of quantum gl_n$defined by admissible sets of relations

The purpose of this paper is to construct new families of irreducible Gelfand-Tsetlin modules for U_q(gl_n). These modules have arbitrary singularity and Gelfand-Tsetlin multiplicities bounded by 2. Most previously known irreducible modules had all Gelfand-Tsetlin multiplicities bounded by 1 \cite{FRZ1}, \cite{FRZ2}. In particular, our method works for q=1 providing new families of irreducible Gelfand-Tsetlin modules for gl_n. This generalizes the results of \cite{FGR3} and \cite{FRZ}.

math.RT↗