arXiv subjects

Jianguo Li

Publications and source records attributed to Jianguo Li.

102 records · Page 6Linked to original sources

arXiv2018

DSOD: Learning Deeply Supervised Object Detectors from Scratch

We present Deeply Supervised Object Detector (DSOD), a framework that can learn object detectors from scratch. State-of-the-art object objectors rely heavily on the off-the-shelf networks pre-trained on large-scale classification datasets like ImageNet, which incurs learning bias due to the difference on both the loss functions and the category distributions between classification and detection tasks. Model fine-tuning for the detection task could alleviate this bias to some extent but not fundamentally. Besides, transferring pre-trained models from classification to detection between discrepant domains is even more difficult (e.g. RGB to depth images). A better solution to tackle these two critical problems is to train object detectors from scratch, which motivates our proposed DSOD. Previous efforts in this direction mostly failed due to much more complicated loss functions and limited training data in object detection. In DSOD, we contribute a set of design principles for training object detectors from scratch. One of the key findings is that deep supervision, enabled by dense layer-wise connections, plays a critical role in learning a good detector. Combining with several other principles, we develop DSOD following the single-shot detection (SSD) framework. Experiments on PASCAL VOC 2007, 2012 and MS COCO datasets demonstrate that DSOD can achieve better results than the state-of-the-art solutions with much more compact models. For instance, DSOD outperforms SSD on all three benchmarks with real-time detection speed, while requires only 1/2 parameters to SSD and 1/10 parameters to Faster RCNN. Our code and models are available at: https://github.com/szq0214/DSOD .

cs.CV↗

arXiv2018

Boosting Adversarial Attacks with Momentum

Deep neural networks are vulnerable to adversarial examples, which poses security concerns on these algorithms due to the potentially severe consequences. Adversarial attacks serve as an important surrogate to evaluate the robustness of deep learning models before they are deployed. However, most of existing adversarial attacks can only fool a black-box model with a low success rate. To address this issue, we propose a broad class of momentum-based iterative algorithms to boost adversarial attacks. By integrating the momentum term into the iterative process for attacks, our methods can stabilize update directions and escape from poor local maxima during the iterations, resulting in more transferable adversarial examples. To further improve the success rates for black-box attacks, we apply momentum iterative algorithms to an ensemble of models, and show that the adversarially trained models with a strong defense ability are also vulnerable to our black-box attacks. We hope that the proposed methods will serve as a benchmark for evaluating the robustness of various deep models and defense methods. With this method, we won the first places in NIPS 2017 Non-targeted Adversarial Attack and Targeted Adversarial Attack competitions.

cs.LG↗

arXiv2018

Relative Cooling Power Enhancement by Tuning Magneto-structural Stability in Ni-Mn-In Heusler Alloys

Off-stoichiometric Ni$_2$MnIn Heusler alloys have drawn recent attention due to their large magnetocaloric entropy change associated with the first-order magneto-structural transition. Here we present crystal structural, calorimetric and magnetic studies of three compositions. Temperature-dependent X-ray diffraction shows clear structural transition from a 6M modulated monoclinic to a L2$_1$ cubic. A significant enhancement of relative cooling power (RCP) was achieved by tuning the magnetic and structural stability through minor compositional changes, with the measured results quantitatively close to the prediction as a function of the ratio between the martensitic transition ($T_m$) temperature and austenite Curie temperature ($T_C$) although the maximal magnetic induced entropy change ($ΔS_{max}$) reduction is observed in the same time. The results provided an evaluation guideline of RCPs as well as magnetic-induced entropy change in designing practical active materials.

cond-mat.mtrl-sci↗

arXiv2017

Superconducting nanowire single photon detection system for space applications

Superconducting nanowire single photon detectors (SNSPDs) have advanced various frontier scientific and technological fields such as quantum key distribution and deep space communications. However, limited by available cooling technology, all past experimental demonstrations have had ground-based applications. In this work we demonstrate a SNSPD system using a hybrid cryocooler compatible with space applications. With a minimum operational temperature of 2.8 K, this SNSPD system presents a maximum system detection efficiency of over 50% and a timing jitter of 48 ps, which paves the way for various space applications.

physics.app-ph↗

arXiv2017

Learning Efficient Convolutional Networks through Network Slimming

The deployment of deep convolutional neural networks (CNNs) in many real world applications is largely hindered by their high computational cost. In this paper, we propose a novel learning scheme for CNNs to simultaneously 1) reduce the model size; 2) decrease the run-time memory footprint; and 3) lower the number of computing operations, without compromising accuracy. This is achieved by enforcing channel-level sparsity in the network in a simple but effective way. Different from many existing approaches, the proposed method directly applies to modern CNN architectures, introduces minimum overhead to the training process, and requires no special software/hardware accelerators for the resulting models. We call our approach network slimming, which takes wide and large networks as input models, but during training insignificant channels are automatically identified and pruned afterwards, yielding thin and compact models with comparable accuracy. We empirically demonstrate the effectiveness of our approach with several state-of-the-art CNN models, including VGGNet, ResNet and DenseNet, on various image classification datasets. For VGGNet, a multi-pass version of network slimming gives a 20x reduction in model size and a 5x reduction in computing operations.

cs.CV↗

arXiv2017

Learning Accurate Low-Bit Deep Neural Networks with Stochastic Quantization

Low-bit deep neural networks (DNNs) become critical for embedded applications due to their low storage requirement and computing efficiency. However, they suffer much from the non-negligible accuracy drop. This paper proposes the stochastic quantization (SQ) algorithm for learning accurate low-bit DNNs. The motivation is due to the following observation. Existing training algorithms approximate the real-valued elements/filters with low-bit representation all together in each iteration. The quantization errors may be small for some elements/filters, while are remarkable for others, which lead to inappropriate gradient direction during training, and thus bring notable accuracy drop. Instead, SQ quantizes a portion of elements/filters to low-bit with a stochastic probability inversely proportional to the quantization error, while keeping the other portion unchanged with full-precision. The quantized and full-precision portions are updated with corresponding gradients separately in each iteration. The SQ ratio is gradually increased until the whole network is quantized. This procedure can greatly compensate the quantization error and thus yield better accuracy for low-bit DNNs. Experiments show that SQ can consistently and significantly improve the accuracy for different low-bit DNNs on various datasets and various network structures.

cs.CV↗

arXiv2017

Weakly Supervised Dense Video Captioning

This paper focuses on a novel and challenging vision task, dense video captioning, which aims to automatically describe a video clip with multiple informative and diverse caption sentences. The proposed method is trained without explicit annotation of fine-grained sentence to video region-sequence correspondence, but is only based on weak video-level sentence annotations. It differs from existing video captioning systems in three technical aspects. First, we propose lexical fully convolutional neural networks (Lexical-FCN) with weakly supervised multi-instance multi-label learning to weakly link video regions with lexical labels. Second, we introduce a novel submodular maximization scheme to generate multiple informative and diverse region-sequences based on the Lexical-FCN outputs. A winner-takes-all scheme is adopted to weakly associate sentences to region-sequences in the training phase. Third, a sequence-to-sequence learning based language model is trained with the weakly supervised information obtained through the association process. We show that the proposed method can not only produce informative and diverse dense captions, but also outperform state-of-the-art single video captioning methods by a large margin.

cs.CV↗

arXiv2016

Leveraging tagging and rating for recommendation: RMF meets weighted diffusion on tripartite graphs

Recommender systems (RSs) have been a widely exploited approach to solving the information overload problem. However, the performance is still limited due to the extreme sparsity of the rating data. With the popularity of Web 2.0, the social tagging system provides more external information to improve recommendation accuracy. Although some existing approaches combine the matrix factorization models with co-occurrence properties and context of tags, they neglect the issue of tag sparsity without the commonly associated tags problem that would also result in inaccurate recommendations. Consequently, in this paper, we propose a novel hybrid collaborative filtering model named WUDiff_RMF, which improves Regularized Matrix Factorization (RMF) model by integrating Weighted User-Diffusion-based CF algorithm(WUDiff) that obtains the information of similar users from the weighted tripartite user-item-tag graph. This model aims to capture the degree correlation of the user-item-tag tripartite network to enhance the performance of recommendation. Experiments conducted on four real-world datasets demonstrate that our approach significantly performs better than already widely used methods in the accuracy of recommendation. Moreover, results show that WUDiff_RMF can alleviate the data sparsity, especially in the circumstance that users have made few ratings and few tags.

cs.IR↗

arXiv2016

Direct Measure of Giant Magnetocaloric Entropy Contributions in Ni-Mn-In

Off-stoichiometric alloys based on Ni 2 MnIn have drawn attention due to the coupled first order magnetic and structural transformations, and the large magnetocaloric entropy associated with the transformations. Here we describe calorimetric and magnetic studies of four compositions. The results provide a direct measure of entropy changes contributions including at the first-order phase transitions, and thereby a determination of the maximum field-induced entropy change corresponding to the giant magnetocaloric effect. We find a large excess entropy change, attributed to magneto-elastic coupling, but only in compositions with no ferromagnetic order in the high-temperature austenite phase. Furthermore, a molecular field model corresponding to antiferromagnetism of the low-temperature phases is in good agreement, and nearly independent of composition, despite significant differences in overall magnetic response of these materials.

cond-mat.mtrl-sci↗

arXiv2015

Deep Attributes from Context-Aware Regional Neural Codes

Recently, many researches employ middle-layer output of convolutional neural network models (CNN) as features for different visual recognition tasks. Although promising results have been achieved in some empirical studies, such type of representations still suffer from the well-known issue of semantic gap. This paper proposes so-called deep attribute framework to alleviate this issue from three aspects. First, we introduce object region proposals as intermedia to represent target images, and extract features from region proposals. Second, we study aggregating features from different CNN layers for all region proposals. The aggregation yields a holistic yet compact representation of input images. Results show that cross-region max-pooling of soft-max layer output outperform all other layers. As soft-max layer directly corresponds to semantic concepts, this representation is named "deep attributes". Third, we observe that only a small portion of generated regions by object proposals algorithm are correlated to classification target. Therefore, we introduce context-aware region refining algorithm to pick out contextual regions and build context-aware classifiers. We apply the proposed deep attributes framework for various vision tasks. Extensive experiments are conducted on standard benchmarks for three visual recognition tasks, i.e., image classification, fine-grained recognition and visual instance retrieval. Results show that deep attribute approaches achieve state-of-the-art results, and outperforms existing peer methods with a significant margin, even though some benchmarks have little overlap of concepts with the pre-trained CNN models.

cs.CV↗

arXiv2015

Calorimetric and magnetic study for Ni$_{50}$Mn$_{36}$In$_{14}$ and relative cooling power in paramagnetic inverse magnetocaloric systems

The non-stoichiometric Heusler alloy Ni$_{50}$Mn$_{36}$In$_{14}$ undergoes a martensitic phase transformation in the vicinity of 345 K, with the high temperature austenite phase exhibiting paramagnetic rather than ferromagnetic behavior, as shown in similar alloys with lower-temperature transformations. Suitably prepared samples are shown to exhibit a sharp transformation, a relatively small thermal hysteresis, and a large field-induced entropy change. We analyzed the magnetocaloric behavior both through magnetization and direct field-dependent calorimetry measurements. For measurements passing through the first-order transformation, an improved method for heat-pulse relaxation calorimetry was designed. The results provide a firm basis for the analytic evaluation of field-induced entropy changes in related materials. An analysis of the relative cooling power (RCP), based on the integrated field-induced entropy change and magnetizing behavior of the Mn spin system with ferromagnetic correlations, shows that a significant RCP may be obtained in these materials by tuning the magnetic and structural transformation temperatures through minor compositional changes or local order changes.

cond-mat.mtrl-sci↗

arXiv2014

Large-scale Supervised Hierarchical Feature Learning for Face Recognition

This paper proposes a novel face recognition algorithm based on large-scale supervised hierarchical feature learning. The approach consists of two parts: hierarchical feature learning and large-scale model learning. The hierarchical feature learning searches feature in three levels of granularity in a supervised way. First, face images are modeled by receptive field theory, and the representation is an image with many channels of Gaussian receptive maps. We activate a few most distinguish channels by supervised learning. Second, the face image is further represented by patches of picked channels, and we search from the over-complete patch pool to activate only those most discriminant patches. Third, the feature descriptor of each patch is further projected to lower dimension subspace with discriminant subspace analysis. Learned feature of activated patches are concatenated to get a full face representation.A linear classifier is learned to separate face pairs from same subjects and different subjects. As the number of face pairs are extremely large, we introduce ADMM (alternative direction method of multipliers) to train the linear classifier on a computing cluster. Experiments show that more training samples will bring notable accuracy improvement. We conduct experiments on FRGC and LFW. Results show that the proposed approach outperforms existing algorithms under the same protocol notably. Besides, the proposed approach is small in memory footprint, and low in computing cost, which makes it suitable for embedded applications.

cs.CV↗