arXiv subjects

Jian Zhang

Publications and source records attributed to Jian Zhang.

At least 649 records · Page 36Linked to original sources

arXiv2019

Compare More Nuanced:Pairwise Alignment Bilinear Network For Few-shot Fine-grained Learning

The recognition ability of human beings is developed in a progressive way. Usually, children learn to discriminate various objects from coarse to fine-grained with limited supervision. Inspired by this learning process, we propose a simple yet effective model for the Few-Shot Fine-Grained (FSFG) recognition, which tries to tackle the challenging fine-grained recognition task using meta-learning. The proposed method, named Pairwise Alignment Bilinear Network (PABN), is an end-to-end deep neural network. Unlike traditional deep bilinear networks for fine-grained classification, which adopt the self-bilinear pooling to capture the subtle features of images, the proposed model uses a novel pairwise bilinear pooling to compare the nuanced differences between base images and query images for learning a deep distance metric. In order to match base image features with query image features, we design feature alignment losses before the proposed pairwise bilinear pooling. Experiment results on four fine-grained classification datasets and one generic few-shot dataset demonstrate that the proposed model outperforms both the state-ofthe-art few-shot fine-grained and general few-shot methods.

cs.CV↗

arXiv2019

Towards Locally Consistent Object Counting with Constrained Multi-stage Convolutional Neural Networks

High-density object counting in surveillance scenes is challenging mainly due to the drastic variation of object scales. The prevalence of deep learning has largely boosted the object counting accuracy on several benchmark datasets. However, does the global counts really count? Armed with this question we dive into the predicted density map whose summation over the whole regions reports the global counts for more in-depth analysis. We observe that the object density map generated by most existing methods usually lacks of local consistency, i.e., counting errors in local regions exist unexpectedly even though the global count seems to well match with the ground-truth. Towards this problem, in this paper we propose a constrained multi-stage Convolutional Neural Networks (CNNs) to jointly pursue locally consistent density map from two aspects. Different from most existing methods that mainly rely on the multi-column architectures of plain CNNs, we exploit a stacking formulation of plain CNNs. Benefited from the internal multi-stage learning process, the feature map could be repeatedly refined, allowing the density map to approach the ground-truth density distribution. For further refinement of the density map, we also propose a grid loss function. With finer local-region-based supervisions, the underlying model is constrained to generate locally consistent density values to minimize the training errors considering both the global and local counts accuracy. Experiments on two widely-tested object counting benchmarks with overall significant results compared with state-of-the-art methods demonstrate the effectiveness of our approach.

cs.CV↗

arXiv2019

Low-Precision Random Fourier Features for Memory-Constrained Kernel Approximation

We investigate how to train kernel approximation methods that generalize well under a memory budget. Building on recent theoretical work, we define a measure of kernel approximation error which we find to be more predictive of the empirical generalization performance of kernel approximation methods than conventional metrics. An important consequence of this definition is that a kernel approximation matrix must be high rank to attain close approximation. Because storing a high-rank approximation is memory intensive, we propose using a low-precision quantization of random Fourier features (LP-RFFs) to build a high-rank approximation under a memory budget. Theoretically, we show quantization has a negligible effect on generalization performance in important settings. Empirically, we demonstrate across four benchmark datasets that LP-RFFs can match the performance of full-precision RFFs and the Nyström method, with 3x-10x and 50x-460x less memory, respectively.

cs.LG↗

arXiv2019

Fast Registration for cross-source point clouds by using weak regional affinity and pixel-wise refinement

Many types of 3D acquisition sensors have emerged in recent years and point cloud has been widely used in many areas. Accurate and fast registration of cross-source 3D point clouds from different sensors is an emerged research problem in computer vision. This problem is extremely challenging because cross-source point clouds contain a mixture of various variances, such as density, partial overlap, large noise and outliers, viewpoint changing. In this paper, an algorithm is proposed to align cross-source point clouds with both high accuracy and high efficiency. There are two main contributions: firstly, two components, the weak region affinity and pixel-wise refinement, are proposed to maintain the global and local information of 3D point clouds. Then, these two components are integrated into an iterative tensor-based registration algorithm to solve the cross-source point cloud registration problem. We conduct experiments on synthetic cross-source benchmark dataset and real cross-source datasets. Comparison with six state-of-the-art methods, the proposed method obtains both higher efficiency and accuracy.

cs.CV↗

arXiv2019

Towards Automatic Construction of Diverse, High-quality Image Dataset

The availability of labeled image datasets has been shown critical for high-level image understanding, which continuously drives the progress of feature designing and models developing. However, constructing labeled image datasets is laborious and monotonous. To eliminate manual annotation, in this work, we propose a novel image dataset construction framework by employing multiple textual queries. We aim at collecting diverse and accurate images for given queries from the Web. Specifically, we formulate noisy textual queries removing and noisy images filtering as a multi-view and multi-instance learning problem separately. Our proposed approach not only improves the accuracy but also enhances the diversity of the selected images. To verify the effectiveness of our proposed approach, we construct an image dataset with 100 categories. The experiments show significant performance gains by using the generated data of our approach on several tasks, such as image classification, cross-dataset generalization, and object detection. The proposed method also consistently outperforms existing weakly supervised and web-supervised approaches.

cs.CV↗

arXiv2019

Acting Is Seeing: Navigating Tight Space Using Flapping Wings

Wings of flying animals can not only generate lift and control torques but also can sense their surroundings. Such dual functions of sensing and actuation coupled in one element are particularly useful for small sized bio-inspired robotic flyers, whose weight, size, and power are under stringent constraint. In this work, we present the first flapping-wing robot using its flapping wings for environmental perception and navigation in tight space, without the need for any visual feedback. As the test platform, we introduce the Purdue Hummingbird, a flapping-wing robot with 17cm wingspan and 12 grams weight, with a pair of 30-40Hz flapping wings driven by only two actuators. By interpreting the wing loading feedback and its variations, the vehicle can detect the presence of environmental changes such as grounds, walls, stairs, obstacles and wind gust. The instantaneous wing loading can be obtained through the measurements and interpretation of the current feedback by the motors that actuate the wings. The effectiveness of the proposed approach is experimentally demonstrated on several challenging flight tasks without vision: terrain following, wall following and going through a narrow corridor. To ensure flight stability, a robust controller was designed for handling unforeseen disturbances during the flight. Sensing and navigating one's environment through actuator loading is a promising method for mobile robots, and it can serve as an alternative or complementary method to visual perception.

cs.RO↗

arXiv2019

Learning Extreme Hummingbird Maneuvers on Flapping Wing Robots

Biological studies show that hummingbirds can perform extreme aerobatic maneuvers during fast escape. Given a sudden looming visual stimulus at hover, a hummingbird initiates a fast backward translation coupled with a 180-degree yaw turn, which is followed by instant posture stabilization in just under 10 wingbeats. Consider the wingbeat frequency of 40Hz, this aggressive maneuver is carried out in just 0.2 seconds. Inspired by the hummingbirds' near-maximal performance during such extreme maneuvers, we developed a flight control strategy and experimentally demonstrated that such maneuverability can be achieved by an at-scale 12-gram hummingbird robot equipped with just two actuators. The proposed hybrid control policy combines model-based nonlinear control with model-free reinforcement learning. We use model-based nonlinear control for nominal flight control, as the dynamic model is relatively accurate for these conditions. However, during extreme maneuver, the modeling error becomes unmanageable. A model-free reinforcement learning policy trained in simulation was optimized to 'destabilize' the system and maximize the performance during maneuvering. The hybrid policy manifests a maneuver that is close to that observed in hummingbirds. Direct simulation-to-real transfer is achieved, demonstrating the hummingbird-like fast evasive maneuvers on the at-scale hummingbird robot.

cs.RO↗

arXiv2019

Flappy Hummingbird: An Open Source Dynamic Simulation of Flapping Wing Robots and Animals

Insects and hummingbirds exhibit extraordinary flight capabilities and can simultaneously master seemingly conflicting goals: stable hovering and aggressive maneuvering, unmatched by small scale man-made vehicles. Flapping Wing Micro Air Vehicles (FWMAVs) hold great promise for closing this performance gap. However, design and control of such systems remain challenging due to various constraints. Here, we present an open source high fidelity dynamic simulation for FWMAVs to serve as a testbed for the design, optimization and flight control of FWMAVs. For simulation validation, we recreated the hummingbird-scale robot developed in our lab in the simulation. System identification was performed to obtain the model parameters. The force generation, open-loop and closed-loop dynamic response between simulated and experimental flights were compared and validated. The unsteady aerodynamics and the highly nonlinear flight dynamics present challenging control problems for conventional and learning control algorithms such as Reinforcement Learning. The interface of the simulation is fully compatible with OpenAI Gym environment. As a benchmark study, we present a linear controller for hovering stabilization and a Deep Reinforcement Learning control policy for goal-directed maneuvering. Finally, we demonstrate direct simulation-to-real transfer of both control policies onto the physical robot, further demonstrating the fidelity of the simulation.

cs.RO↗

arXiv2019

Deep Reinforcement Learning for Image Hashing

Deep hashing methods have received much attention recently, which achieve promising results by taking advantage of the strong representation power of deep networks. However, most existing deep hashing methods learn a whole set of hashing functions independently, while ignore the correlations between different hashing functions that can promote the retrieval accuracy greatly. Inspired by the sequential decision ability of deep reinforcement learning, we propose a new Deep Reinforcement Learning approach for Image Hashing (DRLIH). Our proposed DRLIH approach models the hashing learning problem as a sequential decision process, which learns each hashing function by correcting the errors imposed by previous ones and promotes retrieval accuracy. To the best of our knowledge, this is the first work to address hashing problem from deep reinforcement learning perspective. The main contributions of our proposed DRLIH approach can be summarized as follows: (1) We propose a deep reinforcement learning hashing network. In the proposed network, we utilize recurrent neural network (RNN) as agents to model the hashing functions, which take actions of projecting images into binary codes sequentially, so that the current hashing function learning can take previous hashing functions' error into account. (2) We propose a sequential learning strategy based on proposed DRLIH. We define the state as a tuple of internal features of RNN's hidden layers and image features, which can reflect history decisions made by the agents. We also propose an action group method to enhance the correlation of hash functions in the same group. Experiments on three widely-used datasets demonstrate the effectiveness of our proposed DRLIH approach.

cs.CV↗

arXiv2019

E-LSTM-D: A Deep Learning Framework for Dynamic Network Link Prediction

Predicting the potential relations between nodes in networks, known as link prediction, has long been a challenge in network science. However, most studies just focused on link prediction of static network, while real-world networks always evolve over time with the occurrence and vanishing of nodes and links. Dynamic network link prediction thus has been attracting more and more attention since it can better capture the evolution nature of networks, but still most algorithms fail to achieve satisfied prediction accuracy. Motivated by the excellent performance of Long Short-Term Memory (LSTM) in processing time series, in this paper, we propose a novel Encoder-LSTM-Decoder (E-LSTM-D) deep learning model to predict dynamic links end to end. It could handle long term prediction problems, and suits the networks of different scales with fine-tuned structure. To the best of our knowledge, it is the first time that LSTM, together with an encoder-decoder architecture, is applied to link prediction in dynamic networks. This new model is able to automatically learn structural and temporal features in a unified framework, which can predict the links that never appear in the network before. The extensive experiments show that our E-LSTM-D model significantly outperforms newly proposed dynamic network link prediction methods and obtain the state-of-the-art results.

cs.SI↗

arXiv2019

Achieving sub-1 Ohm-mm Non-Recess S/D Contact Resistance in GaN HEMTs Utilizing Simple CMOS Compatible La/Ti/Al/Ti Metal Contacts

In this paper, we report the use of lanthanum (La) in S/D contacts of GaN HEMTs, achieving 0.97 Ohm-mm contact resistance without S/D recess. The HEMTs show well-behaved electrical characteristics and satisfactory reliability. Our studies show that La, a CMOS compatible metal, is promising to lower GaN HEMT S/D contact resistance. La's low work function (3.5 eV) is beneficial for reducing the barrier between the metals and GaN. The Ohmic contact formation mechanism involved was shown to be different from conventional Ti/Al films. Spherical-shaped high-La regions formed near the surface during annealing. La diffuses into the AlGaN layer, and the overlap of La and Al peaks is significantly increased compared with that before annealing.

physics.app-ph↗

arXiv2019

Renormalizations in unconventional superconducting states of Ce$_{1-x}$Yb$_{x}$CoIn$_{5}$

We have measured the superconducting penetration depth~$Λ(T)$ in the heavy-fermion/intermediate-valent superconducting alloy series~Ce$_{1-x}$Yb$_x$CoIn$_5$ using transverse-field muon spin relaxation, to study the effect of intermediate-valent Yb doping on Fermi-liquid renormalization. From $Λ(T)$ we determine the superfluid density $ρ_s(T)$, and find that it decreases continuously with increasing nominal Yb concentration~$x$, i.e., with increasing intermediate valence. The temperature-dependent renormalization of the "normal" fluid density~$ρ_N(T) = ρ_s(0) - ρ_s(T)$ in both the heavy-fermion and intermediate valence limits is proportional to the temperature-dependent renormalization of the specific heat. This indicates that the temperature-dependent Fermi-liquid Landau parameters of the superconducting quasiparticles entering the two different physical quantities are the same. These results represent an important advance in understanding of both intermediate valence and heavy-fermion phenomena in superconductors.

cond-mat.str-el↗

arXiv2019

Broken time-reversal symmetry in superconducting Pr$_{1-x}$La$_{x}$Pt$_{4}$Ge$_{12}$

The superconducting state of the filled skutterudite alloy series Pr$_{1-x}$La$_{x}$Pt$_{4}$Ge$_{12}$ has been systematically studied by specific heat, zero-field muon spin relaxation ($μ$SR), and superconducting critical field measurements. An additional inhomogeneous local magnetic field, indicative of broken time-reversal symmetry (TRS), is observed in the superconducting states of the alloys. For $x \lesssim 0.5$ the broken-TRS phase sets in below a temperature $T_m$ distinctly lower than the superconducting transition temperature $T_c$. For $x \gtrsim 0.5$ $T_m \approx T_c$. The local field strength decreases as $x \to 1$, where LaPt$_{4}$Ge$_{12}$ is characterized by conventional pairing. The lower critical field $H_{c1}(T)$ of PrPt$_{4}$Ge$_{12}$ shows the onset of a second quadratic temperature region below $T_q \sim T_m$. Upper critical field $H_{c2}(T)$ measurements suggest multiband superconductivity, and point gap nodes are consistent with the specific heat data. In Pr$_{1-x}$La$_{x}$Pt$_{4}$Ge$_{12}$ only a single specific heat discontinuity is observed at $T_c$, in contrast to the second jump seen in PrOs$_{4}$Sb$_{12}$ below $T_c$. These results suggest that superconductivity in PrPt$_{4}$Ge$_{12}$ is characterized by a complex order parameter.

cond-mat.supr-con↗

arXiv2019

Assessment of central serous chorioretinopathy (CSC) depicted on color fundus photographs using deep Learning

To investigate whether and to what extent central serous chorioretinopathy (CSC) depicted on color fundus photographs can be assessed using deep learning technology. We collected a total of 2,504 fundus images acquired on different subjects. We verified the CSC status of these images using their corresponding optical coherence tomography (OCT) images. A total of 1,329 images depicted CSC. These images were preprocessed and normalized. This resulting dataset was randomly split into three parts in the ratio of 8:1:1 respectively for training, validation, and testing purposes. We used the deep learning architecture termed InceptionV3 to train the classifier. We performed nonparametric receiver operating characteristic (ROC) analyses to assess the capability of the developed algorithm to identify CSC. The Kappa coefficient between the two raters was 0.48 (p < 0.001), while the Kappa coefficients between the computer and the two raters were 0.59 (p < 0.001) and 0.33 (p < 0.05).Our experiments showed that the computer algorithm based on deep learning can assess CSC depicted on color fundus photographs in a relatively reliable and consistent way.

cs.CV↗

arXiv2018

Place recognition: An Overview of Vision Perspective

Place recognition is one of the most fundamental topics in computer vision and robotics communities, where the task is to accurately and efficiently recognize the location of a given query image. Despite years of wisdom accumulated in this field, place recognition still remains an open problem due to the various ways in which the appearance of real-world places may differ. This paper presents an overview of the place recognition literature. Since condition invariant and viewpoint invariant features are essential factors to long-term robust visual place recognition system, We start with traditional image description methodology developed in the past, which exploit techniques from image retrieval field. Recently, the rapid advances of related fields such as object detection and image classification have inspired a new technique to improve visual place recognition system, i.e., convolutional neural networks (CNNs). Thus we then introduce recent progress of visual place recognition system based on CNNs to automatically learn better image representations for places. Eventually, we close with discussions and future work of place recognition.

cs.CV↗

arXiv2018

Combinatorial construction of Gelfand-Tsetlin modules for $\mathfrak{gl}_n$

We propose a new effective method of constructing explicitly Gelfand -Tsetlin modules for $\mathfrak{gl}_n$. We obtain a large family of simple modules that have a basis consisting of Gelfand-Tsetlin tableaux, the action of the Lie algebra is given by the Gelfand-Tsetlin formulas and with all Gelfand-Tsetlin multiplicities equal $1$. As an application of our construction we prove necessary and sufficient condition for the Gelfand and Graev's continuation construction to define a module which was conjectured by Lemire and Patera.

math.RT↗

arXiv2018

Quantum Howe duality and invariant polynomials

We construct two examples of q-deformed classical Howe dual pairs (sl(2,C), sl(2,C)) and (sl(2,C), sl(n,C)). Moreover, we obtain a noncommutative version of the first fundamental theorem of classical invariant theory. Our approach to these duality differs from the paper of Lehrer-Zhang-Zhang. Furthermore, we solve the tensor product decomposition problem for Verma modules over U_q(sl(2,C)) provided q is not a root of unity.

math.QA↗

arXiv2018

Scene Text Recognition from Two-Dimensional Perspective

Inspired by speech recognition, recent state-of-the-art algorithms mostly consider scene text recognition as a sequence prediction problem. Though achieving excellent performance, these methods usually neglect an important fact that text in images are actually distributed in two-dimensional space. It is a nature quite different from that of speech, which is essentially a one-dimensional signal. In principle, directly compressing features of text into a one-dimensional form may lose useful information and introduce extra noise. In this paper, we approach scene text recognition from a two-dimensional perspective. A simple yet effective model, called Character Attention Fully Convolutional Network (CA-FCN), is devised for recognizing the text of arbitrary shapes. Scene text recognition is realized with a semantic segmentation network, where an attention mechanism for characters is adopted. Combined with a word formation module, CA-FCN can simultaneously recognize the script and predict the position of each character. Experiments demonstrate that the proposed algorithm outperforms previous methods on both regular and irregular text datasets. Moreover, it is proven to be more robust to imprecise localizations in the text detection phase, which are very common in practice.

cs.CV↗