arXiv subjects

Zhi Gao

Publications and source records attributed to Zhi Gao.

71 records · Page 4Linked to original sources

arXiv2023

Imbalance Knowledge-Driven Multi-modal Network for Land-Cover Semantic Segmentation Using Images and LiDAR Point Clouds

Despite the good results that have been achieved in unimodal segmentation, the inherent limitations of individual data increase the difficulty of achieving breakthroughs in performance. For that reason, multi-modal learning is increasingly being explored within the field of remote sensing. The present multi-modal methods usually map high-dimensional features to low-dimensional spaces as a preprocess before feature extraction to address the nonnegligible domain gap, which inevitably leads to information loss. To address this issue, in this paper we present our novel Imbalance Knowledge-Driven Multi-modal Network (IKD-Net) to extract features from raw multi-modal heterogeneous data directly. IKD-Net is capable of mining imbalance information across modalities while utilizing a strong modal to drive the feature map refinement of the weaker ones in the global and categorical perspectives by way of two sophisticated plug-and-play modules: the Global Knowledge-Guided (GKG) and Class Knowledge-Guided (CKG) gated modules. The whole network then is optimized using a holistic loss function. While we were developing IKD-Net, we also established a new dataset called the National Agriculture Imagery Program and 3D Elevation Program Combined dataset in California (N3C-California), which provides a particular benchmark for multi-modal joint segmentation tasks. In our experiments, IKD-Net outperformed the benchmarks and state-of-the-art methods both in the N3C-California and the small-scale ISPRS Vaihingen dataset. IKD-Net has been ranked first on the real-time leaderboard for the GRSS DFC 2018 challenge evaluation until this paper's submission.

eess.IV↗

arXiv2023

TJ-FlyingFish: Design and Implementation of an Aerial-Aquatic Quadrotor with Tiltable Propulsion Units

Aerial-aquatic vehicles are capable to move in the two most dominant fluids, making them more promising for a wide range of applications. We propose a prototype with special designs for propulsion and thruster configuration to cope with the vast differences in the fluid properties of water and air. For propulsion, the operating range is switched for the different mediums by the dual-speed propulsion unit, providing sufficient thrust and also ensuring output efficiency. For thruster configuration, thrust vectoring is realized by the rotation of the propulsion unit around the mount arm, thus enhancing the underwater maneuverability. This paper presents a quadrotor prototype of this concept and the design details and realization in practice.

cs.RO↗

arXiv2022

Generating Multivariate Load States Using a Conditional Variational Autoencoder

For planning of power systems and for the calibration of operational tools, it is essential to analyse system performance in a large range of representative scenarios. When the available historical data is limited, generative models are a promising solution, but modelling high-dimensional dependencies is challenging. In this paper, a multivariate load state generating model on the basis of a conditional variational autoencoder (CVAE) neural network is proposed. Going beyond common CVAE implementations, the model includes stochastic variation of output samples under given latent vectors and co-optimizes the parameters for this output variability. It is shown that this improves statistical properties of the generated data. The quality of generated multivariate loads is evaluated using univariate and multivariate performance metrics. A generation adequacy case study on the European network is used to illustrate model's ability to generate realistic tail distributions. The experiments demonstrate that the proposed generator outperforms other data generating mechanisms.

eess.SY↗

arXiv2022

DynaVIG: Monocular Vision/INS/GNSS Integrated Navigation and Object Tracking for AGV in Dynamic Scenes

Visual-Inertial Odometry (VIO) usually suffers from drifting over long-time runs, the accuracy is easily affected by dynamic objects. We propose DynaVIG, a navigation and object tracking system based on the integration of Monocular Vision, Inertial Navigation System (INS), and Global Navigation Satellite System (GNSS). Our system aims to provide an accurate global estimation of the navigation states and object poses for the automated ground vehicle (AGV) in dynamic scenes. Due to the scale ambiguity of the object, a prior height model is proposed to initialize the object pose, and the scale is continuously estimated with the aid of GNSS and INS. To precisely track the object with complex moving, we establish an accurate dynamics model according to its motion state. Then the multi-sensor observations are optimized in a unified framework. Experiments on the KITTI dataset demonstrate that the multisensor fusion can effectively improve the accuracy of navigation and object tracking, compared to state-of-the-art methods. In addition, the proposed system achieves good estimation of the objects that change speed or direction.

cs.RO↗

arXiv2022

Asymmetric Hash Code Learning for Remote Sensing Image Retrieval

Remote sensing image retrieval (RSIR), aiming at searching for a set of similar items to a given query image, is a very important task in remote sensing applications. Deep hashing learning as the current mainstream method has achieved satisfactory retrieval performance. On one hand, various deep neural networks are used to extract semantic features of remote sensing images. On the other hand, the hashing techniques are subsequently adopted to map the high-dimensional deep features to the low-dimensional binary codes. This kind of methods attempts to learn one hash function for both the query and database samples in a symmetric way. However, with the number of database samples increasing, it is typically time-consuming to generate the hash codes of large-scale database images. In this paper, we propose a novel deep hashing method, named asymmetric hash code learning (AHCL), for RSIR. The proposed AHCL generates the hash codes of query and database images in an asymmetric way. In more detail, the hash codes of query images are obtained by binarizing the output of the network, while the hash codes of database images are directly learned by solving the designed objective function. In addition, we combine the semantic information of each image and the similarity information of pairs of images as supervised information to train a deep hashing network, which improves the representation ability of deep features and hash codes. The experimental results on three public datasets demonstrate that the proposed method outperforms symmetric methods in terms of retrieval accuracy and efficiency. The source code is available at https://github.com/weiweisong415/Demo AHCL for TGRS2022.

cs.CV↗

arXiv2021

Quantum metrology with precision reaching beyond-$1/N$ scaling through $N$-probe entanglement generating interactions

Nonlinear interactions are recognized as potential resources for quantum metrology, facilitating parameter estimation precisions that scale as the exponential Heisenberg limit of $2^{-N}$. We explore such nonlinearity and propose an associated quantum measurement scenario based on the nonlinear interaction of $N$-probe entanglement generating form. This scenario provides an enhanced precision scaling of $D^{-N}/(N-1)!$ with $D > 2$ a tunable parameter. In addition, it can be readily implemented in a variety of experimental platforms and applied to measurements of a wide range of quantities, including local gravitational acceleration $g$, magnetic field, and its higher-order gradients.

quant-ph↗

arXiv2021

FG-Net: Fast Large-Scale LiDAR Point Clouds Understanding Network Leveraging Correlated Feature Mining and Geometric-Aware Modelling

This work presents FG-Net, a general deep learning framework for large-scale point clouds understanding without voxelizations, which achieves accurate and real-time performance with a single NVIDIA GTX 1080 GPU. First, a novel noise and outlier filtering method is designed to facilitate subsequent high-level tasks. For effective understanding purpose, we propose a deep convolutional neural network leveraging correlated feature mining and deformable convolution based geometric-aware modelling, in which the local feature relationships and geometric patterns can be fully exploited. For the efficiency issue, we put forward an inverse density sampling operation and a feature pyramid based residual learning strategy to save the computational cost and memory consumption respectively. Extensive experiments on real-world challenging datasets demonstrated that our approaches outperform state-of-the-art approaches in terms of accuracy and efficiency. Moreover, weakly supervised transfer learning is also conducted to demonstrate the generalization capacity of our method.

cs.CV↗

arXiv2021

Superevents: Towards Native Semantic Segmentation for Event-based Cameras

Most successful computer vision models transform low-level features, such as Gabor filter responses, into richer representations of intermediate or mid-level complexity for downstream visual tasks. These mid-level representations have not been explored for event cameras, although it is especially relevant to the visually sparse and often disjoint spatial information in the event stream. By making use of locally consistent intermediate representations, termed as superevents, numerous visual tasks ranging from semantic segmentation, visual tracking, depth estimation shall benefit. In essence, superevents are perceptually consistent local units that delineate parts of an object in a scene. Inspired by recent deep learning architectures, we present a novel method that employs lifetime augmentation for obtaining an event stream representation that is fed to a fully convolutional network to extract superevents. Our qualitative and quantitative experimental results on several sequences of a benchmark dataset highlights the significant potential for event-based downstream applications.

cs.CV↗

arXiv2021

A Hyperbolic-to-Hyperbolic Graph Convolutional Network

Hyperbolic graph convolutional networks (GCNs) demonstrate powerful representation ability to model graphs with hierarchical structure. Existing hyperbolic GCNs resort to tangent spaces to realize graph convolution on hyperbolic manifolds, which is inferior because tangent space is only a local approximation of a manifold. In this paper, we propose a hyperbolic-to-hyperbolic graph convolutional network (H2H-GCN) that directly works on hyperbolic manifolds. Specifically, we developed a manifold-preserving graph convolution that consists of a hyperbolic feature transformation and a hyperbolic neighborhood aggregation. The hyperbolic feature transformation works as linear transformation on hyperbolic manifolds. It ensures the transformed node representations still lie on the hyperbolic manifold by imposing the orthogonal constraint on the transformation sub-matrix. The hyperbolic neighborhood aggregation updates each node representation via the Einstein midpoint. The H2H-GCN avoids the distortion caused by tangent space approximations and keeps the global hyperbolic structure. Extensive experiments show that the H2H-GCN achieves substantial improvements on the link prediction, node classification, and graph classification tasks.

cs.LG↗

arXiv2020

A Velocity Map Imaging apparatus optimized for high-resolution crossed molecular beam experiments

We present the design of a Velocity Map Imaging apparatus tailored to the demands of high-resolution crossed molecular beam experiments employing Stark or Zeeman decelerators. The key requirements for these experiments consist of the combination of a high relative velocity resolution for large ionization volumes and a broad range of relatively low lab-frame velocities. The SIMION software package was employed to systematically optimize the electrode geometries and electrical configuration. The final design consists of a stack of 16 tubular electrodes, electrically connected with resistors, which is divided into three electric field regions. The resulting apparatus allows for an inherent velocity blurring of less than 1.1 m/s for NO$^+$ ions originating from a 3x3x3 mm ionization volume, which is negligible in a typical crossed beam experiment. The design was recently employed in several state of the art crossed-beam experiments, allowing the observation of fine details in the velocity distributions of the scattered molecules.

physics.atom-ph↗

arXiv2020

MLFcGAN: Multi-level Feature Fusion based Conditional GAN for Underwater Image Color Correction

Color correction for underwater images has received increasing interests, due to its critical role in facilitating available mature vision algorithms for underwater scenarios. Inspired by the stunning success of deep convolutional neural networks (DCNNs) techniques in many vision tasks, especially the strength in extracting features in multiple scales, we propose a deep multi-scale feature fusion net based on the conditional generative adversarial network (GAN) for underwater image color correction. In our network, multi-scale features are extracted first, followed by augmenting local features on each scale with global features. This design was verified to facilitate more effective and faster network learning, resulting in better performance in both color correction and detail preservation. We conducted extensive experiments and compared with the state-of-the-art approaches quantitatively and qualitatively, showing that our method achieves significant improvements.

eess.IV↗

arXiv2019

High-resolution imaging of molecular collisions using a Zeeman decelerator

We present the first crossed beam scattering experiment using a Zeeman decelerated molecular beam. The narrow velocity spreads of Zeeman decelerated NO ($X ^2Π_{3/2}, j=3/2$) radicals result in high-resolution scattering images, thereby fully resolving quantum diffraction oscillations in the angular scattering distribution for inelastic NO-Ne collisions, and product-pair correlations in the radial scattering distribution for inelastic NO-O$_2$ collisions. These measurements demonstrate similar resolution and sensitivity as in experiments using Stark decelerators, opening up possibilities for controlled and low-energy scattering experiments using chemically relevant species such as H and O atoms, O$_2$ molecules or NH radicals.

physics.atom-ph↗

arXiv2018

Multistage Zeeman deceleration of NH $X\,^3Σ^-$ radicals

We report on the Zeeman deceleration of ground-state NH radicals, using a decelerator that consists of 100 pulsed solenoids and 100 permanent hexapoles. Packets of state-selected NH ($X\,^3Σ^-$, N=0, J=1) radicals are produced with final velocities ranging between 510 m/s and 150 m/s. The velocity distributions of the packets of NH exiting the Zeeman decelerator are probed using velocity map imaging detection. We present a new 1+2' resonance-enhanced multiphoton ionization scheme for NH, that allows for velocity map imaging detection under ion recoil-free conditions. The packets of Zeeman-decelerated NH radicals, in combination with the new detection scheme, offer interesting prospects for the use of this important radical in high-resolution crossed-beam scattering experiments.

physics.atom-ph↗

arXiv2018

Observation of correlated excitations in bimolecular collisions

Whereas collisions between atoms and molecules are largely understood, collisions between two molecules have proven much harder to study. In both experiment and theory, our ability to determine quantum state-resolved bimolecular cross sections lags behind their atom-molecule counterparts by decades. For many bimolecular systems, even rules of thumb -- much less intuitive understanding -- of scattering cross sections are lacking. Here, we report the measurement of state-to-state differential cross sections on the collision of state-selected and velocity-controlled nitric oxide (NO) radicals and oxygen (O2) molecules. Using velocity map imaging of the scattered NO radicals, the full product-pair correlations of rotational excitation that occurs in both collision partners from individual encounters are revealed. The correlated cross sections show surprisingly good agreement with quantum scattering calculations using ab initio NO-O2 potential energy surfaces. The observations show that the well-known energy-gap law that governs atom-molecule collisions does not generally apply to bimolecular excitation processes, and reveal a propensity rule for the vector correlation of product angular momenta.

physics.chem-ph↗

arXiv2017

Learning a Robust Representation via a Deep Network on Symmetric Positive Definite Manifolds

Recent studies have shown that aggregating convolutional features of a pre-trained Convolutional Neural Network (CNN) can obtain impressive performance for a variety of visual tasks. The symmetric Positive Definite (SPD) matrix becomes a powerful tool due to its remarkable ability to learn an appropriate statistic representation to characterize the underlying structure of visual features. In this paper, we propose to aggregate deep convolutional features into an SPD matrix representation through the SPD generation and the SPD transformation under an end-to-end deep network. To this end, several new layers are introduced in our network, including a nonlinear kernel aggregation layer, an SPD matrix transformation layer, and a vectorization layer. The nonlinear kernel aggregation layer is employed to aggregate the convolutional features into a real SPD matrix directly. The SPD matrix transformation layer is designed to construct a more compact and discriminative SPD representation. The vectorization and normalization operations are performed in the vectorization layer for reducing the redundancy and accelerating the convergence. The SPD matrix in our network can be considered as a mid-level representation bridging convolutional features and high-level semantic features. To demonstrate the effectiveness of our method, we conduct extensive experiments on visual classification. Experiment results show that our method notably outperforms state-of-the-art methods.

cs.CV↗

arXiv2017

Google Map Aided Visual Navigation for UAVs in GPS-denied Environment

We propose a framework for Google Map aided UAV navigation in GPS-denied environment. Geo-referenced navigation provides drift-free localization and does not require loop closures. The UAV position is initialized via correlation, which is simple and efficient. We then use optical flow to predict its position in subsequent frames. During pose tracking, we obtain inter-frame translation either by motion field or homography decomposition, and we use HOG features for registration on Google Map. We employ particle filter to conduct a coarse to fine search to localize the UAV. Offline test using aerial images collected by our quadrotor platform shows promising results as our approach eliminates the drift in dead-reckoning, and the small localization error indicates the superiority of our approach as a supplement to GPS.

cs.CV↗

arXiv2017

Real-Time Optical flow-based Video Stabilization for Unmanned Aerial Vehicles

This paper describes the development of a novel algorithm to tackle the problem of real-time video stabilization for unmanned aerial vehicles (UAVs). There are two main components in the algorithm: (1) By designing a suitable model for the global motion of UAV, the proposed algorithm avoids the necessity of estimating the most general motion model, projective transformation, and considers simpler motion models, such as rigid transformation and similarity transformation. (2) To achieve a high processing speed, optical-flow based tracking is employed in lieu of conventional tracking and matching methods used by state-of-the-art algorithms. These two new ideas resulted in a real-time stabilization algorithm, developed over two phases. Stage I considers processing the whole sequence of frames in the video while achieving an average processing speed of 50fps on several publicly available benchmark videos. Next, Stage II undertakes the task of real-time video stabilization using a multi-threading implementation of the algorithm designed in Stage I.

cs.CV↗