arXiv subjects

Feng Gao

Publications and source records attributed to Feng Gao.

At least 289 records · Page 16Linked to original sources

arXiv2019

Learning Perceptual Inference by Contrasting

"Thinking in pictures," [1] i.e., spatial-temporal reasoning, effortless and instantaneous for humans, is believed to be a significant ability to perform logical induction and a crucial factor in the intellectual history of technology development. Modern Artificial Intelligence (AI), fueled by massive datasets, deeper models, and mighty computation, has come to a stage where (super-)human-level performances are observed in certain specific tasks. However, current AI's ability in "thinking in pictures" is still far lacking behind. In this work, we study how to improve machines' reasoning ability on one challenging task of this kind: Raven's Progressive Matrices (RPM). Specifically, we borrow the very idea of "contrast effects" from the field of psychology, cognition, and education to design and train a permutation-invariant model. Inspired by cognitive studies, we equip our model with a simple inference module that is jointly trained with the perception backbone. Combining all the elements, we propose the Contrastive Perceptual Inference network (CoPINet) and empirically demonstrate that CoPINet sets the new state-of-the-art for permutation-invariant models on two major datasets. We conclude that spatial-temporal reasoning depends on envisaging the possibilities consistent with the relations between objects and can be solved from pixel-level inputs.

cs.CV↗

arXiv2019

Spatiotemporal Attention Networks for Wind Power Forecasting

Wind power is one of the most important renewable energy sources and accurate wind power forecasting is very significant for reliable and economic power system operation and control strategies. This paper proposes a novel framework with spatiotemporal attention networks (STAN) for wind power forecasting. This model captures spatial correlations among wind farms and temporal dependencies of wind power time series. First of all, we employ a multi-head self-attention mechanism to extract spatial correlations among wind farms. Then, temporal dependencies are captured by the Sequence-to-Sequence (Seq2Seq) model with a global attention mechanism. Finally, experimental results demonstrate that our model achieves better performance than other baseline approaches. Our work provides useful insights to capture non-Euclidean spatial correlations.

cs.LG↗

arXiv2019

A Simulation Approach to Multi-station Solar Irradiance Data Considering Temporal Correlations

Solar energy is one of important renewable energy sources and simulation of solar irradiance can be used as input for simulation of photovoltaic (PV) generation. This paper proposes a simulation algorithm of multi-station solar irradiance data considering temporal correlations. First of all, we group all the days of the observed data to k clusters for each station based on their daily features of solar irradiance and the daily states constitute Markov chain of days. Then, we reduce state permutations of different stations before getting Markov Transition Probability Matrix (MTPM). In terms of the observed data and MTPM, the simulation approach is proposed. Finally, we test our approach by applying to solar irradiance data of three stations and show that the properties of simulated data match those of the observed data.

eess.SP↗

arXiv2019

Perfect Optical Nonreciprocity in a Double-Cavity Optomechanical System

Nonreciprocal devices are indispensable for building quantum networks and ubiquitous in modern communication technology. Here, we use optomechanical interaction and linearly-coupled interaction to realize optical nonreciprocal transmission in a double-cavity optomechanical system. The scheme relies on the interference between the two interactions. We derive the essential conditions to realize perfect optical nonreciprocity in the system, and analyse the properties of optical nonreciprocal transmission and the output fields from mechanical mode. These results can be used to control optical transmission in quantum information processing.

quant-ph↗

arXiv2019

Scalar field effects on the orbit of S2 star

Precise measurements of the S-stars orbiting SgrA* have set strong constraints on the nature of the compact object at the centre of the Milky Way. The presence of a black hole in that region is well established, but its neighboring environment is still an open debate. In that respect, the existence of dark matter in that central region may be detectable due to its strong signatures on the orbits of stars: the main effect is a Newtonian precession which will affect the overall pericentre shift of S2, the latter being a target measurement of the GRAVITY instrument. The exact nature of this dark matter (e.g., stellar dark remnants or diffuse dark matter) is unknown. This article assumes it to be an scalar field of toroidal distribution, associated with ultra-light dark matter particles, surrounding the Kerr black hole. Such a field is a form of "hair" expected in the context of superradiance, a mechanism that extracts rotational energy from the black hole. Orbital signatures for the S2 star are computed and shown to be detectable by GRAVITY. The scalar field can be constrained because the variation of orbital elements depends both on the relative mass of the scalar field to the black hole and on the field mass coupling parameter.

astro-ph.GA↗

arXiv2019

VRGym: A Virtual Testbed for Physical and Interactive AI

We propose VRGym, a virtual reality testbed for realistic human-robot interaction. Different from existing toolkits and virtual reality environments, the VRGym emphasizes on building and training both physical and interactive agents for robotics, machine learning, and cognitive science. VRGym leverages mechanisms that can generate diverse 3D scenes with high realism through physics-based simulation. We demonstrate that VRGym is able to (i) collect human interactions and fine manipulations, (ii) accommodate various robots with a ROS bridge, (iii) support experiments for human-robot interaction, and (iv) provide toolkits for training the state-of-the-art machine learning algorithms. We hope VRGym can help to advance general-purpose robotics and machine learning agents, as well as assisting human studies in the field of cognitive science.

cs.HC↗

arXiv2019

RAVEN: A Dataset for Relational and Analogical Visual rEasoNing

Dramatic progress has been witnessed in basic vision tasks involving low-level perception, such as object recognition, detection, and tracking. Unfortunately, there is still an enormous performance gap between artificial vision systems and human intelligence in terms of higher-level vision problems, especially ones involving reasoning. Earlier attempts in equipping machines with high-level reasoning have hovered around Visual Question Answering (VQA), one typical task associating vision and language understanding. In this work, we propose a new dataset, built in the context of Raven's Progressive Matrices (RPM) and aimed at lifting machine intelligence by associating vision with structural, relational, and analogical reasoning in a hierarchical representation. Unlike previous works in measuring abstract reasoning using RPM, we establish a semantic link between vision and reasoning by providing structure representation. This addition enables a new type of abstract reasoning by jointly operating on the structure representation. Machine reasoning ability using modern computer vision is evaluated in this newly proposed dataset. Additionally, we also provide human performance as a reference. Finally, we show consistent improvement across all models by incorporating a simple neural module that combines visual understanding and structure reasoning.

cs.CV↗

arXiv2019

The application of co-integration theory in ensemble pulsar timescale algorithm

Employing multiple pulsars and using an appropriate algorithm to establish ensemble pulsar timescale can reduce the influences of various noises on the long-term stability of pulsar timescale, compared to a single pulsar. However, due to the low timing precision and the significant red noises of some pulsars, their participation in the construction of ensemble pulsar timescale is often limited. Inspired by the principle of solving non-stationary sequence modeling using co-integration theory, we puts forward an algorithm based on the co-integration theory to establish ensemble pulsar timescale. It is found that this algorithm can effectively suppress some noise sources if a co-integration relationship between different pulsar data exist. Different from the classical weighted average algorithm, the co-integration method provides the chances of the pulsar with significant red noises to attend the establishment of ensemble pulsar timescale. Based on the data from the North American Nanohertz Observatory for Gravitational Waves, we found that the co-integration algorithm can successfully reduce several timing noises and improve the long-term stability of the ensemble pulsar timescale.

astro-ph.IM↗

arXiv2019

Geometric Scattering for Graph Data Analysis

We explore the generalization of scattering transforms from traditional (e.g., image or audio) signals to graph data, analogous to the generalization of ConvNets in geometric deep learning, and the utility of extracted graph features in graph data analysis. In particular, we focus on the capacity of these features to retain informative variability and relations in the data (e.g., between individual graphs, or in aggregate), while relating our construction to previous theoretical results that establish the stability of similar transforms to families of graph deformations. We demonstrate the application the our geometric scattering features in graph classification of social network data, and in data exploration of biochemistry data.

cs.LG↗

arXiv2019

Attention-driven Tree-structured Convolutional LSTM for High Dimensional Data Understanding

Modeling the sequential information of image sequences has been a vital step of various vision tasks and convolutional long short-term memory (ConvLSTM) has demonstrated its superb performance in such spatiotemporal problems. Nevertheless, the hierarchical data structures in a significant amount of tasks (e.g., human body parts and vessel/airway tree in biomedical images) cannot be properly modeled by sequential models. Thus, ConvLSTM is not suitable for tree-structured image data analysis. In order to address these limitations, we present tree-structured ConvLSTM models for tree-structured image analysis tasks which can be trained end-to-end. To demonstrate the effectiveness of the proposed tree-structured ConvLSTM model, we present a tree-structured segmentation framework which consists of a tree-structured ConvLSTM and an attention fully convolutional network (FCN) model. The proposed framework is extensively validated on four large-scale coronary artery datasets. The results demonstrate the effectiveness and efficiency of the proposed method.

cs.CV↗

arXiv2018

Residual Attention based Network for Hand Bone Age Assessment

Computerized automatic methods have been employed to boost the productivity as well as objectiveness of hand bone age assessment. These approaches make predictions according to the whole X-ray images, which include other objects that may introduce distractions. Instead, our framework is inspired by the clinical workflow (Tanner-Whitehouse) of hand bone age assessment, which focuses on the key components of the hand. The proposed framework is composed of two components: a Mask R-CNN subnet of pixelwise hand segmentation and a residual attention network for hand bone age assessment. The Mask R-CNN subnet segments the hands from X-ray images to avoid the distractions of other objects (e.g., X-ray tags). The hierarchical attention components of the residual attention subnet force our network to focus on the key components of the X-ray images and generate the final predictions as well as the associated visual supports, which is similar to the assessment procedure of clinicians. We evaluate the performance of the proposed pipeline on the RSNA pediatric bone age dataset and the results demonstrate its superiority over the previous methods.

cs.CV↗

arXiv2018

Angular Softmax Loss for End-to-end Speaker Verification

End-to-end speaker verification systems have received increasing interests. The traditional i-vector approach trains a generative model (basically a factor-analysis model) to extract i-vectors as speaker embeddings. In contrast, the end-to-end approach directly trains a discriminative model (often a neural network) to learn discriminative speaker embeddings; a crucial component is the training criterion. In this paper, we use angular softmax (A-softmax), which is originally proposed for face verification, as the loss function for feature learning in end-to-end speaker verification. By introducing margins between classes into softmax loss, A-softmax can learn more discriminative features than softmax loss and triplet loss, and at the same time, is easy and stable for usage. We make two contributions in this work. 1) We introduce A-softmax loss into end-to-end speaker verification and achieve significant EER reductions. 2) We find that the combination of using A-softmax in training the front-end and using PLDA in the back-end scoring further boosts the performance of end-to-end systems under short utterance condition (short in both enrollment and test). Experiments are conducted on part of $Fisher$ dataset and demonstrate the improvements of using A-softmax.

eess.AS↗

arXiv2018

Research on the Security of Blockchain Data: A Survey

With the more and more extensive application of blockchain, blockchain security has been widely concerned by the society and deeply studied by scholars. Moreover, the security of blockchain data directly affects the security of various applications of blockchain. In this survey, we perform a comprehensive classification and summary of the security of blockchain data. First, we present classification of blockchain data attacks. Subsequently, we present the attacks and defenses of blockchain data in terms of privacy, availability, integrity and controllability. Data privacy attacks present data leakage or data obtained by attackers through analysis. Data availability attacks present abnormal or incorrect access to blockchain data. Data integrity attacks present blockchain data being tampered. Data controllability attacks present blockchain data accidentally manipulated by smart contract vulnerability. Finally, we present several important open research directions to identify follow-up studies in this area.

cs.CR↗

arXiv2018

Multiple Star Systems in the Orion Nebula

This work presents an interferometric study of the massive-binary fraction in the Orion Trapezium Cluster with the recently comissioned GRAVITY instrument. We observe a total of 16 stars of mainly OB spectral type. We find three previously unknown companions for $θ^1$ Ori B, $θ^2$ Ori B, and $θ^2$ Ori C. We determine a separation for the previously suspected companion of NU Ori. We confirm four companions for $θ^1$ Ori A, $θ^1$ Ori C, $θ^1$ Ori D, and $θ^2$ Ori A, all with substantially improved astrometry and photometric mass estimates. We refine the orbit of the eccentric high-mass binary $θ^1$ Ori C and we are able to derive a new orbit for $θ^1$ Ori D. We find a system mass of 21.7 $M_{\odot}$ and a period of $53$ days. Together with other previously detected companions seen in spectroscopy or direct imaging, eleven of the 16 high-mass stars are multiple systems. We obtain a total number of 22 companions with separations up to 600 AU. The companion fraction of the early B and O stars in our sample is about 2, significantly higher than in earlier studies of mostly OB associations. The separation distribution hints towards a bimodality. Such a bimodality has been previously found in A stars, but rarely in OB binaries, which up to this point have been assumed to be mostly compact with a tail of wider companions. We also do not find a substantial population of equal-mass binaries. The observed distribution of mass ratios declines steeply with mass, and like the direct star counts, indicates that our companions follow a standard power law initial mass function. Again, this is in contrast to earlier findings of flat mass ratio distributions in OB associations. We exclude collision as a dominant formation mechanism but find no clear preference for core accretion or competitive accretion.

astro-ph.SR↗

arXiv2018

A Detection of Sgr A* in the far infrared

We report the first detection of the Galactic Centre massive black hole, Sgr~A*, in the far infrared. Our measurements were obtained with PACS on board the \emph{Herschel} satellite at $100~\mathrm{μm}$ and $160~\mathrm{μm}$. While the warm dust in the Galactic Centre is too bright to allow for a direct detection of Sgr~A*, we measure a significant and simultaneous variation of its flux of $ΔF_{ν\widehat{=}160 ~\mathrm{μm}} = (0.27\pm0.06)~\mathrm{Jy}$ and $ΔF_{ν\widehat{=}100 ~\mathrm{μm}}= (0.16\pm0.10)~\mathrm{Jy}$ during one observation. The significance level of the $160 ~\mathrm{μm}$ band variability is $4.5σ$ and the corresponding $100 ~\mathrm{μm}$ band variability is significant at $1.6σ$. We find no example of an equally significant false positive detection. Conservatively assuming a variability of $25\%$ in the FIR, we can provide upper limits to the flux. Comparing the latter with theoretical models we find that 1D RIAF models have difficulties explaining the observed faintness. However, the upper limits are consistent with modern ALMA and VLA observations. Our upper limits provide further evidence for a spectral peak at $\sim 10^{12} ~ \mathrm{Hz}$ and constrain the number density of $γ\sim 100$ electrons in the accretion disk and or outflow.

astro-ph.GA↗

arXiv2018

What stellar orbit is needed to measure the spin of the Galactic center black hole from astrometric data?

Astrometric and spectroscopic monitoring of individual stars orbiting the supermassive black hole in the Galactic Center offer a promising way to detect general relativistic effects. While low-order effects are expected to be detected following the periastron passage of S2 in Spring 2018, detecting higher-order effects due to black hole spin will require the discovery of closer stars. In this paper, we set out to determine the requirements such a star would have to satisfy to allow the detection of black hole spin. We focus on the instrument GRAVITY, which saw first light in 2016 and which is expected to achieve astrometric accuracies $10-100 μ$as. For an observing campaign with duration $T$ years, $N_{obs}$ total observations, astrometric precision $σ_x$ and normalized black hole spin $χ$, we find that $a_{orb}(1-e^2)^{3/4} \lesssim 300 R_S \sqrt{\frac{T}{4 \text{years}}} \left(\frac{N_{obs}}{120}\right)^{0.25} \sqrt{\frac{10 μas}{σ_x}} \sqrt{\fracχ{0.9}}$ is needed. For $χ=0.9$ and a potential observing campaign with $σ_x = 10 μ$as, 30 observations/year and duration 4-10 years, we expect $\sim 0.1$ star with $K<19$ satisfying this constraint based on the current knowledge about the stellar population in the central 1". We also propose a method through which GRAVITY could potentially measure radial velocities with precision $\sim 50$ km/s. If the astrometric precision can be maintained, adding radial velocity information increases the expected number of stars by roughly a factor of two. While we focus on GRAVITY, the results can also be scaled to parameters relevant for future extremely large telescopes.

astro-ph.GA↗

arXiv2017

All-optical transistor based on Rydberg atom-assisted opto-mechanical system

We study the optical response of double optomechanical cavity system assisted by Rydberg atomic ensembles. And atomic ensembles are only coupled with one side cavity by a single cavity mode. It has been realized that a long-range manipulation for optical properties of hybrid system, by controlling the Rydberg atomic ensembles decoupled with the optomechanical cavity. Switching on the coupling between atoms and cavity mode, the original time reversal symmetry of double cavity structure has been broken. Based on the controlled optical non-reciprocity, we put forward the theoretical schemes of all-optical controlled diode, rectifier and transistor.

physics.optics↗

arXiv2017

Incorporating Intra-Class Variance to Fine-Grained Visual Recognition

Fine-grained visual recognition aims to capture discriminative characteristics amongst visually similar categories. The state-of-the-art research work has significantly improved the fine-grained recognition performance by deep metric learning using triplet network. However, the impact of intra-category variance on the performance of recognition and robust feature representation has not been well studied. In this paper, we propose to leverage intra-class variance in metric learning of triplet network to improve the performance of fine-grained recognition. Through partitioning training images within each category into a few groups, we form the triplet samples across different categories as well as different groups, which is called Group Sensitive TRiplet Sampling (GS-TRS). Accordingly, the triplet loss function is strengthened by incorporating intra-class variance with GS-TRS, which may contribute to the optimization objective of triplet network. Extensive experiments over benchmark datasets CompCar and VehicleID show that the proposed GS-TRS has significantly outperformed state-of-the-art approaches in both classification and retrieval tasks.

cs.CV↗