arXiv subjects

Feng Gao

Publications and source records attributed to Feng Gao.

At least 217 records · Page 12Linked to original sources

arXiv2023

Differentiable Arbitrating in Zero-sum Markov Games

We initiate the study of how to perturb the reward in a zero-sum Markov game with two players to induce a desirable Nash equilibrium, namely arbitrating. Such a problem admits a bi-level optimization formulation. The lower level requires solving the Nash equilibrium under a given reward function, which makes the overall problem challenging to optimize in an end-to-end way. We propose a backpropagation scheme that differentiates through the Nash equilibrium, which provides the gradient feedback for the upper level. In particular, our method only requires a black-box solver for the (regularized) Nash equilibrium (NE). We develop the convergence analysis for the proposed framework with proper black-box NE solvers and demonstrate the empirical successes in two multi-agent reinforcement learning (MARL) environments.

cs.MA↗

arXiv2023

Second harmonic and cascaded third harmonic generation in generalized quasi-periodic poled lithium niobate waveguides

Lithium niobate (LN) thin film has recently emerged as an important platform for nonlinear optical investigations for its large $χ^{(2)}$ nonlinear coefficients and ability of light localization. In this paper, we report the first fabrication of LN on insulator (LNOI) ridge waveguides with generalized quasi-periodic poled superlattices using the electric field polarization technique and microfabrication techniques. Benefiting from the abundant reciprocal vectors, we observed efficient second-harmonic and cascaded third-harmonic signals in the same device, with the normalized conversion efficiency 1735% W$^{-1}$cm$^{-2}$ and 0.41% W$^{-2}$cm$^{-4}$, respectively. This work opens a new direction of nonlinear integrated photonics based on LN thin film.

physics.optics↗

arXiv2023

The GRAVITY+ Project: Towards All-sky, Faint-Science, High-Contrast Near-Infrared Interferometry at the VLTI

The GRAVITY instrument has been revolutionary for near-infrared interferometry by pushing sensitivity and precision to previously unknown limits. With the upgrade of GRAVITY and the Very Large Telescope Interferometer (VLTI) in GRAVITY+, these limits will be pushed even further, with vastly improved sky coverage, as well as faint-science and high-contrast capabilities. This upgrade includes the implementation of wide-field off-axis fringe-tracking, new adaptive optics systems on all Unit Telescopes, and laser guide stars in an upgraded facility. GRAVITY+ will open up the sky to the measurement of black hole masses across cosmic time in hundreds of active galactic nuclei, use the faint stars in the Galactic centre to probe General Relativity, and enable the characterisation of dozens of young exoplanets to study their formation, bearing the promise of another scientific revolution to come at the VLTI.

astro-ph.IM↗

arXiv2023

Artificial intelligence for diagnosing and predicting survival of patients with renal cell carcinoma: Retrospective multi-center study

Background: Clear cell renal cell carcinoma (ccRCC) is the most common renal-related tumor with high heterogeneity. There is still an urgent need for novel diagnostic and prognostic biomarkers for ccRCC. Methods: We proposed a weakly-supervised deep learning strategy using conventional histology of 1752 whole slide images from multiple centers. Our study was demonstrated through internal cross-validation and external validations for the deep learning-based models. Results: Automatic diagnosis for ccRCC through intelligent subtyping of renal cell carcinoma was proved in this study. Our graderisk achieved aera the curve (AUC) of 0.840 (95% confidence interval: 0.805-0.871) in the TCGA cohort, 0.840 (0.805-0.871) in the General cohort, and 0.840 (0.805-0.871) in the CPTAC cohort for the recognition of high-grade tumor. The OSrisk for the prediction of 5-year survival status achieved AUC of 0.784 (0.746-0.819) in the TCGA cohort, which was further verified in the independent General cohort and the CPTAC cohort, with AUC of 0.774 (0.723-0.820) and 0.702 (0.632-0.765), respectively. Cox regression analysis indicated that graderisk, OSrisk, tumor grade, and tumor stage were found to be independent prognostic factors, which were further incorporated into the competing-risk nomogram (CRN). Kaplan-Meier survival analyses further illustrated that our CRN could significantly distinguish patients with high survival risk, with hazard ratio of 5.664 (3.893-8.239, p < 0.0001) in the TCGA cohort, 35.740 (5.889-216.900, p < 0.0001) in the General cohort and 6.107 (1.815 to 20.540, p < 0.0001) in the CPTAC cohort. Comparison analyses conformed that our CRN outperformed current prognosis indicators in the prediction of survival status, with higher concordance index for clinical prognosis.

eess.IV↗

arXiv2023

Lesion-aware Dynamic Kernel for Polyp Segmentation

Automatic and accurate polyp segmentation plays an essential role in early colorectal cancer diagnosis. However, it has always been a challenging task due to 1) the diverse shape, size, brightness and other appearance characteristics of polyps, 2) the tiny contrast between concealed polyps and their surrounding regions. To address these problems, we propose a lesion-aware dynamic network (LDNet) for polyp segmentation, which is a traditional u-shape encoder-decoder structure incorporated with a dynamic kernel generation and updating scheme. Specifically, the designed segmentation head is conditioned on the global context features of the input image and iteratively updated by the extracted lesion features according to polyp segmentation predictions. This simple but effective scheme endows our model with powerful segmentation performance and generalization capability. Besides, we utilize the extracted lesion representation to enhance the feature contrast between the polyp and background regions by a tailored lesion-aware cross-attention module (LCA), and design an efficient self-attention module (ESA) to capture long-range context relations, further improving the segmentation accuracy. Extensive experiments on four public polyp benchmarks and our collected large-scale polyp dataset demonstrate the superior performance of our method compared with other state-of-the-art approaches. The source code is available at https://github.com/ReaFly/LDNet.

eess.IV↗

arXiv2023

Nearest Neighbor-Based Contrastive Learning for Hyperspectral and LiDAR Data Classification

The joint hyperspectral image (HSI) and LiDAR data classification aims to interpret ground objects at more detailed and precise level. Although deep learning methods have shown remarkable success in the multisource data classification task, self-supervised learning has rarely been explored. It is commonly nontrivial to build a robust self-supervised learning model for multisource data classification, due to the fact that the semantic similarities of neighborhood regions are not exploited in existing contrastive learning framework. Furthermore, the heterogeneous gap induced by the inconsistent distribution of multisource data impedes the classification performance. To overcome these disadvantages, we propose a Nearest Neighbor-based Contrastive Learning Network (NNCNet), which takes full advantage of large amounts of unlabeled data to learn discriminative feature representations. Specifically, we propose a nearest neighbor-based data augmentation scheme to use enhanced semantic relationships among nearby regions. The intermodal semantic alignments can be captured more accurately. In addition, we design a bilinear attention module to exploit the second-order and even high-order feature interactions between the HSI and LiDAR data. Extensive experiments on four public datasets demonstrate the superiority of our NNCNet over state-of-the-art methods. The source codes are available at \url{https://github.com/summitgao/NNCNet}.

eess.IV↗

arXiv2023

GIVL: Improving Geographical Inclusivity of Vision-Language Models with Pre-Training Methods

A key goal for the advancement of AI is to develop technologies that serve the needs not just of one group but of all communities regardless of their geographical region. In fact, a significant proportion of knowledge is locally shared by people from certain regions but may not apply equally in other regions because of cultural differences. If a model is unaware of regional characteristics, it may lead to performance disparity across regions and result in bias against underrepresented groups. We propose GIVL, a Geographically Inclusive Vision-and-Language Pre-trained model. There are two attributes of geo-diverse visual concepts which can help to learn geo-diverse knowledge: 1) concepts under similar categories have unique knowledge and visual characteristics, 2) concepts with similar visual features may fall in completely different categories. Motivated by the attributes, we design new pre-training objectives Image Knowledge Matching (IKM) and Image Edit Checking (IEC) to pre-train GIVL. Compared with similar-size models pre-trained with similar scale of data, GIVL achieves state-of-the-art (SOTA) and more balanced performance on geo-diverse V&L tasks.

cs.CV↗

arXiv2022

Quantum random number generation based on a perovskite light emitting diode

The recent development of perovskite light emitting diodes (PeLEDs) has the potential to revolutionize the fields of optical communication and lighting devices, due to their simplicity of fabrication and outstanding optical properties. Here we demonstrate, for the first time, that PeLEDs can also be used in the field of quantum technologies by demonstrating a highly-secure quantum random number generator (QRNG). Modern QRNGs that certify their privacy are posed to replace widely adopted pseudo and true classical random number generators in applications such as encryption and gambling, and therefore, need to be cheap, fast and with integration capabilities. Using a compact metal-halide PeLED source, we generate random numbers, which are certified to be secure against an eavesdropper, following the quantum measurement-device-independent scenario. The obtained random number generation rate of more than 10 Mbit s$^{-1}$, which is already comparable to actual commercial devices, shows that PeLEDs can work as high-quality light sources for quantum information tasks, thus paving the way for future developments of quantum technologies. Lastly, we argue that the simpler PeLED manufacturing process, when comparing to solid-state devices, may have large environmental impacts when quantum technology systems become more mass produced, due to the possible lower carbon footprint.

quant-ph↗

arXiv2022

TPA-Net: Generate A Dataset for Text to Physics-based Animation

Recent breakthroughs in Vision-Language (V&L) joint research have achieved remarkable results in various text-driven tasks. High-quality Text-to-video (T2V), a task that has been long considered mission-impossible, was proven feasible with reasonably good results in latest works. However, the resulting videos often have undesired artifacts largely because the system is purely data-driven and agnostic to the physical laws. To tackle this issue and further push T2V towards high-level physical realism, we present an autonomous data generation technique and a dataset, which intend to narrow the gap with a large number of multi-modal, 3D Text-to-Video/Simulation (T2V/S) data. In the dataset, we provide high-resolution 3D physical simulations for both solids and fluids, along with textual descriptions of the physical phenomena. We take advantage of state-of-the-art physical simulation methods (i) Incremental Potential Contact (IPC) and (ii) Material Point Method (MPM) to simulate diverse scenarios, including elastic deformations, material fractures, collisions, turbulence, etc. Additionally, high-quality, multi-view rendering videos are supplied for the benefit of T2V, Neural Radiance Fields (NeRF), and other communities. This work is the first step towards fully automated Text-to-Video/Simulation (T2V/S). Live examples and subsequent work are at https://sites.google.com/view/tpa-net.

cs.AI↗

arXiv2022

Adaptive De-noising of Photoacoustic Signal and Image based on Modified Kalman Filter

As a burgeoning medical imaging method based on hybrid fusion of light and ultrasound, photoacoustic imaging (PAI) has demonstrated high potential in various biomedical applications recently, especially in revealing the functional and molecular information to improve diagnostic accuracy. However, stemming from weak amplitude and unavoidable random noise, caused by limited laser power and severe attenuation in deep tissue imaging, PA signals are usually of low signal-to-noise ratio (SNR), and reconstructed PA images are of low quality. Despite that conventional Kalman Filter (KF) can remove Gaussian noise in time domain, it lacks adaptability in real-time estimating condition due to its fixed model. Moreover, KF-based de-noising algorithm has not been applied in PAI before. In this paper, we propose an adaptive Modified Kalman Filter (MKF) targeted at PAI de-noising by tuning system noise matrix Q and measurement noise matrix R in the conventional KF model. Additionally, in order to compensate the signal skewing caused by KF, we cascade the backward part of Rauch-Tung-Striebel smoother (BRTS), which also utilizes the newly determined Q. Finally, as a supplement, we add a commonly used differential filter to remove in-band reflection artifacts. Experimental results using phantom and ex vivo colorectal tissue are provided to prove the validity of the algorithm.

eess.SP↗

arXiv2022

Towards Reasoning-Aware Explainable VQA

The domain of joint vision-language understanding, especially in the context of reasoning in Visual Question Answering (VQA) models, has garnered significant attention in the recent past. While most of the existing VQA models focus on improving the accuracy of VQA, the way models arrive at an answer is oftentimes a black box. As a step towards making the VQA task more explainable and interpretable, our method is built upon the SOTA VQA framework by augmenting it with an end-to-end explanation generation module. In this paper, we investigate two network architectures, including Long Short-Term Memory (LSTM) and Transformer decoder, as the explanation generator. Our method generates human-readable textual explanations while maintaining SOTA VQA accuracy on the GQA-REX (77.49%) and VQA-E (71.48%) datasets. Approximately 65.16% of the generated explanations are approved by humans as valid. Roughly 60.5% of the generated explanations are valid and lead to the correct answers.

cs.CL↗

arXiv2022

Is MultiWOZ a Solved Task? An Interactive TOD Evaluation Framework with User Simulator

Task-Oriented Dialogue (TOD) systems are drawing more and more attention in recent studies. Current methods focus on constructing pre-trained models or fine-tuning strategies while the evaluation of TOD is limited by a policy mismatch problem. That is, during evaluation, the user utterances are from the annotated dataset while these utterances should interact with previous responses which can have many alternatives besides annotated texts. Therefore, in this work, we propose an interactive evaluation framework for TOD. We first build a goal-oriented user simulator based on pre-trained models and then use the user simulator to interact with the dialogue system to generate dialogues. Besides, we introduce a sentence-level and a session-level score to measure the sentence fluency and session coherence in the interactive evaluation. Experimental results show that RL-based TOD systems trained by our proposed user simulator can achieve nearly 98% inform and success rates in the interactive evaluation of MultiWOZ dataset and the proposed scores measure the response quality besides the inform and success rates. We are hoping that our work will encourage simulator-based interactive evaluations in the TOD task.

cs.CL↗

arXiv2022

Acoustic mirror Chern insulator with projective parity-time symmetry

In condensed matter physics, symmetry profoundly governs the fundamentals of topological matter. The emergence of new topological phase is typically linked to the enrichment of symmetries. Different parity-time symmetry relations distinguish between spinless and spinful physical systems. In spinless systems, creating pseudo-spins can realize fragile topological phase but not break the time-reversal symmetry. Therefore, growing attentions were recently focused on the strong topological phase in spinless systems. Here we break the framework of crystallographic symmetry groups by utilizing the projective symmetry gauge field, to realize the Mirror Chern Insulator in a bilayer twisted Hofstadter model. In experiments, the edge modes were unambiguously observed with odd-shaped boundaries, confirming the strong topological features.The clockwise and anti-clockwise edge states with opposite group velocities were completely separated via an energy drain. In addition, we demonstrate that MCI has robust topological whispering gallery modes. Our work establishes a strong foundation for investigating exotic topological effects arising from the interplays between artificial gauge fields and wave systems. The clockwise and anti-clockwise edge states with opposite group velocities were completely separated via an energy drain. In addition, we demonstrate that MCI has robust topological whispering gallery modes. Our work establishes a strong foundation for investigating exotic topological effects arising from the interplays between artificial gauge fields and wave systems.

cond-mat.mes-hall↗

arXiv2022

Synthetic Aperture Radar Image Change Detection via Layer Attention-Based Noise-Tolerant Network

Recently, change detection methods for synthetic aperture radar (SAR) images based on convolutional neural networks (CNN) have gained increasing research attention. However, existing CNN-based methods neglect the interactions among multilayer convolutions, and errors involved in the preclassification restrict the network optimization. To this end, we proposed a layer attention-based noise-tolerant network, termed LANTNet. In particular, we design a layer attention module that adaptively weights the feature of different convolution layers. In addition, we design a noise-tolerant loss function that effectively suppresses the impact of noisy labels. Therefore, the model is insensitive to noisy labels in the preclassification results. The experimental results on three SAR datasets show that the proposed LANTNet performs better compared to several state-of-the-art methods. The source codes are available at https://github.com/summitgao/LANTNet

eess.IV↗

arXiv2022

SSCU-Net: Spatial-Spectral Collaborative Unmixing Network for Hyperspectral Images

Linear spectral unmixing is an essential technique in hyperspectral image processing and interpretation. In recent years, deep learning-based approaches have shown great promise in hyperspectral unmixing, in particular, unsupervised unmixing methods based on autoencoder networks are a recent trend. The autoencoder model, which automatically learns low-dimensional representations (abundances) and reconstructs data with their corresponding bases (endmembers), has achieved superior performance in hyperspectral unmixing. In this article, we explore the effective utilization of spatial and spectral information in autoencoder-based unmixing networks. Important findings on the use of spatial and spectral information in the autoencoder framework are discussed. Inspired by these findings, we propose a spatial-spectral collaborative unmixing network, called SSCU-Net, which learns a spatial autoencoder network and a spectral autoencoder network in an end-to-end manner to more effectively improve the unmixing performance. SSCU-Net is a two-stream deep network and shares an alternating architecture, where the two autoencoder networks are efficiently trained in a collaborative way for estimation of endmembers and abundances. Meanwhile, we propose a new spatial autoencoder network by introducing a superpixel segmentation method based on abundance information, which greatly facilitates the employment of spatial information and improves the accuracy of unmixing network. Moreover, extensive ablation studies are carried out to investigate the performance gain of SSCU-Net. Experimental results on both synthetic and real hyperspectral data sets illustrate the effectiveness and competitiveness of the proposed SSCU-Net compared with several state-of-the-art hyperspectral unmixing methods.

eess.IV↗

arXiv2022

Properties of dense molecular gas along the major axis of M 82

Dense gas is important for galaxy evolution and star formation. Optically-thin dense-gas tracers, such as isotopologues of HCN, HCO+, etc., are very helpful to diagnose excitation conditions of dense molecular gas. However, previous studies of optically-thin dense-gas tracers were mostly focusing on average properties of galaxies as a whole, due to limited sensitivity and angular resolution. M82, a nearby prototype starburst galaxy, offers a unique case for spatially-resolved studies with single-dish telescopes. With the IRAM 30-m telescope, we observed the J = 1 - 0 transition of H13CN, HC15N, H13CO+, HN13C, H15NC, and SiO J = 2 - 1, HC3N J= 10 - 9, H2CO J = 2 - 1 toward five positions along the major axis of M82. The intensity ratios of I(HCN)/I(H13CN) and I(HCO+)/I(H13CO+) show a significant spatial variation along the major axis, with lower values in the central region than those on the disk, indicating higher optical depths in the central region. The optical depths of HCO+ lines are found to be systematically higher than those of HCN lines at all positions. Futhermore, we find that the 14N/15N ratios have an increasing gradient from the center to the outer disk.

astro-ph.GA↗

arXiv2022

Magnetic moments of the hidden-charm strange pentaquark states

This paper calculates the magnetic moments of the hidden-charm strange pentaquark states with a quantum number of $J^P={\frac{1}{2}}^{\pm}$, ${\frac{3}{2}}^{\pm}$, ${\frac{5}{2}}^{\pm}$, and ${\frac{7}{2}}^{+}$ in the molecular, diquark-diquark-antiquark, and diquark-triquark models, respectively. Numerical results demonstrate that the magnetic moments change for a different spin-orbit coupling with the same model and when involving different models with the same angular momentum.

hep-ph↗

arXiv2022

Potential for a precision measurement of solar $pp$ neutrinos in the Serappis Experiment

The Serappis (SEarch for RAre PP-neutrinos In Scintillator) project aims at a precision measurement of the flux of solar $pp$ neutrinos on the few-percent level. Such a measurement will be a relevant contribution to the study of solar neutrino oscillation parameters and a sensitive test of the solar luminosity constraint. The concept of Serappis relies on a small organic liquid scintillator detector ($\sim$20 m$^3$) with excellent energy resolution ($\sim$2.5 % at 1 MeV), low internal background and sufficient shielding from surrounding radioactivity. This can be achieved by a minor upgrade of the OSIRIS facility at the site of the JUNO neutrino experiment in southern China. To go substantially beyond current accuracy levels for the $pp$ flux, an organic scintillator with ultra-low $^{14}$C levels (below $10^{-18}$) is required. The existing OSIRIS detector and JUNO infrastructure will be instrumental in identifying suitable scintillator materials, offering a unique chance for a low-budget high-precision measurement of a fundamental property of our Sun that will be otherwise hard to access.

physics.ins-det↗