arXiv subjects

Feng Gao

Publications and source records attributed to Feng Gao.

At least 235 records · Page 13Linked to original sources

arXiv2022

Photoacoustic Digital Skin: Generation and Simulation of Human Skin Vascular for Quantitative Image Analysis

Photoacoustic computed tomography (PACT) is a hybrid imaging modality, which combines the high optical contrast of pure optical imaging and the high penetration depth of ultrasound imaging. However, photoacoustic image dataset with good quality and large quantity is lacking. In this paper, we mainly talk about how to generate a practical photoacoustic dataset. Firstly, we extracted 389 3D vessel volumes from CT whole-lung scan database, and enhanced the blood vessel structures. Then for each 3D vessel volume, we embedded it into a three-layer cubic phantom to formulate a skin tissue model, which includes epidermis, dermis, and hypodermis. The vessel volume was placed randomly in dermis layer in 10 different ways. Thus, 3890 3D skin tissue phantoms were generated. Then we assigned optical properties for the four kinds of tissue types. Monte-Carlo optical simulations were deployed to obtain the optical fluence distribution. Then acoustic propagation simulations were deployed to obtain the photoacoustic initial pressure. Universal back-projection algorithm was used to reconstruct the photoacoustic images. This dataset could be used for deep learning-based photoacoustic image reconstruction, classification, registration, quantitative image analysis.

physics.med-ph↗

arXiv2022

FPGA Acceleration of Image Reconstruction for Real-Time Photoacoustic Tomography

Photoacoustic (PA) imaging has been widely applied in both preclinical and clinical applications. With a significantly increasing number of data acquisition channels, fast and high-quality image reconstruction for real-time PA imaging is an open challenge in this community. In this paper, we propose a FPGA-accelerated method to achieve a much faster image reconstruction speed by 20~60 times compared with using CPU, with much-reduced system cost and power budget, from dozens of Watt (CPU) to 1~2 Watt (FPGA). Equivalently, the energy efficiency ratio (EER) is improved by ~1000 times. This FPGA acceleration method can be easily adapted to the most widely used algorithms, such as delay-and-sum (DAS) and its variants (e.g. DMAS, DAS-CF). We have performed in-vivo human finger experiments to demonstrate the feasibility and potential of the proposed method. To our best knowledge, this is the first study of accelerating PA image reconstruction based on FPGA platform.

physics.med-ph↗

arXiv2022

Spatial distribution of HOCN around Sagittarius B2

HOCN and HNCO abundance ratio in molecular gas can tell us the information of their formation mechanism. We performed high-sensitivity mapping observations of HOCN, HNCO, and HNC$^{18}$O lines around Sagittarius B2 (Sgr B2) with IRAM 30m telescope at 3-mm wavelength. HNCO 4$_{04}$-3$_{03}$ and HOCN 4$_{04}$-3$_{03}$ are used to obtain the abundance ratio of HNCO to HOCN. The ratio of HNCO 4$_{04}$-3$_{03}$ to HNC$^{18}$O 4$_{04}$-3$_{03}$ is used to calculate the optical depth of HNCO 4$_{04}$-3$_{03}$. The abundance ratio of HOCN and HNCO is observed to range from 0.4% to 0.7% toward most positions, which agrees well with the gas-grain model. However, the relative abundance of HOCN is observed to be enhanced toward the direction of Sgr B2 (S), with HOCN to HNCO abundance ratio of $\sim$ 0.9%. The reason for that still needs further investigation.Based on the intensity ratio of HNCO and HNC$^{18}$O lines, we updated the isotopic ratio of $^{16}$O/$^{18}$O to be 296 $\pm$ 54 in Sgr B2.

astro-ph.GA↗

arXiv2022

Hand-held 3D Photoacoustic Imager with GPS

As an emerging medical diagnostic technology, photoacoustic imaging has been implemented for both preclinical and clinical applications. For clinical convenience, a handheld free scan photoacoustic tomography (PAT) system providing 3D imaging capability is essentially needed, which has potential for surgical navigation and disease diagnosis. In this paper, we proposed a free scan 3D PAT (fsPAT) system based on a handheld linear array ultrasound probe. A global positioning system (GPS) is applied for ultrasound probes coordinate acquisition. The proposed fsPAT can simultaneously realize real time 2D imaging, and large field of view 3D volumetric imaging, which is reconstructed from the multiple 2D images with coordinate information acquired by the GPS. To form a high quality 3D image, a dedicated space transformation method and reconstruction algorithm are used and validated by the proposed system. Both simulation and experimental studies have been performed to prove the feasibility of the proposed fsPAT. To explore its clinical potential, in vivo 3D imaging of human wrist vessels is also conducted, showing clear subcutaneous vessel network with high image contrast.

physics.med-ph↗

arXiv2022

Change Detection from Synthetic Aperture Radar Images via Dual Path Denoising Network

Benefited from the rapid and sustainable development of synthetic aperture radar (SAR) sensors, change detection from SAR images has received increasing attentions over the past few years. Existing unsupervised deep learning-based methods have made great efforts to exploit robust feature representations, but they consume much time to optimize parameters. Besides, these methods use clustering to obtain pseudo-labels for training, and the pseudo-labeled samples often involve errors, which can be considered as "label noise". To address these issues, we propose a Dual Path Denoising Network (DPDNet) for SAR image change detection. In particular, we introduce the random label propagation to clean the label noise involved in preclassification. We also propose the distinctive patch convolution for feature representation learning to reduce the time consumption. Specifically, the attention mechanism is used to select distinctive pixels in the feature maps, and patches around these pixels are selected as convolution kernels. Consequently, the DPDNet does not require a great number of training samples for parameter optimization, and its computational efficiency is greatly enhanced. Extensive experiments have been conducted on five SAR datasets to verify the proposed DPDNet. The experimental results demonstrate that our method outperforms several state-of-the-art methods in change detection results.

eess.IV↗

arXiv2022

Cross-level Contrastive Learning and Consistency Constraint for Semi-supervised Medical Image Segmentation

Semi-supervised learning (SSL), which aims at leveraging a few labeled images and a large number of unlabeled images for network training, is beneficial for relieving the burden of data annotation in medical image segmentation. According to the experience of medical imaging experts, local attributes such as texture, luster and smoothness are very important factors for identifying target objects like lesions and polyps in medical images. Motivated by this, we propose a cross-level contrastive learning scheme to enhance representation capacity for local features in semi-supervised medical image segmentation. Compared to existing image-wise, patch-wise and point-wise contrastive learning algorithms, our devised method is capable of exploring more complex similarity cues, namely the relational characteristics between global and local patch-wise representations. Additionally, for fully making use of cross-level semantic relations, we devise a novel consistency constraint that compares the predictions of patches against those of the full image. With the help of the cross-level contrastive learning and consistency constraint, the unlabelled data can be effectively explored to improve segmentation performance on two medical image datasets for polyp and skin lesion segmentation respectively. Code of our approach is available.

eess.IV↗

arXiv2022

Change Detection from Synthetic Aperture Radar Images via Graph-Based Knowledge Supplement Network

Synthetic aperture radar (SAR) image change detection is a vital yet challenging task in the field of remote sensing image analysis. Most previous works adopt a self-supervised method which uses pseudo-labeled samples to guide subsequent training and testing. However, deep networks commonly require many high-quality samples for parameter optimization. The noise in pseudo-labels inevitably affects the final change detection performance. To solve the problem, we propose a Graph-based Knowledge Supplement Network (GKSNet). To be more specific, we extract discriminative information from the existing labeled dataset as additional knowledge, to suppress the adverse effects of noisy samples to some extent. Afterwards, we design a graph transfer module to distill contextual information attentively from the labeled dataset to the target dataset, which bridges feature correlation between datasets. To validate the proposed method, we conducted extensive experiments on four SAR datasets, which demonstrated the superiority of the proposed GKSNet as compared to several state-of-the-art baselines. Our codes are available at https://github.com/summitgao/SAR_CD_GKSNet.

cs.CV↗

arXiv2022

Adaptive DropBlock Enhanced Generative Adversarial Networks for Hyperspectral Image Classification

In recent years, hyperspectral image (HSI) classification based on generative adversarial networks (GAN) has achieved great progress. GAN-based classification methods can mitigate the limited training sample dilemma to some extent. However, several studies have pointed out that existing GAN-based HSI classification methods are heavily affected by the imbalanced training data problem. The discriminator in GAN always contradicts itself and tries to associate fake labels to the minority-class samples, and thus impair the classification performance. Another critical issue is the mode collapse in GAN-based methods. The generator is only capable of producing samples within a narrow scope of the data space, which severely hinders the advancement of GAN-based HSI classification methods. In this paper, we proposed an Adaptive DropBlock-enhanced Generative Adversarial Networks (ADGAN) for HSI classification. First, to solve the imbalanced training data problem, we adjust the discriminator to be a single classifier, and it will not contradict itself. Second, an adaptive DropBlock (AdapDrop) is proposed as a regularization method employed in the generator and discriminator to alleviate the mode collapse issue. The AdapDrop generated drop masks with adaptive shapes instead of a fixed size region, and it alleviates the limitations of DropBlock in dealing with ground objects with various shapes. Experimental results on three HSI datasets demonstrated that the proposed ADGAN achieved superior performance over state-of-the-art GAN-based methods. Our codes are available at https://github.com/summitgao/HC_ADGAN

cs.CV↗

arXiv2022

A Thousand Words Are Worth More Than a Picture: Natural Language-Centric Outside-Knowledge Visual Question Answering

Outside-knowledge visual question answering (OK-VQA) requires the agent to comprehend the image, make use of relevant knowledge from the entire web, and digest all the information to answer the question. Most previous works address the problem by first fusing the image and question in the multi-modal space, which is inflexible for further fusion with a vast amount of external knowledge. In this paper, we call for a paradigm shift for the OK-VQA task, which transforms the image into plain text, so that we can enable knowledge passage retrieval, and generative question-answering in the natural language space. This paradigm takes advantage of the sheer volume of gigantic knowledge bases and the richness of pre-trained language models. A Transform-Retrieve-Generate framework (TRiG) framework is proposed, which can be plug-and-played with alternative image-to-text models and textual knowledge bases. Experimental results show that our TRiG framework outperforms all state-of-the-art supervised methods by at least 11.1% absolute margin.

cs.CV↗

arXiv2021

Size-adjustable Ring-shape Photoacoustic Tomography System

Photoacoustic tomography (PAT) combines the advantages of the spectroscopic optical absorption contrast and acoustic resolution with deep penetration, and becomes an important novel biomedical imaging technology for scientific research and clinical diagnosis. In this paper, an imaging size-adjustable PAT system is proposed for clinical applications, which can adapt for different size imaging targets. Comparing with the conventional PAT system setup which with a fixed radius ring shape ultrasound transducer (UT) array, the proposed system, which is based on sectorial ultrasound transducer array (SUTA), is more flexible for different size targets imaging. There are 32 elements for each SUTA, and four SUTAs form a 128-channel UT array for photoacoustic wave detection. The four SUTAs are controlled by four stepper motors, and change the SUTAs distribute positon that adapt for imaging applications. The radius of the proposed system imaging region of interest (ROI) can be adjusted from 50 mm to 90 mm, which is much more flexible than the conventional full ring UT array PAT system. The simulation results generated by the MATLAB k-wave toolbox very well demonstrate the feasibility of the proposed system. To further validate the proposed system for size-adjustable imaging, a vascular mimicking phantom and ex-vivo pork breast with indocyanine green (ICG) injected are imaged to prove its feasibility for clinical applications.

physics.ins-det↗

arXiv2021

Physics-Guided Generative Adversarial Networks for Sea Subsurface Temperature Prediction

Sea subsurface temperature, an essential component of aquatic wildlife, underwater dynamics and heat transfer with the sea surface, is affected by global warming in climate change. Existing research is commonly based on either physics-based numerical models or data based models. Physical modeling and machine learning are traditionally considered as two unrelated fields for the sea subsurface temperature prediction task, with very different scientific paradigms (physics-driven and data-driven). However, we believe both methods are complementary to each other. Physical modeling methods can offer the potential for extrapolation beyond observational conditions, while data-driven methods are flexible in adapting to data and are capable of detecting unexpected patterns. The combination of both approaches is very attractive and offers potential performance improvement. In this paper, we propose a novel framework based on generative adversarial network (GAN) combined with numerical model to predict sea subsurface temperature. First, a GAN-based model is used to learn the simplified physics between the surface temperature and the target subsurface temperature in numerical model. Then, observation data are used to calibrate the GAN-based model parameters to obtain better prediction. We evaluate the proposed framework by predicting daily sea subsurface temperature in the South China sea. Extensive experiments demonstrate the effectiveness of the proposed framework compared to existing state-of-the-art methods.

cs.LG↗

arXiv2021

Synthetic Aperture Radar Image Change Detection via Siamese Adaptive Fusion Network

Synthetic aperture radar (SAR) image change detection is a critical yet challenging task in the field of remote sensing image analysis. The task is non-trivial due to the following challenges: Firstly, intrinsic speckle noise of SAR images inevitably degrades the neural network because of error gradient accumulation. Furthermore, the correlation among various levels or scales of feature maps is difficult to be achieved through summation or concatenation. Toward this end, we proposed a siamese adaptive fusion network for SAR image change detection. To be more specific, two-branch CNN is utilized to extract high-level semantic features of multitemporal SAR images. Besides, an adaptive fusion module is designed to adaptively combine multiscale responses in convolutional layers. Therefore, the complementary information is exploited, and feature learning in change detection is further improved. Moreover, a correlation layer is designed to further explore the correlation between multitemporal images. Thereafter, robust feature representation is utilized for classification through a fully-connected layer with softmax. Experimental results on four real SAR datasets demonstrate that the proposed method exhibits superior performance against several state-of-the-art methods. Our codes are available at https://github.com/summitgao/SAR_CD_SAFNet.

eess.IV↗

arXiv2021

SAR Image Change Detection Based on Multiscale Capsule Network

Traditional change detection methods based on convolutional neural networks (CNNs) face the challenges of speckle noise and deformation sensitivity for synthetic aperture radar images. To mitigate these issues, we proposed a Multiscale Capsule Network (Ms-CapsNet) to extract the discriminative information between the changed and unchanged pixels. On the one hand, the capsule module is employed to exploit the spatial relationship of features. Therefore, equivariant properties can be achieved by aggregating the features from different positions. On the other hand, an adaptive fusion convolution (AFC) module is designed for the proposed Ms-CapsNet. Higher semantic features can be captured for the primary capsules. Feature extracted by the AFC module significantly improves the robustness to speckle noise. The effectiveness of the proposed Ms-CapsNet is verified on three real SAR datasets. The comparison experiments with four state-of-the-art methods demonstrated the efficiency of the proposed method. Our codes are available at https://github.com/summitgao/SAR_CD_MS_CapsNet.

cs.CV↗

arXiv2021

Photoacoustic digital brain: numerical modelling and image reconstruction via deep learning

Photoacoustic tomography (PAT) is a newly developed medical imaging modality, which combines the advantages of pure optical imaging and ultrasound imaging, owning both high optical contrast and deep penetration depth. Very recently, PAT is studied in human brain imaging. Nevertheless, while ultrasound waves are passing through the human skull tissues, the strong acoustic attenuation and aberration will happen, which causes photoacoustic signals' distortion. In this work, we use 10 magnetic resonance angiography (MRA) human brain volumes, and manually segment them to obtain the 2D human brain numerical phantoms for PAT. The numerical phantoms contain six kinds of tissues which are scalp, skull, white matter, gray matter, blood vessel and cerebral cortex. For every numerical phantom, optical properties are assigned to every kind of tissues. Then, Monte-Carlo based optical simulation is deployed to obtain the photoacoustic initial pressure. Then, we made two k-wave simulation cases: one takes inhomogeneous medium and uneven sound velocity into consideration, and the other not. Then we use the sensor data of the former one as the input of U-net, and the sensor data of the latter one as the output of U-net to train the network. We randomly choose 7 human brain PA sinograms as the training dataset and 3 human brain PA sinograms as the testing set. The testing result shows that our method could correct the skull acoustic aberration and obtain the blood vessel distribution inside the human brain satisfactorily.

physics.med-ph↗

arXiv2021

Propionamide (C2H5CONH2): The largest peptide-like molecule in space

Peptide bonds, as the molecular bridges that connect amino acids, are crucial to the formation of proteins. Searches and studies of molecules with embedded peptide-like bonds are thus important for the understanding of protein formation in space. Here we report the first tentative detection of propionamide (C2H5CONH2), the largest peptide-like molecule detected in space toward Sagittarius B2(N1) at a position called N1E that is slightly offset from the continuum peak. A new laboratory measurements of the propionamide spectrum were carried out in the 9-461 GHz, which provide good opportunity to check directly for the transition frequencies of detected interstellar lines of propionamide. Our observing result indicates that propionamide emission comes from the warm, compact cores in Sagittarius B2, in which massive protostellars are forming. The column density of propionamide toward Sgr B2(N1E) was derived to be 1.5\times 10^{16} cm^-2, which is three fifths of that of acetamide, and one nineteenth of that of formamide. This detection suggests that large peptide-like molecules can form and survive during star-forming process and may form more complex molecules in the interstellar medium. The detection of propionamide bodes well for the presence of polypeptides, as well as other complex prebiotic molecules in the interstellar medium.

astro-ph.GA↗

arXiv2021

On-chip erbium-doped lithium niobate microring lasers

Lithium niobate on insulator (LNOI), regarded as an important candidate platform for optical integration due to its excellent nonlinear, electro-optic and other physical properties, has become a research hotspot. Light source, as an essential component for integrated optical system, is urgently needed. In this paper, we reported the realization of 1550-nm band on-chip LNOI microlasers based on erbium-doped LNOI ring cavities with loaded quality factors higher than one million, which were fabricated by using electron beam lithography and inductively coupled plasma reactive ion etching processes. These microlasers demonstrated a low pump threshold of ~20 μW and stable performance under the pump of a 980-nm band continuous laser. Comb-like laser spectra spanning from 1510 nm to 1580 nm were observed in high pump power regime, which lays the foundation of the realization of pulsed laser and frequency combs on rare-earth ion doped LNOI platform. This work has effectively promoted the development of on-chip integrated active LNOI devices.

physics.optics↗

arXiv2021

Searching Water Megamasers By Using Mid-infrared Spectroscopy (I): Possible Mid-infrared Indicators

Water megamasers at 22 GHz with a gas disk configuration in galaxies provide the most precise measurements of supermassive black hole masses, as well as independent constraints on the Hubble constant in the nearby universe. The existence of other maser types, such as jet or outflow masers, represents another tracer for AGN science. However, the detection rate of water megamasers in galaxies is extremely low. Over 40 years, only $\sim$ 160 galaxies are found to harbour maser emission, and $\sim$ 30\% of them show features in their maser emission that indicate a disk-like geometry. Therefore, increasing the detection rate of masers is a crucial task to allow expanding on maser studies. We present a comparison of mid-infrared spectroscopic data between a maser galaxy sample and a Seyfert 2 control sample. We find that maser galaxies show significant peculiarities in their mid-infrared spectra: (1) Maser galaxies tend to present stronger silicate absorption at $τ$ 9.7 $μ$m than the control sample, (2) PAH 11.3 $μ$m emission in maser galaxies is much weaker than in the control sample, (3) spectral indices at 20-30 $μ$m are steeper in maser galaxies than in the control sample and tend to be mid-infrared enhanced population. We conclude that there may be good indicators in mid-infrared and far-infrared which could differentiate maser and non-maser Seyfert 2 galaxies. Upcoming infrared facilities, such as the James Webb Space Telescope, may be able to exploit these and other useful criteria and tracers for water megamaser observations.

astro-ph.GA↗

arXiv2021

Learning the Precise Feature for Cluster Assignment

Clustering is one of the fundamental tasks in computer vision and pattern recognition. Recently, deep clustering methods (algorithms based on deep learning) have attracted wide attention with their impressive performance. Most of these algorithms combine deep unsupervised representation learning and standard clustering together. However, the separation of representation learning and clustering will lead to suboptimal solutions because the two-stage strategy prevents representation learning from adapting to subsequent tasks (e.g., clustering according to specific cues). To overcome this issue, efforts have been made in the dynamic adaption of representation and cluster assignment, whereas current state-of-the-art methods suffer from heuristically constructed objectives with representation and cluster assignment alternatively optimized. To further standardize the clustering problem, we audaciously formulate the objective of clustering as finding a precise feature as the cue for cluster assignment. Based on this, we propose a general-purpose deep clustering framework which radically integrates representation learning and clustering into a single pipeline for the first time. The proposed framework exploits the powerful ability of recently developed generative models for learning intrinsic features, and imposes an entropy minimization on the distribution of the cluster assignment by a dedicated variational algorithm. Experimental results show that the performance of the proposed method is superior, or at least comparable to, the state-of-the-art methods on the handwritten digit recognition, fashion recognition, face recognition and object recognition benchmark datasets.

cs.CV↗