arXiv subjects

Rui Li

Publications and source records attributed to Rui Li.

At least 397 records · Page 22Linked to original sources

arXiv2022

A Policy-based Approach to the SpecAugment Method for Low Resource E2E ASR

SpecAugment is a very effective data augmentation method for both HMM and E2E-based automatic speech recognition (ASR) systems. Especially, it also works in low-resource scenarios. However, SpecAugment masks the spectrum of time or the frequency domain in a fixed augmentation policy, which may bring relatively less data diversity to the low-resource ASR. In this paper, we propose a policy-based SpecAugment (Policy-SpecAugment) method to alleviate the above problem. The idea is to use the augmentation-select policy and the augmentation-parameter changing policy to solve the fixed way. These policies are learned based on the loss of validation set, which is applied to the corresponding augmentation policies. It aims to encourage the model to learn more diverse data, which the model relatively requires. In experiments, we evaluate the effectiveness of our approach in low-resource scenarios, i.e., the 100 hours librispeech task. According to the results and analysis, we can see that the above issue can be obviously alleviated using our proposal. In addition, the experimental results show that, compared with the state-of-the-art SpecAugment, the proposed Policy-SpecAugment has a relative WER reduction of more than 10% on the Test/Dev-clean set, more than 5% on the Test/Dev-other set, and an absolute WER reduction of more than 1% on all test sets.

cs.SD↗

arXiv2022

Galaxy-galaxy lensing in the VOICE deep survey

The multi-band photometry of the VOICE imaging data, overlapping with 4.9 deg$^2$ of the Chandra Deep Field South (CDFS) area, enables both shape measurement and photometric redshift estimation to be the two essential quantities for weak lensing analysis. The depth of $mag_{AB}$ is up to 26.1 (5$σ$ limiting) in $r$-band. We estimate the Excess Surface Density (ESD; $ΔΣ$) based on galaxy-galaxy measurements around galaxies at lower redshift (0.10<$z_l$<0.35) while we select the background sources to be at higher redshift ranging from 0.3 to 1.5. The foreground galaxies are divided into two major categories according to their colour (blue/red), each of which has been further divided into high/low stellar mass bins. Then the halo masses of the samples are estimated by modelling the signals, and the posterior of the parameters are samples via Mote Carlo Markov Chain (MCMC) process. We compare our results with the existing Stellar-to-Halo Mass Relation (SHMR) and find that the blue low stellar mass bin (median $M_*=10^{8.31}M_\odot$) deviates from the SHMR relation whereas all other three samples agrees well with empirical curves. We interpret this discrepancy as the effect of a low star formation efficiency of the low-mass blue dwarf galaxy population dominated in the VOICE-CDFS area.

astro-ph.CO↗

arXiv2022

Learning Multi-Modal Brain Tumor Segmentation from Privileged Semi-Paired MRI Images with Curriculum Disentanglement Learning

Due to the difficulties of obtaining multimodal paired images in clinical practice, recent studies propose to train brain tumor segmentation models with unpaired images and capture complementary information through modality translation. However, these models cannot fully exploit the complementary information from different modalities. In this work, we thus present a novel two-step (intra-modality and inter-modality) curriculum disentanglement learning framework to effectively utilize privileged semi-paired images, i.e. limited paired images that are only available in training, for brain tumor segmentation. Specifically, in the first step, we propose to conduct reconstruction and segmentation with augmented intra-modality style-consistent images. In the second step, the model jointly performs reconstruction, unsupervised/supervised translation, and segmentation for both unpaired and paired inter-modality images. A content consistency loss and a supervised translation loss are proposed to leverage complementary information from different modalities in this step. Through these two steps, our method effectively extracts modality-specific style codes describing the attenuation of tissue features and image contrast, and modality-invariant content codes containing anatomical and functional information from the input images. Experiments on three brain tumor segmentation tasks show that our model outperforms competing segmentation models based on unpaired images.

cs.CV↗

arXiv2022

Velocity-resolved Reverberation Mapping of Changing-look Active Galactic Nucleus NGC~4151 During Outburst Stage: Evidence for Kinematics Evolution of Broad-line Region

Changing-look active galactic nucleus NGC~4151, which has attracted a lot of attention, is undergoing the second dramatic outburst stage in its evolutionary history. To investigate the geometry and kinematics of the broad-line region (BLR), and measure the mass of supermassive black hole in NGC~4151, we perform a seven-month photometric and spectroscopic monitoring program in 2020--2021, using the 2.4 m telescope at Lijiang Observatory. We successfully measure the time lags of the responses from broad \ha, \hb, \hg, \hei, and \heii\ emission lines to continuum variation, which are $7.63_{-2.62}^{+1.85}$, $6.21_{-1.13}^{+1.41}$, $5.67_{-1.94}^{+1.65}$, $1.59_{-1.11}^{+0.86}$, and $0.46_{-1.06}^{+1.22}$ days, respectively, following radial stratification. The ratios of time lags among these lines are $1.23 : 1.00 : 0.91 : 0.26 : 0.07$. We find that the continuum lag between the ultraviolet and optical bands can significantly affect the lag measurements of \hei\ and \heii. Virial and infalling gas motions coexist in this campaign, which is different from previous results, implying the evolutionary kinematics of BLR. Based on our measurements and previous ones in the literature, we confirm that the BLR of NGC~4151 is basically virialized. Finally, we compute the black hole mass through multiple lines, and the measurement from \hb\ to be $ 3.94_{-0.72}^{+0.90} \times 10^7 M_{\odot}$, which is consistent with previous results. The corresponding accretion rate is $0.02_{-0.01}^{+0.01} L_{\rm Edd} c^{-2}$, implying a sub-Eddington accretor.

astro-ph.GA↗

arXiv2022

Galaxy morphoto-Z with neural Networks (GaZNets). I. Optimized accuracy and outlier fraction from Imaging and Photometry

In the era of large sky surveys, photometric redshifts (photo-z) represent crucial information for galaxy evolution and cosmology studies. In this work, we propose a new Machine Learning (ML) tool called Galaxy morphoto-Z with neural Networks (GaZNet-1), which uses both images and multi-band photometry measurements to predict galaxy redshifts, with accuracy, precision and outlier fraction superior to standard methods based on photometry only. As a first application of this tool, we estimate photo-z of a sample of galaxies in the Kilo-Degree Survey (KiDS). GaZNet-1 is trained and tested on $\sim140 000$ galaxies collected from KiDS Data Release 4 (DR4), for which spectroscopic redshifts are available from different surveys. This sample is dominated by bright (MAG$\_$AUTO$<21$) and low redshift ($z < 0.8$) systems, however, we could use $\sim$ 6500 galaxies in the range $0.8 < z < 3$ to effectively extend the training to higher redshift. The inputs are the r-band galaxy images plus the 9-band magnitudes and colours, from the combined catalogs of optical photometry from KiDS and near-infrared photometry from the VISTA Kilo-degree Infrared survey. By combining the images and catalogs, GaZNet-1 can achieve extremely high precision in normalized median absolute deviation (NMAD=0.014 for lower redshift and NMAD=0.041 for higher redshift galaxies) and low fraction of outliers ($0.4$\% for lower and $1.27$\% for higher redshift galaxies). Compared to ML codes using only photometry as input, GaZNet-1 also shows a $\sim 10-35$% improvement in precision at different redshifts and a $\sim$ 45% reduction in the fraction of outliers. We finally discuss that, by correctly separating galaxies from stars and active galactic nuclei, the overall photo-z outlier fraction of galaxies can be cut down to $0.3$\%.

astro-ph.GA↗

arXiv2022

Finding Top-r Influential Communities under Aggregation Functions

Community search is a problem that seeks cohesive and connected subgraphs in a graph that satisfy certain topology constraints, e.g., degree constraints. The majority of existing works focus exclusively on the topology and ignore the nodes' influence in the communities. To tackle this deficiency, influential community search is further proposed to include the node's influence. Each node has a weight, namely influence value, in the influential community search problem to represent its network influence. The influence value of a community is produced by an aggregated function, e.g., max, min, avg, and sum, over the influence values of the nodes in the same community. The objective of the influential community search problem is to locate the top-r communities with the highest influence values while satisfying the topology constraints. Existing studies on influential community search have several limitations: (i) they focus exclusively on simple aggregation functions such as min, which may fall short of certain requirements in many real-world scenarios, and (ii) they impose no limitation on the size of the community, whereas most real-world scenarios do. This motivates us to conduct a new study to fill this gap. We consider the problem of identifying the top-r influential communities with/without size constraints while using more complicated aggregation functions such as sum or avg. We give a theoretical analysis demonstrating the hardness of the problems and propose efficient and effective heuristic solutions for our topr influential community search problems. Extensive experiments on real large graphs demonstrate that our proposed solution is significantly more efficient than baseline solutions.

cs.SI↗

arXiv2022

UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagery

Semantic segmentation of remotely sensed urban scene images is required in a wide range of practical applications, such as land cover mapping, urban change detection, environmental protection, and economic assessment.Driven by rapid developments in deep learning technologies, the convolutional neural network (CNN) has dominated semantic segmentation for many years. CNN adopts hierarchical feature representation, demonstrating strong capabilities for local information extraction. However, the local property of the convolution layer limits the network from capturing the global context. Recently, as a hot topic in the domain of computer vision, Transformer has demonstrated its great potential in global information modelling, boosting many vision-related tasks such as image classification, object detection, and particularly semantic segmentation. In this paper, we propose a Transformer-based decoder and construct a UNet-like Transformer (UNetFormer) for real-time urban scene segmentation. For efficient segmentation, the UNetFormer selects the lightweight ResNet18 as the encoder and develops an efficient global-local attention mechanism to model both global and local information in the decoder. Extensive experiments reveal that our method not only runs faster but also produces higher accuracy compared with state-of-the-art lightweight models. Specifically, the proposed UNetFormer achieved 67.8% and 52.4% mIoU on the UAVid and LoveDA datasets, respectively, while the inference speed can achieve up to 322.4 FPS with a 512x512 input on a single NVIDIA GTX 3090 GPU. In further exploration, the proposed Transformer-based decoder combined with a Swin Transformer encoder also achieves the state-of-the-art result (91.3% F1 and 84.1% mIoU) on the Vaihingen dataset. The source code will be freely available at https://github.com/WangLibo1995/GeoSeg.

cs.CV↗

arXiv2022

A New Perspective on the Effects of Spectrum in Graph Neural Networks

Many improvements on GNNs can be deemed as operations on the spectrum of the underlying graph matrix, which motivates us to directly study the characteristics of the spectrum and their effects on GNN performance. By generalizing most existing GNN architectures, we show that the correlation issue caused by the $unsmooth$ spectrum becomes the obstacle to leveraging more powerful graph filters as well as developing deep architectures, which therefore restricts GNNs' performance. Inspired by this, we propose the correlation-free architecture which naturally removes the correlation issue among different channels, making it possible to utilize more sophisticated filters within each channel. The final correlation-free architecture with more powerful filters consistently boosts the performance of learning graph representations. Code is available at https://github.com/qslim/gnn-spectrum.

cs.LG↗

arXiv2022

HousE: Knowledge Graph Embedding with Householder Parameterization

The effectiveness of knowledge graph embedding (KGE) largely depends on the ability to model intrinsic relation patterns and mapping properties. However, existing approaches can only capture some of them with insufficient modeling capacity. In this work, we propose a more powerful KGE framework named HousE, which involves a novel parameterization based on two kinds of Householder transformations: (1) Householder rotations to achieve superior capacity of modeling relation patterns; (2) Householder projections to handle sophisticated relation mapping properties. Theoretically, HousE is capable of modeling crucial relation patterns and mapping properties simultaneously. Besides, HousE is a generalization of existing rotation-based models while extending the rotations to high-dimensional spaces. Empirically, HousE achieves new state-of-the-art performance on five benchmark datasets. Our code is available at https://github.com/anrep/HousE.

cs.AI↗

arXiv2022

A Sahlqvist-style Correspondence Theorem for Linear-time Temporal Logic

The language of modal logic is capable of expressing first-order conditions on Kripke frames. The classic result by Henrik Sahlqvist identifies a significant class of modal formulas for which first-order conditions -- or Sahlqvist correspondents -- can be find in an effective, algorithmic way. Recent works have successfully extended this classic result to more complex modal languages. In this paper, we pursue a similar line and develop a Sahlqvist-style correspondence theorem for Linear-time Temporal Logic (LTL), which is one of the most widely used formal languages for temporal specification. LTL extends the syntax of basic modal logic with dedicated temporal operators Next X and Until U . As a result, the complexity of the class of formulas that have first-order correspondents also increases accordingly. In this paper, we identify a significant class of LTL Sahlqvist formulas built by using modal operators F , G, X, and U . The main result of this paper is to prove the correspondence of LTL Sahlqvist formulas to frame conditions that are definable in first-order language.

cs.LO↗

arXiv2022

Transformer Meets Convolution: A Bilateral Awareness Network for Semantic Segmentation of Very Fine Resolution Urban Scene Images

Semantic segmentation from very fine resolution (VFR) urban scene images plays a significant role in several application scenarios including autonomous driving, land cover classification, and urban planning, etc. However, the tremendous details contained in the VFR image, especially the considerable variations in scale and appearance of objects, severely limit the potential of the existing deep learning approaches. Addressing such issues represents a promising research field in the remote sensing community, which paves the way for scene-level landscape pattern analysis and decision making. In this paper, we propose a Bilateral Awareness Network which contains a dependency path and a texture path to fully capture the long-range relationships and fine-grained details in VFR images. Specifically, the dependency path is conducted based on the ResT, a novel Transformer backbone with memory-efficient multi-head self-attention, while the texture path is built on the stacked convolution operation. Besides, using the linear attention mechanism, a feature aggregation module is designed to effectively fuse the dependency features and texture features. Extensive experiments conducted on the three large-scale urban scene image segmentation datasets, i.e., ISPRS Vaihingen dataset, ISPRS Potsdam dataset, and UAVid dataset, demonstrate the effectiveness of our BANet. Specifically, a 64.6% mIoU is achieved on the UAVid dataset. Code is available at https://github.com/WangLibo1995/GeoSeg.

cs.CV↗

arXiv2022

A Novel Transformer Based Semantic Segmentation Scheme for Fine-Resolution Remote Sensing Images

The fully convolutional network (FCN) with an encoder-decoder architecture has been the standard paradigm for semantic segmentation. The encoder-decoder architecture utilizes an encoder to capture multilevel feature maps, which are incorporated into the final prediction by a decoder. As the context is crucial for precise segmentation, tremendous effort has been made to extract such information in an intelligent fashion, including employing dilated/atrous convolutions or inserting attention modules. However, these endeavors are all based on the FCN architecture with ResNet or other backbones, which cannot fully exploit the context from the theoretical concept. By contrast, we introduce the Swin Transformer as the backbone to extract the context information and design a novel decoder of densely connected feature aggregation module (DCFAM) to restore the resolution and produce the segmentation map. The experimental results on two remotely sensed semantic segmentation datasets demonstrate the effectiveness of the proposed scheme.Code is available at https://github.com/WangLibo1995/GeoSeg

cs.CV↗

arXiv2022

A Look at Improving Robustness in Visual-inertial SLAM by Moment Matching

The fusion of camera sensor and inertial data is a leading method for ego-motion tracking in autonomous and smart devices. State estimation techniques that rely on non-linear filtering are a strong paradigm for solving the associated information fusion task. The de facto inference method in this space is the celebrated extended Kalman filter (EKF), which relies on first-order linearizations of both the dynamical and measurement model. This paper takes a critical look at the practical implications and limitations posed by the EKF, especially under faulty visual feature associations and the presence of strong confounding noise. As an alternative, we revisit the assumed density formulation of Bayesian filtering and employ a moment matching (unscented Kalman filtering) approach to both visual-inertial odometry and visual SLAM. Our results highlight important aspects in robustness both in dynamics propagation and visual measurement updates, and we show state-of-the-art results on EuRoC MAV drone data benchmark.

cs.RO↗

arXiv2022

Low-energy subband wave-functions and effective $g$-factor of one-dimensional hole gas

One-dimensional (1D) hole gas confined in a cylindrical Ge nanowire has potential applications in quantum information technologies. Here, we analytically study the low-energy properties of this 1D hole gas. The subbands of the hole gas are two-fold degenerate. The low-energy subband wave-functions are obtained exactly, and the degenerate pairs are related to each other via a combination of the time-reversal and the spin-rotation transformations. In evaluating the effective $g$-factor of these low-energy subbands, the orbital effects of the magnetic field are shown to contribute as strongly as the Zeeman term. Also, near the center of the $k_{z}$ space, there is a sharp dip or a sharp peak in the effective $g$-factor. At the site $k_{z}=0$, the longitudinal $g$-factor $g_{l}$ is much less than the transverse $g$-factor $g_{t}$ for the lowest subband, while away from the site $k_{z}=0$, $g_{l}$ can be comparable to $g_{t}$.

cond-mat.mes-hall↗

arXiv2022

Searching strong `spin'-orbit coupled one-dimensional hole gas in strong magnetic fields

We show that a strong `spin'-orbit coupled one-dimensional (1D) hole gas is achievable via applying a strong magnetic field to the original two-fold degenerate (spin degeneracy) hole gas confined in a cylindrical Ge nanowire. Both strong longitudinal and strong transverse magnetic fields are feasible to achieve this goal. Based on quasi-degenerate perturbation calculations, we show the induced low-energy subband dispersion of the hole gas can be written as $E=\hbar^{2}k^{2}_{z}/(2m^{*}_{h})+ασ^{z}k_{z}+g^{*}_{h}μ_{B}Bσ^{x}/2$, a form exactly the same as that of the electron gas in the conduction band. Here the Pauli matrices $σ^{z,x}$ represent a pseudo spin (or `spin' ), because the real spin degree of freedom has been split off from the subband dispersions by the strong magnetic field. Also, for a moderate nanowire radius $R=10$ nm, the induced effective hole mass $m^{*}_{h}$ ($0.065\sim0.08~m_{e}$) and the `spin'-orbit coupling $α$ ($0.35\sim0.8$ eV~Å) have a small magnetic field dependence in the studied magnetic field interval $1<B<15$ T, while the effective $g$-factor $g^{*}_{h}$ of the hole `spin' only has a small magnetic field dependence in the large field region.

cond-mat.mes-hall↗

arXiv2022

MACU-Net for Semantic Segmentation of Fine-Resolution Remotely Sensed Images

Semantic segmentation of remotely sensed images plays an important role in land resource management, yield estimation, and economic assessment. U-Net, a deep encoder-decoder architecture, has been used frequently for image segmentation with high accuracy. In this Letter, we incorporate multi-scale features generated by different layers of U-Net and design a multi-scale skip connected and asymmetric-convolution-based U-Net (MACU-Net), for segmentation using fine-resolution remotely sensed images. Our design has the following advantages: (1) The multi-scale skip connections combine and realign semantic features contained in both low-level and high-level feature maps; (2) the asymmetric convolution block strengthens the feature representation and feature extraction capability of a standard convolution layer. Experiments conducted on two remotely sensed datasets captured by different satellite sensors demonstrate that the proposed MACU-Net transcends the U-Net, U-NetPPL, U-Net 3+, amongst other benchmark approaches. Code is available at https://github.com/lironui/MACU-Net.

eess.IV↗

arXiv2022

Unsupervised Multi-Modal Medical Image Registration via Discriminator-Free Image-to-Image Translation

In clinical practice, well-aligned multi-modal images, such as Magnetic Resonance (MR) and Computed Tomography (CT), together can provide complementary information for image-guided therapies. Multi-modal image registration is essential for the accurate alignment of these multi-modal images. However, it remains a very challenging task due to complicated and unknown spatial correspondence between different modalities. In this paper, we propose a novel translation-based unsupervised deformable image registration approach to convert the multi-modal registration problem to a mono-modal one. Specifically, our approach incorporates a discriminator-free translation network to facilitate the training of the registration network and a patchwise contrastive loss to encourage the translation network to preserve object shapes. Furthermore, we propose to replace an adversarial loss, that is widely used in previous multi-modal image registration methods, with a pixel loss in order to integrate the output of translation into the target modality. This leads to an unsupervised method requiring no ground-truth deformation or pairs of aligned images for training. We evaluate four variants of our approach on the public Learn2Reg 2021 datasets \cite{hering2021learn2reg}. The experimental results demonstrate that the proposed architecture achieves state-of-the-art performance. Our code is available at https://github.com/heyblackC/DFMIR.

cs.CV↗

arXiv2022

HASA: Hybrid Architecture Search with Aggregation Strategy for Echinococcosis Classification and Ovary Segmentation in Ultrasound Images

Different from handcrafted features, deep neural networks can automatically learn task-specific features from data. Due to this data-driven nature, they have achieved remarkable success in various areas. However, manual design and selection of suitable network architectures are time-consuming and require substantial effort of human experts. To address this problem, researchers have proposed neural architecture search (NAS) algorithms which can automatically generate network architectures but suffer from heavy computational cost and instability if searching from scratch. In this paper, we propose a hybrid NAS framework for ultrasound (US) image classification and segmentation. The hybrid framework consists of a pre-trained backbone and several searched cells (i.e., network building blocks), which takes advantage of the strengths of both NAS and the expert knowledge from existing convolutional neural networks. Specifically, two effective and lightweight operations, a mixed depth-wise convolution operator and a squeeze-and-excitation block, are introduced into the candidate operations to enhance the variety and capacity of the searched cells. These two operations not only decrease model parameters but also boost network performance. Moreover, we propose a re-aggregation strategy for the searched cells, aiming to further improve the performance for different vision tasks. We tested our method on two large US image datasets, including a 9-class echinococcosis dataset containing 9566 images for classification and an ovary dataset containing 3204 images for segmentation. Ablation experiments and comparison with other handcrafted or automatically searched architectures demonstrate that our method can generate more powerful and lightweight models for the above US image classification and segmentation tasks.

cs.CV↗