arXiv subjects

Yan Lu

Publications and source records attributed to Yan Lu.

At least 235 records · Page 13Linked to original sources

arXiv2021

Video Instance Segmentation by Instance Flow Assembly

Instance segmentation is a challenging task aiming at classifying and segmenting all object instances of specific classes. While two-stage box-based methods achieve top performances in the image domain, they cannot easily extend their superiority into the video domain. This is because they usually deal with features or images cropped from the detected bounding boxes without alignment, failing to capture pixel-level temporal consistency. We embrace the observation that bottom-up methods dealing with box-free features could offer accurate spacial correlations across frames, which can be fully utilized for object and pixel level tracking. We first propose our bottom-up framework equipped with a temporal context fusion module to better encode inter-frame correlations. Intra-frame cues for semantic segmentation and object localization are simultaneously extracted and reconstructed by corresponding decoders after a shared backbone. For efficient and robust tracking among instances, we introduce an instance-level correspondence across adjacent frames, which is represented by a center-to-center flow, termed as instance flow, to assemble messy dense temporal correspondences. Experiments demonstrate that the proposed method outperforms the state-of-the-art online methods (taking image-level input) on the challenging Youtube-VIS dataset.

cs.CV↗

arXiv2021

Self-Supervised Video Representation Learning with Meta-Contrastive Network

Self-supervised learning has been successfully applied to pre-train video representations, which aims at efficient adaptation from pre-training domain to downstream tasks. Existing approaches merely leverage contrastive loss to learn instance-level discrimination. However, lack of category information will lead to hard-positive problem that constrains the generalization ability of this kind of methods. We find that the multi-task process of meta learning can provide a solution to this problem. In this paper, we propose a Meta-Contrastive Network (MCN), which combines the contrastive learning and meta learning, to enhance the learning ability of existing self-supervised approaches. Our method contains two training stages based on model-agnostic meta learning (MAML), each of which consists of a contrastive branch and a meta branch. Extensive evaluations demonstrate the effectiveness of our method. For two downstream tasks, i.e., video action recognition and video retrieval, MCN outperforms state-of-the-art approaches on UCF101 and HMDB51 datasets. To be more specific, with R(2+1)D backbone, MCN achieves Top-1 accuracies of 84.8% and 54.5% for video action recognition, as well as 52.5% and 23.7% for video retrieval.

cs.CV↗

arXiv2021

Geometry Uncertainty Projection Network for Monocular 3D Object Detection

Geometry Projection is a powerful depth estimation method in monocular 3D object detection. It estimates depth dependent on heights, which introduces mathematical priors into the deep model. But projection process also introduces the error amplification problem, in which the error of the estimated height will be amplified and reflected greatly at the output depth. This property leads to uncontrollable depth inferences and also damages the training efficiency. In this paper, we propose a Geometry Uncertainty Projection Network (GUP Net) to tackle the error amplification problem at both inference and training stages. Specifically, a GUP module is proposed to obtains the geometry-guided uncertainty of the inferred depth, which not only provides high reliable confidence for each depth but also benefits depth learning. Furthermore, at the training stage, we propose a Hierarchical Task Learning strategy to reduce the instability caused by error amplification. This learning algorithm monitors the learning situation of each task by a proposed indicator and adaptively assigns the proper loss weights for different tasks according to their pre-tasks situation. Based on that, each task starts learning only when its pre-tasks are learned well, which can significantly improve the stability and efficiency of the training process. Extensive experiments demonstrate the effectiveness of the proposed method. The overall model can infer more reliable object depth than existing methods and outperforms the state-of-the-art image-based monocular 3D detectors by 3.74% and 4.7% AP40 of the car and pedestrian categories on the KITTI benchmark.

cs.CV↗

arXiv2021

Study on Outliers in the Big Stellar Spectral Dataset of the Fifth Data Release (DR5) of the Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST)

To study the quality of stellar spectra of the Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST) and the correctness of the corresponding stellar parameters derived by the LASP (LAMOST Stellar Parameter Pipeline), the outlier analysis method is applied to the archived AFGK stars in the fifth data release (DR5) of LAMOST. The outlier factor is defined in order to sort more than 3 million stellar spectra selected from the DR5 Stellar Parameter catalog. We propose an improved Local Outlier Factor (LOF) method based on Principal Component Analysis and Monte Carlo to enable the computation of the LOF rankings for randomly picked sub-samples that are computed in parallel by multiple computers, and finally to obtain the outlier ranking of each spectrum in the entire dataset. Totally 3,627 most outlier ranked spectra, around one-thousandth of all spectra, are selected and clustered into 10 groups, and the parameter density distribution of them conforms to the parameter distribution of LAMOST DR5, which suggests that in the whole parameter space the probability of bad spectra is uniformly distributed. By cross-matching the 3,627 spectra with APOGEE, we obtain 122 common ones. The published parameters calculated from LASP agree with APOGEE for the 122 spectra although there are bad pixels or bad flux calibrations in them. On the other hand, some outlier spectra show strong nebular contamination warning the corresponding parameters should be carefully used. A catalog and a spectral atlas of all the 3,627 outliers can be found at the link http://paperdata.china-vo.org/LY_paper/dr5Outlier/dr5Outlier_resource.zip.

astro-ph.SR↗

arXiv2021

Rotational Velocities of Am and Non-CP Stars based on Kepler and LAMOST DR5

Rotation is a critical physical process operating in the formation of Am stars. There is a strong correlation between low-velocity rotation and chemical peculiarity. However, the existence of many non-CP slow rotators challenges the understanding of Am stars. The purpose of our work is to search for low-velocity rotating non-CP A-type stars and Am stars and to make a comparative analysis. In this paper, we pick out a sample from the LAMOST-Kepler project, including 21 Am stars, 125 non-CP slow rotators, and 53 non-CP fast rotators. We calculate the rotational frequencies through periodic change of light curves caused by inhomogeneous stellar surfaces and then obtain the rotational velocities. For slow rotators, the age of Am stars is statistically younger than that of non-CP stars in the same temperature bin. In the comparison of the period, the average amplitude, and stellar mass of Am and non-CP stars, we discover that there is no difference in the photometric variability between Am and non-CP stars, which implies similar inhomogeneities on the surfaces. The average amplitude of non-CP stars has a downward trend with the increase of effective temperature and stellar mass, which is consistent with the theoretical prediction caused by weak dynamo-generated magnetic fields in A-type stars. In addition, we confirm four non-non-CP stars which have flares by checking FOV images, 24 pixel images, and pixel-level light curves.

astro-ph.SR↗

arXiv2021

A catalog of early-type Hα emission line stars and 58 newly confirmed Herbig Ae/Bes from LAMOST DR7

We derive a catalog of early-type emission-line stars including 30,048 spectra of 25,886 stars from LAMOST DR7, in which 3,922 have Simbad records. The sample is obtained using K-Nearest Neighbor and Random Forest methods and visually inspected. The spectra are classified into 3 morphological types (10 subtypes) based on H$α$ emission line profiles. Some spectra contaminated by nebula emission lines such as from HII regions are flagged in the catalog. We also provide a specific sub-catalog of 101 stars with the stellar wind by calculating stellar wind or accretion flow velocities based on P Cygni or inverse P Cygni profiles, in which 74\% of them having velocities below 400km/s. More important, with two color-color diagrams (H-K, K- W1) and (H-K, J-H) of a collection of known Herbig Ae/Be stars (HAeBes) and classical Ae/Be stars (CAeBes), we propose an updated criterion to separate HAeBes from CAeBes. By the criterion, we select 201 HAeBes candidates and 5,547 CAeBes candidates from the sample. We confirmed 66 of the 201 HAeBes by using both WISE images and LAMOST spectra and present a specific HAeBe sub-catalog, in which 58 are newly identified. In addition, the WISE colors (W1-W2, W1- W3, and W1-W4) show the distribution consistency between our confirmed HAeBes and that of the known HAeBes. Most of the 66 confirmed HAeBes locate in the lower edge of the main sequence of hot end in the HR diagram, while the distances of about 77\% exceed 1Kpc, which enlarges the number of far distant known HAeBes.

astro-ph.SR↗

arXiv2021

SSAN: Separable Self-Attention Network for Video Representation Learning

Self-attention has been successfully applied to video representation learning due to the effectiveness of modeling long range dependencies. Existing approaches build the dependencies merely by computing the pairwise correlations along spatial and temporal dimensions simultaneously. However, spatial correlations and temporal correlations represent different contextual information of scenes and temporal reasoning. Intuitively, learning spatial contextual information first will benefit temporal modeling. In this paper, we propose a separable self-attention (SSA) module, which models spatial and temporal correlations sequentially, so that spatial contexts can be efficiently used in temporal modeling. By adding SSA module into 2D CNN, we build a SSA network (SSAN) for video representation learning. On the task of video action recognition, our approach outperforms state-of-the-art methods on Something-Something and Kinetics-400 datasets. Our models often outperform counterparts with shallower network and fewer modalities. We further verify the semantic learning ability of our method in visual-language task of video retrieval, which showcases the homogeneity of video representations and text embeddings. On MSR-VTT and Youcook2 datasets, video representations learnt by SSA significantly improve the state-of-the-art performance.

cs.CV↗

arXiv2021

MonoGRNet: A General Framework for Monocular 3D Object Detection

Detecting and localizing objects in the real 3D space, which plays a crucial role in scene understanding, is particularly challenging given only a monocular image due to the geometric information loss during imagery projection. We propose MonoGRNet for the amodal 3D object detection from a monocular image via geometric reasoning in both the observed 2D projection and the unobserved depth dimension. MonoGRNet decomposes the monocular 3D object detection task into four sub-tasks including 2D object detection, instance-level depth estimation, projected 3D center estimation and local corner regression. The task decomposition significantly facilitates the monocular 3D object detection, allowing the target 3D bounding boxes to be efficiently predicted in a single forward pass, without using object proposals, post-processing or the computationally expensive pixel-level depth estimation utilized by previous methods. In addition, MonoGRNet flexibly adapts to both fully and weakly supervised learning, which improves the feasibility of our framework in diverse settings. Experiments are conducted on KITTI, Cityscapes and MS COCO datasets. Results demonstrate the promising performance of our framework in various scenarios.

cs.CV↗

arXiv2021

Interactive Speech and Noise Modeling for Speech Enhancement

Speech enhancement is challenging because of the diversity of background noise types. Most of the existing methods are focused on modelling the speech rather than the noise. In this paper, we propose a novel idea to model speech and noise simultaneously in a two-branch convolutional neural network, namely SN-Net. In SN-Net, the two branches predict speech and noise, respectively. Instead of information fusion only at the final output layer, interaction modules are introduced at several intermediate feature domains between the two branches to benefit each other. Such an interaction can leverage features learned from one branch to counteract the undesired part and restore the missing component of the other and thus enhance their discrimination capabilities. We also design a feature extraction module, namely residual-convolution-and-attention (RA), to capture the correlations along temporal and frequency dimensions for both the speech and the noises. Evaluations on public datasets show that the interaction module plays a key role in simultaneous modeling and the SN-Net outperforms the state-of-the-art by a large margin on various evaluation metrics. The proposed SN-Net also shows superior performance for speaker separation.

eess.AS↗

arXiv2021

Phoneme-based Distribution Regularization for Speech Enhancement

Existing speech enhancement methods mainly separate speech from noises at the signal level or in the time-frequency domain. They seldom pay attention to the semantic information of a corrupted signal. In this paper, we aim to bridge this gap by extracting phoneme identities to help speech enhancement. Specifically, we propose a phoneme-based distribution regularization (PbDr) for speech enhancement, which incorporates frame-wise phoneme information into speech enhancement network in a conditional manner. As different phonemes always lead to different feature distributions in frequency, we propose to learn a parameter pair, i.e. scale and bias, through a phoneme classification vector to modulate the speech enhancement network. The modulation parameter pair includes not only frame-wise but also frequency-wise conditions, which effectively map features to phoneme-related distributions. In this way, we explicitly regularize speech enhancement features by recognition vectors. Experiments on public datasets demonstrate that the proposed PbDr module can not only boost the perceptual quality for speech enhancement but also the recognition accuracy of an ASR system on the enhanced speech. This PbDr module could be readily incorporated into other speech enhancement networks as well.

eess.AS↗

arXiv2021

Switchable enhanced spin photocurrent in Rashba and cubic Dresselhaus ferroelectric semiconductors

Generating and controlling spin current (SC) are of central interest in spin physics and applications. To date, the spin-orbit interaction (SOI) is an established pathway to generate SC through the spin-charge current conversion. We predict an efficient spin-light conversion via the Rashba and higher-order cubic Dresselhaus SOIs in ferroelectrics. Different from the known Edelstein effect, where SC is created by the nonequilibrium spin density, our predicted spin-polarized current is from direct interactions between light and unique spin textures generated by SOI in ferroelectrics. Using first-principles simulations, we demonstrate these concepts by calculating the DC spin photocurrent in a prototypical Rashba ferroelectric, α-GeTe. The photo-induced SC is about two orders of magnitude larger than the charge photocurrent. More importantly, we can conveniently switch the direction of SC by an applied electric field via inverting the spin textures. These predictions give hope to generating and controlling light-driven SC via nonvolatile electric-field.

cond-mat.mtrl-sci↗

arXiv2021

Custom Object Detection via Multi-Camera Self-Supervised Learning

This paper proposes MCSSL, a self-supervised learning approach for building custom object detection models in multi-camera networks. MCSSL associates bounding boxes between cameras with overlapping fields of view by leveraging epipolar geometry and state-of-the-art tracking and reID algorithms, and prudently generates two sets of pseudo-labels to fine-tune backbone and detection networks respectively in an object detection model. To train effectively on pseudo-labels,a powerful reID-like pretext task with consistency loss is constructed for model customization. Our evaluation shows that compared with legacy selftraining methods, MCSSL improves average mAP by 5.44% and 6.76% on WildTrack and CityFlow dataset, respectively.

cs.CV↗

arXiv2020

Weakly-supervised Temporal Action Localization by Uncertainty Modeling

Weakly-supervised temporal action localization aims to learn detecting temporal intervals of action classes with only video-level labels. To this end, it is crucial to separate frames of action classes from the background frames (i.e., frames not belonging to any action classes). In this paper, we present a new perspective on background frames where they are modeled as out-of-distribution samples regarding their inconsistency. Then, background frames can be detected by estimating the probability of each frame being out-of-distribution, known as uncertainty, but it is infeasible to directly learn uncertainty without frame-level labels. To realize the uncertainty learning in the weakly-supervised setting, we leverage the multiple instance learning formulation. Moreover, we further introduce a background entropy loss to better discriminate background frames by encouraging their in-distribution (action) probabilities to be uniformly distributed over all action classes. Experimental results show that our uncertainty modeling is effective at alleviating the interference of background frames and brings a large performance gain without bells and whistles. We demonstrate that our model significantly outperforms state-of-the-art methods on the benchmarks, THUMOS'14 and ActivityNet (1.2 & 1.3). Our code is available at https://github.com/Pilhyeon/WTAL-Uncertainty-Modeling.

cs.CV↗

arXiv2020

M Subdwarf Research. II. Atmospheric Parameters and Kinematics

Applying the revised M subdwarf classification criteria discussed in Paper I to LAMOST DR7, combining the M subdwarf sample from Savcheva et al, a new M subdwarf sample was constructed for further study. The atmospheric parameters for each object were derived fitting with the PHOENIX grid, combining with Gaia DR2, the relationship between the gravity and metallicity were explored according to the locus both in the color-absolute magnitude diagram and the reduced proper motion diagram. Objects that have both the largest gravity and the lowest metallicity are located away from the main-sequence cloud and may be considered as the intrinsic M subdwarfs, which can be classified as luminosity class VI. Another group of objects whose spectra show typical M subdwarf characters have lower gravity and relatively moderate metal deficiency and occupy part of the ordinary M dwarf region in both diagrams. The Galactic U , V , W space velocity components and their dispersion show that the local Galactic halo population sampled in the solar neighborhood is represented by objects of high gravity and an inconspicuous bimodal metallicity distribution, with a fraction of prograde orbits. The other M subdwarfs seem to partly belong to the thick disk component with a significant fraction of thin disk moderately metal-poor objects intricately mixed with them. However, the selection effects, especially the favored anti-center direction of investigation in the LAMOST sub-sample, but also contamination by multiplicity and parameter coupling could play important roles and need to be further investigated.

astro-ph.SR↗

arXiv2020

Double Dirac Cones and Topologically Non-Trivial Phonons for Continuous, Square Symmetric (C$_{4v}$ and C$_{2v}$) Unit Cells

Because phononic topological insulators have primarily been studied in discrete, graphene-like structures with C$_{6}$ or C$_{3}$ hexagonal symmetry, an open question is how to systematically achieve double Dirac cones and topologically non-trivial structures using continuous, non-hexagonal unit cells. Here, we address this challenge by presenting a novel computational methodology for the inverse design of continuous two-dimensional square phononic metamaterials exhibiting C$_{4v}$ and C$_{2v}$ symmetry. This leads to the systematic design of square unit cell topologies exhibiting a double Dirac degeneracy, which enables topologically-protected interface propagation based on the quantum spin Hall effect (QSHE). Numerical simulations prove that helical edge states emerge at the interface between two topologically distinct square phononic metamaterials, which opens the possibility of QSHE-based pseudospin-dependent transport beyond hexagonal lattices.

cond-mat.mes-hall↗

arXiv2020

Weakly Supervised 3D Object Detection from Point Clouds

A crucial task in scene understanding is 3D object detection, which aims to detect and localize the 3D bounding boxes of objects belonging to specific classes. Existing 3D object detectors heavily rely on annotated 3D bounding boxes during training, while these annotations could be expensive to obtain and only accessible in limited scenarios. Weakly supervised learning is a promising approach to reducing the annotation requirement, but existing weakly supervised object detectors are mostly for 2D detection rather than 3D. In this work, we propose VS3D, a framework for weakly supervised 3D object detection from point clouds without using any ground truth 3D bounding box for training. First, we introduce an unsupervised 3D proposal module that generates object proposals by leveraging normalized point cloud densities. Second, we present a cross-modal knowledge distillation strategy, where a convolutional neural network learns to predict the final results from the 3D object proposals by querying a teacher network pretrained on image datasets. Comprehensive experiments on the challenging KITTI dataset demonstrate the superior performance of our VS3D in diverse evaluation settings. The source code and pretrained models are publicly available at https://github.com/Zengyi-Qin/Weakly-Supervised-3D-Object-Detection.

cs.CV↗

arXiv2020

MonoGRNet: A Geometric Reasoning Network for Monocular 3D Object Localization

Detecting and localizing objects in the real 3D space, which plays a crucial role in scene understanding, is particularly challenging given only a single RGB image due to the geometric information loss during imagery projection. We propose MonoGRNet for the amodal 3D object detection from a monocular RGB image via geometric reasoning in both the observed 2D projection and the unobserved depth dimension. MonoGRNet is a single, unified network composed of four task-specific subnetworks, responsible for 2D object detection, instance depth estimation (IDE), 3D localization and local corner regression. Unlike the pixel-level depth estimation that needs per-pixel annotations, we propose a novel IDE method that directly predicts the depth of the targeting 3D bounding box's center using sparse supervision. The 3D localization is further achieved by estimating the position in the horizontal and vertical dimensions. Finally, MonoGRNet is jointly learned by optimizing the locations and poses of the 3D bounding boxes in the global context. We demonstrate that MonoGRNet achieves state-of-the-art performance on challenging datasets.

cs.CV↗

arXiv2020

Enhanced Catalytic Activity of Gold@Polydopamine Nanoreactors with Multi-compartment Structure Under NIR Irradiation

Photothermal conversion (PTC) nanostructures have great potential for applications in many fields, and therefore, they have attracted tremendous attention. However, the construction of a PTC nanoreactor with multi-compartment structure to achieve the combination of unique chemical properties and structural feature is still challenging due to the synthetic difficulties. Herein, we designed and synthesized a catalytically active, PTC gold (Au)@polydopamine (PDA) nanoreactor driven by infrared irradiation using assembled PS-b-P2VP nanosphere as soft template. The particles exhibit multi-compartment structure which is revealed by 3D electron tomography characterization technique. They feature permeable shells with tunable shell thickness. Full kinetics for the reduction reaction of 4-nitrophenol has been investigated using these particles as nanoreactors and compared with other reported systems. Notably, a remarkable acceleration of the catalytic reaction upon near-infrared irradiation is demonstrated, which reveals for the first time the importance of the synergistic effect of photothermal conversion and complex inner structure to the kinetics of the catalytic reduction. The ease of synthesis and fresh insights into catalysis will promote a new platform for novel nanoreactor studies.

physics.chem-ph↗