arXiv subjects

Mengmeng Wang

Publications and source records attributed to Mengmeng Wang.

At least 91 records · Page 5Linked to original sources

arXiv2021

Structure-aware Person Image Generation with Pose Decomposition and Semantic Correlation

In this paper we tackle the problem of pose guided person image generation, which aims to transfer a person image from the source pose to a novel target pose while maintaining the source appearance. Given the inefficiency of standard CNNs in handling large spatial transformation, we propose a structure-aware flow based method for high-quality person image generation. Specifically, instead of learning the complex overall pose changes of human body, we decompose the human body into different semantic parts (e.g., head, torso, and legs) and apply different networks to predict the flow fields for these parts separately. Moreover, we carefully design the network modules to effectively capture the local and global semantic correlations of features within and among the human parts respectively. Extensive experimental results show that our method can generate high-quality results under large pose discrepancy and outperforms state-of-the-art methods in both qualitative and quantitative comparisons.

cs.CV↗

arXiv2020

HR-Depth: High Resolution Self-Supervised Monocular Depth Estimation

Self-supervised learning shows great potential in monoculardepth estimation, using image sequences as the only source ofsupervision. Although people try to use the high-resolutionimage for depth estimation, the accuracy of prediction hasnot been significantly improved. In this work, we find thecore reason comes from the inaccurate depth estimation inlarge gradient regions, making the bilinear interpolation er-ror gradually disappear as the resolution increases. To obtainmore accurate depth estimation in large gradient regions, itis necessary to obtain high-resolution features with spatialand semantic information. Therefore, we present an improvedDepthNet, HR-Depth, with two effective strategies: (1) re-design the skip-connection in DepthNet to get better high-resolution features and (2) propose feature fusion Squeeze-and-Excitation(fSE) module to fuse feature more efficiently.Using Resnet-18 as the encoder, HR-Depth surpasses all pre-vious state-of-the-art(SoTA) methods with the least param-eters at both high and low resolution. Moreover, previousstate-of-the-art methods are based on fairly complex and deepnetworks with a mass of parameters which limits their realapplications. Thus we also construct a lightweight networkwhich uses MobileNetV3 as encoder. Experiments show thatthe lightweight network can perform on par with many largemodels like Monodepth2 at high-resolution with only20%parameters. All codes and models will be available at https://github.com/shawLyu/HR-Depth.

cs.CV↗

arXiv2020

Minimal flag triangulations of lower-dimensional manifolds

We prove the following results on flag triangulations of 2- and 3-manifolds. In dimension 2, we prove that the vertex-minimal flag triangulations of $\mathbb{R} P^2$ and $\mathbb{S}^1\times \mathbb{S}^1$ have 11 and 12 vertices, respectively. In general, we show that $8+3k$ (resp. $8+4k$) vertices suffice to obtain a flag triangulation of the connected sum of $k$ copies of $\mathbb{R} P^2$ (resp. $\mathbb{S}^1\times \mathbb{S}^1$). In dimension 3, we describe an algorithm based on the Lutz-Nevo theorem which provides supporting computational evidence for the following generalization of the Charney-Davis conjecture: for any flag 3-manifold, $γ_2:=f_1-5f_0+16\geq 16 β_1$, where $f_i$ is the number of $i$-dimensional faces and $β_1$ is the first Betti number over a field. The conjecture is tight in the sense that for any value of $β_1$, there exists a flag 3-manifold for which the equality holds.

math.CO↗

arXiv2020

Collaborative Distillation in the Parameter and Spectrum Domains for Video Action Recognition

Recent years have witnessed the significant progress of action recognition task with deep networks. However, most of current video networks require large memory and computational resources, which hinders their applications in practice. Existing knowledge distillation methods are limited to the image-level spatial domain, ignoring the temporal and frequency information which provide structural knowledge and are important for video analysis. This paper explores how to train small and efficient networks for action recognition. Specifically, we propose two distillation strategies in the frequency domain, namely the feature spectrum and parameter distribution distillations respectively. Our insight is that appealing performance of action recognition requires \textit{explicitly} modeling the temporal frequency spectrum of video features. Therefore, we introduce a spectrum loss that enforces the student network to mimic the temporal frequency spectrum from the teacher network, instead of \textit{implicitly} distilling features as many previous works. Second, the parameter frequency distribution is further adopted to guide the student network to learn the appearance modeling process from the teacher. Besides, a collaborative learning strategy is presented to optimize the training process from a probabilistic view. Extensive experiments are conducted on several action recognition benchmarks, such as Kinetics, Something-Something, and Jester, which consistently verify effectiveness of our approach, and demonstrate that our method can achieve higher performance than state-of-the-art methods with the same backbone.

cs.CV↗

arXiv2020

Semantic Graph Based Place Recognition for 3D Point Clouds

Due to the difficulty in generating the effective descriptors which are robust to occlusion and viewpoint changes, place recognition for 3D point cloud remains an open issue. Unlike most of the existing methods that focus on extracting local, global, and statistical features of raw point clouds, our method aims at the semantic level that can be superior in terms of robustness to environmental changes. Inspired by the perspective of humans, who recognize scenes through identifying semantic objects and capturing their relations, this paper presents a novel semantic graph based approach for place recognition. First, we propose a novel semantic graph representation for the point cloud scenes by reserving the semantic and topological information of the raw point cloud. Thus, place recognition is modeled as a graph matching problem. Then we design a fast and effective graph similarity network to compute the similarity. Exhaustive evaluations on the KITTI dataset show that our approach is robust to the occlusion as well as viewpoint changes and outperforms the state-of-the-art methods with a large margin. Our code is available at: \url{https://github.com/kxhit/SG_PR}.

cs.CV↗

arXiv2020

The 'Letter' Distribution in the Chinese Language

Corpus-based statistical analysis plays a significant role in linguistic research, and ample evidence has shown that different languages exhibit some common laws. Studies have found that letters in some alphabetic writing languages have strikingly similar statistical usage frequency distributions. Does this hold for Chinese, which employs ideogram writing? We obtained letter frequency data of some alphabetic writing languages and found the common law of the letter distributions. In addition, we collected Chinese literature corpora for different historical periods from the Tang Dynasty to the present, and we dismantled the Chinese written language into three kinds of basic particles: characters, strokes and constructive parts. The results of the statistical analysis showed that, in different historical periods, the intensity of the use of basic particles in Chinese writing varied, but the form of the distribution was consistent. In particular, the distributions of the Chinese constructive parts are certainly consistent with those alphabetic writing languages. This study provides new evidence of the consistency of human languages.

cs.CL↗

arXiv2020

FReeNet: Multi-Identity Face Reenactment

This paper presents a novel multi-identity face reenactment framework, named FReeNet, to transfer facial expressions from an arbitrary source face to a target face with a shared model. The proposed FReeNet consists of two parts: Unified Landmark Converter (ULC) and Geometry-aware Generator (GAG). The ULC adopts an encode-decoder architecture to efficiently convert expression in a latent landmark space, which significantly narrows the gap of the face contour between source and target identities. The GAG leverages the converted landmark to reenact the photorealistic image with a reference image of the target person. Moreover, a new triplet perceptual loss is proposed to force the GAG module to learn appearance and geometry information simultaneously, which also enriches facial details of the reenacted images. Further experiments demonstrate the superiority of our approach for generating photorealistic and expression-alike faces, as well as the flexibility for transferring facial expressions between identities.

cs.CV↗

arXiv2020

Extended Feature Pyramid Network for Small Object Detection

Small object detection remains an unsolved challenge because it is hard to extract information of small objects with only a few pixels. While scale-level corresponding detection in feature pyramid network alleviates this problem, we find feature coupling of various scales still impairs the performance of small objects. In this paper, we propose extended feature pyramid network (EFPN) with an extra high-resolution pyramid level specialized for small object detection. Specifically, we design a novel module, named feature texture transfer (FTT), which is used to super-resolve features and extract credible regional details simultaneously. Moreover, we design a foreground-background-balanced loss function to alleviate area imbalance of foreground and background. In our experiments, the proposed EFPN is efficient on both computation and memory, and yields state-of-the-art results on small traffic-sign dataset Tsinghua-Tencent 100K and small category of general object detection dataset MS COCO.

cs.CV↗

arXiv2020

Realistic Face Reenactment via Self-Supervised Disentangling of Identity and Pose

Recent works have shown how realistic talking face images can be obtained under the supervision of geometry guidance, e.g., facial landmark or boundary. To alleviate the demand for manual annotations, in this paper, we propose a novel self-supervised hybrid model (DAE-GAN) that learns how to reenact face naturally given large amounts of unlabeled videos. Our approach combines two deforming autoencoders with the latest advances in the conditional generation. On the one hand, we adopt the deforming autoencoder to disentangle identity and pose representations. A strong prior in talking face videos is that each frame can be encoded as two parts: one for video-specific identity and the other for various poses. Inspired by that, we utilize a multi-frame deforming autoencoder to learn a pose-invariant embedded face for each video. Meanwhile, a multi-scale deforming autoencoder is proposed to extract pose-related information for each frame. On the other hand, the conditional generator allows for enhancing fine details and overall reality. It leverages the disentangled features to generate photo-realistic and pose-alike face images. We evaluate our model on VoxCeleb1 and RaFD dataset. Experiment results demonstrate the superior quality of reenacted images and the flexibility of transferring facial movements between identities.

cs.CV↗

arXiv2019

3D characterization of the primary Al3Sc phases in an Al-Sc alloy using Synchrotron X-ray tomography and electron microscopy

The three-dimensional structures of the primary Al3Sc particles in an Al-2Sc master alloy were studied by synchrotron X-ray microtomography, scanning and transmission electron microscopy. The Al3Sc phases were found to be a single cube and a cluster of cubes. The surface area, equivalent diameter of the Al3Sc cubes increased with the increasing of cube volume, but the specific surface area decreases. The primary Al3Sc cubes and Al-matrix have the same crystal orientation, indicating that the Al3Sc phases are the heterogeneous nucleation sites for Al. The experimental results show that α-Al2O3 are the possible nucleation sites for the Al3Sc cubes.

cond-mat.mtrl-sci↗

arXiv2019

STM: SpatioTemporal and Motion Encoding for Action Recognition

Spatiotemporal and motion features are two complementary and crucial information for video action recognition. Recent state-of-the-art methods adopt a 3D CNN stream to learn spatiotemporal features and another flow stream to learn motion features. In this work, we aim to efficiently encode these two features in a unified 2D framework. To this end, we first propose an STM block, which contains a Channel-wise SpatioTemporal Module (CSTM) to present the spatiotemporal features and a Channel-wise Motion Module (CMM) to efficiently encode motion features. We then replace original residual blocks in the ResNet architecture with STM blcoks to form a simple yet effective STM network by introducing very limited extra computation cost. Extensive experiments demonstrate that the proposed STM network outperforms the state-of-the-art methods on both temporal-related datasets (i.e., Something-Something v1 & v2 and Jester) and scene-related datasets (i.e., Kinetics-400, UCF-101, and HMDB-51) with the help of encoding spatiotemporal and motion features together.

cs.CV↗

arXiv2018

Superconductivity in a misfit layered compound (SnSe)$_{1.16}$(NbSe$_2$)

The large size single crystals of (SnSe)$_{1.16}$(NbSe$_2$) misfit layered compound were grown and superconductivity with $T_c$ of 3.4 K was first discovered in this system. Powder X-ray diffraction (XRD) and high resolution transmission electron microscopy (HRTEM) clearly display the misfit feature between SnSe and NbSe$_2$ subsystems. The Sommerfeld coefficient $γ$ inferred from specific-heat measurements is 16.73 mJ mol$^{-1}$ K$^{-2}$, slightly larger than the usual misfit compounds. The normalized specific heat jump $Δ$$C_e$/$γ$$T_{\rm c}$ is about 0.98, and the electron-phonon coupling constant $λ$$_{e-ph}$ is estimated to be 0.80. The estimated value of the in-plane upper critical magnetic field, $H_{c2}^{ab}$(0), is about 7.82 T, exceeding the Pauli paramagnetic limit slightly. Both the specific-heat and $H_{c2}$ data suggest that (SnSe)$_{1.16}$(NbSe$_2$) is a multi-band superconductor.

cond-mat.supr-con↗

arXiv2018

Pressure induced superconductivity bordering a charge-density-wave state in NbTe4 with strong spinorbit coupling

Transition-metal chalcogenides host various phases of matter, such as charge-density wave (CDW), superconductors, and topological insulators or semimetals. Superconductivity and its competition with CDW in low-dimensional compounds have attracted much interest and stimulated considerable research. Here we report pressure induced superconductivity in a strong spin-orbit (SO) coupled quasi-one-dimensional (1D) transition-metal chalcogenide NbTe$_4$, which is a CDW material under ambient pressure. With increasing pressure, the CDW transition temperature is gradually suppressed, and superconducting transition, which is fingerprinted by a steep resistivity drop, emerges at pressures above 12.4 GPa. Under pressure $p$ = 69 GPa, zero resistance is detected with a transition temperature $T_c$ = 2.2 K and an upper critical field $H_{c2}$= 2 T. We also find large magnetoresistance (MR) up to 102\% at low temperatures, which is a distinct feature differentiating NbTe$_4$ from other conventional CDW materials.

cond-mat.supr-con↗

arXiv2018

Superconductivity in tantalum self-intercalated 4$Ha$-Ta$_{1.03}$Se$_2$

TaSe$_2$ has several different polytypes and abundant physical properties such as superconductivity and charge density waves (CDW), which had been investigated in the past few decades. However, there is no report on the physical properties of 4$Ha$ polytype up to now. Here we report the crystal growth and discovery of superconductivity in the tantalum self-intercalated 4$Ha$-Ta$_{1.03}$Se$_2$ single crystal with a superconducting transition onset temperature $T_{\rm c}$ $\approx$ 2.7 K, which is the first observation of superconductivity in 4$Ha$ polytype of TaSe$_2$. A slightly suppressed CDW transition is found around 106 K. A large $μ_0H_{\rm c2}/T_{\rm c}$ value of about 4.48 is found when magnetic field is applied in the $ab$ plane, which probably results from the enhanced spin-orbit coupling(SOC). Special stacking faults are observed, which further enhance the anisotropy. Although the density of states at the Fermi level is lower than that of other polytypes, $T_{\rm c}$ remains the same, indicating the stack mode of 4$Ha$ polytype may be beneficial to superconductivity in TaSe$_2$.

cond-mat.supr-con↗

arXiv2017

Large Margin Object Tracking with Circulant Feature Maps

Structured output support vector machine (SVM) based tracking algorithms have shown favorable performance recently. Nonetheless, the time-consuming candidate sampling and complex optimization limit their real-time applications. In this paper, we propose a novel large margin object tracking method which absorbs the strong discriminative ability from structured output SVM and speeds up by the correlation filter algorithm significantly. Secondly, a multimodal target detection technique is proposed to improve the target localization precision and prevent model drift introduced by similar objects or background noise. Thirdly, we exploit the feedback from high-confidence tracking results to avoid the model corruption problem. We implement two versions of the proposed tracker with the representations from both conventional hand-crafted and deep convolution neural networks (CNNs) based features to validate the strong compatibility of the algorithm. The experimental results demonstrate that the proposed tracker performs superiorly against several state-of-the-art algorithms on the challenging benchmark sequences while runs at speed in excess of 80 frames per second. The source code and experimental results will be made publicly available.

cs.CV↗

arXiv2017

Real-time 3D Human Tracking for Mobile Robots with Multisensors

Acquiring the accurate 3-D position of a target person around a robot provides fundamental and valuable information that is applicable to a wide range of robotic tasks, including home service, navigation and entertainment. This paper presents a real-time robotic 3-D human tracking system which combines a monocular camera with an ultrasonic sensor by the extended Kalman filter (EKF). The proposed system consists of three sub-modules: monocular camera sensor tracking model, ultrasonic sensor tracking model and multi-sensor fusion. An improved visual tracking algorithm is presented to provide partial location estimation (2-D). The algorithm is designed to overcome severe occlusions, scale variation, target missing and achieve robust re-detection. The scale accuracy is further enhanced by the estimated 3-D information. An ultrasonic sensor array is employed to provide the range information from the target person to the robot and Gaussian Process Regression is used for partial location estimation (2-D). EKF is adopted to sequentially process multiple, heterogeneous measurements arriving in an asynchronous order from the vision sensor and the ultrasonic sensor separately. In the experiments, the proposed tracking system is tested in both simulation platform and actual mobile robot for various indoor and outdoor scenes. The experimental results show the superior performance of the 3-D tracking system in terms of both the accuracy and robustness.

cs.RO↗

arXiv2017

VBS ${\rm W}^\pm {\rm W}^\pm {\rm H}$ production at the HL-LHC and a 100 TeV pp-collider

${\rm W}^\pm {\rm W}^\pm {\rm H}$ production at hadron colliders through vector boson scattering is a so far unconsidered process, which leads to a clean signature of two same-sign charged leptons and two widely separated jets. This process is sensitive to the ${\rm HHH}$ and ${\rm WWHH}$ couplings and any deviation of these couplings from their SM predictions serves as direct evidence of new physics beyond the SM. In this paper we perform a Monte Carlo study of this process for the $\sqrt{s}=14$ TeV LHC and a $100$ TeV pp-collider, and provide projections of the constraints on the triple-Higgs and ${\rm WWHH}$ quartic couplings for these environments. In particular, we consider the impact of pileup on the expected sensitivity in this channel. Our analysis demonstrates that although the sensitivity to the ${\rm HHH}$ coupling is rather low, the ${\rm WWHH}$ coupling can be constrained in this channel within $\sim 100\%$ and $\sim 20\%$ at 95\% confidence level around the SM prediction at the HL-LHC and a 100 TeV pp-collider, respectively.

hep-ph↗

arXiv2016

Robust Object Tracking with a Hierarchical Ensemble Framework

Autonomous robots enjoy a wide popularity nowadays and have been applied in many applications, such as home security, entertainment, delivery, navigation and guidance. It is vital to robots to track objects accurately in these applications, so it is necessary to focus on tracking algorithms to improve the robustness and accuracy. In this paper, we propose a robust object tracking algorithm based on a hierarchical ensemble framework which can incorporate information including individual pixel features, local patches and holistic target models. The framework combines multiple ensemble models simultaneously instead of using a single ensemble model individually. A discriminative model which accounts for the matching degree of local patches is adopted via a bottom ensemble layer, and a generative model which exploits holistic templates is used to search for the object through the middle ensemble layer as well as an adaptive Kalman filter. We test the proposed tracker on challenging benchmark image sequences. Both qualitative and quantitative evaluations demonstrate that the proposed tracker performs superiorly against several state-of-the-art algorithms, especially when the appearance changes dramatically and the occlusions occur.

cs.CV↗