arXiv subjects

Yong Liu

Publications and source records attributed to Yong Liu.

At least 793 records · Page 44Linked to original sources

arXiv2021

From KP-I lump solution to travelling waves of Gross-Pitaevskii equation

Let $q(x,y)$ be an nondegenerate lump solution to KP-I (Kadomtsev-Petviashvili-I) equation $$\partial_x^4q-2\sqrt{2}\partial_x^2q-3\sqrt{2}\partial_x((\partial_xq) ^2)-2\partial_y^2q=0. $$ We prove the existence of a traveling wave solution $ u_{\e} (x-ct, y)$ to GP (Gross-Pitaevskii) equation $$ i\partial_{t}Ψ+ΔΨ+(1-|Ψ|^{2})Ψ=0,\ \ \ \mbox{in} \ {\mathbb R}^2 $$ in the transonic limit $$ c=\sqrt{2}-ε^2 $$ with $$ u_ε=1 + i εq(x,y) + {\mathcal O} (ε^2). $$ This proves the existence of finite energy solutions in the so-called Jones-Roberts program in the transonic range $ c \in (\sqrt{2}-ε^2, \sqrt{2})$. The main ingredients in our proof are detailed point-wise estimates of the Green function associated to a family of fourth order hypoelliptic operators $$\partial_x^4-(2\sqrt{2}-\e^2)\partial_x^2-2\partial_y^2+\e^2\partial_x^2\partial_y^2+\e^4\partial_y^4.$$

math.AP↗

arXiv2021

Explicitly Modeling the Discriminability for Instance-Aware Visual Object Tracking

Visual object tracking performance has been dramatically improved in recent years, but some severe challenges remain open, like distractors and occlusions. We suspect the reason is that the feature representations of the tracking targets are only expressively learned but not fully discriminatively modeled. In this paper, we propose a novel Instance-Aware Tracker (IAT) to explicitly excavate the discriminability of feature representations, which improves the classical visual tracking pipeline with an instance-level classifier. First, we introduce a contrastive learning mechanism to formulate the classification task, ensuring that every training sample could be uniquely modeled and be highly distinguishable from plenty of other samples. Besides, we design an effective negative sample selection scheme to contain various intra and inter classes in the instance classification branch. Furthermore, we implement two variants of the proposed IAT, including a video-level one and an object-level one. They realize the concept of \textbf{instance} in different granularity as videos and target bounding boxes, respectively. The former enhances the ability to recognize the target from the background while the latter boosts the discriminative power for mitigating the target-distractor dilemma. Extensive experimental evaluations on 8 benchmark datasets show that both two versions of the proposed IAT achieve leading results against state-of-the-art methods while running at 30FPS. Code will be available when it is published.

cs.CV↗

arXiv2021

Hierarchical Aspect-guided Explanation Generation for Explainable Recommendation

Explainable recommendation systems provide explanations for recommendation results to improve their transparency and persuasiveness. The existing explainable recommendation methods generate textual explanations without explicitly considering the user's preferences on different aspects of the item. In this paper, we propose a novel explanation generation framework, named Hierarchical Aspect-guided explanation Generation (HAG), for explainable recommendation. Specifically, HAG employs a review-based syntax graph to provide a unified view of the user/item details. An aspect-guided graph pooling operator is proposed to extract the aspect-relevant information from the review-based syntax graphs to model the user's preferences on an item at the aspect level. Then, a hierarchical explanation decoder is developed to generate aspects and aspect-relevant explanations based on the attention mechanism. The experimental results on three real datasets indicate that HAG outperforms state-of-the-art explanation generation methods in both single-aspect and multi-aspect explanation generation tasks, and also achieves comparable or even better preference prediction accuracy than strong baseline methods.

cs.CL↗

arXiv2021

3D Brain Reconstruction by Hierarchical Shape-Perception Network from a Single Incomplete Image

3D shape reconstruction is essential in the navigation of minimally-invasive and auto robot-guided surgeries whose operating environments are indirect and narrow, and there have been some works that focused on reconstructing the 3D shape of the surgical organ through limited 2D information available. However, the lack and incompleteness of such information caused by intraoperative emergencies (such as bleeding) and risk control conditions have not been considered. In this paper, a novel hierarchical shape-perception network (HSPN) is proposed to reconstruct the 3D point clouds (PCs) of specific brains from one single incomplete image with low latency. A branching predictor and several hierarchical attention pipelines are constructed to generate point clouds that accurately describe the incomplete images and then complete these point clouds with high quality. Meanwhile, attention gate blocks (AGBs) are designed to efficiently aggregate geometric local features of incomplete PCs transmitted by hierarchical attention pipelines and internal features of reconstructing point clouds. With the proposed HSPN, 3D shape perception and completion can be achieved spontaneously. Comprehensive results measured by Chamfer distance and PC-to-PC error demonstrate that the performance of the proposed HSPN outperforms other competitive methods in terms of qualitative displays, quantitative experiment, and classification evaluation.

eess.IV↗

arXiv2021

DecGAN: Decoupling Generative Adversarial Network detecting abnormal neural circuits for Alzheimer's disease

One of the main reasons for Alzheimer's disease (AD) is the disorder of some neural circuits. Existing methods for AD prediction have achieved great success, however, detecting abnormal neural circuits from the perspective of brain networks is still a big challenge. In this work, a novel decoupling generative adversarial network (DecGAN) is proposed to detect abnormal neural circuits for AD. Concretely, a decoupling module is designed to decompose a brain network into two parts: one part is composed of a few sparse graphs which represent the neural circuits largely determining the development of AD; the other part is a supplement graph, whose influence on AD can be ignored. Furthermore, the adversarial strategy is utilized to guide the decoupling module to extract the feature more related to AD. Meanwhile, by encoding the detected neural circuits to hypergraph data, an analytic module associated with the hyperedge neurons algorithm is designed to identify the neural circuits. More importantly, a novel sparse capacity loss based on the spatial-spectral hypergraph similarity is developed to minimize the intrinsic topological distribution of neural circuits, which can significantly improve the accuracy and robustness of the proposed model. Experimental results demonstrate that the proposed model can effectively detect the abnormal neural circuits at different stages of AD, which is helpful for pathological study and early treatment.

cs.LG↗

arXiv2021

A Prior Guided Adversarial Representation Learning and Hypergraph Perceptual Network for Predicting Abnormal Connections of Alzheimer's Disease

Alzheimer's disease is characterized by alterations of the brain's structural and functional connectivity during its progressive degenerative processes. Existing auxiliary diagnostic methods have accomplished the classification task, but few of them can accurately evaluate the changing characteristics of brain connectivity. In this work, a prior guided adversarial representation learning and hypergraph perceptual network (PGARL-HPN) is proposed to predict abnormal brain connections using triple-modality medical images. Concretely, a prior distribution from the anatomical knowledge is estimated to guide multimodal representation learning using an adversarial strategy. Also, the pairwise collaborative discriminator structure is further utilized to narrow the difference of representation distribution. Moreover, the hypergraph perceptual network is developed to effectively fuse the learned representations while establishing high-order relations within and between multimodal images. Experimental results demonstrate that the proposed model outperforms other related methods in analyzing and predicting Alzheimer's disease progression. More importantly, the identified abnormal connections are partly consistent with the previous neuroscience discoveries. The proposed model can evaluate characteristics of abnormal brain connections at different stages of Alzheimer's disease, which is helpful for cognitive disease study and early treatment.

cs.LG↗

arXiv2021

Quantum spin Hall effect in two-dimensional transition-metal chalcogenides

Based on first-principles calculations, we have found a family of 2D transition-metal (TM) chalcogenides MX5 (M = Zr, Hf and X = S, Se and Te) can host quantum spin Hall (QSH) effect. The molecular dynamics simulation indicate that they are all thermal-dynamically stable at room temperature, the largest band gap is 0.19 eV. We have investigated MX5's electronic properties and found their properties are very similar. The single-layer ZrX5 are all gapless semimetals without consideration of spin-orbit coupling (SOC). The consideration of SOC will result in insulating phases with band gaps of 0.05 eV (direct), 0.18 eV (direct) and 0.13 eV (indirect) for ZrS5, ZrSe5 to ZrTe5, respectively. The evolution of Wannier charge centers and edge states confirm they are all QSH insulators. The mechanisms for QSH effect in ZrX5 originate from the special nonsymmorphic space group features. In addition, the QSH state of ZrS5 survives at a large range of strain as long as the interchain coupling is not strong enough to reverse the band ordering. The single-layer ZrS5 will occur a topological insulator (TI)-to-semimetal (metal) or metal-to-semimetal transition under certain strain. Monolayer MX5 expand the TI materials based on TM chalcogenides and may open up a new way to fabricate novel low power spintronic devices at room temperature.

cond-mat.mtrl-sci↗

arXiv2021

Geometry-Entangled Visual Semantic Transformer for Image Captioning

Recent advancements of image captioning have featured Visual-Semantic Fusion or Geometry-Aid attention refinement. However, those fusion-based models, they are still criticized for the lack of geometry information for inter and intra attention refinement. On the other side, models based on Geometry-Aid attention still suffer from the modality gap between visual and semantic information. In this paper, we introduce a novel Geometry-Entangled Visual Semantic Transformer (GEVST) network to realize the complementary advantages of Visual-Semantic Fusion and Geometry-Aid attention refinement. Concretely, a Dense-Cap model proposes some dense captions with corresponding geometry information at first. Then, to empower GEVST with the ability to bridge the modality gap among visual and semantic information, we build four parallel transformer encoders VV(Pure Visual), VS(Semantic fused to Visual), SV(Visual fused to Semantic), SS(Pure Semantic) for final caption generation. Both visual and semantic geometry features are used in the Fusion module and also the Self-Attention module for better attention measurement. To validate our model, we conduct extensive experiments on the MS-COCO dataset, the experimental results show that our GEVST model can obtain promising performance gains.

cs.CV↗

arXiv2021

General Quantum Bernoulli Factory: Framework Analysis and Experiments

The unremitting pursuit for quantum advantages gives rise to the discovery of a quantum-enhanced randomness processing named quantum Bernoulli factory (QBF). This quantum enhanced process can show its priority over the corresponding classical process through readily available experimental resources, thus in the near term it may be capable of accelerating the applications of classical Bernoulli factories, such as the widely used sampling algorithms. In this work, we provide the framework analysis of the QBF. We thoroughly analyze the quantum state evolution in this process, discovering the field structure of the constructible quantum states. Our framework analysis shows that naturally, the previous works can be described as specific instances of this framework. Then, as a proof of principle, we experimentally demonstrate this framework via an entangled two-photon source along with a reconfigurable photonic logic, and show the advantages of the QBF over the classical model through a classically infeasible instance. These results may stimulate the discovery of advantages of the quantum randomness processing in a wider range of tasks, as well as its potential applications.

quant-ph↗

arXiv2021

Semantic Segmentation-assisted Scene Completion for LiDAR Point Clouds

Outdoor scene completion is a challenging issue in 3D scene understanding, which plays an important role in intelligent robotics and autonomous driving. Due to the sparsity of LiDAR acquisition, it is far more complex for 3D scene completion and semantic segmentation. Since semantic features can provide constraints and semantic priors for completion tasks, the relationship between them is worth exploring. Therefore, we propose an end-to-end semantic segmentation-assisted scene completion network, including a 2D completion branch and a 3D semantic segmentation branch. Specifically, the network takes a raw point cloud as input, and merges the features from the segmentation branch into the completion branch hierarchically to provide semantic information. By adopting BEV representation and 3D sparse convolution, we can benefit from the lower operand while maintaining effective expression. Besides, the decoder of the segmentation branch is used as an auxiliary, which can be discarded in the inference stage to save computational consumption. Extensive experiments demonstrate that our method achieves competitive performance on SemanticKITTI dataset with low latency. Code and models will be released at https://github.com/jokester-zzz/SSA-SC.

cs.CV↗

arXiv2021

TransVOS: Video Object Segmentation with Transformers

Recently, Space-Time Memory Network (STM) based methods have achieved state-of-the-art performance in semi-supervised video object segmentation (VOS). A crucial problem in this task is how to model the dependency both among different frames and inside every frame. However, most of these methods neglect the spatial relationships (inside each frame) and do not make full use of the temporal relationships (among different frames). In this paper, we propose a new transformer-based framework, termed TransVOS, introducing a vision transformer to fully exploit and model both the temporal and spatial relationships. Moreover, most STM-based approaches employ two separate encoders to extract features of two significant inputs, i.e., reference sets (history frames with predicted masks) and query frame (current frame), respectively, increasing the models' parameters and complexity. To slim the popular two-encoder pipeline while keeping the effectiveness, we design a single two-path feature extractor to encode the above two inputs in a unified way. Extensive experiments demonstrate the superiority of our TransVOS over state-of-the-art methods on both DAVIS and YouTube-VOS datasets.

cs.CV↗

arXiv2021

Strain Tunable Intrinsic Ferromagnetic in 2D Square CrBr$_2$

Two-dimensional (2D) intrinsic magnetic materials with high Curie temperature (Tc) coexisting with 100% spin-polarization are highly desirable for realizing promising spintronic devices. In the present work, the intrinsic magnetism of monolayer square CrBr2 is predicted by using first-principles calculations. The monolayer CrBr2 is an intrinsic ferromagnetic (FM) half-metal with the half-metallic gap of 1.58 eV. Monte Carlo simulations based on the Heisenberg model estimates Tc as 212 K. Furthermore, the large compressive strain makes CrBr2 undergo ferromagnetic-antiferromagnetic phase transition, when the biaxial tensile strain larger than 9.3% leads to the emergence of semiconducting electronic structures. Our results show that the intrinsic half-metal with a high Tc and controllable magnetic properties endow monolayer square CrBr2 a potential material for spintronic applications.

cond-mat.mtrl-sci↗

arXiv2021

ActionCLIP: A New Paradigm for Video Action Recognition

The canonical approach to video action recognition dictates a neural model to do a classic and standard 1-of-N majority vote task. They are trained to predict a fixed set of predefined categories, limiting their transferable ability on new datasets with unseen concepts. In this paper, we provide a new perspective on action recognition by attaching importance to the semantic information of label texts rather than simply mapping them into numbers. Specifically, we model this task as a video-text matching problem within a multimodal learning framework, which strengthens the video representation with more semantic language supervision and enables our model to do zero-shot action recognition without any further labeled data or parameters requirements. Moreover, to handle the deficiency of label texts and make use of tremendous web data, we propose a new paradigm based on this multimodal learning framework for action recognition, which we dub "pre-train, prompt and fine-tune". This paradigm first learns powerful representations from pre-training on a large amount of web image-text or video-text data. Then it makes the action recognition task to act more like pre-training problems via prompt engineering. Finally, it end-to-end fine-tunes on target datasets to obtain strong performance. We give an instantiation of the new paradigm, ActionCLIP, which not only has superior and flexible zero-shot/few-shot transfer ability but also reaches a top performance on general action recognition task, achieving 83.8% top-1 accuracy on Kinetics-400 with a ViT-B/16 as the backbone. Code is available at https://github.com/sallymmx/ActionCLIP.git

cs.CV↗

arXiv2021

CLINS: Continuous-Time Trajectory Estimation for LiDAR-Inertial System

In this paper, we propose a highly accurate continuous-time trajectory estimation framework dedicated to SLAM (Simultaneous Localization and Mapping) applications, which enables fuse high-frequency and asynchronous sensor data effectively. We apply the proposed framework in a 3D LiDAR-inertial system for evaluations. The proposed method adopts a non-rigid registration method for continuous-time trajectory estimation and simultaneously removing the motion distortion in LiDAR scans. Additionally, we propose a two-state continuous-time trajectory correction method to efficiently and efficiently tackle the computationally-intractable global optimization problem when loop closure happens. We examine the accuracy of the proposed approach on several publicly available datasets and the data we collected. The experimental results indicate that the proposed method outperforms the discrete-time methods regarding accuracy especially when aggressive motion occurs. Furthermore, we open source our code at \url{https://github.com/APRIL-ZJU/clins} to benefit research community.

cs.RO↗

arXiv2021

An oscillation free local discontinuous Galerkin method for nonlinear degenerate parabolic equations

In this paper, we develop an oscillation free local discontinuous Galerkin (OFLDG) method for solving nonlinear degenerate parabolic equations. Following the idea of our recent work [J. Lu, Y. Liu, and C.-W. Shu, SIAM J. Numer. Anal. 59(2021), pp. 1299-1324.], we add the damping terms to the LDG scheme to control the spurious oscillations when solutions have a large gradient. The $L^2$-stability and optimal priori error estimates for the semi-discrete scheme are established. The numerical experiments demonstrate that the proposed method maintains the high-order accuracy and controls the spurious oscillations well.

math.NA↗

arXiv2021

Go Wider Instead of Deeper

More transformer blocks with residual connections have recently achieved impressive results on various tasks. To achieve better performance with fewer trainable parameters, recent methods are proposed to go shallower by parameter sharing or model compressing along with the depth. However, weak modeling capacity limits their performance. Contrastively, going wider by inducing more trainable matrixes and parameters would produce a huge model requiring advanced parallelism to train and inference. In this paper, we propose a parameter-efficient framework, going wider instead of deeper. Specially, following existing works, we adapt parameter sharing to compress along depth. But, such deployment would limit the performance. To maximize modeling capacity, we scale along model width by replacing feed-forward network (FFN) with mixture-of-experts (MoE). Across transformer blocks, instead of sharing normalization layers, we propose to use individual layernorms to transform various semantic representations in a more parameter-efficient way. To evaluate our plug-and-run framework, we design WideNet and conduct comprehensive experiments on popular computer vision and natural language processing benchmarks. On ImageNet-1K, our best model outperforms Vision Transformer (ViT) by $1.5\%$ with $0.72 \times$ trainable parameters. Using $0.46 \times$ and $0.13 \times$ parameters, our WideNet can still surpass ViT and ViT-MoE by $0.8\%$ and $2.1\%$, respectively. On four natural language processing datasets, WideNet outperforms ALBERT by $1.8\%$ on average and surpass BERT using factorized embedding parameterization by $0.8\%$ with fewer parameters.

cs.LG↗

arXiv2021

A well-balanced oscillation-free discontinuous Galerkin method for shallow water equations

In this paper, we develop a well-balanced oscillation-free discontinuous Galerkin (OFDG) method for solving the shallow water equations with a non-flat bottom topography. One notable feature of the constructed scheme is the well-balanced property, which preserves exactly the hydrostatic equilibrium solutions up to machine error. Another feature is the non-oscillatory property, which is very important in the numerical simulation when there exist some shock discontinuities. To control the spurious oscillations, we construct an OFDG method with an extra damping term to the existing well-balanced DG schemes proposed in [Y. Xing and C.-W. Shu, CICP, 1(2006), 100-134.]. With a careful construction of the damping term, the proposed method achieves both the well-balanced property and non-oscillatory property simultaneously without compromising any order of accuracy. We also present a detailed procedure for the construction and a theoretical analysis for the preservation of the well-balancedness property. Extensive numerical experiments including one- and two-dimensional space demonstrate that the proposed methods possess the desired properties without sacrificing any order of accuracy.

math.NA↗

arXiv2021

FCFR-Net: Feature Fusion based Coarse-to-Fine Residual Learning for Depth Completion

Depth completion aims to recover a dense depth map from a sparse depth map with the corresponding color image as input. Recent approaches mainly formulate depth completion as a one-stage end-to-end learning task, which outputs dense depth maps directly. However, the feature extraction and supervision in one-stage frameworks are insufficient, limiting the performance of these approaches. To address this problem, we propose a novel end-to-end residual learning framework, which formulates the depth completion as a two-stage learning task, i.e., a sparse-to-coarse stage and a coarse-to-fine stage. First, a coarse dense depth map is obtained by a simple CNN framework. Then, a refined depth map is further obtained using a residual learning strategy in the coarse-to-fine stage with a coarse depth map and color image as input. Specially, in the coarse-to-fine stage, a channel shuffle extraction operation is utilized to extract more representative features from the color image and coarse depth map, and an energy based fusion operation is exploited to effectively fuse these features obtained by channel shuffle operation, thus leading to more accurate and refined depth maps. We achieve SoTA performance in RMSE on KITTI benchmark. Extensive experiments on other datasets future demonstrate the superiority of our approach over current state-of-the-art depth completion approaches.

cs.CV↗