arXiv subjects

Bin Liu

Publications and source records attributed to Bin Liu.

At least 343 records · Page 19Linked to original sources

arXiv2022

Numerical study of three-dimensional single-mode Rayleigh-Taylor instability in turbulent mixing stage

Rayleigh-Taylor instability (RTI) as a multi-scale, strongly nonlinear physical phenomenon which plays an important role in the engineering applications and scientific research. In this paper, the mesoscopic lattice Boltzmann method is used to numerically study the late-time evolutional mechanism of three-dimensional (3D) single-mode RTI and the influences of extensive dimensionless Reynolds number and Atwood number on phase interfacial dynamics, spike and bubble growth are investigated in details. For a high Reynolds number, it is reported that the development of 3D single-mode RTI would undergo four different stages: linear growth stage, saturated velocity growth stage, reacceleration stage and turbulent mixing stage. A series of complex interfacial structures with large topological changes can be observed at the turbulent mixing stage, which always preserve the symmetries with respect to the middle axis at a low Atwood number, and the lines of symmetry within spike and bubble are broken as the Atwood number is increased. Five statistical methods for computing the spike and bubble growth rates are then analyzed to reveal the growth law of 3D single-mode RTI in turbulent mixing stage. It is found that the spike late-time growth rate shows an overall increase with the Atwood number, while the bubble growth rate seems to be independence of the Atwood number, approaching a constant of around 0.1. When the Reynolds number decreases, the later stages cannot be reached gradually and the evolution of phase interface presents a laminar flow state.

physics.flu-dyn↗

arXiv2022

Revealing sign-reversal $s^{+-}$-wave pairing by quasiparticle interference in the heavy-fermion superconductor CeCu$_2$Si$_2$

Recent observations of two nodeless gaps in superconducting CeCu$_2$Si$_2$ have raised intensive debates as to its exact gap structure of either sign-reversal ($s^{+-}$) or sign-preserving ($s^{++}$) pairing. Here we investigate the quasiparticle interference (QPI) using realistic Fermi surface topology for both weak and strong interband impurity scatterings. Our calculations of the QPI and integrated antisymmetrized local density of states reveal qualitative distinctions between $s^{+-}$ and $s^{++}$ pairing states, which include the intragap impurity resonance and a significant energy-dependence difference between two gap energies. Our predictions provide a guide for phase-sensitive QPI measurements to uncover decisively the true pairing symmetry in the heavy-fermion superconductor CeCu$_2$Si$_2$.

cond-mat.supr-con↗

arXiv2022

Online Multi-Object Tracking with Unsupervised Re-Identification Learning and Occlusion Estimation

Occlusion between different objects is a typical challenge in Multi-Object Tracking (MOT), which often leads to inferior tracking results due to the missing detected objects. The common practice in multi-object tracking is re-identifying the missed objects after their reappearance. Though tracking performance can be boosted by the re-identification, the annotation of identity is required to train the model. In addition, such practice of re-identification still can not track those highly occluded objects when they are missed by the detector. In this paper, we focus on online multi-object tracking and design two novel modules, the unsupervised re-identification learning module and the occlusion estimation module, to handle these problems. Specifically, the proposed unsupervised re-identification learning module does not require any (pseudo) identity information nor suffer from the scalability issue. The proposed occlusion estimation module tries to predict the locations where occlusions happen, which are used to estimate the positions of missed objects by the detector. Our study shows that, when applied to state-of-the-art MOT methods, the proposed unsupervised re-identification learning is comparable to supervised re-identification learning, and the tracking performance is further improved by the proposed occlusion estimation module.

cs.CV↗

arXiv2021

INTCP: Information-centric TCP for Satellite Network

Satellite networks are booming to provide high-speed and low latency Internet access, but the transport layer becomes one of the main obstacles. Legacy end-to-end TCP is designed for terrestrial networks, not suitable for error-prone, propagation delay varying, and intermittent satellite links. It is necessary to make a clean-slate design for the satellite transport layer. This paper introduces a novel Information-centric Hop-by-Hop transport layer design, INTCP. It carries out hop-by-hop packets retransmission and hop-by-hop congestion control with the help of cache and request-response model. Hop-by-hop retransmission recovers lost packets on hop, reduces retransmission delay. INTCP controls traffic and congestion also by hop. Each hop tries its best to maximize its bandwidth utilization and improves end-to-end throughput. The capability of caching enables asynchronous multicast in transport layer. This would save precious spectrum resources in the satellite network. The performance of INTCP is evaluated with the simulated Starlink constellation. Long-distance communication with more than 1000km is carried out. The results demonstrate that, for the unicast scenario INTCP could reduce 42% one-way delay, 53% delay jitters, and improve 60% throughput compared with the legacy TCP. In multicast scenario, INTCP could achieve more than 6X throughput.

cs.NI↗

arXiv2021

Invariants and dualities of a certain parabolic group

In this note, I will prove a conjecture in \cite{BYY}, which is related to the invariants of a maximal parabolic subgroup of $\GL_{n+1}$. Consequently, the natural tensor invariants of this typical maximal parabolic subgroup of $\GL_{n+1}$ are determined when $n\geq r$.

math.RT↗

arXiv2021

Enhanced Brauer algebras and enhanced dualities for orthogonal and symplectic groups

This note is a sequel to Shu-Xue-Yao's paper \cite{BYY} where the author studied the so-called enhanced groups and related dualities for type $A$. In this note, we continue to investigate the enhanced dualities for classical groups of type $B$, $C$, and $D$. To show this, we first introduce an enhanced Brauer algebra. Due to Proposition \ref{B dual}, we can easily obtain the restricted and Levi dualities, hence the parabolic duality is naturally described. Moreover, a special case is listed in §\ref{3} by some explicit calculations.

math.RT↗

arXiv2021

Text classification with pixel embedding

We propose a novel framework to understand the text by converting sentences or articles into video-like 3-dimensional tensors. Each frame, corresponding to a slice of the tensor, is a word image that is rendered by the word's shape. The length of the tensor equals to the number of words in the sentence or article. The proposed transformation from the text to a 3-dimensional tensor makes it very convenient to implement an $n$-gram model with convolutional neural networks for text analysis. Concretely, we impose a 3-dimensional convolutional kernel on the 3-dimensional text tensor. The first two dimensions of the convolutional kernel size equal the size of the word image and the last dimension of the kernel size is $n$. That is, every time when we slide the 3-dimensional kernel over a word sequence, the convolution covers $n$ word images and outputs a scalar. By iterating this process continuously for each $n$-gram along with the sentence or article with multiple kernels, we obtain a 2-dimensional feature map. A subsequent 1-dimensional max-over-time pooling is applied to this feature map, and three fully-connected layers are used for conducting text classification finally. Experiments of several text classification datasets demonstrate surprisingly superior performances using the proposed model in comparison with existing methods.

cs.CL↗

arXiv2021

Detecting and Identifying Optical Signal Attacks on Autonomous Driving Systems

For autonomous driving, an essential task is to detect surrounding objects accurately. To this end, most existing systems use optical devices, including cameras and light detection and ranging (LiDAR) sensors, to collect environment data in real time. In recent years, many researchers have developed advanced machine learning models to detect surrounding objects. Nevertheless, the aforementioned optical devices are vulnerable to optical signal attacks, which could compromise the accuracy of object detection. To address this critical issue, we propose a framework to detect and identify sensors that are under attack. Specifically, we first develop a new technique to detect attacks on a system that consists of three sensors. Our main idea is to: 1) use data from three sensors to obtain two versions of depth maps (i.e., disparity) and 2) detect attacks by analyzing the distribution of disparity errors. In our study, we use real data sets and the state-of-the-art machine learning model to evaluate our attack detection scheme and the results confirm the effectiveness of our detection method. Based on the detection scheme, we further develop an identification model that is capable of identifying up to n-2 attacked sensors in a system with one LiDAR and n cameras. We prove the correctness of our identification scheme and conduct experiments to show the accuracy of our identification method. Finally, we investigate the overall sensitivity of our framework.

cs.CV↗

arXiv2021

Unsupervised Finetuning

This paper studies "unsupervised finetuning", the symmetrical problem of the well-known "supervised finetuning". Given a pretrained model and small-scale unlabeled target data, unsupervised finetuning is to adapt the representation pretrained from the source domain to the target domain so that better transfer performance can be obtained. This problem is more challenging than the supervised counterpart, as the low data density in the small-scale target data is not friendly for unsupervised learning, leading to the damage of the pretrained representation and poor representation in the target domain. In this paper, we find the source data is crucial when shifting the finetuning paradigm from supervise to unsupervise, and propose two simple and effective strategies to combine source and target data into unsupervised finetuning: "sparse source data replaying", and "data mixing". The motivation of the former strategy is to add a small portion of source data back to occupy their pretrained representation space and help push the target data to reside in a smaller compact space; and the motivation of the latter strategy is to increase the data density and help learn more compact representation. To demonstrate the effectiveness of our proposed ``unsupervised finetuning'' strategy, we conduct extensive experiments on multiple different target datasets, which show better transfer performance than the naive strategy.

cs.CV↗

arXiv2021

Irreducible modules of $\frak {sl}_{mp}$ in characteristic $p$ with regular or subregular nilpotent $p$-character

Let $\bbk$ be an algebraically closed field of prime characteristic $p$. If $p$ does not divide $n$, irreducible modules over $\frak {sl}_n$ for regular and subregular nilpotent representations have already known(see \cite{Jan2} and \cite{Jan3}). In this article, we investigate the question when $p$ divides $n$, and precisely describe simple modules of $\frak {sl}_n$ for regular and subregular nilpotent representations.

math.RT↗

arXiv2021

Asymmetric Graph Representation Learning

Despite the enormous success of graph neural networks (GNNs), most existing GNNs can only be applicable to undirected graphs where relationships among connected nodes are two-way symmetric (i.e., information can be passed back and forth). However, there is a vast amount of applications where the information flow is asymmetric, leading to directed graphs where information can only be passed in one direction. For example, a directed edge indicates that the information can only be conveyed forwardly from the start node to the end node, but not backwardly. To accommodate such an asymmetric structure of directed graphs within the framework of GNNs, we propose a simple yet remarkably effective framework for directed graph analysis to incorporate such one-way information passing. We define an incoming embedding and an outgoing embedding for each node to model its sending and receiving features respectively. We further develop two steps in our directed GNN model with the first one to aggregate/update the incoming features of nodes and the second one to aggregate/update the outgoing features. By imposing the two roles for each node, the likelihood of a directed edge can be calculated based on the outgoing embedding of the start node and the incoming embedding of the end node. The log-likelihood of all edges plays a natural role of regularization for the proposed model, which can alleviate the over-smoothing problem of the deep GNNs. Extensive experiments on multiple real-world directed graphs demonstrate outstanding performances of the proposed model in both node-level and graph-level tasks.

cs.LG↗

arXiv2021

Reversible Structural Transition of Two-Dimensional Copper Selenide on Cu(111)

Structural engineering opens a door to manipulating the structures and thus tuning the properties of two-dimensional materials. Here, we report a reversible structural transition in honeycomb CuSe monolayer on Cu(111) through scanning tunneling microscopy (STM) and Auger electron spectroscopy (AES). Direct selenization of Cu(111) gives rise to the formation of honeycomb CuSe monolayers with 1D moiré structures (stripe-CuSe), due to the asymmetric lattice distortions in CuSe induced by the lattice mismatch. Additional deposition of Se combined with post annealing results in the formation of honeycomb CuSe with quasi-ordered arrays of triangular holes (hole-CuSe), namely, the structural transition from stripe-CuSe to hole-CuSe. Further, annealing the hole-CuSe at higher temperature leads to the reverse structural transition, namely from hole-CuSe to stripe-CuSe. AES measurement unravels the Se content change in the reversible structural transition. Therefore, both the Se coverage and annealing temperature play significant roles in the reversible structural transition in CuSe on Cu(111). Our work provides insights in understanding of the structural transitions in 2D materials.

cond-mat.mtrl-sci↗

arXiv2021

Robust Dynamic Multi-Modal Data Fusion: A Model Uncertainty Perspective

This paper is concerned with multi-modal data fusion (MMDF) under unexpected modality failures in nonlinear non-Gaussian dynamic processes. An efficient framework to tackle this problem is proposed. In particular, a notion termed modality "\emph{usefulness}", which takes a value of 1 or 0, is used for indicating whether the observation of this modality is useful or not. For $n$ modalities involved, $2^n$ combinations of their "\emph{usefulness}" values exist. Each combination defines one hypothetical model of the true data generative process. Then the problem of concern is formalized as a task of nonlinear non-Gaussian state filtering under model uncertainty, which is addressed by a dynamic model averaging (DMA) based particle filter (PF) algorithm. This DMA algorithm employs $2^n$ models, while all models share the same state-transition function and a unique set of particle values. That makes its computational complexity only slightly larger than a single model based PF algorithm, especially for scenarios in which $n$ is small. Experimental results show that the proposed solution outperforms remarkably state-of-the-art methods. Code and data are available at https://github.com/robinlau1981/fusion.

cs.LG↗

arXiv2021

GPRInvNet: Deep Learning-Based Ground Penetrating Radar Data Inversion for Tunnel Lining

A DNN architecture referred to as GPRInvNet was proposed to tackle the challenges of mapping the ground-penetrating radar (GPR) B-Scan data to complex permittivity maps of subsurface structures. The GPRInvNet consisted of a trace-to-trace encoder and a decoder. It was specially designed to take into account the characteristics of GPR inversion when faced with complex GPR B-Scan data, as well as addressing the spatial alignment issues between time-series B-Scan data and spatial permittivity maps. It displayed the ability to fuse features from several adjacent traces on the B-Scan data to enhance each trace, and then further condense the features of each trace separately. As a result, the sensitive zones on the permittivity maps spatially aligned to the enhanced trace could be reconstructed accurately. The GPRInvNet has been utilized to reconstruct the permittivity map of tunnel linings. A diverse range of dielectric models of tunnel linings containing complex defects has been reconstructed using GPRInvNet. The results have demonstrated that the GPRInvNet is capable of effectively reconstructing complex tunnel lining defects with clear boundaries. Comparative results with existing baseline methods also demonstrated the superiority of the GPRInvNet. For the purpose of generalizing the GPRInvNet to real GPR data, some background noise patches recorded from practical model testing were integrated into the synthetic GPR data to retrain the GPRInvNet. The model testing has been conducted for validation, and experimental results revealed that the GPRInvNet had also achieved satisfactory results with regard to the real data.

cs.CV↗

arXiv2021

ISNet: Integrate Image-Level and Semantic-Level Context for Semantic Segmentation

Co-occurrent visual pattern makes aggregating contextual information a common paradigm to enhance the pixel representation for semantic image segmentation. The existing approaches focus on modeling the context from the perspective of the whole image, i.e., aggregating the image-level contextual information. Despite impressive, these methods weaken the significance of the pixel representations of the same category, i.e., the semantic-level contextual information. To address this, this paper proposes to augment the pixel representations by aggregating the image-level and semantic-level contextual information, respectively. First, an image-level context module is designed to capture the contextual information for each pixel in the whole image. Second, we aggregate the representations of the same category for each pixel where the category regions are learned under the supervision of the ground-truth segmentation. Third, we compute the similarities between each pixel representation and the image-level contextual information, the semantic-level contextual information, respectively. At last, a pixel representation is augmented by weighted aggregating both the image-level contextual information and the semantic-level contextual information with the similarities as the weights. Integrating the image-level and semantic-level context allows this paper to report state-of-the-art accuracy on four benchmarks, i.e., ADE20K, LIP, COCOStuff and Cityscapes.

cs.CV↗

arXiv2021

Identifying Illicit Drug Dealers on Instagram with Large-scale Multimodal Data Fusion

Illicit drug trafficking via social media sites such as Instagram has become a severe problem, thus drawing a great deal of attention from law enforcement and public health agencies. How to identify illicit drug dealers from social media data has remained a technical challenge due to the following reasons. On the one hand, the available data are limited because of privacy concerns with crawling social media sites; on the other hand, the diversity of drug dealing patterns makes it difficult to reliably distinguish drug dealers from common drug users. Unlike existing methods that focus on posting-based detection, we propose to tackle the problem of illicit drug dealer identification by constructing a large-scale multimodal dataset named Identifying Drug Dealers on Instagram (IDDIG). Totally nearly 4,000 user accounts, of which over 1,400 are drug dealers, have been collected from Instagram with multiple data sources including post comments, post images, homepage bio, and homepage images. We then design a quadruple-based multimodal fusion method to combine the multiple data sources associated with each user account for drug dealer identification. Experimental results on the constructed IDDIG dataset demonstrate the effectiveness of the proposed method in identifying drug dealers (almost 95% accuracy). Moreover, we have developed a hashtag-based community detection technique for discovering evolving patterns, especially those related to geography and drug types.

cs.LG↗

arXiv2021

Detection of Illicit Drug Trafficking Events on Instagram: A Deep Multimodal Multilabel Learning Approach

Social media such as Instagram and Twitter have become important platforms for marketing and selling illicit drugs. Detection of online illicit drug trafficking has become critical to combat the online trade of illicit drugs. However, the legal status often varies spatially and temporally; even for the same drug, federal and state legislation can have different regulations about its legality. Meanwhile, more drug trafficking events are disguised as a novel form of advertising commenting leading to information heterogeneity. Accordingly, accurate detection of illicit drug trafficking events (IDTEs) from social media has become even more challenging. In this work, we conduct the first systematic study on fine-grained detection of IDTEs on Instagram. We propose to take a deep multimodal multilabel learning (DMML) approach to detect IDTEs and demonstrate its effectiveness on a newly constructed dataset called multimodal IDTE(MM-IDTE). Specifically, our model takes text and image data as the input and combines multimodal information to predict multiple labels of illicit drugs. Inspired by the success of BERT, we have developed a self-supervised multimodal bidirectional transformer by jointly fine-tuning pretrained text and image encoders. We have constructed a large-scale dataset MM-IDTE with manually annotated multiple drug labels to support fine-grained detection of illicit drugs. Extensive experimental results on the MM-IDTE dataset show that the proposed DMML methodology can accurately detect IDTEs even in the presence of special characters and style changes attempting to evade detection.

cs.LG↗

arXiv2021

Escaping the Gradient Vanishing: Periodic Alternatives of Softmax in Attention Mechanism

Softmax is widely used in neural networks for multiclass classification, gate structure and attention mechanisms. The statistical assumption that the input is normal distributed supports the gradient stability of Softmax. However, when used in attention mechanisms such as transformers, since the correlation scores between embeddings are often not normally distributed, the gradient vanishing problem appears, and we prove this point through experimental confirmation. In this work, we suggest that replacing the exponential function by periodic functions, and we delve into some potential periodic alternatives of Softmax from the view of value and gradient. Through experiments on a simply designed demo referenced to LeViT, our method is proved to be able to alleviate the gradient problem and yield substantial improvements compared to Softmax and its variants. Further, we analyze the impact of pre-normalization for Softmax and our methods through mathematics and experiments. Lastly, we increase the depth of the demo and prove the applicability of our method in deep structures.

cs.CV↗