arXiv Science⌕ Search

arXiv subjects

Min Li

Publications and source records attributed to Min Li.

At least 235 records · Page 13Linked to original sources
arXiv2021

Hybrid gene selection approach using XGBoost and multi-objective genetic algorithm for cancer classification

Microarray gene expression data are often accompanied by a large number of genes and a small number of samples. However, only a few of these genes are relevant to cancer, resulting in signigicant gene selection challenges. Hence, we propose a two-stage gene selection approach by combining extreme gradient boosting (XGBoost) and a multi-objective optimization genetic algorithm (XGBoost-MOGA) for cancer classification in microarray datasets. In the first stage, the genes are ranked use an ensemble-based feature selection using XGBoost. This stage can effectively remove irrelevant genes and yield a group comprising the most relevant genes related to the class. In the second stage, XGBoost-MOGA searches for an optimal gene subset based on the most relevant genes's group using a multi-objective optimization genetic algorithm. We performed comprehensive experiments to compare XGBoost-MOGA with other state-of-the-art feature selection methods using two well-known learning classifiers on 13 publicly available microarray expression datasets. The experimental results show that XGBoost-MOGA yields significantly better results than previous state-of-the-art algorithms in terms of various evaluation criteria, such as accuracy, F-score, precision, and recall.

cs.LG↗
arXiv2021

Objects as Extreme Points

Object detection can be regarded as a pixel clustering task, and its boundary is determined by four extreme points (leftmost, top, rightmost, and bottom). However, most studies focus on the center or corner points of the object, which are actually conditional results of the extreme points. In this paper, we present an Extreme-Point-Prediction- Based object detector (EPP-Net), which directly regresses the relative displacement vector between each pixel and the four extreme points. We also propose a new metric to measure the similarity between two groups of extreme points, namely, Extreme Intersection over Union (EIoU), and incorporate this EIoU as a new regression loss. Moreover, we propose a novel branch to predict the EIoU between the ground-truth and the prediction results, and take it as the localization confidence to filter out poor detection results. On the MS-COCO dataset, our method achieves an average precision (AP) of 44.0% with ResNet-50 and an AP of 50.3% with ResNeXt-101-DCN. The proposed EPP-Net provides a new method to detect objects and outperforms state-of-the-art anchor-free detectors.

cs.CV↗
arXiv2021

TestRank: Bringing Order into Unlabeled Test Instances for Deep Learning Tasks

Deep learning (DL) has achieved unprecedented success in a variety of tasks. However, DL systems are notoriously difficult to test and debug due to the lack of explainability of DL models and the huge test input space to cover. Generally speaking, it is relatively easy to collect a massive amount of test data, but the labeling cost can be quite high. Consequently, it is essential to conduct test selection and label only those selected "high quality" bug-revealing test inputs for test cost reduction. In this paper, we propose a novel test prioritization technique that brings order into the unlabeled test instances according to their bug-revealing capabilities, namely TestRank. Different from existing solutions, TestRank leverages both intrinsic attributes and contextual attributes of test instances when prioritizing them. To be specific, we first build a similarity graph on test instances and training samples, and we conduct graph-based semi-supervised learning to extract contextual features. Then, for a particular test instance, the contextual features extracted from the graph neural network (GNN) and the intrinsic features obtained with the DL model itself are combined to predict its bug-revealing probability. Finally, TestRank prioritizes unlabeled test instances in descending order of the above probability value. We evaluate the performance of TestRank on a variety of image classification datasets. Experimental results show that the debugging efficiency of our method significantly outperforms existing test prioritization techniques.

cs.LG↗
arXiv2021

A Survey on Fundamental Limits of Integrated Sensing and Communication

The integrated sensing and communication (ISAC), in which the sensing and communication share the same frequency band and hardware, has emerged as a key technology in future wireless systems. Early works on ISAC have been focused on the design, analysis and optimization of practical ISAC technologies for various ISAC systems. While this line of works are necessary, it is equally important to study the fundamental limits of ISAC in order to understand the gap between the current state-of-the-art technologies and the performance limits, and provide useful insights and guidance for the development of better ISAC technologies that can approach the performance limits. In this paper, we aim to provide a comprehensive survey for the current research progress on the fundamental limits of ISAC. Particularly, we first propose a systematic classification method for both traditional radio sensing (such as radar sensing and wireless localization) and ISAC so that they can be naturally incorporated into a unified framework. Then we summarize the major performance metrics and bounds used in sensing, communications and ISAC, respectively. After that, we present the current research progresses on fundamental limits of each class of the traditional sensing and ISAC systems. Finally, the open problems and future research directions are discussed.

cs.IT↗
arXiv2021

Skimming and Scanning for Untrimmed Video Action Recognition

Video action recognition (VAR) is a primary task of video understanding, and untrimmed videos are more common in real-life scenes. Untrimmed videos have redundant and diverse clips containing contextual information, so sampling dense clips is essential. Recently, some works attempt to train a generic model to select the N most representative clips. However, it is difficult to model the complex relations from intra-class clips and inter-class videos within a single model and fixed selected number, and the entanglement of multiple relations is also hard to explain. Thus, instead of "only look once", we argue "divide and conquer" strategy will be more suitable in untrimmed VAR. Inspired by the speed reading mechanism, we propose a simple yet effective clip-level solution based on skim-scan techniques. Specifically, the proposed Skim-Scan framework first skims the entire video and drops those uninformative and misleading clips. For the remaining clips, it scans clips with diverse features gradually to drop redundant clips but cover essential content. The above strategies can adaptively select the necessary clips according to the difficulty of the different videos. To trade off the computational complexity and performance, we observe the similar statistical expression between lightweight and heavy networks, thus it supports us to explore the combination of them. Comprehensive experiments are performed on ActivityNet and mini-FCVID datasets, and results demonstrate that our solution surpasses the state-of-the-art performance in terms of both accuracy and efficiency.

cs.CV↗
arXiv2021

Efficient Alternating Least Squares Algorithms for Low Multilinear Rank Approximation of Tensors

The low multilinear rank approximation, also known as the truncated Tucker decomposition, has been extensively utilized in many applications that involve higher-order tensors. Popular methods for low multilinear rank approximation usually rely directly on matrix SVD, therefore often suffer from the notorious intermediate data explosion issue and are not easy to parallelize, especially when the input tensor is large. In this paper, we propose a new class of truncated HOSVD algorithms based on alternating least squares (ALS) for efficiently computing the low multilinear rank approximation of tensors. The proposed ALS-based approaches are able to eliminate the redundant computations of the singular vectors of intermediate matrices and are therefore free of data explosion. Also, the new methods are more flexible with adjustable convergence tolerance and are intrinsically parallelizable on high-performance computers. Theoretical analysis reveals that the ALS iteration in the proposed algorithms is q-linear convergent with a relatively wide convergence region. Numerical experiments with large-scale tensors from both synthetic and real-world applications demonstrate that ALS-based methods can substantially reduce the total cost of the original ones and are highly scalable for parallel computing.

math.NA↗
arXiv2021

BridgeDPI: A Novel Graph Neural Network for Predicting Drug-Protein Interactions

Motivation: Exploring drug-protein interactions (DPIs) work as a pivotal step in drug discovery. The fast expansion of available biological data enables computational methods effectively assist in experimental methods. Among them, deep learning methods extract features only from basic characteristics, such as protein sequences, molecule structures. Others achieve significant improvement by learning from not only sequences/molecules but the protein-protein and drug-drug associations (PPAs and DDAs). The PPAs and DDAs are generally obtained by using computational methods. However, existing computational methods have some limitations, resulting in low-quality PPAs and DDAs that hamper the prediction performance. Therefore, we hope to develop a novel supervised learning method to learn the PPAs and DDAs effectively and thereby improve the prediction performance of the specific task of DPI. Results: In this research, we propose a novel deep learning framework, namely BridgeDPI. BridgeDPI introduces a class of nodes named hyper-nodes, which bridge different proteins/drugs to work as PPAs and DDAs. The hyper-nodes can be supervised learned for the specific task of DPI since the whole process is an end-to-end learning. Consequently, such a model would improve prediction performance of DPI. In three real-world datasets, we further demonstrate that BridgeDPI outperforms state-of-the-art methods. Moreover, ablation studies verify the effectiveness of the hyper-nodes. Last, in an independent verification, BridgeDPI explores the candidate bindings among COVID-19's proteins and various antiviral drugs. And the predictive results accord with the statement of the World Health Organization and Food and Drug Administration, showing the validity and reliability of BridgeDPI.

cs.LG↗
arXiv2020

Controlling asymmetric absorption of metasurfaces via non-Hermitian doping

Metasurfaces based on subwavelength resonators enable novel ways to manipulate the flow of light at optical interfaces. In pursuit of multifunctional or reconfigurable metadevices, efficient tuning of macroscopic performance with little structural/material variation remains a challenge. Here, we put forward the concept of non-Hermitian doping in metasurfaces, showing that an ordinary retroreflector can be switched to asymmetric one by introducing absorptive defects in local regions. The asymmetric absorption performance begins with zero at the Hermitian state, gradually increases under non-Hermitian doping, and reaches the maximum of unity at the exceptional point. This effect is experimentally demonstrated at microwave frequencies via the observation of asymmetric near-field distribution and far-field scattering properties and from a planar metasurface. Furthermore, while importing local gain constituents in conventional retroreflector, it can be tuned to an extremely asymmetric one-side amplifier, extending unidirectional amplification from one-dimensional waveguide to two-dimensional scattering systems. The proposed methodology provides an alternative pathway for engineering electromagnetic metadevices and systems with small perturbations. Introduction

physics.optics↗
arXiv2020

Adaptive SpMV/SpMSpV on GPUs for Input Vectors of Varied Sparsity

Despite numerous efforts for optimizing the performance of Sparse Matrix and Vector Multiplication (SpMV) on modern hardware architectures, few works are done to its sparse counterpart, Sparse Matrix and Sparse Vector Multiplication (SpMSpV), not to mention dealing with input vectors of varied sparsity. The key challenge is that depending on the sparsity levels, distribution of data, and compute platform, the optimal choice of SpMV/SpMSpV kernel can vary, and a static choice does not suffice. In this paper, we propose an adaptive SpMV/SpMSpV framework, which can automatically select the appropriate SpMV/SpMSpV kernel on GPUs for any sparse matrix and vector at the runtime. Based on systematic analysis on key factors such as computing pattern, workload distribution and write-back strategy, eight candidate SpMV/SpMSpV kernels are encapsulated into the framework to achieve high performance in a seamless manner. A comprehensive study on machine learning based kernel selector is performed to choose the kernel and adapt with the varieties of both the input and hardware from both accuracy and overhead perspectives. Experiments demonstrate that the adaptive framework can substantially outperform the previous state-of-the-art in real-world applications on NVIDIA Tesla K40m, P100 and V100 GPUs.

cs.DC↗
arXiv2020

a-Tucker: Input-Adaptive and Matricization-Free Tucker Decomposition for Dense Tensors on CPUs and GPUs

Tucker decomposition is one of the most popular models for analyzing and compressing large-scale tensorial data. Existing Tucker decomposition algorithms usually rely on a single solver to compute the factor matrices and core tensor, and are not flexible enough to adapt with the diversities of the input data and the hardware. Moreover, to exploit highly efficient GEMM kernels, most Tucker decomposition implementations make use of explicit matricizations, which could introduce extra costs in terms of data conversion and memory usage. In this paper, we present a-Tucker, a new framework for input-adaptive and matricization-free Tucker decomposition of dense tensors. A mode-wise flexible Tucker decomposition algorithm is proposed to enable the switch of different solvers for the factor matrices and core tensor, and a machine-learning adaptive solver selector is applied to automatically cope with the variations of both the input data and the hardware. To further improve the performance and enhance the memory efficiency, we implement a-Tucker in a fully matricization-free manner without any conversion between tensors and matrices. Experiments with a variety of synthetic and real-world tensors show that a-Tucker can substantially outperform existing works on both CPUs and GPUs.

cs.DC↗
arXiv2020

DeepDyve: Dynamic Verification for Deep Neural Networks

Deep neural networks (DNNs) have become one of the enabling technologies in many safety-critical applications, e.g., autonomous driving and medical image analysis. DNN systems, however, suffer from various kinds of threats, such as adversarial example attacks and fault injection attacks. While there are many defense methods proposed against maliciously crafted inputs, solutions against faults presented in the DNN system itself (e.g., parameters and calculations) are far less explored. In this paper, we develop a novel lightweight fault-tolerant solution for DNN-based systems, namely DeepDyve, which employs pre-trained neural networks that are far simpler and smaller than the original DNN for dynamic verification. The key to enabling such lightweight checking is that the smaller neural network only needs to produce approximate results for the initial task without sacrificing fault coverage much. We develop efficient and effective architecture and task exploration techniques to achieve optimized risk/overhead trade-off in DeepDyve. Experimental results show that DeepDyve can reduce 90% of the risks at around 10% overhead.

cs.LG↗
arXiv2020

Joint Beam Training and Data Transmission Design for Covert Millimeter-Wave Communication

Covert communication prevents legitimate transmission from being detected by a warden while maintaining certain covert rate at the intended user. Prior works have considered the design of covert communication over conventional low-frequency bands, but few works so far have explored the higher-frequency millimeter-wave (mmWave) spectrum. The directional nature of mmWave communication makes it attractive for covert transmission. However, how to establish such directional link in a covert manner in the first place remains as a significant challenge. In this paper, we consider a covert mmWave communication system, where legitimate parties Alice and Bob adopt beam training approach for directional link establishment. Accounting for the training overhead, we develop a new design framework that jointly optimizes beam training duration, training power and data transmission power to maximize the effective throughput of Alice-Bob link while ensuring the covertness constraint at warden Willie is met. We further propose a dual-decomposition successive convex approximation algorithm to solve the problem efficiently. Numerical studies demonstrate interesting tradeoff among the key design parameters considered and also the necessity of joint design of beam training and data transmission for covert mmWave communication.

cs.IT↗
arXiv2020

Robust Adaptive Beam Tracking for Mobile Millimetre Wave Communications

Millimetre wave (mmWave) beam tracking is a challenging task because tracking algorithms are required to provide consistent high accuracy with low probability of loss of track and minimal overhead. To meet these requirements, we propose in this paper a new analog beam tracking framework namely Adaptive Tracking with Stochastic Control (ATSC). Under this framework, beam direction updates are made using a novel mechanism based on measurements taken from only two beam directions perturbed from the current data beam. To achieve high tracking accuracy and reliability, we provide a systematic approach to jointly optimise the algorithm parameters. The complete framework includes a method for adapting the tracking rate together with a criterion for realignment (perceived loss of track). ATSC adapts the amount of tracking overhead that matches well to the mobility level, without incurring frequent loss of track, as verified by an extensive set of experiments under both representative statistical channel models as well as realistic urban scenarios simulated by ray-tracing software. In particular, numerical results show that ATSC can track dominant channel directions with high accuracy for vehicles moving at 72 km/hour in complicated urban scenarios, with an overhead of less than 1\%.

eess.SP↗
arXiv2020

Millimeter-Wave Beam Search with Iterative Deactivation and Beam Shifting

Millimeter Wave (mmWave) communications rely on highly directional beams to combat severe propagation loss. In this paper, an adaptive beam search algorithm based on spatial scanning, called Iterative Deactivation and Beam Shifting (IDBS), is proposed for mmWave beam alignment. IDBS does not require advance information such as the Signal-to-Noise Ratio (SNR) and channel statistics, and matches the training overhead to the unknown SNR to achieve satisfactory performance. The algorithm works by gradually deactivating beams using a Bayesian probability criterion based on a uniform improper prior, where beam deactivation can be implemented with low-complexity operations that require computing a low-degree polynomial or a search through a look-up table. Numerical results confirm that IDBS adapts to different propagation scenarios such as line-of-sight and non-line-of-sight and to different SNRs. It can achieve better tradeoffs between training overhead and beam alignment accuracy than existing non-adaptive algorithms that have fixed training overheads.

cs.IT↗
arXiv2020

Dust Condensation in Evolving Discs and the Composition of Planetary Building Blocks

Partial condensation of dust from the Solar nebula is likely responsible for the diverse chemical compositions of chondrites and rocky planets/planetesimals in the inner Solar system. We present a forward physical-chemical model of a protoplanetary disc to predict the chemical compositions of planetary building blocks that may form from such a disc. Our model includes the physical evolution of the disc and the condensation, partial advection, and decoupling of the dust within it. The chemical composition of the condensate changes with time and radius. We compare the results of two dust condensation models: one where an element condenses when the midplane temperature in the disc is lower than the 50\% condensation temperature ($\rm T_{50}$) of that element and the other where the condensation of the dust is calculated by a Gibbs free energy minimization technique assuming chemical equilibrium at local disc temperature and pressure. The results of two models are generally consistent with some systematic differences of $\sim 10$\% depending upon the radial distance and an element's condensation temperature. Both models predict compositions similar to CM, CO, and CV chondrites provided that the decoupling timescale of the dust is on the order of the evolution timescale of the disc or longer. If the decoupling timescale is too short, the composition deviates significantly from the measured values. These models may contribute to our understanding of the chemical compositions of chondrites, and ultimately the terrestrial planets in the solar system, and may constrain the potential chemical compositions of rocky exoplanets.

astro-ph.EP↗
arXiv2020

Numerical methods for stochastic Volterra integral equations with weakly singular kernels

In this paper, we first establish the existence, uniqueness and Hölder continuity of the solution to stochastic Volterra integral equations with weakly singular kernels. Then, we propose a $θ$-Euler-Maruyama scheme and a Milstein scheme to solve the equations numerically and we obtain the strong rates of convergence for both schemes in $L^{p}$ norm for any $p\geq 1$. For the $θ$-Euler-Maruyama scheme the rate is $\min\{1-α,\frac{1}{2}-β\}~ % (0<α<1, 0< β<\frac{1}{2})$ and for the Milstein scheme the rate is $\min\{1-α,1-2β\}$ when $α\neq \frac 12$, where $(0<α<1, 0< β<\frac{1}{2})$. These results on the rates of convergence are significantly different from that of the similar schemes for the stochastic Volterra integral equations with regular kernels. The difficulty to obtain our results is the lack of Itô formula for the equations. To get around of this difficulty we use instead the Taylor formula and then carry a sophisticated analysis on the equation the solution satisfies.

math.NA↗
arXiv2020

The stabilizing index and cyclic index of coalescence and Cartesian product of uniform hypergraphs

Let $G$ be connected uniform hypergraph and let $\mathcal{A}(G)$ be the adjacency tensor of $G$. The stabilizing index of $G$ is the number of eigenvectors of $\mathcal{A}(G)$ associated with the spectral radius, and the cyclic index of $G$ is the number of eigenvalues of $\mathcal{A}(G)$ with modulus equal to the spectral radius. Let $G_1 \odot G_2$ and $G_1 \Box G_2$ be the coalescence and Cartesian product of connected $m$-uniform hypergraphs $G_1$ and $G_2$ respectively. In this paper, we give explicit formulas for the the stabilizing indices and cyclic indices of $G_1 \odot G_2$ and $G_1 \Box G_2$ in terms of those of $G_1$ and $G_2$ or the invariant divisors of their incidence matrices over $\mathbb{Z}_m$, respectively.

math.CO↗