arXiv subjects

Lei Zhu

Publications and source records attributed to Lei Zhu.

At least 307 records · Page 17Linked to original sources

arXiv2021

Smart Contract Vulnerability Detection: From Pure Neural Network to Interpretable Graph Feature and Expert Pattern Fusion

Smart contracts hold digital coins worth billions of dollars, their security issues have drawn extensive attention in the past years. Towards smart contract vulnerability detection, conventional methods heavily rely on fixed expert rules, leading to low accuracy and poor scalability. Recent deep learning approaches alleviate this issue but fail to encode useful expert knowledge. In this paper, we explore combining deep learning with expert patterns in an explainable fashion. Specifically, we develop automatic tools to extract expert patterns from the source code. We then cast the code into a semantic graph to extract deep graph features. Thereafter, the global graph feature and local expert patterns are fused to cooperate and approach the final prediction, while yielding their interpretable weights. Experiments are conducted on all available smart contracts with source code in two platforms, Ethereum and VNT Chain. Empirically, our system significantly outperforms state-of-the-art methods. Our code is released.

cs.LG↗

arXiv2021

Cross-Domain Gradient Discrepancy Minimization for Unsupervised Domain Adaptation

Unsupervised Domain Adaptation (UDA) aims to generalize the knowledge learned from a well-labeled source domain to an unlabeled target domain. Recently, adversarial domain adaptation with two distinct classifiers (bi-classifier) has been introduced into UDA which is effective to align distributions between different domains. Previous bi-classifier adversarial learning methods only focus on the similarity between the outputs of two distinct classifiers. However, the similarity of the outputs cannot guarantee the accuracy of target samples, i.e., target samples may match to wrong categories even if the discrepancy between two classifiers is small. To challenge this issue, in this paper, we propose a cross-domain gradient discrepancy minimization (CGDM) method which explicitly minimizes the discrepancy of gradients generated by source samples and target samples. Specifically, the gradient gives a cue for the semantic information of target samples so it can be used as a good supervision to improve the accuracy of target samples. In order to compute the gradient signal of target samples, we further obtain target pseudo labels through a clustering-based self-supervised learning. Extensive experiments on three widely used UDA datasets show that our method surpasses many previous state-of-the-arts. Codes are available at https://github.com/lijin118/CGDM.

cs.CV↗

arXiv2021

Convergent Filaments Contracting Towards an Intermediate-mass Prestellar Core

Filamentary structures are closely associated with star-forming cores, but their detailed physical connections are still not clear. We studied the dense gas in the region of OMC-3 MMS-7 in Orion A molecular cloud using the molecular lines observed with the Atacama Large Millimeter/submillimeter Array (ALMA) and the Submillimeter Array (SMA). The ALMA N$_2$H$^+$ (1-0) emission has revealed three dense filaments intersected at the center, coincident with the central core MMS-7, which has a mass of $3.6\,M_\odot$. The filaments and cores are embedded in a parental clump with total mass of $29\,M_\odot$. The N$_2$H$^+$ velocity field exhibits a noticeable increasing trend along the filaments towards the central core MMS-7 with a scale of $v-v_{\rm lsr} \simeq 1.5$ ${\rm km\, s^{-1}}$ over a spatial range of $\sim$20 arcsec ($8\times 10^3$ AU), corresponding to a gradient of $40\,{\rm km\, s^{-1}}\,{\rm pc}^{-1}$. This feature is most likely to indicate an infall motion towards the center. The derived infall rate ($8\times 10^{-5}\,M_\odot$ year$^{-1}$) and timescale ($3.6\times 10^5$ years) are much lower than that in a spherical free-fall collapse and more consistent with the contraction of filament structures. The filaments also exhibit a possible fragmentation, but it does not seem to largely interrupt the gas structure or the infall motion towards the center. MMS-7 thus provides an example of filamentary infall into an individual prestellar core. The filament contraction could be less intense but more steady than the global spherical collapse, and may help generate an intermediate- or even high-mass star.

astro-ph.GA↗

arXiv2021

A new standard quadratic optimization approach to beam angle optimization for fixed-field intensity modulated radiation therapy

Beam angle optimization (BAO) largely determines the performance of fixed-field intensity modulated radiation therapy (IMRT), and it is usually considered as non-convex optimization and an NP hard problem. In this work, BAO is reformulated into a highly efficient framework of standard quadratic optimization. The maximum of beamlet intensities for each incident field as the surrogate variable indicating whether one radiation field has been selected. By converting the function of maximum value in the objective into a set of linear constraints, the problem is solved as standard quadratic optimization via reweighting l1-norm scheme. The performance of the proposed BAO has been verified on a digital phantom and two patients. And the conclusion is drawn: the proposed convex optimization framework is able to find an optimal set of beam angles, leading to improved dose sparing on OARs in fixed-field IMRT.

physics.med-ph↗

arXiv2021

UGRec: Modeling Directed and Undirected Relations for Recommendation

Recommender systems, which merely leverage user-item interactions for user preference prediction (such as the collaborative filtering-based ones), often face dramatic performance degradation when the interactions of users or items are insufficient. In recent years, various types of side information have been explored to alleviate this problem. Among them, knowledge graph (KG) has attracted extensive research interests as it can encode users/items and their associated attributes in the graph structure to preserve the relation information. In contrast, less attention has been paid to the item-item co-occurrence information (i.e., \textit{co-view}), which contains rich item-item similarity information. It provides information from a perspective different from the user/item-attribute graph and is also valuable for the CF recommendation models. In this work, we make an effort to study the potential of integrating both types of side information (i.e., KG and item-item co-occurrence data) for recommendation. To achieve the goal, we propose a unified graph-based recommendation model (UGRec), which integrates the traditional directed relations in KG and the undirected item-item co-occurrence relations simultaneously. In particular, for a directed relation, we transform the head and tail entities into the corresponding relation space to model their relation; and for an undirected co-occurrence relation, we project head and tail entities into a unique hyperplane in the entity space to minimize their distance. In addition, a head-tail relation-aware attentive mechanism is designed for fine-grained relation modeling. Extensive experiments have been conducted on several publicly accessible datasets to evaluate the proposed model. Results show that our model outperforms several previous state-of-the-art methods and demonstrate the effectiveness of our UGRec model.

cs.IR↗

arXiv2021

DA-GCN: A Domain-aware Attentive Graph Convolution Network for Shared-account Cross-domain Sequential Recommendation

Shared-account Cross-domain Sequential recommendation (SCSR) is the task of recommending the next item based on a sequence of recorded user behaviors, where multiple users share a single account, and their behaviours are available in multiple domains. Existing work on solving SCSR mainly relies on mining sequential patterns via RNN-based models, which are not expressive enough to capture the relationships among multiple entities. Moreover, all existing algorithms try to bridge two domains via knowledge transfer in the latent space, and the explicit cross-domain graph structure is unexploited. In this work, we propose a novel graph-based solution, namely DA-GCN, to address the above challenges. Specifically, we first link users and items in each domain as a graph. Then, we devise a domain-aware graph convolution network to learn user-specific node representations. To fully account for users' domain-specific preferences on items, two novel attention mechanisms are further developed to selectively guide the message passing process. Extensive experiments on two real-world datasets are conducted to demonstrate the superiority of our DA-GCN method.

cs.IR↗

arXiv2021

Learning the Superpixel in a Non-iterative and Lifelong Manner

Superpixel is generated by automatically clustering pixels in an image into hundreds of compact partitions, which is widely used to perceive the object contours for its excellent contour adherence. Although some works use the Convolution Neural Network (CNN) to generate high-quality superpixel, we challenge the design principles of these networks, specifically for their dependence on manual labels and excess computation resources, which limits their flexibility compared with the traditional unsupervised segmentation methods. We target at redefining the CNN-based superpixel segmentation as a lifelong clustering task and propose an unsupervised CNN-based method called LNS-Net. The LNS-Net can learn superpixel in a non-iterative and lifelong manner without any manual labels. Specifically, a lightweight feature embedder is proposed for LNS-Net to efficiently generate the cluster-friendly features. With those features, seed nodes can be automatically assigned to cluster pixels in a non-iterative way. Additionally, our LNS-Net can adapt the sequentially lifelong learning by rescaling the gradient of weight based on both channel and spatial context to avoid overfitting. Experiments show that the proposed LNS-Net achieves significantly better performance on three benchmarks with nearly ten times lower complexity compared with other state-of-the-art methods.

cs.CV↗

arXiv2021

Involution: Inverting the Inherence of Convolution for Visual Recognition

Convolution has been the core ingredient of modern neural networks, triggering the surge of deep learning in vision. In this work, we rethink the inherent principles of standard convolution for vision tasks, specifically spatial-agnostic and channel-specific. Instead, we present a novel atomic operation for deep neural networks by inverting the aforementioned design principles of convolution, coined as involution. We additionally demystify the recent popular self-attention operator and subsume it into our involution family as an over-complicated instantiation. The proposed involution operator could be leveraged as fundamental bricks to build the new generation of neural networks for visual recognition, powering different deep learning models on several prevalent benchmarks, including ImageNet classification, COCO detection and segmentation, together with Cityscapes segmentation. Our involution-based models improve the performance of convolutional baselines using ResNet-50 by up to 1.6% top-1 accuracy, 2.5% and 2.4% bounding box AP, and 4.7% mean IoU absolutely while compressing the computational cost to 66%, 65%, 72%, and 57% on the above benchmarks, respectively. Code and pre-trained models for all the tasks are available at https://github.com/d-li14/involution.

cs.CV↗

arXiv2021

Global Guidance Network for Breast Lesion Segmentation in Ultrasound Images

Automatic breast lesion segmentation in ultrasound helps to diagnose breast cancer, which is one of the dreadful diseases that affect women globally. Segmenting breast regions accurately from ultrasound image is a challenging task due to the inherent speckle artifacts, blurry breast lesion boundaries, and inhomogeneous intensity distributions inside the breast lesion regions. Recently, convolutional neural networks (CNNs) have demonstrated remarkable results in medical image segmentation tasks. However, the convolutional operations in a CNN often focus on local regions, which suffer from limited capabilities in capturing long-range dependencies of the input ultrasound image, resulting in degraded breast lesion segmentation accuracy. In this paper, we develop a deep convolutional neural network equipped with a global guidance block (GGB) and breast lesion boundary detection (BD) modules for boosting the breast ultrasound lesion segmentation. The GGB utilizes the multi-layer integrated feature map as a guidance information to learn the long-range non-local dependencies from both spatial and channel domains. The BD modules learn additional breast lesion boundary map to enhance the boundary quality of a segmentation result refinement. Experimental results on a public dataset and a collected dataset show that our network outperforms other medical image segmentation methods and the recent semantic segmentation methods on breast ultrasound lesion segmentation. Moreover, we also show the application of our network on the ultrasound prostate segmentation, in which our method better identifies prostate regions than state-of-the-art networks.

eess.IV↗

arXiv2021

Interest-aware Message-Passing GCN for Recommendation

Graph Convolution Networks (GCNs) manifest great potential in recommendation. This is attributed to their capability on learning good user and item embeddings by exploiting the collaborative signals from the high-order neighbors. Like other GCN models, the GCN based recommendation models also suffer from the notorious over-smoothing problem - when stacking more layers, node embeddings become more similar and eventually indistinguishable, resulted in performance degradation. The recently proposed LightGCN and LR-GCN alleviate this problem to some extent, however, we argue that they overlook an important factor for the over-smoothing problem in recommendation, that is, high-order neighboring users with no common interests of a user can be also involved in the user's embedding learning in the graph convolution operation. As a result, the multi-layer graph convolution will make users with dissimilar interests have similar embeddings. In this paper, we propose a novel Interest-aware Message-Passing GCN (IMP-GCN) recommendation model, which performs high-order graph convolution inside subgraphs. The subgraph consists of users with similar interests and their interacted items. To form the subgraphs, we design an unsupervised subgraph generation module, which can effectively identify users with common interests by exploiting both user feature and graph structure. To this end, our model can avoid propagating negative information from high-order neighbors into embedding learning. Experimental results on three large-scale benchmark datasets show that our model can gain performance improvement by stacking more layers and outperform the state-of-the-art GCN-based recommendation models significantly.

cs.IR↗

arXiv2021

MLCask: Efficient Management of Component Evolution in Collaborative Data Analytics Pipelines

With the ever-increasing adoption of machine learning for data analytics, maintaining a machine learning pipeline is becoming more complex as both the datasets and trained models evolve with time. In a collaborative environment, the changes and updates due to pipeline evolution often cause cumbersome coordination and maintenance work, raising the costs and making it hard to use. Existing solutions, unfortunately, do not address the version evolution problem, especially in a collaborative environment where non-linear version control semantics are necessary to isolate operations made by different user roles. The lack of version control semantics also incurs unnecessary storage consumption and lowers efficiency due to data duplication and repeated data pre-processing, which are avoidable. In this paper, we identify two main challenges that arise during the deployment of machine learning pipelines, and address them with the design of versioning for an end-to-end analytics system MLCask. The system supports multiple user roles with the ability to perform Git-like branching and merging operations in the context of the machine learning pipelines. We define and accelerate the metric-driven merge operation by pruning the pipeline search tree using reusable history records and pipeline compatibility information. Further, we design and implement the prioritized pipeline search, which gives preference to the pipelines that probably yield better performance. The effectiveness of MLCask is evaluated through an extensive study over several real-world deployment cases. The performance evaluation shows that the proposed merge operation is up to 7.8x faster and saves up to 11.9x storage space than the baseline method that does not utilize history records.

cs.SE↗

arXiv2021

Triple-cooperative Video Shadow Detection

Shadow detection in a single image has received significant research interest in recent years. However, much fewer works have been explored in shadow detection over dynamic scenes. The bottleneck is the lack of a well-established dataset with high-quality annotations for video shadow detection. In this work, we collect a new video shadow detection dataset, which contains 120 videos with 11, 685 frames, covering 60 object categories, varying lengths, and different motion/lighting conditions. All the frames are annotated with a high-quality pixel-level shadow mask. To the best of our knowledge, this is the first learning-oriented dataset for video shadow detection. Furthermore, we develop a new baseline model, named triple-cooperative video shadow detection network (TVSD-Net). It utilizes triple parallel networks in a cooperative manner to learn discriminative representations at intra-video and inter-video levels. Within the network, a dual gated co-attention module is proposed to constrain features from neighboring frames in the same video, while an auxiliary similarity loss is introduced to mine semantic information between different videos. Finally, we conduct a comprehensive study on ViSha, evaluating 12 state-of-the-art models (including single image shadow detectors, video object segmentation, and saliency detection methods). Experiments demonstrate that our model outperforms SOTA competitors.

cs.CV↗

arXiv2021

Optimization of graded filleted lattice structures subject to yield and buckling constraints

To reduce the stress concentration and ensure the structural safety for lattice structure designs, in this paper, a new optimization framework is developed for the optimal design of graded lattice structures, innovatively integrating fillet designs as well as yield and elastic buckling constraints. Both strut and fillet radii are defined as design variables. Homogenization method is employed to characterize the effective elastic constants and yield stresses of the lattice metamaterials. Metamaterial models are developed to represent the relationships between the metamaterial effective properties and lattice geometric variables. A yield constraint, based on the modified Hills yield criterion, is developed as a function of relative strut radii and fillet parameters. An elastic buckling constraint, based on the Euler buckling formula and the Johnson formula, is developed as a function of relative strut radii. Both yield and buckling constraints are integrated into an optimization problem formulation; a new optimization framework is proposed and a case study of minimizing the compliance of a Messerschmitt-Bolkow-Blohm beam is conducted. The yield and buckling constraints guarantee the safety of the optimized beams composed of BCC and PC lattices. Reductions in compliance and stress concentration are achieved by the optimized MBB beams.

cond-mat.mes-hall↗

arXiv2021

Revealing the diverse magnetic field morphologies in Taurus dense cores with sensitive sub-millimeter polarimetry

We have obtained sensitive dust continuum polarization observations at 850 $μ$m in the B213 region of Taurus using POL-2 on SCUBA-2 at the James Clerk Maxwell Telescope (JCMT), as part of the BISTRO (B-fields in STar-forming Region Observations) survey. These observations allow us to probe magnetic field (B-field) at high spatial resolution ($\sim$2000 au or $\sim$0.01 pc at 140 pc) in two protostellar cores (K04166 and K04169) and one prestellar core (Miz-8b) that lie within the B213 filament. Using the Davis-Chandrasekhar-Fermi method, we estimate the B-field strengths in K04166, K04169, and Miz-8b to be 38$\pm$14 $μ$G, 44$\pm$16 $μ$G, and 12$\pm$5 $μ$G, respectively. These cores show distinct mean B-field orientations. B-field in K04166 is well ordered and aligned parallel to the orientations of the core minor axis, outflows, core rotation axis, and large-scale uniform B-field, in accordance with magnetically regulated star formation via ambipolar diffusion taking place in K04166. B-field in K04169 is found to be ordered but oriented nearly perpendicular to the core minor axis and large-scale B-field, and not well-correlated with other axes. In contrast, Miz-8b exhibits disordered B-field which show no preferred alignment with the core minor axis or large-scale field. We found that only one core, K04166, retains a memory of the large-scale uniform B-field. The other two cores, K04169 and Miz-8b, are decoupled from the large-scale field. Such a complex B-field configuration could be caused by gas inflow onto the filament, even in the presence of a substantial magnetic flux.

astro-ph.GA↗

arXiv2021

Deep Texture-Aware Features for Camouflaged Object Detection

Camouflaged object detection is a challenging task that aims to identify objects having similar texture to the surroundings. This paper presents to amplify the subtle texture difference between camouflaged objects and the background for camouflaged object detection by formulating multiple texture-aware refinement modules to learn the texture-aware features in a deep convolutional neural network. The texture-aware refinement module computes the covariance matrices of feature responses to extract the texture information, designs an affinity loss to learn a set of parameter maps that help to separate the texture between camouflaged objects and the background, and adopts a boundary-consistency loss to explore the object detail structures.We evaluate our network on the benchmark dataset for camouflaged object detection both qualitatively and quantitatively. Experimental results show that our approach outperforms various state-of-the-art methods by a large margin.

cs.CV↗

arXiv2020

ALMA [N ıı] 205 μm Imaging Spectroscopy of the Lensed Submillimeter galaxy ID 141 at redshift 4.24

We present the Atacama Large Millimeter/submillimeter Array (ALMA) observation of the Sub-millimeter galaxy (SMG) ID 141 at z=4.24 in the [N II] 205 $μ$m line (hereafter [N II]) and the underlying continuum at (rest-frame) 197.6 $μ$m. Benefiting from lensing magnification by a galaxy pair at z=0.595, ID 141 is one of the brightest z$>4$ SMGs. At the angular resolutions of $\sim1.2"$ to $1.5"$ ($1" \sim6.9$ kpc), our observation clearly separates, and moderately resolves the two lensed images in both continuum and line emission at $\rm S/N>5$ . Our continuum-based lensing model implies an averaged amplification factor of $\sim5.8$ and reveals that the de-lensed continuum image has the Sérsic index $\simeq 0.95$ and the Sérsic radius of $\sim0.18" (\sim 1.24$ kpc). Furthermore, the reconstructed [N II] velocity field in the source plane is dominated by a rotation component with a maximum velocity of $\sim 300$ km/s at large radii, indicating a dark matter halo mass of $\sim 10^{12}M_{\odot}$. This, together with the reconstructed velocity dispersion field being smooth and modest in value ($<100$ km/s) over much of the outer parts of the galaxy, favours the interpretation of ID 141 being a disk galaxy dynamically supported by rotation. The observed [N II]/CO (7-6) and [N II]/[C II] 158 $μ$m line luminosity ratios, which are consistent with the corresponding line ratio vs. far-infrared color correlation from local luminous infrared galaxies, imply a de-lensed star formation rate of ($1.8\pm 0.6)\times10^3M_\odot$/yr and provide an independent estimate on the size of the star-forming region $0.7^{+0.3}_{-0.3}$ kpc in radius.

astro-ph.GA↗

arXiv2020

Super-Resolution Ultrasound Localization Microscopy Based on a High Frame-rate Clinical Ultrasound Scanner: An In-human Feasibility Study

Non-invasive detection of microvascular alterations in deep tissues in vivo provides critical information for clinical diagnosis and evaluation of a broad-spectrum of pathologies. Recently, the emergence of super-resolution ultrasound localization microscopy (ULM) offers new possibilities for clinical imaging of microvasculature at capillary level. Currently, the clinical utility of ULM on clinical ultrasound scanners is hindered by the technical limitations, such as long data acquisition time, and compromised tracking performance associated with low imaging frame-rate. Here we present an in-human ULM on a high frame-rate (HFR) clinical ultrasound scanner to achieve super-resolution microvessel imaging using a short acquisition time (<10s). Ultrasound MB data were acquired from different human tissues, (liver, kidney, pancreatic, and breast tumor) using an HFR clinical scanner. By leveraging the HFR and advanced processing techniques including sub-pixel motion registration, MB signal separation, and Kalman filter-based tracking, MBs can be robustly localized and tracked for successful ULM under the circumstances of relatively high MB concentration and limited data acquisition time in humans. Subtle morphological and hemodynamic information were demonstrated on data acquired with single breath-hold and free-hand scanning. Compared with contrast-enhanced power Doppler generated based on the same MB dataset, ULM showed a 5.7-fold resolution improvement in a vessel, and provided a wide-range flow speed measurement that is Doppler angle-independent. This study demonstrated the feasibility of ultrafast in-human ULM in various human tissues based on a clinical scanner that supports HFR imaging, and showed a great potential for the implementation of super-resolution ultrasound microvessel imaging in a myriad of clinical applications involving microvascular abnormalities and pathologies.

physics.med-ph↗

arXiv2020

Towards Self-Tuning Parameter Servers

Recent years, many applications have been driven advances by the use of Machine Learning (ML). Nowadays, it is common to see industrial-strength machine learning jobs that involve millions of model parameters, terabytes of training data, and weeks of training. Good efficiency, i.e., fast completion time of running a specific ML job, therefore, is a key feature of a successful ML system. While the completion time of a long-running ML job is determined by the time required to reach model convergence, practically that is also largely influenced by the values of various system settings. In this paper, we contribute techniques towards building self-tuning parameter servers. Parameter Server (PS) is a popular system architecture for large-scale machine learning systems; and by self-tuning we mean while a long-running ML job is iteratively training the expert-suggested model, the system is also iteratively learning which system setting is more efficient for that job and applies it online. While our techniques are general enough to various PS-style ML systems, we have prototyped our techniques on top of TensorFlow. Experiments show that our techniques can reduce the completion times of a variety of long-running TensorFlow jobs from 1.4x to 18x.

cs.DB↗