arXiv subjects

Li Zhang

Publications and source records attributed to Li Zhang.

At least 721 records · Page 40Linked to original sources

arXiv2021

Large evanescently-induced Brillouin scattering at the surrounding of a nanofibre

Brillouin scattering has been widely exploited for advanced photonics functionalities such as microwave photonics, signal processing, sensing, lasing, and more recently in micro- and nano-photonic waveguides. So far, all the works have focused on the opto-acoustic interaction driven from the core region of micro- and nano-waveguides. Here we observe, for the first time, an efficient Brillouin scattering generated by an evanescent field nearby a sub-wavelength waveguide embedded in a pressurised gas cell, with a maximum gain coefficient of $18.90 \pm 0.17$ m$^{-1}$W$^{-1}$. This gain is 11 times larger than the highest Brillouin gain obtained in a hollow-core fibre and 79 times larger than in a standard single-mode fibre. The realisation of strong free-space Brillouin scattering from a waveguide benefits from the flexibility of confined light while providing a direct access to the opto-acoustic interaction, as required in free-space optoacoustics such as Brillouin spectroscopy and microscopy. Therefore, our work creates an important bridge between Brillouin scattering in waveguides, Brillouin spectroscopy and microscopy, and opens new avenues in light-sound interactions, optomechanics, sensing, lasing and imaging.

physics.optics↗

arXiv2021

BEFD: Boundary Enhancement and Feature Denoising for Vessel Segmentation

Blood vessel segmentation is crucial for many diagnostic and research applications. In recent years, CNN-based models have leaded to breakthroughs in the task of segmentation, however, such methods usually lose high-frequency information like object boundaries and subtle structures, which are vital to vessel segmentation. To tackle this issue, we propose Boundary Enhancement and Feature Denoising (BEFD) module to facilitate the network ability of extracting boundary information in semantic segmentation, which can be integrated into arbitrary encoder-decoder architecture in an end-to-end way. By introducing Sobel edge detector, the network is able to acquire additional edge prior, thus enhancing boundary in an unsupervised manner for medical image segmentation. In addition, we also utilize a denoising block to reduce the noise hidden in the low-level features. Experimental results on retinal vessel dataset and angiocarpy dataset demonstrate the superior performance of the new BEFD module.

eess.IV↗

arXiv2021

Three Decades of Deception Techniques in Active Cyber Defense -- Retrospect and Outlook

Deception techniques have been widely seen as a game changer in cyber defense. In this paper, we review representative techniques in honeypots, honeytokens, and moving target defense, spanning from the late 1980s to the year 2021. Techniques from these three domains complement with each other and may be leveraged to build a holistic deception based defense. However, to the best of our knowledge, there has not been a work that provides a systematic retrospect of these three domains all together and investigates their integrated usage for orchestrated deceptions. Our paper aims to fill this gap. By utilizing a tailored cyber kill chain model which can reflect the current threat landscape and a four-layer deception stack, a two-dimensional taxonomy is developed, based on which the deception techniques are classified. The taxonomy literally answers which phases of a cyber attack campaign the techniques can disrupt and which layers of the deception stack they belong to. Cyber defenders may use the taxonomy as a reference to design an organized and comprehensive deception plan, or to prioritize deception efforts for a budget conscious solution. We also discuss two important points for achieving active and resilient cyber defense, namely deception in depth and deception lifecycle, where several notable proposals are illustrated. Finally, some outlooks on future research directions are presented, including dynamic integration of different deception techniques, quantified deception effects and deception operation cost, hardware-supported deception techniques, as well as techniques developed based on better understanding of the human element.

cs.CR↗

arXiv2021

Complementary Evidence Identification in Open-Domain Question Answering

This paper proposes a new problem of complementary evidence identification for open-domain question answering (QA). The problem aims to efficiently find a small set of passages that covers full evidence from multiple aspects as to answer a complex question. To this end, we proposes a method that learns vector representations of passages and models the sufficiency and diversity within the selected set, in addition to the relevance between the question and passages. Our experiments demonstrate that our method considers the dependence within the supporting evidence and significantly improves the accuracy of complementary evidence selection in QA domain.

cs.CL↗

arXiv2021

Hierarchical Road Topology Learning for Urban Map-less Driving

The majority of current approaches in autonomous driving rely on High-Definition (HD) maps which detail the road geometry and surrounding area. Yet, this reliance is one of the obstacles to mass deployment of autonomous vehicles due to poor scalability of such prior maps. In this paper, we tackle the problem of online road map extraction via leveraging the sensory system aboard the vehicle itself. To this end, we design a structured model where a graph representation of the road network is generated in a hierarchical fashion within a fully convolutional network. The method is able to handle complex road topology and does not require a user in the loop.

cs.RO↗

arXiv2021

Depth-conditioned Dynamic Message Propagation for Monocular 3D Object Detection

The objective of this paper is to learn context- and depth-aware feature representation to solve the problem of monocular 3D object detection. We make following contributions: (i) rather than appealing to the complicated pseudo-LiDAR based approach, we propose a depth-conditioned dynamic message propagation (DDMP) network to effectively integrate the multi-scale depth information with the image context;(ii) this is achieved by first adaptively sampling context-aware nodes in the image context and then dynamically predicting hybrid depth-dependent filter weights and affinity matrices for propagating information; (iii) by augmenting a center-aware depth encoding (CDE) task, our method successfully alleviates the inaccurate depth prior; (iv) we thoroughly demonstrate the effectiveness of our proposed approach and show state-of-the-art results among the monocular-based approaches on the KITTI benchmark dataset. Particularly, we rank $1^{st}$ in the highly competitive KITTI monocular 3D object detection track on the submission day (November 16th, 2020). Code and models are released at \url{https://github.com/fudan-zvg/DDMP}

cs.CV↗

arXiv2021

Few-shot Action Recognition with Prototype-centered Attentive Learning

Few-shot action recognition aims to recognize action classes with few training samples. Most existing methods adopt a meta-learning approach with episodic training. In each episode, the few samples in a meta-training task are split into support and query sets. The former is used to build a classifier, which is then evaluated on the latter using a query-centered loss for model updating. There are however two major limitations: lack of data efficiency due to the query-centered only loss design and inability to deal with the support set outlying samples and inter-class distribution overlapping problems. In this paper, we overcome both limitations by proposing a new Prototype-centered Attentive Learning (PAL) model composed of two novel components. First, a prototype-centered contrastive learning loss is introduced to complement the conventional query-centered learning objective, in order to make full use of the limited training samples in each episode. Second, PAL further integrates a hybrid attentive learning mechanism that can minimize the negative impacts of outliers and promote class separation. Extensive experiments on four standard few-shot action benchmarks show that our method clearly outperforms previous state-of-the-art methods, with the improvement particularly significant (10+\%) on the most challenging fine-grained action recognition benchmark.

cs.CV↗

arXiv2021

Boundary-sensitive Pre-training for Temporal Localization in Videos

Many video analysis tasks require temporal localization thus detection of content changes. However, most existing models developed for these tasks are pre-trained on general video action classification tasks. This is because large scale annotation of temporal boundaries in untrimmed videos is expensive. Therefore no suitable datasets exist for temporal boundary-sensitive pre-training. In this paper for the first time, we investigate model pre-training for temporal localization by introducing a novel boundary-sensitive pretext (BSP) task. Instead of relying on costly manual annotations of temporal boundaries, we propose to synthesize temporal boundaries in existing video action classification datasets. With the synthesized boundaries, BSP can be simply conducted via classifying the boundary types. This enables the learning of video representations that are much more transferable to downstream temporal localization tasks. Extensive experiments show that the proposed BSP is superior and complementary to the existing action classification based pre-training counterpart, and achieves new state-of-the-art performance on several temporal localization tasks.

cs.CV↗

arXiv2021

Robust and Accurate Object Detection via Adversarial Learning

Data augmentation has become a de facto component for training high-performance deep image classifiers, but its potential is under-explored for object detection. Noting that most state-of-the-art object detectors benefit from fine-tuning a pre-trained classifier, we first study how the classifiers' gains from various data augmentations transfer to object detection. The results are discouraging; the gains diminish after fine-tuning in terms of either accuracy or robustness. This work instead augments the fine-tuning stage for object detectors by exploring adversarial examples, which can be viewed as a model-dependent data augmentation. Our method dynamically selects the stronger adversarial images sourced from a detector's classification and localization branches and evolves with the detector to ensure the augmentation policy stays current and relevant. This model-dependent augmentation generalizes to different object detectors better than AutoAugment, a model-agnostic augmentation policy searched based on one particular detector. Our approach boosts the performance of state-of-the-art EfficientDets by +1.1 mAP on the COCO object detection benchmark. It also improves the detectors' robustness against natural distortions by +3.8 mAP and against domain shift by +1.3 mAP. Models are available at https://github.com/google/automl/tree/master/efficientdet/Det-AdvProp.md

cs.CV↗

arXiv2021

Learning Dynamic Alignment via Meta-filter for Few-shot Learning

Few-shot learning (FSL), which aims to recognise new classes by adapting the learned knowledge with extremely limited few-shot (support) examples, remains an important open problem in computer vision. Most of the existing methods for feature alignment in few-shot learning only consider image-level or spatial-level alignment while omitting the channel disparity. Our insight is that these methods would lead to poor adaptation with redundant matching, and leveraging channel-wise adjustment is the key to well adapting the learned knowledge to new classes. Therefore, in this paper, we propose to learn a dynamic alignment, which can effectively highlight both query regions and channels according to different local support information. Specifically, this is achieved by first dynamically sampling the neighbourhood of the feature position conditioned on the input few shot, based on which we further predict a both position-dependent and channel-dependent Dynamic Meta-filter. The filter is used to align the query feature with position-specific and channel-specific knowledge. Moreover, we adopt Neural Ordinary Differential Equation (ODE) to enable a more accurate control of the alignment. In such a sense our model is able to better capture fine-grained semantic context of the few-shot example and thus facilitates dynamical knowledge adaptation for few-shot learning. The resulting framework establishes the new state-of-the-arts on major few-shot visual recognition benchmarks, including miniImageNet and tieredImageNet.

cs.CV↗

arXiv2021

Fluence Adaptation for Task-based Dose Optimization in X-ray Phase-Contrast Imaging

Purpose: Grating-based imaging (GBI) and edge-illumination (EI) are two promising types of XPCI as the conventional x-ray sources can be directly utilized. For GBI and EI systems, the phase-stepping acquisition with multiple exposures at a constant fluence is usually adopted in the literature. This work, however, attempts to challenge such a constant fluence concept during the phase-stepping process and proposes a fluence adaptation mechanism for dose reduction. Method: Recently, analytic multi-order moment analysis has been proposed to improve the computing efficiency. In these algorithms, multiple contrasts can be calculated by summing together the weighted phase-stepping curves (PSCs) with some kernel functions, which suggests us that the raw data at different steps have different contributions for the noise in retrieved contrasts. Based on analytic retrieval formulas and the Gaussian noise model for detected signals, we derived an optimal adaptive fluence distribution, which is proportional to the absolute weighting kernel functions and the root of original sample PSCs acquired under the constant fluence. Results: To validate our analyses, simulations and experiments are conducted for GBI and EI systems. Simulated results demonstrate that the dose reduction ratio between our proposed fluence distributions and the typical constant one can be about 20% for the phase contrast, which is consistent with our theoretical predictions. Although the experimental noise reduction ratios are a little smaller than the theoretical ones, synthetic and real experiments both observe better noise performance by our proposed method. Our simulated results also give out the effective ranges of the parameters of the PSCs, such as the visibility in GBI, the standard deviation and the mean value in EI, providing a guidance for the use of our proposed approach in practice.

physics.med-ph↗

arXiv2021

Long-term multi-wavelength variations of Fermi blazar 3C 279

The long-term optical, X-ray and $γ$-ray data of blazar 3C 279 have been compiled from $Swift$-XRT, $RXTE$ PCA, $Fermi$-LAT, SMARTS and literature. The source exhibits strong variability on long time scales. Since 1980s to now, the optical $R$ band light curve spans above 32 yr, and a possible 5.6-yr-long quasi-periodic variation component has been found in it. The optical spectral behavior has been investigated. In the optical band, the mean spectral index is -1.71. The source exhibits an obvious special spectral behavior. In the low state, the source shows a clear bluer-when-brighter behavior in a sense that the optical spectrum turns harder (flatter) when the brightness increases. While in the high state, the optical spectrum is stable, that means the source spectral index does not vary with the brightness. The correlation analysis has been performed among optical, X-ray and $γ$-ray energy bands. The result indicates that the variations of $γ$-ray and X-ray bands are well correlated without time delay on the time scale of days, and their variations exhibit weak correlations with those of optical band. The variations, especial outbursts, are simultaneous, but the magnitude of variations is disproportionate. The detailed analysis reveals that the main outbursts exhibit strong correlations in different $γ$-ray, X-ray and optical bands.

astro-ph.HE↗

arXiv2021

Automatically detecting the conflicts between software requirements based on finer semantic analysis

Context: Conflicts between software requirements bring uncertainties to product development. Some great approaches have been proposed to identify these conflicts. However, they usually require the software requirements represented with specific templates and/or depend on other external source which is often uneasy to build for lots of projects in practice. Objective: We aim to propose an approach Finer Semantic Analysis-based Requirements Conflict Detector (FSARC) to automatically detecting the conflicts between the given natural language functional requirements by analyzing their finer semantic compositions. Method: We build a harmonized semantic meta-model of functional requirements with the form of eight-tuple. Then we propose algorithms to automatically analyze the linguistic features of requirements and to annotate the semantic elements for their semantic model construction. And we define seven types of conflicts as long as their heuristic detecting rules on the ground of their text pattern and semantical dependency. Finally, we design and implement the algorithm for conflicts detection. Results: The experiment with four requirement datasets illustrates that the recall of FSARC is nearly 100% and the average precision is 83.88% on conflicts detection. Conclusion: We provide a useful tool for detecting the conflicts between natural language functional requirements to improve the quality of the final requirements set. Besides, our approach is capable of transforming the natural language functional requirements into eight semantic tuples, which is useful not only the detection of the conflicts between requirements but also some other tasks such as constructing the association between requirements and so on.

cs.SE↗

arXiv2021

The NPU System for the 2020 Personalized Voice Trigger Challenge

This paper describes the system developed by the NPU team for the 2020 personalized voice trigger challenge. Our submitted system consists of two independently trained subsystems: a small footprint keyword spotting (KWS) system and a speaker verification (SV) system. For the KWS system, a multi-scale dilated temporal convolutional (MDTC) network is proposed to detect wake-up word (WuW). For SV system, Write something here. The KWS predicts posterior probabilities of whether an audio utterance contains WuW and estimates the location of WuW at the same time. When the posterior probability ofWuW reaches a predefined threshold, the identity information of triggered segment is determined by the SV system. On evaluation dataset, our submitted system obtains detection costs of 0.081and 0.091 in close talking and far-field tasks, respectively.

cs.SD↗

arXiv2021

Unlocking the Origin of Compositional Fluctuations in InGaN Light Emitting Diodes

The accurate determination of the compositional fluctuations is pivotal in understanding their role in the reduction of efficiency in high indium content $In_{x}Ga_{1-x}N$ light-emitting diodes, the origin of which is still poorly understood. Here we have combined electron energy loss spectroscopy (EELS) imaging at sub-nanometer resolution with multiscale computational models to obtain a statistical distribution of the compositional fluctuations in $In_{x}Ga_{1-x}N$ quantum wells (QWs). Employing a multiscale computational model, we show the tendency of intrinsic compositional fluctuation in $In_{x}Ga_{1-x}N$ QWs at different Indium concentration and in the presence of strain. We have developed a systematic formalism based on the autonomous detection of compositional fluctuation in observed and simulated EELS maps. We have shown a direct comparison between the computationally predicted and experimentally observed compositional fluctuations. We have found that although a random alloy model captures the distribution of compositional fluctuations in relatively low In ($\sim$ 18%) content $In_{x}Ga_{1-x}N$ QWs, there exists a striking deviation from the model in higher In content ($\geq$ 24%) QWs. Our results highlight a distinct behavior in carrier localization driven by compositional fluctuations in the low and high In-content InGaN QWs, which would ultimately affect the performance of LEDs. Furthermore, our robust computational and atomic characterization method can be widely applied to study materials in which nanoscale compositional fluctuations play a significant role on the material performance.

cond-mat.mtrl-sci↗

arXiv2021

A Survey on Concept Factorization: From Shallow to Deep Representation Learning

The quality of learned features by representation learning determines the performance of learning algorithms and the related application tasks (such as high-dimensional data clustering). As a relatively new paradigm for representation learning, Concept Factorization (CF) has attracted a great deal of interests in the areas of machine learning and data mining for over a decade. Lots of effective CF based methods have been proposed based on different perspectives and properties, but note that it still remains not easy to grasp the essential connections and figure out the underlying explanatory factors from exiting studies. In this paper, we therefore survey the recent advances on CF methodologies and the potential benchmarks by categorizing and summarizing the current methods. Specifically, we first re-view the root CF method, and then explore the advancement of CF-based representation learning ranging from shallow to deep/multilayer cases. We also introduce the potential application areas of CF-based methods. Finally, we point out some future directions for studying the CF-based representation learning. Overall, this survey provides an insightful overview of both theoretical basis and current developments in the field of CF, which can also help the interested researchers to understand the current trends of CF and find the most appropriate CF techniques to deal with particular applications.

cs.LG↗

arXiv2021

Failure Prediction in Production Line Based on Federated Learning: An Empirical Study

Data protection across organizations is limiting the application of centralized learning (CL) techniques. Federated learning (FL) enables multiple participants to build a learning model without sharing data. Nevertheless, there are very few research works on FL in intelligent manufacturing. This paper presents the results of an empirical study on failure prediction in the production line based on FL. This paper (1) designs Federated Support Vector Machine (FedSVM) and Federated Random Forest (FedRF) algorithms for the horizontal FL and vertical FL scenarios, respectively; (2) proposes an experiment process for evaluating the effectiveness between the FL and CL algorithms; (3) finds that the performance of FL and CL are not significantly different on the global testing data, on the random partial testing data, and on the estimated unknown Bosch data, respectively. The fact that the testing data is heterogeneous enhances our findings. Our study reveals that FL can replace CL for failure prediction.

cs.LG↗

arXiv2021

Surface-acoustic-wave-controlled optomechanically induced transparency in a hybrid piezo-optomechanical planar distributed Bragg-reflector-cavity system

We propose a scheme that can generate tunable optomechanically induced transparency in a hybrid piezooptomechanical cavity system. The system is composed of a high-quality planar distributed Bragg reflector cavity modified with an embedded Gaussian-shaped defect. Moreover, interdigitated transducers are fabricated on the surface of the cavity to generate surface acoustic waves. Under the actuation of the surface acoustic wave, the upper Bragg mirrors can be vibrated as a bulk acoustic resonator, and the distributed Bragg reflector cavity becomes a standard three-level optomechanical system. In this situation, we show that when a strong pump optical field and a weak probe optical field are simultaneously applied to the hybrid optomechanical cavity system, optomechanically induced transparency occurs under the quantum interference between different energy-level pathways. Our scheme can be applied in the fields of optical switches and quantum information processing in solid-state quantum systems.

quant-ph↗