arXiv subjects

Liang Xu

Publications and source records attributed to Liang Xu.

At least 145 records · Page 8Linked to original sources

arXiv2021

A Data-Driven Convex Programming Approach to Worst-Case Robust Tracking Controller Design

This paper studies finite-horizon robust tracking control for discrete-time linear systems, based on input-output data. We leverage behavioral theory to represent system trajectories through a set of noiseless historical data, instead of using an explicit system model. By assuming that recent output data available to the controller are affected by noise terms verifying a quadratic bound, we formulate an optimization problem with a linear cost and LMI constraints for solving the robust tracking problem without any approximations. Our approach hinges on a parameterization of noise trajectories compatible with the data-dependent system representation and on a reformulation of the tracking cost, which enables the application of the S-lemma. In addition, we propose a method for reducing the computational complexity and demonstrate that the size of the resulting LMIs does not scale with the number of historical data. Finally, we show that the proposed formulation can easily incorporate actuator disturbances as well as constraints on inputs and outputs. The performance of the new controllers is discussed through simulations.

math.OC↗

arXiv2021

Pushing the Envelope of Thin Crack Detection

In this study, we consider the problem of detecting cracks from the image of a concrete surface for automated inspection of infrastructure, such as bridges. Its overall accuracy is determined by how accurately thin cracks with sub-pixel widths can be detected. Our interest is in making it possible to detect cracks close to the limit of thinness if it can be defined. Toward this end, we first propose a method for training a CNN to make it detect cracks more accurately than humans while training them on human-annotated labels. To achieve this seemingly impossible goal, we intentionally lower the spatial resolution of input images while maintaining that of their labels when training a CNN. This makes it possible to annotate cracks that are too thin for humans to detect, which we call super-human labels. We experimentally show that this makes it possible to detect cracks from an image of one-third the resolution of images used for annotation with about the same accuracy. We additionally propose three methods for further improving the detection accuracy of thin cracks: i) P-pooling to maintain small image structures during downsampling operations; ii) Removal of short-segment cracks in a post-processing step utilizing a prior of crack shapes learned using the VAE-GAN framework; iii) Modeling uncertainty of the prediction to better handle hard labels beyond the limit of CNNs' detection ability, which technically work as noisy labels. We experimentally examine the effectiveness of these methods.

cs.CV↗

arXiv2021

NVAE-GAN Based Approach for Unsupervised Time Series Anomaly Detection

In recent studies, Lots of work has been done to solve time series anomaly detection by applying Variational Auto-Encoders (VAEs). Time series anomaly detection is a very common but challenging task in many industries, which plays an important role in network monitoring, facility maintenance, information security, and so on. However, it is very difficult to detect anomalies in time series with high accuracy, due to noisy data collected from real world, and complicated abnormal patterns. From recent studies, we are inspired by Nouveau VAE (NVAE) and propose our anomaly detection model: Time series to Image VAE (T2IVAE), an unsupervised model based on NVAE for univariate series, transforming 1D time series to 2D image as input, and adopting the reconstruction error to detect anomalies. Besides, we also apply the Generative Adversarial Networks based techniques to T2IVAE training strategy, aiming to reduce the overfitting. We evaluate our model performance on three datasets, and compare it with other several popular models using F1 score. T2IVAE achieves 0.639 on Numenta Anomaly Benchmark, 0.651 on public dataset from NASA, and 0.504 on our dataset collected from real-world scenario, outperforms other comparison models.

cs.LG↗

arXiv2021

Low-cost and high-performance data augmentation for deep-learning-based skin lesion classification

Although deep convolutional neural networks (DCNNs) have achieved significant accuracy in skin lesion classification comparable or even superior to those of dermatologists, practical implementation of these models for skin cancer screening in low resource settings is hindered by their limitations in computational cost and training dataset. To overcome these limitations, we propose a low-cost and high-performance data augmentation strategy that includes two consecutive stages of augmentation search and network search. At the augmentation search stage, the augmentation strategy is optimized in the search space of Low-Cost-Augment (LCA) under the criteria of balanced accuracy (BACC) with 5-fold cross validation. At the network search stage, the DCNNs are fine-tuned with the full training set in order to select the model with the highest BACC. The efficiency of the proposed data augmentation strategy is verified on the HAM10000 dataset using EfficientNets as a baseline. With the proposed strategy, we are able to reduce the search space to 60 and achieve a high BACC of 0.853 by using a single DCNN model without external database, suitable to be implemented in mobile devices for DCNN-based skin lesion detection in low resource settings.

cs.CV↗

arXiv2020

CLUE: A Chinese Language Understanding Evaluation Benchmark

The advent of natural language understanding (NLU) benchmarks for English, such as GLUE and SuperGLUE allows new NLU models to be evaluated across a diverse set of tasks. These comprehensive benchmarks have facilitated a broad range of research and applications in natural language processing (NLP). The problem, however, is that most such benchmarks are limited to English, which has made it difficult to replicate many of the successes in English NLU for other languages. To help remedy this issue, we introduce the first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark. CLUE is an open-ended, community-driven project that brings together 9 tasks spanning several well-established single-sentence/sentence-pair classification tasks, as well as machine reading comprehension, all on original Chinese text. To establish results on these tasks, we report scores using an exhaustive set of current state-of-the-art pre-trained Chinese models (9 in total). We also introduce a number of supplementary datasets and additional tools to help facilitate further progress on Chinese NLU. Our benchmark is released at https://www.CLUEbenchmarks.com

cs.CL↗

arXiv2020

Astronomical Site Monitoring System at Lijiang Observatory

We installed two sets of Astronomical Site Monitoring System(ASMS) at Lijiang Observatory(GMG), for the running of the 2.4-meter Lijiang optical telescope(LJT) and the 1.6-meter Multi-channel Photometric Survey Telescope (Mephisto). The Mephistro is under construction. ASMS has been running on robotic mode since 2017. The core instruments: Cloud Sensor, All-Sky Camera and Autonomous-DIMM that are developed by our group, together with the commercial Meteorological Station and Sky Quality Meter, are combined into the astronomical optical site monitoring system. The new Cloud Sensor's Cloud-Clear Relationship is presented for the first time, which is used to calculate the All-Sky cloud cover. We designed the Autonomous-DIMM located on a tower, with the same height as LJT. The seeing data have been observed for a full year. ASMS's data for the year 2019 are also analysed in detail, which are valuable to observers.

astro-ph.IM↗

arXiv2020

OCNLI: Original Chinese Natural Language Inference

Despite the tremendous recent progress on natural language inference (NLI), driven largely by large-scale investment in new datasets (e.g., SNLI, MNLI) and advances in modeling, most progress has been limited to English due to a lack of reliable datasets for most of the world's languages. In this paper, we present the first large-scale NLI dataset (consisting of ~56,000 annotated sentence pairs) for Chinese called the Original Chinese Natural Language Inference dataset (OCNLI). Unlike recent attempts at extending NLI to other languages, our dataset does not rely on any automatic translation or non-expert annotation. Instead, we elicit annotations from native speakers specializing in linguistics. We follow closely the annotation protocol used for MNLI, but create new strategies for eliciting diverse hypotheses. We establish several baseline results on our dataset using state-of-the-art pre-trained models for Chinese, and find even the best performing models to be far outpaced by human performance (~12% absolute performance gap), making it a challenging new resource that we hope will help to accelerate progress in Chinese NLU. To the best of our knowledge, this is the first human-elicited MNLI-style corpus for a non-English language.

cs.CL↗

arXiv2020

Approaching quantum-limited metrology with imperfect detectors by using weak-value amplification

Weak value amplification (WVA) is a metrological protocol that amplifies ultra-small physical effects. However, the amplified outcomes necessarily occur with highly suppressed probabilities, leading to the extensive debate on whether the overall measurement precision is improved in comparison to that of conventional measurement (CM). Here, we experimentally demonstrate the unambiguous advantages of WVA that overcome practical limitations including noise and saturation of photo-detection and maintain a shot-noise-scaling precision for a large range of input light intensity well beyond the dynamic range of the photodetector. The precision achieved by WVA is six times higher than that of CM in our setup. Our results clear the way for the widespread use of WVA in applications involving the measurement of small signals including precision metrology and commercial sensors.

quant-ph↗

arXiv2020

PaStaNet: Toward Human Activity Knowledge Engine

Existing image-based activity understanding methods mainly adopt direct mapping, i.e. from image to activity concepts, which may encounter performance bottleneck since the huge gap. In light of this, we propose a new path: infer human part states first and then reason out the activities based on part-level semantics. Human Body Part States (PaSta) are fine-grained action semantic tokens, e.g. , which can compose the activities and help us step toward human activity knowledge engine. To fully utilize the power of PaSta, we build a large-scale knowledge base PaStaNet, which contains 7M+ PaSta annotations. And two corresponding models are proposed: first, we design a model named Activity2Vec to extract PaSta features, which aim to be general representations for various activities. Second, we use a PaSta-based Reasoning method to infer activities. Promoted by PaStaNet, our method achieves significant improvements, e.g. 6.4 and 13.9 mAP on full and one-shot sets of HICO in supervised learning, and 3.2 and 4.2 mAP on V-COCO and images-based AVA in transfer learning. Code and data are available at http://hake-mvig.cn/.

cs.CV↗

arXiv2020

Self-acceleration and energy channeling in the saturation of the ion-sound instability in a bounded plasma

A novel regime of the saturation of the Pierce-type ion-sound instability in bounded ion-beam-plasma system is revealed in 1D PIC simulations. It is found that the saturation of the instability is mediated by the oscillating virtual anode potential structure. The periodically oscillating potential barrier separates the incoming beam ions into two groups. One component forms a supersonic beam which is accelerated to an energy exceeding the energy of the initial cold ion beam. The other component is organized as a self-consistent phase space structure of trapped ions with a wide energy spread - the ion hole. The effective temperature (energy spread) of the ions trapped in the hole is lower than the initial beam energy. In the final stage the ion hole expands over the whole system length.

physics.plasm-ph↗

arXiv2020

Consensusability of linear interconnected multi-agent systems

Consensusability is an important property for many multi-agent systems (MASs) as it implies the existence of networked controllers driving the states of MAS subsystems to the same value. Consensusability is of interest even when the MAS subsystems are physically coupled, which is the case for real-world systems such as power networks. In this paper, we study necessary and sufficient conditions for the consensusability of linear interconnected MASs. These conditions are given in terms of the parameters of the subsystem matrices, as well as the eigenvalues of the physical and communication graph Laplacians. Our results show that weak coupling between subsystems and fast information diffusion rates in the physical and communication graphs favor consensusability. Technical results are verified through computer simulations.

eess.SY↗

arXiv2020

CLUECorpus2020: A Large-scale Chinese Corpus for Pre-training Language Model

In this paper, we introduce the Chinese corpus from CLUE organization, CLUECorpus2020, a large-scale corpus that can be used directly for self-supervised learning such as pre-training of a language model, or language generation. It has 100G raw corpus with 35 billion Chinese characters, which is retrieved from Common Crawl. To better understand this corpus, we conduct language understanding experiments on both small and large scale, and results show that the models trained on this corpus can achieve excellent performance on Chinese. We release a new Chinese vocabulary with a size of 8K, which is only one-third of the vocabulary size used in Chinese Bert released by Google. It saves computational cost and memory while works as good as original vocabulary. We also release both large and tiny versions of the pre-trained model on this corpus. The former achieves the state-of-the-art result, and the latter retains most precision while accelerating training and prediction speed for eight times compared to Bert-base. To facilitate future work on self-supervised learning on Chinese, we release our dataset, new vocabulary, codes, and pre-trained models on Github.

cs.CL↗

arXiv2020

CLUENER2020: Fine-grained Named Entity Recognition Dataset and Benchmark for Chinese

In this paper, we introduce the NER dataset from CLUE organization (CLUENER2020), a well-defined fine-grained dataset for named entity recognition in Chinese. CLUENER2020 contains 10 categories. Apart from common labels like person, organization, and location, it contains more diverse categories. It is more challenging than current other Chinese NER datasets and could better reflect real-world applications. For comparison, we implement several state-of-the-art baselines as sequence labeling tasks and report human performance, as well as its analysis. To facilitate future work on fine-grained NER for Chinese, we release our dataset, baselines, and leader-board.

cs.CL↗

arXiv2019

3D Objectness Estimation via Bottom-up Regret Grouping

3D objectness estimation, namely discovering semantic objects from 3D scene, is a challenging and significant task in 3D understanding. In this paper, we propose a 3D objectness method working in a bottom-up manner. Beginning with over-segmented 3D segments, we iteratively group them into object proposals by learning an ingenious grouping predictor to determine whether two 3D segments can be grouped or not. To enhance robustness, a novel regret mechanism is presented to withdraw incorrect grouping operations. Hence the irreparable consequences brought by mistaken grouping in prior bottom-up works can be greatly reduced. Our experiments show that our method outperforms state-of-the-art 3D objectness methods with a small number of proposals in two difficult datasets, GMU-kitchen and CTD. Further ablation study also demonstrates the effectiveness of our grouping predictor and regret mechanism.

cs.CV↗

arXiv2019

Active Galactic Nuclei with Ultra-fast Outflows Monitoring Project: The Broad-line Region of Mrk 79 as a Disk Wind

We developed a spectroscopic monitoring project to investigate the kinematics of the broad-line region (BLR) in active galactic nuclei (AGN) with ultra-fast outflows (UFOs). Mrk~79 is a radio-quiet AGN with UFOs and warm absorbers, had been monitored by three reverberation mapping (RM) campaigns, but its BLR kinematics is not understood yet. In this paper, we report the results from a new RM-campaign of Mrk~79, which was undertaken by Lijiang 2.4-m telescope. Mrk~79 is seeming to come out the faint state, the mean flux approximates a magnitude fainter than historical record. We successfully measured the lags of the broad emission lines including H$β~\lambda4861$, H$γ~\lambda4340$, He II $\lambda4686$ and He I $\lambda5876$ with respect to the varying AGN continuum. Based on the broad H$β~\lambda4861$ line, we measured black hole (BH) mass of $M_{\bullet}=5.13^{+1.57}_{-1.55}\times10^{7}M_{\odot}$, estimated accretion rates of ${\dot{M}_{\bullet}}=(0.05\pm0.02)~L_{\rm Edd}~c^{-2}$, indicating that Mrk~79 is a sub-Eddington accretor. We found that Mrk~79 deviates from the canonical Radius$-$Luminosity relationship. The marginal blueshift of the broad He II $\lambda4686$ line detected from rms spectrum indicates outflow of high-ionization gas. The velocity-resolved lag profiles of the broad H$γ~\lambda4340$, H$β~\lambda4861$, and He I $\lambda5876$ lines show similar signatures that the largest lag occurs in the red wing of the lines then the lag decreases to both sides. These signatures should suggest that the BLR of Keplerian motion probably exists the outflow gas motion. All findings including UFOs, warm absorbers, and the kinematics of high- and low-ionization BLR, may provide an indirect evidence that the BLR of Mrk~79 probably originates from disk wind.

astro-ph.GA↗

arXiv2019

HAKE: Human Activity Knowledge Engine

Human activity understanding is crucial for building automatic intelligent system. With the help of deep learning, activity understanding has made huge progress recently. But some challenges such as imbalanced data distribution, action ambiguity, complex visual patterns still remain. To address these and promote the activity understanding, we build a large-scale Human Activity Knowledge Engine (HAKE) based on the human body part states. Upon existing activity datasets, we annotate the part states of all the active persons in all images, thus establish the relationship between instance activity and body part states. Furthermore, we propose a HAKE based part state recognition model with a knowledge extractor named Activity2Vec and a corresponding part state based reasoning network. With HAKE, our method can alleviate the learning difficulty brought by the long-tail data distribution, and bring in interpretability. Now our HAKE has more than 7 M+ part state annotations and is still under construction. We first validate our approach on a part of HAKE in this preliminary paper, where we show 7.2 mAP performance improvement on Human-Object Interaction recognition, and 12.38 mAP improvement on the one-shot subsets.

cs.CV↗

arXiv2019

Transferable Interactiveness Knowledge for Human-Object Interaction Detection

Human-Object Interaction (HOI) Detection is an important problem to understand how humans interact with objects. In this paper, we explore Interactiveness Knowledge which indicates whether human and object interact with each other or not. We found that interactiveness knowledge can be learned across HOI datasets, regardless of HOI category settings. Our core idea is to exploit an Interactiveness Network to learn the general interactiveness knowledge from multiple HOI datasets and perform Non-Interaction Suppression before HOI classification in inference. On account of the generalization of interactiveness, interactiveness network is a transferable knowledge learner and can be cooperated with any HOI detection models to achieve desirable results. We extensively evaluate the proposed method on HICO-DET and V-COCO datasets. Our framework outperforms state-of-the-art HOI detection results by a great margin, verifying its efficacy and flexibility. Code is available at https://github.com/DirtyHarryLYL/Transferable-Interactiveness-Network.

cs.CV↗

arXiv2019

Stimulated emission depletion microscopy with array detection and photon reassignment

We propose a novel stimulated emission depletion (STED) microscopy based on array detection and photon reassignment. By replacing the single-point detector in traditional STED with a detector array and utilizing the photon reassignment method to recombine the images acquired by each detector, the final photon reassignment STED (prSTED) image could be obtained. We analyze the principle and imaging characteristics of prSTED, and the results indicate that, compared with traditional STED, prSTED can improve the signal-to-noise ratio (SNR) of the image by increasing the obtained photon flux while maintaining the original spatial resolution of STED. In addition, the SNR and resolution of prSTED are strongly correlated with the intensity of depletion beam. Corresponding theoretical and experimental analysis about this feature are also conducted. In general, considering the enhanced signal strength, imaging speed and compatibility with some other imaging techniques, we believe prSTED would be a helpful promotion in biomedical imaging.

physics.optics↗