arXiv Science⌕ Search

arXiv subjects

Jie Liu

Publications and source records attributed to Jie Liu.

At least 541 records · Page 30Linked to original sources

Real-Time Quantized Image Super-Resolution on Mobile NPUs, Mobile AI 2021 Challenge: Report

Image super-resolution is one of the most popular computer vision problems with many important applications to mobile devices. While many solutions have been proposed for this task, they are usually not optimized even for common smartphone AI hardware, not to mention more constrained smart TV platforms that are often supporting INT8 inference only. To address this problem, we introduce the first Mobile AI challenge, where the target is to develop an end-to-end deep learning-based image super-resolution solutions that can demonstrate a real-time performance on mobile or edge NPUs. For this, the participants were provided with the DIV2K dataset and trained quantized models to do an efficient 3X image upscaling. The runtime of all models was evaluated on the Synaptics VS680 Smart Home board with a dedicated NPU capable of accelerating quantized neural networks. The proposed solutions are fully compatible with all major mobile AI accelerators and are capable of reconstructing Full HD images under 40-60 ms while achieving high fidelity results. A detailed description of all models developed in the challenge is provided in this paper.

eess.IV↗

Inception Convolution with Efficient Dilation Search

As a variant of standard convolution, a dilated convolution can control effective receptive fields and handle large scale variance of objects without introducing additional computational costs. To fully explore the potential of dilated convolution, we proposed a new type of dilated convolution (referred to as inception convolution), where the convolution operations have independent dilation patterns among different axes, channels and layers. To develop a practical method for learning complex inception convolution based on the data, a simple but effective search algorithm, referred to as efficient dilation optimization (EDO), is developed. Based on statistical optimization, the EDO method operates in a low-cost manner and is extremely fast when it is applied on large scale datasets. Empirical results validate that our method achieves consistent performance gains for image recognition, object detection, instance segmentation, human detection, and human pose estimation. For instance, by simply replacing the 3x3 standard convolution in the ResNet-50 backbone with inception convolution, we significantly improve the AP of Faster R-CNN from 36.4% to 39.2% on MS COCO.

cs.CV↗

Simultaneous 2.25/8.60 GHz observations of the newly discovered magnetar -- Swift J1818.0-1607

Swift J1818.0-1607 discovered in early 2020 is not only the fifth magnetar known with periodic radio pulsations but also the fastest rotating one. Simultaneous 2.25 and 8.60 GHz observations of Swift J1818.0-1607 were carried out with Shanghai Tian Ma Radio Telescope (TMRT) from MJD 58936 to 59092. The spin-frequency $ν$ and first-order derivative $\dotν$ of this magnetar were obtained with piecewise fitting method because of its instable timing properties. We found that the amplitude of short-term $\dotν$ fluctuations decreased with time, and the long-term declining trend of $ν$ discovered previously continued in our observations. The best fitted long-term $\dotν$ were about $-2.25 \times 10^{-11}~s^{-2}$ using our observation data spanning 156 days. The derived characteristic age was about 522 yr, supporting the recent viewpoint that this magnetar may be older than initially thought shortly after its discovery. The flux density of this magnetar was increased at both 2.25 and 8.60 GHz during our observations, and its radio spectrum became flatter at the same time. We also detected bright-quiet type emission mode switching in Swift J1818.0-1607.

astro-ph.HE↗

Two-dimensional time- and space-resolved diagnostic method for integrated implosion process

To precisely measure and evaluate X-ray generation and evolution in a hohlraum during an implosion process, we present a two-dimensional (2D) time- and space-resolved diagnostic method by combining a compressed ultrafast photography (CUP) system and a simplified version of space-resolving flux detector (SSRFD). Numerical experiment results showed that the reconstruction quality of the conventional CUP significantly improved owing to the addition of the external SSRFD, especially when a coded mask with a large pixel size was used in the CUP. Further, the performance of the CUP cooperation with the SSRFD was better than that of adding an external charge-coupled device or streak camera. Compared with existing ultrafast imaging techniques in laser fusion, the proposed method has a prominent advantage of measuring the 2D evolution of implosion by combining high temporal resolution of streak camera and high spatial resolution of SSRFD; moreover, it can provide guidance for designing diagnostic experiments in laser fusion research.

physics.ins-det↗

Underwater Target Recognition based on Multi-Decision LOFAR Spectrum Enhancement: A Deep Learning Approach

The Low frequency analysis and recording (LOFAR) spectrum is one of the key features of the under water target, which can be used for underwater target recognition. However, the underwater environment noise is complicated and the signal-to-noise ratio of the underwater target is rather low, which introduces the breakpoints to the LOFAR spectrum and thus hinders the underwater target recognition. To overcome this issue and to further improve the recognition performance, we adopt a deep learning approach for underwater target recognition and propose a LOFAR spectrum enhancement (LSE)-based underwater target recognition scheme, which consists of preprocessing, offline training, and online testing. In preprocessing, a LOFAR spectrum enhancement based on multi-step decision algorithm is specifically designed to recover the breakpoints in LOFAR spectrum. In offline training, we then adopt the enhanced LOFAR spectrum as the input of convolutional neural network (CNN) and develop a LOFAR-based CNN (LOFAR-CNN) for online recognition. Taking advantage of the powerful capability of CNN in feature extraction, the proposed LOFAR-CNN can further improve the recognition accuracy. Finally, extensive simulation results demonstrate that the LOFAR-CNN network can achieve a recognition accuracy of $95.22\%$, which outperforms the state-of-the-art methods.

eess.SP↗

InterBERT: Vision-and-Language Interaction for Multi-modal Pretraining

Multi-modal pretraining for learning high-level multi-modal representation is a further step towards deep learning and artificial intelligence. In this work, we propose a novel model, namely InterBERT (BERT for Interaction), which is the first model of our series of multimodal pretraining methods M6 (MultiModality-to-MultiModality Multitask Mega-transformer). The model owns strong capability of modeling interaction between the information flows of different modalities. The single-stream interaction module is capable of effectively processing information of multiple modalilties, and the two-stream module on top preserves the independence of each modality to avoid performance downgrade in single-modal tasks. We pretrain the model with three pretraining tasks, including masked segment modeling (MSM), masked region modeling (MRM) and image-text matching (ITM); and finetune the model on a series of vision-and-language downstream tasks. Experimental results demonstrate that InterBERT outperforms a series of strong baselines, including the most recent multi-modal pretraining methods, and the analysis shows that MSM and MRM are effective for pretraining and our method can achieve performances comparable to BERT in single-modal tasks. Besides, we propose a large-scale dataset for multi-modal pretraining in Chinese, and we develop the Chinese InterBERT which is the first Chinese multi-modal pretrained model. We pretrain the Chinese InterBERT on our proposed dataset of 3.1M image-text pairs from the mobile Taobao, the largest Chinese e-commerce platform. We finetune the model for text-based image retrieval, and recently we deployed the model online for topic-based recommendation.

cs.CL↗

Minimal setup for non-Abelian braiding of Majorana zero modes

Braiding Majorana zero modes (MZMs) is the key procedure toward topological quantum computation. However, the complexity of the braiding manipulation hinders its experimental realization. Here we propose an experimental setup composing of MZMs and a quantum dot state which can substantially simplify the braiding protocol of MZMs. Such braiding scheme, which corresponds to a specific closed loop in the parameter space, is quite universal and can be realized in various platforms. Moreover, the braiding results can be directly measured and manifested through electric current, which provides a simple and novel way to detect the non-Abelian statistics of MZMs.

cond-mat.mes-hall↗

Deuterium-tritium fusion process in strong laser fields: Semiclassical simulation

In this paper, we investigate the deuterium-tritium (DT) fusion process in the presence of strong laser fields with a semiclassical (SC) method. In this model, two nuclei with a given incident kinetic energy that closely approach each other are simulated by tracing the classical Newtonian trajectories in the combined Coulomb repulsive potentials and laser fields. At the nearest position or classical turning point, quantum tunneling through the Coulomb barrier emerges, and its penetrability is estimated with the Wentzel-Kramers-Brillouin formula. Nuclear fusion occurs after the tunneling, and the total fusion cross section takes the Gamow form. We find that the tunneling penetrability can be enhanced dramatically because the nuclei can closely approach each other due to the quiver motion of the charged nuclei driven by the intense laser fields. We then calculate the DT fusion section for a wide range of laser parameters according to various incident nuclei kinetic energies and obtain the phase diagrams for the enhanced DT fusion. We compare our SC results with the quantum results of the Kramers-Henneberger approximation and the Volkov state approximation.

nucl-th↗

Degradiation of $β$-Ga$_2$O$_3$ Schottky barrier diode under swift heavy ion irradiation

The electrical characteristics and microstructures of $β$-Ga$_2$O$_3$ Schottky barrier diode (SBD) devices irradiated with swift heavy ions (2096 MeV Ta ions) have been studied. It was found that $β$-Ga$_2$O$_3$ SBD devices showed the reliability degradation after irradiation, including turn-on voltage Von, on-resistance Ron, ideality factor n and the reverse leakage current density Jr. In addition, the carrier concentration of the drift layer was decreased significantly and the calculated carrier removal rates were 5*106 - 1.3*107 cm-1. Latent tracks induced by swift heavy ions were observed visually in the whole $β$-Ga$_2$O$_3$ matrix. Furthermore, crystal structure of tracks was amorphized completely. The latent tracks induced by Ta ions bombardments were found to be the reason for the decrease in carrier mobility and carrier concentration. Eventually, these defects caused the degradation of electrical characteristics of the devices. By comparing the carrier removal rates, the $β$-Ga$_2$O$_3$ SBD devices were more sensitive to swift heavy ions irradiation than SiC and GaN devices.

cond-mat.mtrl-sci↗

Large System Achievable Rate Analysis of RIS-Assisted MIMO Wireless Communication with Statistical CSIT

Reconfigurable intelligent surface (RIS) is an emerging technology to enhance wireless communication in terms of energy cost and system performance by equipping a considerable quantity of nearly passive reflecting elements. This study focuses on a downlink RIS-assisted multiple-input multiple-output (MIMO) wireless communication system that comprises three communication links of Rician channel, including base station (BS) to RIS, RIS to user, and BS to user. The objective is to design an optimal transmit covariance matrix at BS and diagonal phase-shifting matrix at RIS to maximize the achievable ergodic rate by exploiting the statistical channel state information at BS. Therefore, a large-system approximation of the achievable ergodic rate is derived using the replica method in large dimension random matrix theory. This large-system approximation enables the identification of asymptotic-optimal transmit covariance and diagonal phase-shifting matrices using an alternating optimization algorithm. Simulation results show that the large-system results are consistent with the achievable ergodic rate calculated by Monte Carlo averaging. The results verify that the proposed algorithm can significantly enhance the RIS-assisted MIMO system performance.

cs.IT↗

Bidirectional Machine Reading Comprehension for Aspect Sentiment Triplet Extraction

Aspect sentiment triplet extraction (ASTE), which aims to identify aspects from review sentences along with their corresponding opinion expressions and sentiments, is an emerging task in fine-grained opinion mining. Since ASTE consists of multiple subtasks, including opinion entity extraction, relation detection, and sentiment classification, it is critical and challenging to appropriately capture and utilize the associations among them. In this paper, we transform ASTE task into a multi-turn machine reading comprehension (MTMRC) task and propose a bidirectional MRC (BMRC) framework to address this challenge. Specifically, we devise three types of queries, including non-restrictive extraction queries, restrictive extraction queries and sentiment classification queries, to build the associations among different subtasks. Furthermore, considering that an aspect sentiment triplet can derive from either an aspect or an opinion expression, we design a bidirectional MRC structure. One direction sequentially recognizes aspects, opinion expressions, and sentiments to obtain triplets, while the other direction identifies opinion expressions first, then aspects, and at last sentiments. By making the two directions complement each other, our framework can identify triplets more comprehensively. To verify the effectiveness of our approach, we conduct extensive experiments on four benchmark datasets. The experimental results demonstrate that BMRC achieves state-of-the-art performances.

cs.CL↗

Truncation-Free Matching System for Display Advertising at Alibaba

Matching module plays a critical role in display advertising systems. Without query from user, it is challenging for system to match user traffic and ads suitably. System packs up a group of users with common properties such as the same gender or similar shopping interests into a crowd. Here term crowd can be viewed as a tag over users. Then advertisers bid for different crowds and deliver their ads to those targeted users. Matching module in most industrial display advertising systems follows a two-stage paradigm. When receiving a user request, matching system (i) finds the crowds that the user belongs to; (ii) retrieves all ads that have targeted those crowds. However, in applications such as display advertising at Alibaba, with very large volumes of crowds and ads, both stages of matching have to truncate the long-tailed parts for online serving, under limited latency. That's to say, not all ads have the chance to participate in online matching. This results in sub-optimal result for both advertising performance and platform revenue. In this paper, we study the truncation problem and propose a Truncation Free Matching System (TFMS). The basic idea is to decouple the matching computation from the online pipeline. Instead of executing the two-stage matching when user visits, TFMS utilizes a near-line truncation-free matching to pre-calculate and store those top valuable ads for each user. Then the online pipeline just needs to fetch the pre-stored ads as matching results. In this way, we can jump out of online system's latency and computation cost limitations, and leverage flexible computation resource to finish the user-ad matching. TFMS has been deployed in our productive system since 2019, bringing (i) more than 50% improvement of impressions for advertisers who encountered truncation before, (ii) 9.4% Revenue Per Mile gain, which is significant enough for the business.

cs.IR↗

Electron-Ion Collider in China

Lepton scattering is an established ideal tool for studying inner structure of small particles such as nucleons as well as nuclei. As a future high energy nuclear physics project, an Electron-ion collider in China (EicC) has been proposed. It will be constructed based on an upgraded heavy-ion accelerator, High Intensity heavy-ion Accelerator Facility (HIAF) which is currently under construction, together with a new electron ring. The proposed collider will provide highly polarized electrons (with a polarization of $\sim$80%) and protons (with a polarization of $\sim$70%) with variable center of mass energies from 15 to 20 GeV and the luminosity of (2-3) $\times$ 10$^{33}$ cm$^{-2}$ s$^{-1}$. Polarized deuterons and Helium-3, as well as unpolarized ion beams from Carbon to Uranium, will be also available at the EicC. The main foci of the EicC will be precision measurements of the structure of the nucleon in the sea quark region, including 3D tomography of nucleon; the partonic structure of nuclei and the parton interaction with the nuclear environment; the exotic states, especially those with heavy flavor quark contents. In addition, issues fundamental to understanding the origin of mass could be addressed by measurements of heavy quarkonia near-threshold production at the EicC. In order to achieve the above-mentioned physics goals, a hermetical detector system will be constructed with cutting-edge technologies. This document is the result of collective contributions and valuable inputs from experts across the globe. The EicC physics program complements the ongoing scientific programs at the Jefferson Laboratory and the future EIC project in the United States. The success of this project will also advance both nuclear and particle physics as well as accelerator and detector technology in China.

nucl-ex↗

Localization properties in Lieb lattices and their extensions

We study the localization properties of generalized, two- and three-dimensional Lieb lattices, $\mathcal{L}_2(n)$ and $\mathcal{L}_3(n)$, $n= 1, 2, 3$ and $4$, at energies corresponding to flat and dispersive bands using the transfer matrix method (TMM) and finite size scaling (FSS). We find that the scaling properties of the flat bands are different from scaling in dispersive bands for all $\mathcal{L}_d(n)$. For the $d=3$ dimensional case, states are extended for disorders $W$ down to $W=0.01 t$ at the flat bands, indicating that the disorder can lift the degeneracy of the flat bands quickly. The phase diagram with periodic boundary condition for $\mathcal{L}_3(1)$ looks similar to the one for hard boundaries. We present the critical disorder $W_c$ at energy $E=0$ and find a decreasing $W_c$ for increasing $n$ for $\mathcal{L}_3(n)$, up to $n=3$. Last, we show a table of FSS parameters including so-called irrelevant variables; but the results indicate that the accuracy is too low to determine these reliably. \end{abstract}

cond-mat.dis-nn↗

Back-n White Neutron Source at CSNS and its Applications

Back-streaming neutrons from the spallation target of the China Spallation Neutron Source (CSNS) that emit through the incoming proton channel were exploited to build a white neutron beam facility (the so-called Back-n white neutron source), which was completed in March 2018. The Back-n neutron beam is very intense, at approximately 2*10^7 n/cm^2/s at 55 m from the target, and has a nominal proton beam with a power of 100 kW in the CSNS-I phase and a kinetic energy of 1.6 GeV and a thick tungsten target in multiple slices with modest moderation from the cooling water through the slices. In addition, the excellent energy spectrum spanning from 0.5 eV to 200 MeV, and a good time resolution related to the time-of-flight measurements make it a typical white neutron source for nuclear data measurements; its overall performance is among that of the best white neutron sources in the world. Equipped with advanced spectrometers, detectors, and application utilities, the Back-n facility can serve wide applications, with a focus on neutron-induced cross-section measurements. This article presents an overview of the neutron beam characteristics, the experimental setups, and the ongoing applications at Back-n.

physics.acc-ph↗

Colonoscopy Polyp Detection: Domain Adaptation From Medical Report Images to Real-time Videos

Automatic colorectal polyp detection in colonoscopy video is a fundamental task, which has received a lot of attention. Manually annotating polyp region in a large scale video dataset is time-consuming and expensive, which limits the development of deep learning techniques. A compromise is to train the target model by using labeled images and infer on colonoscopy videos. However, there are several issues between the image-based training and video-based inference, including domain differences, lack of positive samples, and temporal smoothness. To address these issues, we propose an Image-video-joint polyp detection network (Ivy-Net) to address the domain gap between colonoscopy images from historical medical reports and real-time videos. In our Ivy-Net, a modified mixup is utilized to generate training data by combining the positive images and negative video frames at the pixel level, which could learn the domain adaptive representations and augment the positive samples. Simultaneously, a temporal coherence regularization (TCR) is proposed to introduce the smooth constraint on feature-level in adjacent frames and improve polyp detection by unlabeled colonoscopy videos. For evaluation, a new large colonoscopy polyp dataset is collected, which contains 3056 images from historical medical reports of 889 positive patients and 7.5-hour videos of 69 patients (28 positive). The experiments on the collected dataset demonstrate that our Ivy-Net achieves the state-of-the-art result on colonoscopy video.

eess.IV↗

An efficient adaptive variational quantum solver of the Schrodinger equation based on reduced density matrices

Recently, an adaptive variational algorithm termed Adaptive Derivative-Assembled Pseudo-Trotter ansatz Variational Quantum Eigensolver (ADAPT-VQE) has been proposed by Grimsley et al. (Nat. Commun. 10, 3007) while the number of measurements required to perform this algorithm scales O(N^8). In this work, we present an efficient adaptive variational quantum solver of the Schrodinger equation based on ADAPT-VQE together with the reduced density matrix reconstruction approach, which reduces the number of measurements from O(N^8) to O(N^4). This new algorithm is quite suitable for quantum simulations of chemical systems on near-term noisy intermediate-scale hardware due to low circuit complexity and reduced measurement. Numerical benchmark calculations for small molecules demonstrate that this new algorithm provides an accurate description of the ground-state potential energy curves. In addition, we generalize this new algorithm for excited states with the variational quantum deflation approach and achieve the same accuracy as ground-state simulations.

quant-ph↗

The item selection problem for user cold-start recommendation

When a new user just signs up on a website, we usually have no information about him/her, i.e. no interaction with items, no user profile and no social links with other users. Under such circumstances, we still expect our recommender systems could attract the users at the first time so that the users decide to stay on the website and become active users. This problem falls into new user cold-start category and it is crucial to the development and even survival of a company. Existing works on user cold-start recommendation either require additional user efforts, e.g. setting up an interview process, or make use of side information [10] such as user demographics, locations, social relations, etc. However, users may not be willing to take the interview and side information on cold-start users is usually not available. Therefore, we consider a pure cold-start scenario where neither interaction nor side information is available and no user effort is required. Studying this setting is also important for the initialization of other cold-start solutions, such as initializing the first few questions of an interview.

cs.IR↗