arXiv subjects

Bo Liu

Publications and source records attributed to Bo Liu.

At least 487 records · Page 27Linked to original sources

arXiv2022

Unconditionally secure digital signatures implemented in an 8-user quantum network

The ability to know and verifiably demonstrate the origins of messages can often be as important as encrypting the message itself. Here we present an experimental demonstration of an unconditionally secure digital signature (USS) protocol implemented for the first time, to the best of our knowledge, on a fully connected quantum network without trusted nodes. Our USS protocol is secure against forging, repudiation and messages are transferrable. We show the feasibility of unconditionally secure signatures using only bi-partite entangled states distributed throughout the network and experimentally evaluate the performance of the protocol in real world scenarios with varying message lengths.

quant-ph↗

arXiv2022

HardBoost: Boosting Zero-Shot Learning with Hard Classes

This work is a systematical analysis on the so-called hard class problem in zero-shot learning (ZSL), that is, some unseen classes disproportionally affect the ZSL performances than others, as well as how to remedy the problem by detecting and exploiting hard classes. At first, we report our empirical finding that the hard class problem is a ubiquitous phenomenon and persists regardless of used specific methods in ZSL. Then, we find that high semantic affinity among unseen classes is a plausible underlying cause of hardness and design two metrics to detect hard classes. Finally, two frameworks are proposed to remedy the problem by detecting and exploiting hard classes, one under inductive setting, the other under transductive setting. The proposed frameworks could accommodate most existing ZSL methods to further significantly boost their performances with little efforts. Extensive experiments on three popular benchmarks demonstrate the benefits by identifying and exploiting the hard classes in ZSL.

cs.CV↗

arXiv2021

Stable and Efficient Policy Evaluation

Policy evaluation algorithms are essential to reinforcement learning due to their ability to predict the performance of a policy. However, there are two long-standing issues lying in this prediction problem that need to be tackled: off-policy stability and on-policy efficiency. The conventional temporal difference (TD) algorithm is known to perform very well in the on-policy setting, yet is not off-policy stable. On the other hand, the gradient TD and emphatic TD algorithms are off-policy stable, but are not on-policy efficient. This paper introduces novel algorithms that are both off-policy stable and on-policy efficient by using the oblique projection method. The empirical experimental results on various domains validate the effectiveness of the proposed approach.

cs.LG↗

arXiv2021

Text Mining Drug/Chemical-Protein Interactions using an Ensemble of BERT and T5 Based Models

In Track-1 of the BioCreative VII Challenge participants are asked to identify interactions between drugs/chemicals and proteins. In-context named entity annotations for each drug/chemical and protein are provided and one of fourteen different interactions must be automatically predicted. For this relation extraction task, we attempt both a BERT-based sentence classification approach, and a more novel text-to-text approach using a T5 model. We find that larger BERT-based models perform better in general, with our BioMegatron-based model achieving the highest scores across all metrics, achieving 0.74 F1 score. Though our novel T5 text-to-text method did not perform as well as most of our BERT-based models, it outperformed those trained on similar data, showing promising results, achieving 0.65 F1 score. We believe a text-to-text approach to relation extraction has some competitive advantages and there is a lot of room for research advancement.

cs.CL↗

arXiv2021

Chemical Identification and Indexing in PubMed Articles via BERT and Text-to-Text Approaches

The Biocreative VII Track-2 challenge consists of named entity recognition, entity-linking (or entity-normalization), and topic indexing tasks -- with entities and topics limited to chemicals for this challenge. Named entity recognition is a well-established problem and we achieve our best performance with BERT-based BioMegatron models. We extend our BERT-based approach to the entity linking task. After the second stage of pretraining BioBERT with a metric-learning loss strategy called self-alignment pretraining (SAP), we link entities based on the cosine similarity between their SAP-BioBERT word embeddings. Despite the success of our named entity recognition experiments, we find the chemical indexing task generally more challenging. In addition to conventional NER methods, we attempt both named entity recognition and entity linking with a novel text-to-text or "prompt" based method that uses generative language models such as T5 and GPT. We achieve encouraging results with this new approach.

cs.CL↗

arXiv2021

Automatic Extraction of Medication Names in Tweets as Named Entity Recognition

Social media posts contain potentially valuable information about medical conditions and health-related behavior. Biocreative VII Task 3 focuses on mining this information by recognizing mentions of medications and dietary supplements in tweets. We approach this task by fine tuning multiple BERT-style language models to perform token-level classification, and combining them into ensembles to generate final predictions. Our best system consists of five Megatron-BERT-345M models and achieves a strict F1 score of 0.764 on unseen test data.

cs.CL↗

arXiv2021

Artificial intelligence enabled radio propagation for communications-Part I: Channel characterization and antenna-channel optimization

To provide higher data rates, as well as better coverage, cost efficiency, security, adaptability, and scalability, the 5G and beyond 5G networks are developed with various artificial intelligence techniques. In this two-part paper, we investigate the application of artificial intelligence (AI) and in particular machine learning (ML) to the study of wireless propagation channels. It firstly provides a comprehensive overview of ML for channel characterization and ML-based antenna-channel optimization in this first part, and then it gives a state-of-the-art literature review of channel scenario identification and channel modeling in Part II. Fundamental results and key concepts of ML for communication networks are presented, and widely used ML methods for channel data processing, propagation channel estimation, and characterization are analyzed and compared. A discussion of challenges and future research directions for ML-enabled next generation networks of the topics covered in this part rounds off the paper.

eess.SP↗

arXiv2021

Artificial intelligence enabled radio propagation for communications-Part II: Scenario identification and channel modeling

This two-part paper investigates the application of artificial intelligence (AI) and in particular machine learning (ML) to the study of wireless propagation channels. In Part I, we introduced AI and ML as well as provided a comprehensive survey on ML enabled channel characterization and antenna-channel optimization, and in this part (Part II) we review state-of-the-art literature on scenario identification and channel modeling here. In particular, the key ideas of ML for scenario identification and channel modeling/prediction are presented, and the widely used ML methods for propagation scenario identification and channel modeling and prediction are analyzed and compared. Based on the state-of-art, the future challenges of AI/ML-based channel data processing techniques are given as well.

eess.SP↗

arXiv2021

Spatial enantioseparation of gaseous chiral molecules

We explore the spatial enantioseparation of gaseous chiral molecules for the cyclic three-level systems coupled with three electromagnetic fields. Due to molecular rotations, the specific requirements of the polarization directions of the three electromagnetic fields lead to the space-dependent part of the overall phase of the coupling strengths. Thus, the overall phase of the coupling strengths, which differs with $π$ for the enantiomers in the cyclic three-level model of chiral molecules, varies intensely in the length scale of the typical wavelength of the applied electromagnetic fields. Under the induced gauge potentials resulting from the space-dependent part of the overall phase and the space-dependent intensities of coupling strengths, we further show spatial enantioseparation for typical parameters of gaseous chiral molecules.

physics.atom-ph↗

arXiv2021

Fully passive entanglement based quantum key distribution scheme

In general, generation of entangled photon pairs and also the random choice of measurement basis can be implemented with passive optical devices in entanglement based quantum key distribution (QKD) system. However, auxiliary random numbers are still mandatory for conducting the privacy amplification procedure. In this paper, we propose a fully passive entanglement based QKD scheme in which certified random bits for privacy amplification are extracted from detection events of measurement-basis-mismatched entangled photon pairs. The privacy of these random bits can be certified by estimating the phase error rate in the sifted key. The idea of extracting certified random numbers from measurement-basis-mismatched photons, can be extended to all practical QKD schemes.

quant-ph↗

arXiv2021

Machine versus Human Attention in Deep Reinforcement Learning Tasks

Deep reinforcement learning (RL) algorithms are powerful tools for solving visuomotor decision tasks. However, the trained models are often difficult to interpret, because they are represented as end-to-end deep neural networks. In this paper, we shed light on the inner workings of such trained models by analyzing the pixels that they attend to during task execution, and comparing them with the pixels attended to by humans executing the same tasks. To this end, we investigate the following two questions that, to the best of our knowledge, have not been previously studied. 1) How similar are the visual representations learned by RL agents and humans when performing the same task? and, 2) How do similarities and differences in these learned representations explain RL agents' performance on these tasks? Specifically, we compare the saliency maps of RL agents against visual attention models of human experts when learning to play Atari games. Further, we analyze how hyperparameters of the deep RL algorithm affect the learned representations and saliency maps of the trained agents. The insights provided have the potential to inform novel algorithms for closing the performance gap between human experts and RL agents.

cs.LG↗

arXiv2021

Neural Auto-Curricula

When solving two-player zero-sum games, multi-agent reinforcement learning (MARL) algorithms often create populations of agents where, at each iteration, a new agent is discovered as the best response to a mixture over the opponent population. Within such a process, the update rules of "who to compete with" (i.e., the opponent mixture) and "how to beat them" (i.e., finding best responses) are underpinned by manually developed game theoretical principles such as fictitious play and Double Oracle. In this paper, we introduce a novel framework -- Neural Auto-Curricula (NAC) -- that leverages meta-gradient descent to automate the discovery of the learning update rule without explicit human design. Specifically, we parameterise the opponent selection module by neural networks and the best-response module by optimisation subroutines, and update their parameters solely via interaction with the game engine, where both players aim to minimise their exploitability. Surprisingly, even without human design, the discovered MARL algorithms achieve competitive or even better performance with the state-of-the-art population-based game solvers (e.g., PSRO) on Games of Skill, differentiable Lotto, non-transitive Mixture Games, Iterated Matching Pennies, and Kuhn Poker. Additionally, we show that NAC is able to generalise from small games to large games, for example training on Kuhn Poker and outperforming PSRO on Leduc Poker. Our work inspires a promising future direction to discover general MARL algorithms solely from data.

cs.AI↗

arXiv2021

Local evidence for collective spin excitations in the distorted kagome antiferromagnet Pr$_3$BWO$_9$

We report the local probe investigation of a frustrated antiferromagnet Pr$_3$BWO$_9$ with the distorted kagome lattice. Absence of magnetic order or spin freezing is indicated by the spectral analysis down to 0.3 K and specific heat measurements down to 0.09 K. The Knight shifts show an upturn behavior with the sample cooling down, which is further suppressed by external field. For the spin dynamics, gapped spin excitation is observed from the temperature dependence of spin-lattice relaxation rates, with the gap size proportional to the applied magnetic field intensity. Comparatively, an unexpected sharp peak is observed in the nuclear spin-spin relaxation rate data at $T^*\sim 4-5$ K. These results indicate an unconventional persistent fluctuating paramagnetic ground state with antiferromagnetic collective spin excitations in the strongly frustrated spin system.

cond-mat.str-el↗

arXiv2021

Effects of shallow carbon and deep N++ layer on the radiation hardness of IHEP-IME LGAD sensors

Low Gain Avalanche Diode (LGAD) is applied for the High-Granularity Timing Detector (HGTD), and it will be used to upgrade the ATLAS experiment. The first batch IHEP-IME LGAD sensors were designed by the Institute of High Energy Physics (IHEP) and fabricated by the Institute of Microelectronics (IME). Three IHEP-IME sensors (W1, W7 and W8) were irradiated by the neutrons up to the fluence of 2.5 x 10^15 n_eq/cm^2 to study the effect of the shallow carbon and deep N++ layer on the irradiation hardness. Taking W7 as a reference, W1 has an extra shallow carbon applied, and W8 has a deeper N++ layer.

physics.ins-det↗

arXiv2021

BEV-Net: Assessing Social Distancing Compliance by Joint People Localization and Geometric Reasoning

Social distancing, an essential public health measure to limit the spread of contagious diseases, has gained significant attention since the outbreak of the COVID-19 pandemic. In this work, the problem of visual social distancing compliance assessment in busy public areas, with wide field-of-view cameras, is considered. A dataset of crowd scenes with people annotations under a bird's eye view (BEV) and ground truth for metric distances is introduced, and several measures for the evaluation of social distance detection systems are proposed. A multi-branch network, BEV-Net, is proposed to localize individuals in world coordinates and identify high-risk regions where social distancing is violated. BEV-Net combines detection of head and feet locations, camera pose estimation, a differentiable homography module to map image into BEV coordinates, and geometric reasoning to produce a BEV map of the people locations in the scene. Experiments on complex crowded scenes demonstrate the power of the approach and show superior performance over baselines derived from methods in the literature. Applications of interest for public health decision makers are finally discussed. Datasets, code and pretrained models are publicly available at GitHub.

cs.CV↗

arXiv2021

Google Landmark Retrieval 2021 Competition Third Place Solution

We present our solutions to the Google Landmark Challenges 2021, for both the retrieval and the recognition tracks. Both solutions are ensembles of transformers and ConvNet models based on Sub-center ArcFace with dynamic margins. Since the two tracks share the same training data, we used the same pipeline and training approach, but with different model selections for the ensemble and different post-processing. The key improvement over last year is newer state-of-the-art vision architectures, especially transformers which significantly outperform ConvNets for the retrieval task. We finished third and fourth places for the retrieval and recognition tracks respectively.

cs.CV↗

arXiv2021

Proposal of Analog In-Memory Computing with Magnified Tunnel Magnetoresistance Ratio and Universal STT-MRAM Cell

In-memory computing (IMC) is an effectual solution for energy-efficient artificial intelligence applications. Analog IMC amortizes the power consumption of multiple sensing amplifiers with analog-to-digital converter (ADC), and simultaneously completes the calculation of multi-line data with high parallelism degree. Based on a universal one-transistor one-magnetic tunnel junction (MTJ) spin transfer torque magnetic RAM (STT-MRAM) cell, this paper demonstrates a novel tunneling magnetoresistance (TMR) ratio magnifying method to realize analog IMC. Previous concerns include low TMR ratio and analog calculation nonlinearity are addressed using device-circuit interaction. Peripheral circuits are minimally modified to enable in-memory matrix-vector multiplication. A current mirror with feedback structure is implemented to enhance analog computing linearity and calculation accuracy. The proposed design maximumly supports 1024 2-bit input and 1-bit weight multiply-and-accumulate (MAC) computations simultaneously. The 2-bit input is represented by the width of the input (IN) pulses, while the 1-bit weight is stored in STT-MRAM and the x7500 magnified TMR (m-TMR) ratio is obtained by latching. The proposal is simulated using 28-nm CMOS process and MTJ compact model. The integral nonlinearity is reduced by 57.6% compared with the conventional structure. 9.47-25.4 TOPS/W is realized with 2-bit input, 1-bit weight and 4-bit output convolution neural network (CNN).

cs.ET↗

arXiv2021

Manipulating Goldstone modes via the superradiant light in a bosonic lattice gas inside a cavity

We study the low-energy excitations of a bosonic lattice gas with cavity-mediated interactions. By performing two successive Hubbard-Stratonovich transformations, we derive an effective field theory to study the strongly-coupling regime. Taking into account the quantum fluctuation, we report the unusual effect of the superradiant cavity light induced density imbalance, which has been shown to have a negligible effect on the single particle excitation in the previous studies. Instead, we show that such negligible fluctuation of density imbalance dramatically changes the behavior of the low-energy excitation and results in a free switching between two types of Goldstone modes in its single particle excitation, i.e., type I and type II with odd and even power energy-momentum dispersion, respectively. Our proposal would open a new horizon for manipulating Goldstone modes from bridging the cavity light and strongly interacting quantum matters.

cond-mat.quant-gas↗