arXiv subjects

Bo Liu

Publications and source records attributed to Bo Liu.

At least 613 records · Page 34Linked to original sources

arXiv2019

Optimal Function Approximation with Relu Neural Networks

We consider in this paper the optimal approximations of convex univariate functions with feed-forward Relu neural networks. We are interested in the following question: what is the minimal approximation error given the number of approximating linear pieces? We establish the necessary and sufficient conditions and uniqueness of optimal approximations, and give lower and upper bounds of the optimal approximation errors. Relu neural network architectures are then presented to generate these optimal approximations. Finally, we propose an algorithm to find the optimal approximations, as well as prove its convergence and validate it with experimental results.

cs.LG↗

arXiv2019

Towards Photo-Realistic Visible Watermark Removal with Conditional Generative Adversarial Networks

Visible watermark plays an important role in image copyright protection and the robustness of a visible watermark to an attack is shown to be essential. To evaluate and improve the effectiveness of watermark, watermark removal attracts increasing attention and becomes a hot research top. Current methods cast the watermark removal as an image-to-image translation problem where the encode-decode architectures with pixel-wise loss are adopted to transfer the transparent watermarked pixels into unmarked pixels. However, when a number of realistic images are presented, the watermarks are more likely to be unknown and diverse (i.e., the watermarks might be opaque or semi-transparent; the category and pattern of watermarks are unknown). When applying existing methods to the real-world scenarios, they mostly can not satisfactorily reconstruct the hidden information obscured under the complex and various watermarks (i.e., the residual watermark traces remain and the reconstructed images lack reality). To address this difficulty, in this paper, we present a new watermark processing framework using the conditional generative adversarial networks (cGANs) for visible watermark removal in the real-world application. The proposed method enables the watermark removal solution to be more closed to the photo-realistic reconstruction using a patch-based discriminator conditioned on the watermarked images, which is adversarially trained to differentiate the difference between the recovered images and original watermark-free images. Extensive experimental results on a large-scale visible watermark dataset demonstrate the effectiveness of the proposed method and clearly indicate that our proposed approach can produce more photo-realistic and convincing results compared with the state-of-the-art methods.

cs.CV↗

arXiv2019

Transfer Learning-Based Label Proportions Method with Data of Uncertainty

Learning with label proportions (LLP), which is a learning task that only provides unlabeled data in bags and each bag's label proportion, has widespread successful applications in practice. However, most of the existing LLP methods don't consider the knowledge transfer for uncertain data. This paper presents a transfer learning-based approach for the problem of learning with label proportions(TL-LLP) to transfer knowledge from source task to target task where both the source and target tasks contain uncertain data. Our approach first formulates objective model for the uncertain data and deals with transfer learning at the same time, and then proposes an iterative framework to build an accurate classifier for the target task. Extensive experiments have shown that the proposed TL-LLP method can obtain the better accuracies and is less sensitive to noise compared with the existing LLP methods.

cs.LG↗

arXiv2019

Sharpen Focus: Learning with Attention Separability and Consistency

Recent developments in gradient-based attention modeling have seen attention maps emerge as a powerful tool for interpreting convolutional neural networks. Despite good localization for an individual class of interest, these techniques produce attention maps with substantially overlapping responses among different classes, leading to the problem of visual confusion and the need for discriminative attention. In this paper, we address this problem by means of a new framework that makes class-discriminative attention a principled part of the learning process. Our key innovations include new learning objectives for attention separability and cross-layer consistency, which result in improved attention discriminability and reduced visual confusion. Extensive experiments on image classification benchmarks show the effectiveness of our approach in terms of improved classification accuracy, including CIFAR-100 (+3.33%), Caltech-256 (+1.64%), ILSVRC2012 (+0.92%), CUB-200-2011 (+4.8%) and PASCAL VOC2012 (+5.73%).

cs.CV↗

arXiv2019

Multi-scale Cell Instance Segmentation with Keypoint Graph based Bounding Boxes

Most existing methods handle cell instance segmentation problems directly without relying on additional detection boxes. These methods generally fails to separate touching cells due to the lack of global understanding of the objects. In contrast, box-based instance segmentation solves this problem by combining object detection with segmentation. However, existing methods typically utilize anchor box-based detectors, which would lead to inferior instance segmentation performance due to the class imbalance issue. In this paper, we propose a new box-based cell instance segmentation method. In particular, we first detect the five pre-defined points of a cell via keypoints detection. Then we group these points according to a keypoint graph and subsequently extract the bounding box for each cell. Finally, cell segmentation is performed on feature maps within the bounding boxes. We validate our method on two cell datasets with distinct object shapes, and empirically demonstrate the superiority of our method compared to other instance segmentation techniques. Code is available at: https://github.com/yijingru/KG_Instance_Segmentation.

cs.CV↗

arXiv2019

Passively stable distribution of polarisation entanglement over 192 km of deployed optical fibre

Quantum key distribution (QKD) based on entangled photon pairs holds the potential for repeater-based quantum networks connecting clients over long distance. We demonstrate long-distance entanglement distribution by means of polarisation-entangled photon pairs through two successive deployed 96 km-long telecommunications fibres in the same submarine cable. One photon of each pair was detected directly after the source, while the other travelled the fibre cable in both directions for a total distance of 192 km and attenuation of 48 dB. The observed two-photon Bell state exhibited a fidelity 85% $\pm$ 2% and was stable over several hours. We employed neither active stabilisation of the quantum state nor chromatic dispersion compensation for the fibre.

quant-ph↗

arXiv2019

Anonymized BERT: An Augmentation Approach to the Gendered Pronoun Resolution Challenge

We present our 7th place solution to the Gendered Pronoun Resolution challenge, which uses BERT without fine-tuning and a novel augmentation strategy designed for contextual embedding token-level tasks. Our method anonymizes the referent by replacing candidate names with a set of common placeholder names. Besides the usual benefits of effectively increasing training data size, this approach diversifies idiosyncratic information embedded in names. Using same set of common first names can also help the model recognize names better, shorten token length, and remove gender and regional biases associated with names. The system scored 0.1947 log loss in stage 2, where the augmentation contributed to an improvements of 0.04. Post-competition analysis shows that, when using different embedding layers, the system scores 0.1799 which would be third place.

cs.CL↗

arXiv2019

Non-uniqueness phenomenon of object representation in modelling IT cortex by deep convolutional neural network (DCNN)

Recently DCNN (Deep Convolutional Neural Network) has been advocated as a general and promising modelling approach for neural object representation in primate inferotemporal cortex. In this work, we show that some inherent non-uniqueness problem exists in the DCNN-based modelling of image object representations. This non-uniqueness phenomenon reveals to some extent the theoretical limitation of this general modelling approach, and invites due attention to be taken in practice.

q-bio.NC↗

arXiv2019

Enhancement of intrinsic magnetic damping in defect-free epitaxial Fe3O4 thin films

We have investigated the magnetic damping of precessional spin dynamics in defect-controlled epitaxial grown Fe$_3$O$_4$(111)/Yttria-stabilized Zirconia (YSZ) nanoscale films by all-optical pump-probe measurements. The intrinsic damping constant of the defect-free Fe$_3$O$_4$ film is found to be strikingly larger than that of the as-grown Fe$_3$O$_4$ film with structural defects. We demonstrate that the population of the first-order perpendicular standing spin wave (PSSW) mode, which is exclusively observed in the defect-free film under sufficiently high external magnetic fields, leads to the enhancement of the magnetic damping of the uniform precession (Kittel) mode. We propose a physical picture in which the PSSW mode acts as an additional channel for the extra energy dissipation of the Kittel mode. The energy transfer from Kittel mode to PSSW mode increases as in-plane magnetization precession becomes more uniform, resulting in the unique intrinsic magnetic damping enhancement in the defect-free Fe$_3$O$_4$ film.

cond-mat.mtrl-sci↗

arXiv2019

Optimal Control of Complex Systems through Variational Inference with a Discrete Event Decision Process

Complex social systems are composed of interconnected individuals whose interactions result in group behaviors. Optimal control of a real-world complex system has many applications, including road traffic management, epidemic prevention, and information dissemination. However, such real-world complex system control is difficult to achieve because of high-dimensional and non-linear system dynamics, and the exploding state and action spaces for the decision maker. Prior methods can be divided into two categories: simulation-based and analytical approaches. Existing simulation approaches have high-variance in Monte Carlo integration, and the analytical approaches suffer from modeling inaccuracy. We adopted simulation modeling in specifying the complex dynamics of a complex system, and developed analytical solutions for searching optimal strategies in a complex network with high-dimensional state-action space. To capture the complex system dynamics, we formulate the complex social network decision making problem as a discrete event decision process. To address the curse of dimensionality and search in high-dimensional state action spaces in complex systems, we reduce control of a complex system to variational inference and parameter learning, introduce Bethe entropy approximation, and develop an expectation propagation algorithm. Our proposed algorithm leads to higher system expected rewards, faster convergence, and lower variance of value function in a real-world transportation scenario than state-of-the-art analytical and sampling approaches.

eess.SY↗

arXiv2019

Feature Space Transfer for Data Augmentation

The problem of data augmentation in feature space is considered. A new architecture, denoted the FeATure TransfEr Network (FATTEN), is proposed for the modeling of feature trajectories induced by variations of object pose. This architecture exploits a parametrization of the pose manifold in terms of pose and appearance. This leads to a deep encoder/decoder network architecture, where the encoder factors into an appearance and a pose predictor. Unlike previous attempts at trajectory transfer, FATTEN can be efficiently trained end-to-end, with no need to train separate feature transfer functions. This is realized by supplying the decoder with information about a target pose and the use of a multi-task loss that penalizes category- and pose-mismatches. In result, FATTEN discourages discontinuous or non-smooth trajectories that fail to capture the structure of the pose manifold, and generalizes well on object recognition tasks involving large pose variation. Experimental results on the artificial ModelNet database show that it can successfully learn to map source features to target features of a desired pose, while preserving class identity. Most notably, by using feature space transfer for data augmentation (w.r.t. pose and depth) on SUN-RGBD objects, we demonstrate considerable performance improvements on one/few-shot object recognition in a transfer learning setup, compared to current state-of-the-art methods.

cs.CV↗

arXiv2019

Predicting pregnancy using large-scale data from a women's health tracking mobile application

Predicting pregnancy has been a fundamental problem in women's health for more than 50 years. Previous datasets have been collected via carefully curated medical studies, but the recent growth of women's health tracking mobile apps offers potential for reaching a much broader population. However, the feasibility of predicting pregnancy from mobile health tracking data is unclear. Here we develop four models -- a logistic regression model, and 3 LSTM models -- to predict a woman's probability of becoming pregnant using data from a women's health tracking app, Clue by BioWink GmbH. Evaluating our models on a dataset of 79 million logs from 65,276 women with ground truth pregnancy test data, we show that our predicted pregnancy probabilities meaningfully stratify women: women in the top 10% of predicted probabilities have a 89% chance of becoming pregnant over 6 menstrual cycles, as compared to a 27% chance for women in the bottom 10%. We develop a technique for extracting interpretable time trends from our deep learning models, and show these trends are consistent with previous fertility research. Our findings illustrate the potential that women's health tracking data offers for predicting pregnancy on a broader population; we conclude by discussing the steps needed to fulfill this potential.

stat.AP↗

arXiv2019

Oblique droplet impact onto a deep liquid pool

The oblique impact of a liquid droplet onto a deep liquid pool is studied numerically with the adaptive volume-of-fluid solver Basilisk. The splashing threshold, cavity formation, cavity evolution and the maximum cavity dimensions are quantified as a function of the Weber number and the impact angle. We compare the numerical results with recent experimental work by Gielen et al. [Phys. Rev. Fluids 2, 083602 (2017)]. Similarly to the experimental results, three different impact regimes are observed: deposition of the droplet onto the pool, single-sided splashing in the direction of the impact and splashing in all directions. We show good qualitative and quantitative agreement of the splashing behaviour and cavity formation between the simulations and the experiments. Furthermore, the simulations provide a three dimensional view of the impact phenomenon, give access to velocity and pressure fields, and allow to explore impact parameters that are hard to achieve experimentally.

physics.flu-dyn↗

arXiv2019

Constraining the anomalous Higgs boson coupling in $H$+$γ$ production

Higgs boson production in association with a photon ($H$+$γ$) offers a promising channel to test the Higgs boson to photon coupling at various energy scales. Its potential sensitivity to anomalous couplings of the Higgs boson has not been explored with the proton-proton collision data. In this paper, we reinterpret the latest ATLAS $H$+$γ$ resonance search results within the Standard Model effective field theory (EFT) framework, using 36.1 fb$^{-1}$ of proton-proton collision data recorded with the ATLAS detector at $\sqrt{s}=13$ TeV. Constraints on the Wilson coefficients of dimension-six EFT operators related to the Higgs boson to photon coupling are provided for the first time in the $H$+$γ$ final state at the LHC.

hep-ph↗

arXiv2019

Precision Higgs Physics at CEPC

The discovery of the Higgs boson with its mass around 125 GeV by the ATLAS and CMS Collaborations marked the beginning of a new era in high energy physics. The Higgs boson will be the subject of extensive studies of the ongoing LHC program. At the same time, lepton collider based Higgs factories have been proposed as a possible next step beyond the LHC, with its main goal to precisely measure the properties of the Higgs boson and probe potential new physics associated with the Higgs boson. The Circular Electron Positron Collider~(CEPC) is one of such proposed Higgs factories. The CEPC is an $e^+e^-$ circular collider proposed by and to be hosted in China. Located in a tunnel of approximately 100~km in circumference, it will operate at a center-of-mass energy of 240~GeV as the Higgs factory. In this paper, we present the first estimates on the precision of the Higgs boson property measurements achievable at the CEPC and discuss implications of these measurements.

hep-ex↗

arXiv2019

SDRL: Interpretable and Data-efficient Deep Reinforcement Learning Leveraging Symbolic Planning

Deep reinforcement learning (DRL) has gained great success by learning directly from high-dimensional sensory inputs, yet is notorious for the lack of interpretability. Interpretability of the subtasks is critical in hierarchical decision-making as it increases the transparency of black-box-style DRL approach and helps the RL practitioners to understand the high-level behavior of the system better. In this paper, we introduce symbolic planning into DRL and propose a framework of Symbolic Deep Reinforcement Learning (SDRL) that can handle both high-dimensional sensory inputs and symbolic planning. The task-level interpretability is enabled by relating symbolic actions to options.This framework features a planner -- controller -- meta-controller architecture, which takes charge of subtask scheduling, data-driven subtask learning, and subtask evaluation, respectively. The three components cross-fertilize each other and eventually converge to an optimal symbolic plan along with the learned subtasks, bringing together the advantages of long-term planning capability with symbolic knowledge and end-to-end reinforcement learning directly from a high-dimensional sensory input. Experimental results validate the interpretability of subtasks, along with improved data efficiency compared with state-of-the-art approaches.

cs.AI↗

arXiv2018

A Container-based DoS Attack-Resilient Control Framework for Real-Time UAV Systems

The Unmanned aerial vehicles (UAVs) sector is fast-expanding. Protection of real-time UAV applications against malicious attacks has become an urgent problem that needs to be solved. Denial-of-service (DoS) attack aims to exhaust system resources and cause important tasks to miss deadlines. DoS attack may be one of the common problems of UAV systems, due to its simple implementation. In this paper, we present a software framework that offers DoS attack-resilient control for real-time UAV systems using containers: ContainerDrone. The framework provides defense mechanisms for three critical system resources: CPU, memory, and communication channel. We restrict attacker's access to CPU core set and utilization. Memory bandwidth throttling limits attacker's memory usage. By simulating sensors and drivers in the container, a security monitor constantly checks DoS attacks over communication channels. Upon the detection of a security rule violation, the framework switches to the safety controller to mitigate the attack. We implemented a prototype quadcopter with commercially off-the-shelf (COTS) hardware and open-source software. Our experimental results demonstrated the effectiveness of the proposed framework defending against various DoS attacks.

cs.CR↗

arXiv2018

Viconmavlink: A software tool for indoor positioning using a motion capture system

Motion capture is a widely-used technology in robotics research thanks to its precise posi tional measurements with real-time performance. This paper presents ViconMAVLink, a cross-platform open-source software tool that provides indoor positioning services to networked robots. ViconMAVLink converts Vicon motion capture data into proper pose and motion data formats and send localization information to robots using the MAVLink protocol. The software is a convenient tool for mobile robotics researchers to conduct experiments in a controlled indoor environment.

cs.RO↗