arXiv subjects
Publications and source records attributed to Peng Sun.
We show that for any topological dynamical system with approximate product property, the set of points whose forward orbits do not accumulate to any point in a large set carries full topological pressure.
Even since the "quasi" parton distribution function (PDF) was proposed under the large-momentum effective theory (LaMET) framework, its renormalization under the lattice regularization has been a central challenge to be solved due to the linear divergence. Thus, we investigate several possible ways to renormalize the quasi-PDF operators in high accuracy with non-perturbative calculation using the quench configurations at several lattice spacings. We find that the ratio of the UV divergences obtained from the Wilson loop and off-shell quasi-PDF operator is not a constant of the Wilson link length $z$. Although the linear divergence in them may be consistent to each other numerically, there is some additional UV divergence in the quasi-PDF operator.
We present a detailed Lattice QCD study of the unpolarized isovector quark Parton Distribution Function (PDF) using large-momentum effective theory framework. We choose a quasi-PDF defined by a spatial correlator which is free from mixing with other operators of the same dimension. In the lattice simulation, we use a Gaussian-momentum-smeared source at $M_π=356$ MeV and $P_z \in \{1.8,2.3\}$ GeV. To control the systematics associated with the excited states, we explore {five different source-sink separations}. The nonperturbative renormalization is conducted in a regularization-independent momentum subtraction scheme, and the matching between the renormalized quasi-PDF and $\bar{\rm MS}$ PDF is calculated based on perturbative QCD up to one-loop order. Systematic errors due to renormalization and perturbative matching are also analyzed in detail. Our results for lightcone PDF are in reasonable agreement with the latest phenomenological analysis.
The faster-than-Nyquist nonlinear frequency division multiplexing system was first proposed, which provided 12.5% and 25% increase in spectral efficiency for the compression factor of 0.89 and 0.8 respectively.
We show that systems with the structure introduced by Climenhaga and Thompson have dense intermediate pressures and dense intermediate entropies of ergodic measures. The result applies to the Mañé diffeomorphisms.
It is important to scale out deep neural network (DNN) training for reducing model training time. The high communication overhead is one of the major performance bottlenecks for distributed DNN training across multiple GPUs. Our investigations have shown that popular open-source DNN systems could only achieve 2.5 speedup ratio on 64 GPUs connected by 56 Gbps network. To address this problem, we propose a communication backend named GradientFlow for distributed DNN training, and employ a set of network optimization techniques. First, we integrate ring-based allreduce, mixed-precision training, and computation/communication overlap into GradientFlow. Second, we propose lazy allreduce to improve network throughput by fusing multiple communication operations into a single one, and design coarse-grained sparse communication to reduce network traffic by only transmitting important gradient chunks. When training ImageNet/AlexNet on 512 GPUs, our approach achieves 410.2 speedup ratio and completes 95-epoch training in 1.5 minutes, which outperforms existing approaches.
We study the multiple soft gluon radiation effects in $Z$ boson plus jet production at the LHC. By applying the transverse momentum dependent factorization formalism, the large logarithms introduced by the small total transverse momentum of the $Z$ boson plus jet final state system, are resummed to all orders in the expansion of the strong interaction coupling at the accuracy of Next-to-Leading Logarithm(NLL). We also compare the prediction of our resummation calculation to the CMS data by employing a reweighting procedure to estimate the effect from imposing kinematic cuts on the leptons from $Z$ boson decay, and find good agreement for both the imbalance transverse momentum and the azimuthal angle correlation of the final state $Z$ boson and jet system, for $pp\to Z+jet$ production at the LHC.
Learning knowledge graph embedding from an existing knowledge graph is very important to knowledge graph completion. For a fact $(h,r,t)$ with the head entity $h$ having a relation $r$ with the tail entity $t$, the current approaches aim to learn low dimensional representations $(\mathbf{h},\mathbf{r},\mathbf{t})$, each of which corresponds to the elements in $(h, r, t)$, respectively. As $(\mathbf{h},\mathbf{r},\mathbf{t})$ is learned from the existing facts within a knowledge graph, these representations can not be used to detect unknown facts (if the entities or relations never occur in the knowledge graph). This paper proposes a new approach called TransW, aiming to go beyond the current work by composing knowledge graph embeddings using word embeddings. Given the fact that an entity or a relation contains one or more words (quite often), it is sensible to learn a mapping function from word embedding spaces to knowledge embedding spaces, which shows how entities are constructed using human words. More importantly, composing knowledge embeddings using word embeddings makes it possible to deal with the emerging new facts (either new entities or relations). Experimental results using three public datasets show the consistency and outperformance of the proposed TransW.
We introduce Arena, a toolkit for multi-agent reinforcement learning (MARL) research. In MARL, it usually requires customizing observations, rewards and actions for each agent, changing cooperative-competitive agent-interaction, and playing with/against a third-party agent, etc. We provide a novel modular design, called Interface, for manipulating such routines in essentially two ways: 1) Different interfaces can be concatenated and combined, which extends the OpenAI Gym Wrappers concept to MARL scenarios. 2) During MARL training or testing, interfaces can be embedded in either wrapped OpenAI Gym compatible Environments or raw environment compatible Agents. We offer off-the-shelf interfaces for several popular MARL platforms, including StarCraft II, Pommerman, ViZDoom, Soccer, etc. The interfaces effectively support self-play RL and cooperative-competitive hybrid MARL. Also, Arena can be conveniently extended to your own favorite MARL platform.
Video object segmentation aims at accurately segmenting the target object regions across consecutive frames. It is technically challenging for coping with complicated factors (e.g., shape deformations, occlusion and out of the lens). Recent approaches have largely solved them by using backforth re-identification and bi-directional mask propagation. However, their methods are extremely slow and only support offline inference, which in principle cannot be applied in real time. Motivated by this observation, we propose a efficient detection-based paradigm for video object segmentation. We propose an unified One-Pass Video Segmentation framework (OVS-Net) for modeling spatial-temporal representation in a unified pipeline, which seamlessly integrates object detection, object segmentation, and object re-identification. The proposed framework lends itself to one-pass inference that effectively and efficiently performs video object segmentation. Moreover, we propose a maskguided attention module for modeling the multi-scale object boundary and multi-level feature fusion. Experiments on the challenging DAVIS 2017 demonstrate the effectiveness of the proposed framework with comparable performance to the state-of-the-art, and the great efficiency about 11.5 FPS towards pioneering real-time work to our knowledge, more than 5 times faster than other state-of-the-art methods.
We present a detailed phenomenological study of the multiple soft gluon radiation for the $t$-channel single top and anti-top quark production at the Large Hadron Collider (LHC). By applying the transverse momentum dependent factorization formalism, large logarithms introduced by small total transverse momentum $q_\perp$ of the single-top (anti-top) plus one-jet final state system are resummed to all orders in the expansion of the strong interaction coupling at the accuracy of Next-to-Leading Logarithm. We discuss various kinematical distributions which are sensitive to this effect and find that soft gluon radiation become more important when the final state jet is required to be in the forward region. We show that the main difference from PYTHIA prediction lies on the inclusion of the exact color coherence effect between the initial and final states in our resummation calculation. We further propose to apply the experimental observable $ϕ^*$ to test the effect of multiple gluon radiation in the single-top and anti-top events. The bottom quark mass effect and jet rapidity distribution are also discussed.
Recent studies showed that single-machine graph processing systems can be as highly competitive as cluster-based approaches on large-scale problems. While several out-of-core graph processing systems and computation models have been proposed, the high disk I/O overhead could significantly reduce performance in many practical cases. In this paper, we propose GraphMP to tackle big graph analytics on a single machine. GraphMP achieves low disk I/O overhead with three techniques. First, we design a vertex-centric sliding window (VSW) computation model to avoid reading and writing vertices on disk. Second, we propose a selective scheduling method to skip loading and processing unnecessary edge shards on disk. Third, we use a compressed edge cache mechanism to fully utilize the available memory of a machine to reduce the amount of disk accesses for edges. Extensive evaluations have shown that GraphMP could outperform existing single-machine out-of-core systems such as GraphChi, X-Stream and GridGraph by up to 51, and can be as highly competitive as distributed graph engines like Pregel+, PowerGraph and Chaos.
We study the soft gluon radiation effects for the $s$-channel single top quark production at the LHC. By applying the transverse momentum dependent factorization formalism, the large logarithms about the small total transverse momentum ($q_\perp$) of the single-top plus one-jet final state system, are resummed to all orders in the expansion of the strong interaction coupling at the accuracy of Next-to-Leading Logarithm (NLL). We compare our numerical results with PYTHIA and find that both the $q_\perp$ and $ϕ^*$ observables from PYTHIA are consistent with our prediction. Furthermore, we point out the soft gluon radiation effects from the final state become significant in this process, especially for the boosted kinematical region.
We study active object tracking, where a tracker takes visual observations (i.e., frame sequences) as input and produces the corresponding camera control signals as output (e.g., move forward, turn left, etc.). Conventional methods tackle tracking and camera control tasks separately, and the resulting system is difficult to tune jointly. These methods also require significant human efforts for image labeling and expensive trial-and-error system tuning in the real world. To address these issues, we propose, in this paper, an end-to-end solution via deep reinforcement learning. A ConvNet-LSTM function approximator is adopted for the direct frame-to-action prediction. We further propose an environment augmentation technique and a customized reward function, which are crucial for successful training. The tracker trained in simulators (ViZDoom and Unreal Engine) demonstrates good generalization behaviors in the case of unseen object moving paths, unseen object appearances, unseen backgrounds, and distracting objects. The system is robust and can restore tracking after occasional lost of the target being tracked. We also find that the tracking ability, obtained solely from simulators, can potentially transfer to real-world scenarios. We demonstrate successful examples of such transfer, via experiments over the VOT dataset and the deployment of a real-world robot using the proposed active tracker trained in simulation.
Starcraft II (SC2) is widely considered as the most challenging Real Time Strategy (RTS) game. The underlying challenges include a large observation space, a huge (continuous and infinite) action space, partial observations, simultaneous move for all players, and long horizon delayed rewards for local decisions. To push the frontier of AI research, Deepmind and Blizzard jointly developed the StarCraft II Learning Environment (SC2LE) as a testbench of complex decision making systems. SC2LE provides a few mini games such as MoveToBeacon, CollectMineralShards, and DefeatRoaches, where some AI agents have achieved the performance level of human professional players. However, for full games, the current AI agents are still far from achieving human professional level performance. To bridge this gap, we present two full game AI agents in this paper - the AI agent TStarBot1 is based on deep reinforcement learning over a flat action structure, and the AI agent TStarBot2 is based on hard-coded rules over a hierarchical action structure. Both TStarBot1 and TStarBot2 are able to defeat the built-in AI agents from level 1 to level 10 in a full game (1v1 Zerg-vs-Zerg game on the AbyssalReef map), noting that level 8, level 9, and level 10 are cheating agents with unfair advantages such as full vision on the whole map and resource harvest boosting. To the best of our knowledge, this is the first public work to investigate AI agents that can defeat the built-in AI in the StarCraft II full game.
We propose a fast and near-optimal approach to joint channel-estimation, equalization, and decoding of coded single-carrier (SC) transmissions over frequency-selective channels with few-bit analog-to-digital converters (ADCs). Our approach leverages parametric bilinear generalized approximate message passing (PBiGAMP) to reduce the implementation complexity of joint channel estimation and (soft) symbol decoding to that of a few fast Fourier transforms (FFTs). Furthermore, it learns and exploits sparsity in the channel impulse response. Our work is motivated by millimeter-wave systems with bandwidths on the order of Gsamples/sec, where few-bit ADCs, SC transmissions, and fast processing all lead to significant reductions in power consumption and implementation cost. We numerically demonstrate our approach using signals and channels generated according to the IEEE 802.11ad wireless local area network (LAN) standard, in the case that the receiver uses analog beamforming and a single ADC.
Object detection in remote sensing, especially in aerial images, remains a challenging problem due to low image resolution, complex backgrounds, and variation of scale and angles of objects in images. In current implementations, multi-scale based and angle-based networks have been proposed and generate promising results with aerial image detection. In this paper, we propose a novel loss function, called Salience Biased Loss (SBL), for deep neural networks, which uses salience information of the input image to achieve improved performance for object detection. Our novel loss function treats training examples differently based on input complexity in order to avoid the over-contribution of easy cases in the training process. In our experiments, RetinaNet was trained with SBL to generate an one-stage detector, SBL-RetinaNet. SBL-RetinaNet is applied to the largest existing public aerial image dataset, DOTA. Experimental results show our proposed loss function with the RetinaNet architecture outperformed other state-of-art object detection models by at least 4.31 mAP, and RetinaNet by 2.26 mAP with the same inference speed of RetinaNet.
Most existing deep reinforcement learning (DRL) frameworks consider either discrete action space or continuous action space solely. Motivated by applications in computer games, we consider the scenario with discrete-continuous hybrid action space. To handle hybrid action space, previous works either approximate the hybrid space by discretization, or relax it into a continuous set. In this paper, we propose a parametrized deep Q-network (P- DQN) framework for the hybrid action space without approximation or relaxation. Our algorithm combines the spirits of both DQN (dealing with discrete action space) and DDPG (dealing with continuous action space) by seamlessly integrating them. Empirical results on a simulation example, scoring a goal in simulated RoboCup soccer and the solo mode in game King of Glory (KOG) validate the efficiency and effectiveness of our method.