arXiv subjects

Peng Li

Publications and source records attributed to Peng Li.

At least 451 records · Page 25Linked to original sources

arXiv2019

Boosting Throughput and Efficiency of Hardware Spiking Neural Accelerators using Time Compression Supporting Multiple Spike Codes

Spiking neural networks (SNNs) are the third generation of neural networks and can explore both rate and temporal coding for energy-efficient event-driven computation. However, the decision accuracy of existing SNN designs is contingent upon processing a large number of spikes over a long period. Nevertheless, the switching power of SNN hardware accelerators is proportional to the number of spikes processed while the length of spike trains limits throughput and static power efficiency. This paper presents the first study on developing temporal compression to significantly boost throughput and reduce energy dissipation of digital hardware SNN accelerators while being applicable to multiple spike codes. The proposed compression architectures consist of low-cost input spike compression units, novel input-and-output-weighted spiking neurons, and reconfigurable time constant scaling to support large and flexible time compression ratios. Our compression architectures can be transparently applied to any given pre-designed SNNs employing either rate or temporal codes while incurring minimal modification of the neural models, learning algorithms, and hardware design. Using spiking speech and image recognition datasets, we demonstrate the feasibility of supporting large time compression ratios of up to 16x, delivering up to 15.93x, 13.88x, and 86.21x improvements in throughput, energy dissipation, the tradeoffs between hardware area, runtime, energy, and classification accuracy, respectively based on different spike codes on a Xilinx Zynq-7000 FPGA. These results are achieved while incurring little extra hardware overhead.

cs.NE↗

arXiv2019

Quantifying and Correlating Rhythm Formants in Speech

The objective of the present study is exploratory: to introduce and apply a new theory of speech rhythm zones or rhythm formants (R-formants). R-formants are zones of high magnitude frequencies in the low frequency (LF) long-term spectrum (LTS), rather like formants in the short-term spectra of vowels and consonants. After an illustration of the method, an R-formant analysis is made of non-elicited extracts from public speeches. The LF-LTS of three domains, the amplitude modulated (AM) absolute (rectified) signal, the amplitude envelope modulation (AEM) and frequency modulation (FM, F0, 'pitch') of the signal are compared. The first two correlate well, but the third does not correlate consistently with the other two, presumably due to variability of tone, pitch accent and intonation. Consequently, only the LF LTS of the absolute speech signal is used in the empirical analysis. An informal discussion of the relation between R-formant patterns and utterance structure and a selection of pragmatic variables over the same utterances showed some trends for R-formant functionality and thus useful directions for future research.

eess.AS↗

arXiv2019

Optically active beams: non-reciprocal optical activity in free space induced by spin-orbital interaction of light

Optical activity, the power of a medium to rotate the polarization of a light beam, has contributed significantly to molecular structure assessments in stereochemistry, biomolecular science and crystallography. Thus far, it is commonly believed that optical activity is manifested only in the chiral media which can give rise to circular birefringence of light. Here, we experimentally demonstrate that free space can also support the implementation of non-reciprocal optical activity with Bessel beams by spin-orbital interaction. Specifically, non-diffractive optically active beams are realized, with their optical rotatory power readily controlled by simple optical elements. We show that such free-space optical activity can be exploited to form non-reciprocal optical components such as polarization rotators, isolators, and circulators. Our results may bring about new possibilities of media-independent optical activity to other transverse waves ranging from radio to optical frequencies.

physics.optics↗

arXiv2019

EmoSense: Computational Intelligence Driven Emotion Sensing via Wireless Channel Data

Emotion is well-recognized as a distinguished symbol of human beings, and it plays a crucial role in our daily lives. Existing vision-based or sensor-based solutions are either obstructive to use or rely on specialized hardware, hindering their applicability. This paper introduces EmoSense, a first-of-its-kind wireless emotion sensing system driven by computational intelligence. The basic methodology is to explore the physical expression of emotions from wireless channel response via data mining. The design and implementation of EmoSense {face} two major challenges: extracting physical expression from wireless channel data and recovering emotion from the corresponding physical expression. For the former, we present a Fresnel zone based theoretical model depicting the fingerprint of the physical expression on channel response. For the latter, we design an efficient computational intelligence driven mechanism to recognize emotion from the corresponding fingerprints. We prototyped EmoSense on the commodity WiFi infrastructure and compared it with main-stream sensor-based and vision-based approaches in the real-world scenario. The numerical study over $3360$ cases confirms that EmoSense achieves a comparable performance to the vision-based and sensor-based rivals under different scenarios. EmoSense only leverages the low-cost and prevalent WiFi infrastructures and thus constitutes a tempting solution for emotion sensing.

cs.HC↗

arXiv2019

Broadband Optical Detection using the Spin Seebeck Effect

The generation, control, and detection of spin currents in solid-state devices are critical for Joule-heating minimization, spin-based computation, and electrical energy generation from thermal gradients. Although incorporation of spin functionality into technologically important architectures is still in its infancy, advantages over all-electric devices are increasingly becoming clear. Here, we utilize the spin Seebeck effect (SSE) in Pt/Y3Fe5O12 devices to detect light from 390 to 2200 nm. We find the device responsivity is remarkably flat across this technologically important wavelength range, closely following the Pt absorption coefficient. As expected from a SSE-generation mechanism, we observe that the photovoltage and Pt heating dynamics are in strong agreement. To precisely determine the optically created thermal gradient produced from a point-like heat source, we introduce a field-modulation method for measuring the SSE. Our results show broadband optical detection can be performed with devices based solely on spin current generation and detection.

cond-mat.mtrl-sci↗

arXiv2019

FastPose: Towards Real-time Pose Estimation and Tracking via Scale-normalized Multi-task Networks

Both accuracy and efficiency are significant for pose estimation and tracking in videos. State-of-the-art performance is dominated by two-stages top-down methods. Despite the leading results, these methods are impractical for real-world applications due to their separated architectures and complicated calculation. This paper addresses the task of articulated multi-person pose estimation and tracking towards real-time speed. An end-to-end multi-task network (MTN) is designed to perform human detection, pose estimation, and person re-identification (Re-ID) tasks simultaneously. To alleviate the performance bottleneck caused by scale variation problem, a paradigm which exploits scale-normalized image and feature pyramids (SIFP) is proposed to boost both performance and speed. Given the results of MTN, we adopt an occlusion-aware Re-ID feature strategy in the pose tracking module, where pose information is utilized to infer the occlusion state to make better use of Re-ID feature. In experiments, we demonstrate that the pose estimation and tracking performance improves steadily utilizing SIFP through different backbones. Using ResNet-18 and ResNet-50 as backbones, the overall pose tracking framework achieves competitive performance with 29.4 FPS and 12.2 FPS, respectively. Additionally, occlusion-aware Re-ID feature decreases the identification switches by 37% in the pose tracking process.

cs.CV↗

arXiv2019

General approaches for shear-correcting coordinate transformations in Bragg coherent diffraction imaging: Part 1

In this two-part article series we provide a generalized description of the scattering geometry of Bragg coherent diffraction imaging (BCDI) experiments, the shear distortion effects inherent to the resulting three-dimensional (3D) image from current phase retrieval methods and strategies to mitigate this distortion. In this Part I, we derive in general terms the real-space coordinate transformation to correct this shear, which originates in the more fundamental relationship between the representations of mutually conjugate 3D spaces. Such a transformation, applied as a final post-processing step following phase retrieval, is crucial for arriving at an un-distorted and physically meaningful image of the 3D scatterer. As the relevance of BCDI grows in the field of materials characterization, we take this opportunity to generalize the available sparse literature that addresses the geometric theory of BCDI and the subsequent analysis methods. This aspect, specific to coherent Bragg diffraction and absent in two-dimensional transmission CDI experiments, gains particular importance concerning spatially-resolved characterization of 3D crystalline materials in a realiable, non-destructive manner. These articles describe this theory, from the diffraction in Bragg geometry, to the corrections needed to obtain a properly rendered digital image of the 3D scatterer. Part I provides the experimental BCDI communitcy with the theoretical underpinnings of the 3D real-space distortions in the phase-retrieved object, along with the necessary post-retrieval correction method. Part II builds upon the geometric theory developed in Part I with the formalism to correct the shear distortions directly on an orthogonal grid within the phase retrieval algorithm itself, allowing more physically realistic constraints to be applied.

physics.ins-det↗

arXiv2019

General approaches for shear-correcting coordinate transformations in Bragg coherent diffraction imaging: Part 2

X-ray Bragg coherent diffraction imaging has been demonstrated as a powerful three-dimensional (3D) microscopy approach for the investigation of sub-micrometer-scale crystalline particles. It is based on the measurement of a series of coherent diffraction intensity patterns that are numerically inverted to retrieve an image of the spatial distribution of relative phase and amplitude of the Bragg structure factor of the scatterer. This 3D information, which is collected through an angular rotation of the sample, is necessarily obtained in a non-orthogonal frame in Fourier space that must be eventually reconciled. To deal with this, the currently favored approach (detailed in Part I) is to perform the entire inversion in conjugate non-orthogonal real and Fourier space frames, and to transform the 3D sample image into an orthogonal frame as a post-processing step for result analysis. In this article, a direct follow-up of Part I, we demonstrate two different transformation strategies that enable the entire inversion procedure of the measured data set to be performed in an orthogonal frame. The new approaches described here build mathematical and numerical frameworks that apply to the cases of evenly and non-evenly sampled data along the direction of sample rotation (the rocking curve). The value of these methods is that they rely on and incorporate significantly more information about the experimental geometry into the design of the phase retrieval Fourier transformation than the strategy presented in Part I. Two important outcomes are 1) that the resulting sample image is correctly interpreted in a shear-free frame, and 2) physically realistic constraints of BCDI phase retrieval that are difficult to implement with current methods are easily incorporated. Computing scripts are also given to aid readers in the implementation of the proposed formalisms.

physics.ins-det↗

arXiv2019

DocRED: A Large-Scale Document-Level Relation Extraction Dataset

Multiple entities in a document generally exhibit complex inter-sentence relations, and cannot be well handled by existing relation extraction (RE) methods that typically focus on extracting intra-sentence relations for single entity pairs. In order to accelerate the research on document-level RE, we introduce DocRED, a new dataset constructed from Wikipedia and Wikidata with three features: (1) DocRED annotates both named entities and relations, and is the largest human-annotated dataset for document-level RE from plain text; (2) DocRED requires reading multiple sentences in a document to extract entities and infer their relations by synthesizing all information of the document; (3) along with the human-annotated data, we also offer large-scale distantly supervised data, which enables DocRED to be adopted for both supervised and weakly supervised scenarios. In order to verify the challenges of document-level RE, we implement recent state-of-the-art methods for RE and conduct a thorough evaluation of these methods on DocRED. Empirical results show that DocRED is challenging for existing RE methods, which indicates that document-level RE remains an open problem and requires further efforts. Based on the detailed analysis on the experiments, we discuss multiple promising directions for future research.

cs.CL↗

arXiv2019

Key Fact as Pivot: A Two-Stage Model for Low Resource Table-to-Text Generation

Table-to-text generation aims to translate the structured data into the unstructured text. Most existing methods adopt the encoder-decoder framework to learn the transformation, which requires large-scale training samples. However, the lack of large parallel data is a major practical problem for many domains. In this work, we consider the scenario of low resource table-to-text generation, where only limited parallel data is available. We propose a novel model to separate the generation into two stages: key fact prediction and surface realization. It first predicts the key facts from the tables, and then generates the text with the key facts. The training of key fact prediction needs much fewer annotated data, while surface realization can be trained with pseudo parallel corpus. We evaluate our model on a biography generation dataset. Our model can achieve $27.34$ BLEU score with only $1,000$ parallel data, while the baseline model only obtain the performance of $9.71$ BLEU score.

cs.CL↗

arXiv2019

Strong band kinks in magic-thickness Yb films arising from interfacial electron-phonon coupling

Interfacial electron-phonon coupling in ultrathin films has attracted much interest; it can give rise to novel effects and phenomena, including enhanced superconductivity. Here we report an observation of strong kinks in the energy dispersions of quantum well states in ultrathin Yb films grown on graphite. These kinks, arising from interfacial electron-phonon coupling, are most prominent for films with a preferred ("magic") thickness of 4 monolayers, which are strained and hole doped by the substrate. The energy position of the kinks agrees well with the optical phonon energy of graphite, and the extracted electron-phonon coupling strength λ shows a large subband dependence, with a maximum value up to 0.6. The kinks decay rapidly with increasing film thickness, consistent with its interfacial origin. The variation of λ is correlated with evolution of the electronic wave function amplitudes at the interface. A Lifshitz transition occurs just beyond the magic thickness where the heavy Yb 5d bands begin to populate right below the Fermi level.

cond-mat.mes-hall↗

arXiv2019

Global Adversarial Attacks for Assessing Deep Learning Robustness

It has been shown that deep neural networks (DNNs) may be vulnerable to adversarial attacks, raising the concern on their robustness particularly for safety-critical applications. Recognizing the local nature and limitations of existing adversarial attacks, we present a new type of global adversarial attacks for assessing global DNN robustness. More specifically, we propose a novel concept of global adversarial example pairs in which each pair of two examples are close to each other but have different class labels predicted by the DNN. We further propose two families of global attack methods and show that our methods are able to generate diverse and intriguing adversarial example pairs at locations far from the training or testing data. Moreover, we demonstrate that DNNs hardened using the strong projected gradient descent (PGD) based (local) adversarial training are vulnerable to the proposed global adversarial example pairs, suggesting that global robustness must be considered while training robust deep learning networks.

cs.LG↗

arXiv2019

SAVIOR: Towards Bug-Driven Hybrid Testing

Hybrid testing combines fuzz testing and concolic execution. It leverages fuzz testing to test easy-to-reach code regions and uses concolic execution to explore code blocks guarded by complex branch conditions. However, its code coverage-centric design is inefficient in vulnerability detection. First, it blindly selects seeds for concolic execution and aims to explore new code continuously. However, as statistics show, a large portion of the explored code is often bug-free. Therefore, giving equal attention to every part of the code during hybrid testing is a non-optimal strategy. It slows down the detection of real vulnerabilities by over 43%. Second, classic hybrid testing quickly moves on after reaching a chunk of code, rather than examining the hidden defects inside. It may frequently miss subtle vulnerabilities despite that it has already explored the vulnerable code paths. We propose SAVIOR, a new hybrid testing framework pioneering a bug-driven principle. Unlike the existing hybrid testing tools, SAVIOR prioritizes the concolic execution of the seeds that are likely to uncover more vulnerabilities. Moreover, SAVIOR verifies all vulnerable program locations along the executing program path. By modeling faulty situations using SMT constraints, SAVIOR reasons the feasibility of vulnerabilities and generates concrete test cases as proofs. Our evaluation shows that the bug-driven approach outperforms mainstream automated testing techniques, including state-of-the-art hybrid testing systems driven by code coverage. On average, SAVIOR detects vulnerabilities 43.4% faster than DRILLER and 44.3% faster than QSYM, leading to the discovery of 88 and 76 more uniquebugs,respectively.Accordingtotheevaluationon11 well fuzzed benchmark programs, within the first 24 hours, SAVIOR triggers 481 UBSAN violations, among which 243 are real bugs.

cs.SE↗

arXiv2019

Large Fermi Surface Expansion through Anisotropic c-f Mixing in the Semimetallic Kondo Lattice System CeBi

Using angle-resolved photoemission spectroscopy (ARPES) and resonant ARPES, we report evidence of strong anisotropic conduction-f electron mixing (c-f mixing) in CeBi by observing a largely expanded Ce-5d pocket at low temperature, with no change in the Bi-6p bands. The Fermi surface (FS) expansion is accompanied by a pronounced spectral weight transfer from the local 4f 0 peak of Ce (corresponding to Ce3+) to the itinerant conduction bands near the Fermi level. Careful analysis suggests that the observed large FS change (with a volume expansion of the electron pocket up to 40%) can most naturally be explained by a small valence change (~ 1%) of Ce, which coexists with a very weak Kondo screening. Our work therefore provides evidence for a FS change driven by real charge fluctuations deep in the Kondo limit, which is made possible by the low carrier density.

cond-mat.str-el↗

arXiv2019

Exploiting Offset-guided Network for Pose Estimation and Tracking

Human pose estimation has witnessed a significant advance thanks to the development of deep learning. Recent human pose estimation approaches tend to directly predict the location heatmaps, which causes quantization errors and inevitably deteriorates the performance within the reduced network output. Aim at solving it, we revisit the heatmap-offset aggregation method and propose the Offset-guided Network (OGN) with an intuitive but effective fusion strategy for both two-stages pose estimation and Mask R-CNN. For two-stages pose estimation, a greedy box generation strategy is also proposed to keep more necessary candidates while performing person detection. For mask R-CNN, ratio-consistent is adopted to improve the generalization ability of the network. State-of-the-art results on COCO and PoseTrack dataset verify the effectiveness of our offset-guided pose estimation and tracking.

cs.CV↗

arXiv2019

State-aware Re-identification Feature for Multi-target Multi-camera Tracking

Multi-target Multi-camera Tracking (MTMCT) aims to extract the trajectories from videos captured by a set of cameras. Recently, the tracking performance of MTMCT is significantly enhanced with the employment of re-identification (Re-ID) model. However, the appearance feature usually becomes unreliable due to the occlusion and orientation variance of the targets. Directly applying Re-ID model in MTMCT will encounter the problem of identity switches (IDS) and tracklet fragment caused by occlusion. To solve these problems, we propose a novel tracking framework in this paper. In this framework, the occlusion status and orientation information are utilized in Re-ID model with human pose information considered. In addition, the tracklet association using the proposed fused tracking feature is adopted to handle the fragment problem. The proposed tracker achieves 81.3\% IDF1 on the multiple-camera hard sequence, which outperforms all other reference methods by a large margin.

cs.CV↗

arXiv2019

A Dual Reinforcement Learning Framework for Unsupervised Text Style Transfer

Unsupervised text style transfer aims to transfer the underlying style of text but keep its main content unchanged without parallel data. Most existing methods typically follow two steps: first separating the content from the original style, and then fusing the content with the desired style. However, the separation in the first step is challenging because the content and style interact in subtle ways in natural language. Therefore, in this paper, we propose a dual reinforcement learning framework to directly transfer the style of the text via a one-step mapping model, without any separation of content and style. Specifically, we consider the learning of the source-to-target and target-to-source mappings as a dual task, and two rewards are designed based on such a dual structure to reflect the style accuracy and content preservation, respectively. In this way, the two one-step mapping models can be trained via reinforcement learning, without any use of parallel data. Automatic evaluations show that our model outperforms the state-of-the-art systems by a large margin, especially with more than 8 BLEU points improvement averaged on two benchmark datasets. Human evaluations also validate the effectiveness of our model in terms of style accuracy, content preservation and fluency. Our code and data, including outputs of all baselines and our model are available at https://github.com/luofuli/DualLanST.

cs.CL↗

arXiv2019

SNR-adaptive OCT angiography enabled by statistical characterization of intensity and decorrelation with multi-variate time series model

In OCT angiography (OCTA), decorrelation computation has been widely used as a local motion index to identify dynamic flow from static tissues, but its dependence on SNR severely degrades the vascular visibility, particularly in low- SNR regions. To mathematically characterize the decorrelation-SNR dependence of OCT signals, we developed a multi-variate time series (MVTS) model. Based on the model, we derived a universal asymptotic linear relation of decorrelation to inverse SNR (iSNR), with the variance in static and noise regions determined by the average kernel size. Accordingly, with the population distribution of static and noise voxels being explicitly calculated in the iSNR and decorrelation (ID) space, a linear classifier is developed by removing static and noise voxels at all SNR, to generate a SNR-adaptive OCTA, termed as ID-OCTA. Then, flow phantom and human skin experiments were performed to validate the proposed ID-OCTA. Both qualitative and quantitative assessments demonstrated that ID-OCTA offers a superior visibility of blood vessels, particularly in the deep layer. Finally, implications of this work on both system design and hemodynamic quantification are further discussed.

physics.med-ph↗