arXiv subjects

Yu Liu

Publications and source records attributed to Yu Liu.

At least 991 records · Page 55Linked to original sources

arXiv2019

From Caesar Cipher to Unsupervised Learning: A New Method for Classifier Parameter Estimation

Many important classification problems, such as object classification, speech recognition, and machine translation, have been tackled by the supervised learning paradigm in the past, where training corpora of parallel input-output pairs are required with high cost. To remove the need for the parallel training corpora has practical significance for real-world applications, and it is one of the main goals of unsupervised learning. Recently, encouraging progress in unsupervised learning for solving such classification problems has been made and the nature of the challenges has been clarified. In this article, we review this progress and disseminate a class of promising new methods to facilitate understanding the methods for machine learning researchers. In particular, we emphasize the key information that enables the success of unsupervised learning - the sequential statistics as the distributional prior in the labels. Exploitation of such sequential statistics makes it possible to estimate parameters of classifiers without the need of paired input-output data. In this paper, we first introduce the concept of Caesar Cipher and its decryption, which motivated the construction of the novel loss function for unsupervised learning we use throughout the paper. Then we use a simple but representative binary classification task as an example to derive and describe the unsupervised learning algorithm in a step-by-step, easy-to-understand fashion. We include two cases, one with Bigram language model as the sequential statistics for use in unsupervised parameter estimation, and another with a simpler Unigram language model. For both cases, detailed derivation steps for the learning algorithm are included. Further, a summary table compares computational steps of the two cases in executing the unsupervised learning algorithm for learning binary classifiers.

cs.LG↗

arXiv2019

Modulating quantum Fisher information of qubit in dissipative cavity by coupling strength

By using the non-Markovian master equation, we investigate the effect of the cavity and the environment on the quantum Fisher information (QFI) of an atom qubit system in a dissipation cavity. We obtain the formulae of QFI for two different initial states and analyze the effect of the atom-cavity coupling and the cavity-reservoir coupling on the QFI. The results show that the dynamic behavior of the QFI is obviously dependent on the initial atomic states, the atom-cavity coupling and the cavity-reservoir coupling. The stronger the atom-cavity coupling, the quicker the QFI oscillates and the slower the QFI reduces. Especially, the QFI will tend to a stable value not zero if the atom-cavity coupling is large enough. On the other hand, the smaller the cavity-reservoir coupling, the stronger the non-Markovian effect, the slower the QFI decay. In other words, choosing the best parameter can improve the accuracy of parameter estimation. In addition, the physical explanation of the dynamic behavior of the QFI is given by means of the QFI flow.

quant-ph↗

arXiv2019

PRSim: Sublinear Time SimRank Computation on Large Power-Law Graphs

{\it SimRank} is a classic measure of the similarities of nodes in a graph. Given a node $u$ in graph $G =(V, E)$, a {\em single-source SimRank query} returns the SimRank similarities $s(u, v)$ between node $u$ and each node $v \in V$. This type of queries has numerous applications in web search and social networks analysis, such as link prediction, web mining, and spam detection. Existing methods for single-source SimRank queries, however, incur query cost at least linear to the number of nodes $n$, which renders them inapplicable for real-time and interactive analysis. { This paper proposes \prsim, an algorithm that exploits the structure of graphs to efficiently answer single-source SimRank queries. \prsim uses an index of size $O(m)$, where $m$ is the number of edges in the graph, and guarantees a query time that depends on the {\em reverse PageRank} distribution of the input graph. In particular, we prove that \prsim runs in sub-linear time if the degree distribution of the input graph follows the power-law distribution, a property possessed by many real-world graphs. Based on the theoretical analysis, we show that the empirical query time of all existing SimRank algorithms also depends on the reverse PageRank distribution of the graph.} Finally, we present the first experimental study that evaluates the absolute errors of various SimRank algorithms on large graphs, and we show that \prsim outperforms the state of the art in terms of query time, accuracy, index size, and scalability.

cs.DS↗

arXiv2019

Extracting human emotions at different places based on facial expressions and spatial clustering analysis

The emergence of big data enables us to evaluate the various human emotions at places from a statistic perspective by applying affective computing. In this study, a novel framework for extracting human emotions from large-scale georeferenced photos at different places is proposed. After the construction of places based on spatial clustering of user generated footprints collected in social media websites, online cognitive services are utilized to extract human emotions from facial expressions using the state-of-the-art computer vision techniques. And two happiness metrics are defined for measuring the human emotions at different places. To validate the feasibility of the framework, we take 80 tourist attractions around the world as an example and a happiness ranking list of places is generated based on human emotions calculated over 2 million faces detected out from over 6 million photos. Different kinds of geographical contexts are taken into consideration to find out the relationship between human emotions and environmental factors. Results show that much of the emotional variation at different places can be explained by a few factors such as openness. The research may offer insights on integrating human emotions to enrich the understanding of sense of place in geography and in place-based GIS.

cs.CV↗

arXiv2019

RGBD Based Dimensional Decomposition Residual Network for 3D Semantic Scene Completion

RGB images differentiate from depth images as they carry more details about the color and texture information, which can be utilized as a vital complementary to depth for boosting the performance of 3D semantic scene completion (SSC). SSC is composed of 3D shape completion (SC) and semantic scene labeling while most of the existing methods use depth as the sole input which causes the performance bottleneck. Moreover, the state-of-the-art methods employ 3D CNNs which have cumbersome networks and tremendous parameters. We introduce a light-weight Dimensional Decomposition Residual network (DDR) for 3D dense prediction tasks. The novel factorized convolution layer is effective for reducing the network parameters, and the proposed multi-scale fusion mechanism for depth and color image can improve the completion and segmentation accuracy simultaneously. Our method demonstrates excellent performance on two public datasets. Compared with the latest method SSCNet, we achieve 5.9% gains in SC-IoU and 5.7% gains in SSC-IOU, albeit with only 21% network parameters and 16.6% FLOPs employed compared with that of SSCNet.

cs.CV↗

arXiv2019

Experimental Quantum-enhanced Cryptographic Remote Control

The Internet of Things (IoT), as a cutting-edge integrated cross-technology, promises to informationize people's daily lives, while being threatened by continuous challenges of eavesdropping and tampering. The emerging quantum cryptography, harnessing the random nature of quantum mechanics, may also enable unconditionally secure control network, beyond the applications in secure communications. Here, we present a quantum-enhanced cryptographic remote control scheme that combines quantum randomness and one-time pad algorithm for delivering commands remotely. We experimentally demonstrate this on an unmanned aircraft vehicle (UAV) control system. We precharge quantum random number (QRN) into controller and controlee before launching UAV, instead of distributing QRN like standard quantum communication during flight. We statistically verify the randomness of both quantum keys and the converted ciphertexts to check the security capability. All commands in the air are found to be completely chaotic after encryption, and only matched keys on UAV can decipher those commands precisely. In addition, the controlee does not response to the commands that are not or incorrectly encrypted, showing the immunity against interference and decoy. Our work adds true randomness and quantum enhancement into the realm of secure control algorithm in a straightforward and practical fashion, providing a promoted solution for the security of artificial intelligence and IoT.

cs.CR↗

arXiv2019

Two-dimensional honeycomb borophene oxide: A promising anode material offering super high capacity for Li/Na-ion batteries

Rational design of novel two-dimensional (2D) electrode materials with high capacity is crucial for the further development of Li-ion and Na-ion batteries. Herein, based on first-principles calculations, we systemically investigate Li and Na storage behaviors in the recently discovered 2D topological nodal-loop metal - the honeycomb borophene oxide (h-B2O). We show that h-B2O is an almost ideal anode material. It has good conductivity before and after Li/Na adsorption, fast ion diffusion with diffusion barrier less than 0.5 eV, low open-circuit voltage (less than 1 V), and small lattice change (less than 6.2%) during intercalation. Most remarkably, its theoretical storage capacity is extremely high, reaching up to 2137 mAh/g for Li and 1425 mAh/g for Na. Its Li storage capacity is more than six times higher than graphite (372 mAh/g), and is actually the highest among all 2D materials discovered to date. Our results strongly suggest that 2D h-B2O is an exceedingly promising anode material for both Li- and Na-ion batteries with super high capacity.

cond-mat.mtrl-sci↗

arXiv2019

Talking Face Generation by Adversarially Disentangled Audio-Visual Representation

Talking face generation aims to synthesize a sequence of face images that correspond to a clip of speech. This is a challenging task because face appearance variation and semantics of speech are coupled together in the subtle movements of the talking face regions. Existing works either construct specific face appearance model on specific subjects or model the transformation between lip motion and speech. In this work, we integrate both aspects and enable arbitrary-subject talking face generation by learning disentangled audio-visual representation. We find that the talking face sequence is actually a composition of both subject-related information and speech-related information. These two spaces are then explicitly disentangled through a novel associative-and-adversarial training process. This disentangled representation has an advantage where both audio and video can serve as inputs for generation. Extensive experiments show that the proposed approach generates realistic talking face sequences on arbitrary subjects with much clearer lip motion patterns than previous work. We also demonstrate the learned audio-visual representation is extremely useful for the tasks of automatic lip reading and audio-video retrieval.

cs.CV↗

arXiv2019

Gorenstein dimension of abelian categories

Let C be triangulated category and X a cluster tilting subcategory of C. Koenig and Zhu showed that the quotient category C/X is Gorenstein of Gorenstein dimension at most one. The notion of an extriangulated category was introduced by Nakaoka and Palu as a simultaneous generalization of exact categories and triangulated categories. Now let C be extriangulated category with enough projectives and enough injectives, and X a cluster tilting subcategory of C. In this article, we show that under certain conditions the quotient category C/X is Gorenstein of Gorenstein dimension at most one. As an application, this result generalizes work by Koenig and Zhu.

math.RT↗

arXiv2019

Knowledge Distillation via Route Constrained Optimization

Distillation-based learning boosts the performance of the miniaturized neural network based on the hypothesis that the representation of a teacher model can be used as structured and relatively weak supervision, and thus would be easily learned by a miniaturized model. However, we find that the representation of a converged heavy model is still a strong constraint for training a small student model, which leads to a high lower bound of congruence loss. In this work, inspired by curriculum learning we consider the knowledge distillation from the perspective of curriculum learning by routing. Instead of supervising the student model with a converged teacher model, we supervised it with some anchor points selected from the route in parameter space that the teacher model passed by, as we called route constrained optimization (RCO). We experimentally demonstrate this simple operation greatly reduces the lower bound of congruence loss for knowledge distillation, hint and mimicking learning. On close-set classification tasks like CIFAR100 and ImageNet, RCO improves knowledge distillation by 2.14% and 1.5% respectively. For the sake of evaluating the generalization, we also test RCO on the open-set face recognition task MegaFace.

cs.LG↗

arXiv2019

Measuring Road Network Topology Vulnerability by Ricci Curvature

Describing the basic properties of road network systems, such as their robustness, vulnerability, and reliability, has been a very important research topic in the field of urban transportation. Current research mainly uses several statistical indicators of complex networks to analyze the road network systems. However, these methods are essentially node-based. These node-based methods are more concerned with the number of connections between nodes, and lack of consideration for interactions. So, this leads to the well-known node paradox problem, and their ability of characterizing the local and intrinsic properties of a network is weak. From the perspective of network intrinsic geometry, this paper proposes a method for measuring road network vulnerability using a discrete Ricci curvature, which can identify the key sections of a road network and indicate its fragile elements. The results show that our method performs better than complex network statistics on measuring the vulnerability of a road network. Additionally, it can characterize the evolution of the road network vulnerability among different periods of time in the same city through our method. Finally, we compare our method with the previous method of centrality and show the different between them. This article provides a new perspective on a geometry to analyze the vulnerability of a road network and describes the inherent nature of the vulnerability of a road system from a new perspective. It also contributes to enriching the analytical methods of complex road networks.

cs.SI↗

arXiv2019

Conditional Adversarial Generative Flow for Controllable Image Synthesis

Flow-based generative models show great potential in image synthesis due to its reversible pipeline and exact log-likelihood target, yet it suffers from weak ability for conditional image synthesis, especially for multi-label or unaware conditions. This is because the potential distribution of image conditions is hard to measure precisely from its latent variable $z$. In this paper, based on modeling a joint probabilistic density of an image and its conditions, we propose a novel flow-based generative model named conditional adversarial generative flow (CAGlow). Instead of disentangling attributes from latent space, we blaze a new trail for learning an encoder to estimate the mapping from condition space to latent space in an adversarial manner. Given a specific condition $c$, CAGlow can encode it to a sampled $z$, and then enable robust conditional image synthesis in complex situations like combining person identity with multiple attributes. The proposed CAGlow can be implemented in both supervised and unsupervised manners, thus can synthesize images with conditional information like categories, attributes, and even some unknown properties. Extensive experiments show that CAGlow ensures the independence of different conditions and outperforms regular Glow to a significant extent.

cs.CV↗

arXiv2019

Correlation Congruence for Knowledge Distillation

Most teacher-student frameworks based on knowledge distillation (KD) depend on a strong congruent constraint on instance level. However, they usually ignore the correlation between multiple instances, which is also valuable for knowledge transfer. In this work, we propose a new framework named correlation congruence for knowledge distillation (CCKD), which transfers not only the instance-level information, but also the correlation between instances. Furthermore, a generalized kernel method based on Taylor series expansion is proposed to better capture the correlation between instances. Empirical experiments and ablation studies on image classification tasks (including CIFAR-100, ImageNet-1K) and metric learning tasks (including ReID and Face Recognition) show that the proposed CCKD substantially outperforms the original KD and achieves state-of-the-art accuracy compared with other SOTA KD-based methods. The CCKD can be easily deployed in the majority of the teacher-student framework such as KD and hint-based learning methods.

cs.CV↗

arXiv2019

Pulsed Quantum-State Reconstruction of Dark Systems

We propose a novel strategy to reconstruct the quantum state of dark systems, i.e., degrees of freedom that are not directly accessible for measurement or control. Our scheme relies on the quantum control of a two-level probe that exerts a state-dependent potential on the dark system. Using a sequence of control pulses applied to the probe makes it possible to tailor the information one can obtain and, for example, allows us to reconstruct the density operator of a dark spin as well as the Wigner characteristic function of a harmonic oscillator. Because of the symmetry of the applied pulse sequence, this scheme is robust against slow noise on the probe. The proof-of-principle experiments are readily feasible in solid-state spins and trapped ions.

quant-ph↗

arXiv2019

Possible correlations between gamma-ray burst and its host galaxy offset

We collected the information of 304 gamma-ray bursts (GRBs) from the literature, and analyzed the correlations among the host galaxy offsets (the distance from the site of the GRB to the center of its host galaxy), $T_{\rm 90,i}$ (the duration $T_{\rm 90}$ in rest-frame), $T_{\rm R45,i}$ (the duration $T_{\rm R45}$ in rest-frame), $E_{\rm γ,iso}$ (the isotropic equivalent energy), $L_{\rm γ,iso}$ ($=E_{\rm γ,iso}/T_{\rm 90,i}$, the isotropic equivalent luminosity) and $L_{\rm pk}$ (peak luminosity). We found that $ T_{\rm 90,i}$, $ T_{\rm R45,i}$, $ E_{\rm γ,iso}$, $L_{\rm pk}$ have negative correlation with $ {\rm offset}$, which is consistent with origin of short GRBs (SGRBs) and long GRBs (LGRBs). On separate analysis, we found similar results for $\log E_{\rm γ,iso}$ - $\log {\rm (offset)}$ and $\log L_{\rm pk}$ - $\log {\rm (offset)}$ relations in case of SGRBs only, while no obvious relation for LGRBs. There is no correlations between offset and $L_{\rm γ,iso}$. We also put the special GRB 170817A {and GRB 060218A} on the plots. {The two GRBs both have low luminosity and small offset.} In the $ \log ({\rm offset})- \log T_{\rm 90,i}$ plot, we found GRB 170817A locates in between the two regions of SGRBs and LGRBs and it is the outlier in the $ {\rm offset}-E_{\rm γ, iso}$, $ {\rm offset}-L_{\rm γ, iso}$ and $ {\rm offset}-L_{\rm pk}$ plots. Together with GRB 060218A being an outlier in all plots, it indicates the speciality of GRBs 170817A and 060218A, and might imply more subgroups of the GRB samples.

astro-ph.HE↗

arXiv2019

Abelian quotients associated with fully rigid subcategories

In this article, we study the Gorenstein property of abelian quotient categories induced by fully rigid subcategories on an exact category B. We also study when d-cluster tilting subcategories become fully rigid. We show that the quotient abelian category induced by such d-cluster tilting subcategories are hereditary.

math.RT↗

arXiv2019

A comprehensive statistical study on gamma-ray bursts

In order to obtain an overview of the gamma-ray bursts (GRBs), we need a full sample. In this paper, we collected 6289 GRBs (from GRB 910421 to GRB 160509A) from the literature, including prompt emission, afterglow and host galaxy properties. We hope to use this large sample to reveal the intrinsic properties of GRB. We have listed all the data in machine readable tables, including the properties of the GRBs, correlation coefficients and linear regression results of two arbitrary parameters, and linear regression results of any three parameters. These machine readable tables could be used as a data reservoir for further studies on the classifications or correlations. One may find some intrinsic properties from these statistical results. With this comprehensive table, it is possible to find relations between different parameters, and to classify the GRBs into different kinds of sub-groups. With the completion, it may reveal the nature of GRBs and may be used as tools like pseudo-redshift indicators, standard candles, etc. All the machine readable data and statistical results are available on the website of the journal.

astro-ph.HE↗

arXiv2019

First Unambiguous Imaging of Large-Scale Quasi-Periodic Extreme-Ultraviolet Wave or Shock

We report the first unambiguous quasi-periodic large-scale extreme-ultraviolet (EUV) wave or shock that was detected by the Atmospheric Imaging Assembly on board the Solar Dynamics Observatory. During the whip-like unwinding eruption of a small filament on 2012 April 24, multiple consecutive large-scale wavefronts emanating from AR11467 were observed simultaneously along the solar surface and a closed transequatorial loop system. In the meantime, an upward propagating dome-shaped wavefront was also observed, whose initial speed and deceleration are about 1392 km/s and 1.78 km/s^2, respectively. Along the solar surface, the quasi-peridoic wavefronts had a period of about 163 +/- 21 seconds and propagated at a nearly constant speed of 747 +/- 26 km/s; they interacted with active region AR11469 and launched a sympathetic upward propagating secondary EUV wave. The wavefronts along the loop system propagated at a speed of 897 km/s, and they were reflected back at the southern end of the loop system at a similar speed. In addition to the propagating waves, a standing kink wave was also present in the loop system simultaneously. Periodicity analysis reveals that the period of the wavefronts was consistent with that of the unwinding helical structures of the erupting filament. Based on these observational facts, we propose that the observed quasi-periodic EUV wavefronts were most likely excited by the periodic unwinding motion of the filament helical structures. In addition, two different seismological methods are applied to derive the magnetic field strength of the loop system, and for the first time the reliability of these inversion techniques are tested with the same magnetic structure.

astro-ph.SR↗