arXiv subjects

Liang Wang

Publications and source records attributed to Liang Wang.

At least 631 records · Page 35Linked to original sources

arXiv2018

A Hierarchical Contextual Attention-based GRU Network for Sequential Recommendation

Sequential recommendation is one of fundamental tasks for Web applications. Previous methods are mostly based on Markov chains with a strong Markov assumption. Recently, recurrent neural networks (RNNs) are getting more and more popular and has demonstrated its effectiveness in many tasks. The last hidden state is usually applied as the sequence's representation to make recommendation. Benefit from the natural characteristics of RNN, the hidden state is a combination of long-term dependency and short-term interest to some degrees. However, the monotonic temporal dependency of RNN impairs the user's short-term interest. Consequently, the hidden state is not sufficient to reflect the user's final interest. In this work, to deal with this problem, we propose a Hierarchical Contextual Attention-based GRU (HCA-GRU) network. The first level of HCA-GRU is conducted on the input. We construct a contextual input by using several recent inputs based on the attention mechanism. This can model the complicated correlations among recent items and strengthen the hidden state. The second level is executed on the hidden state. We fuse the current hidden state and a contextual hidden state built by the attention mechanism, which leads to a more suitable user's overall interest. Experiments on two real-world datasets show that HCA-GRU can effectively generate the personalized ranking list and achieve significant improvement.

cs.IR↗

arXiv2017

Learning Semantic Concepts and Order for Image and Sentence Matching

Image and sentence matching has made great progress recently, but it remains challenging due to the large visual-semantic discrepancy. This mainly arises from that the representation of pixel-level image usually lacks of high-level semantic information as in its matched sentence. In this work, we propose a semantic-enhanced image and sentence matching model, which can improve the image representation by learning semantic concepts and then organizing them in a correct semantic order. Given an image, we first use a multi-regional multi-label CNN to predict its semantic concepts, including objects, properties, actions, etc. Then, considering that different orders of semantic concepts lead to diverse semantic meanings, we use a context-gated sentence generation scheme for semantic order learning. It simultaneously uses the image global context containing concept relations as reference and the groundtruth semantic order in the matched sentence as supervision. After obtaining the improved image representation, we learn the sentence representation with a conventional LSTM, and then jointly perform image and sentence matching and sentence generation for model learning. Extensive experiments demonstrate the effectiveness of our learned semantic concepts and order, by achieving the state-of-the-art results on two public benchmark datasets.

cs.CV↗

arXiv2017

User-centric Composable Services: A New Generation of Personal Data Analytics

Machine Learning (ML) techniques, such as Neural Network, are widely used in today's applications. However, there is still a big gap between the current ML systems and users' requirements. ML systems focus on improving the performance of models in training, while individual users cares more about response time and expressiveness of the tool. Many existing research and product begin to move computation towards edge devices. Based on the numerical computing system Owl, we propose to build the Zoo system to support construction, compose, and deployment of ML models on edge and local devices.

cs.LG↗

arXiv2017

Probabilistic Synchronous Parallel

Most machine learning and deep neural network algorithms rely on certain iterative algorithms to optimise their utility/cost functions, e.g. Stochastic Gradient Descent. In distributed learning, the networked nodes have to work collaboratively to update the model parameters, and the way how they proceed is referred to as synchronous parallel design (or barrier control). Synchronous parallel protocol is the building block of any distributed learning framework, and its design has direct impact on the performance and scalability of the system. In this paper, we propose a new barrier control technique - Probabilistic Synchronous Parallel (PSP). Com- paring to the previous Bulk Synchronous Parallel (BSP), Stale Synchronous Parallel (SSP), and (Asynchronous Parallel) ASP, the proposed solution e ectively improves both the convergence speed and the scalability of the SGD algorithm by introducing a sampling primitive into the system. Moreover, we also show that the sampling primitive can be applied atop of the existing barrier control mechanisms to derive fully distributed PSP-based synchronous parallel. We not only provide a thorough theoretical analysis1 on the convergence of PSP-based SGD algorithm, but also implement a full-featured distributed learning framework called Actor and perform intensive evaluation atop of it.

cs.DC↗

arXiv2017

Towards Better Understanding of Bitcoin Unreachable Peers

The bitcoin peer-to-peer network has drawn significant attention from researchers, but so far has mostly focused on publicly visible portions of the network, i.e., publicly reachable peers. This mostly ignores the hidden parts of the network: unreachable Bitcoin peers behind NATs and firewalls. In this paper, we characterize Bitcoin peers that might be behind NATs or firewalls from different perspectives. Using a special-purpose measurement tool we conduct a large scale measurement study of the Bitcoin network, and discover several previously unreported usage patterns: a small number of peers are involved in the propagation of 89% of all bitcoin transactions, public cloud services are being used for Bitcoin network probing and crawling, a large amount of transactions are generated from only two mobile applications. We also empirically evaluate a method that uses timing information to re-identify the peer that created a transaction against unreachable peers. We find this method very accurate for peers that use the latest version of the Bitcoin Core client.

cs.NI↗

arXiv2017

Optimal Reserve Price for Online Ads Trading Based on Inventory Identification

The online ads trading platform plays a crucial role in connecting publishers and advertisers and generates tremendous value in facilitating the convenience of our lives. It has been evolving into a more and more complicated structure. In this paper, we consider the problem of maximizing the revenue for the seller side via utilizing proper reserve price for the auctions in a dynamical way. Predicting the optimal reserve price for each auction in the repeated auction marketplaces is a non-trivial problem. However, we were able to come up with an efficient method of improving the seller revenue by mainly focusing on adjusting the reserve price for those high-value inventories. Previously, no dedicated work has been performed from this perspective. Inspired by Paul and Michael, our model first identifies the value of the inventory by predicting the top bid price bucket using a cascade of classifiers. The cascade is essential in significantly reducing the false positive rate of a single classifier. Based on the output of the first step, we build another cluster of classifiers to predict the price separations between the top two bids. We showed that although the high-value auctions are only a small portion of all the traffic, successfully identifying them and setting correct reserve price would result in a significant revenue lift. Moreover, our optimization is compatible with all other reserve price models in the system and does not impact their performance. In other words, when combined with other models, the enhancement on exchange revenue will be aggregated. Simulations on randomly sampled Yahoo ads exchange (YAXR) data showed stable and expected lift after applying our model.

cs.GT↗

arXiv2017

Irregular Convolutional Neural Networks

Convolutional kernels are basic and vital components of deep Convolutional Neural Networks (CNN). In this paper, we equip convolutional kernels with shape attributes to generate the deep Irregular Convolutional Neural Networks (ICNN). Compared to traditional CNN applying regular convolutional kernels like ${3\times3}$, our approach trains irregular kernel shapes to better fit the geometric variations of input features. In other words, shapes are learnable parameters in addition to weights. The kernel shapes and weights are learned simultaneously during end-to-end training with the standard back-propagation algorithm. Experiments for semantic segmentation are implemented to validate the effectiveness of our proposed ICNN.

cs.CV↗

arXiv2017

Mining Significant Microblogs for Misinformation Identification: An Attention-based Approach

With the rapid growth of social media, massive misinformation is also spreading widely on social media, such as microblog, and bring negative effects to human life. Nowadays, automatic misinformation identification has drawn attention from academic and industrial communities. For an event on social media usually consists of multiple microblogs, current methods are mainly based on global statistical features. However, information on social media is full of noisy and outliers, which should be alleviated. Moreover, most of microblogs about an event have little contribution to the identification of misinformation, where useful information can be easily overwhelmed by useless information. Thus, it is important to mine significant microblogs for a reliable misinformation identification method. In this paper, we propose an Attention-based approach for Identification of Misinformation (AIM). Based on the attention mechanism, AIM can select microblogs with largest attention values for misinformation identification. The attention mechanism in AIM contains two parts: content attention and dynamic attention. Content attention is calculated based textual features of each microblog. Dynamic attention is related to the time interval between the posting time of a microblog and the beginning of the event. To evaluate AIM, we conduct a series of experiments on the Weibo dataset and the Twitter dataset, and the experimental results show that the proposed AIM model outperforms the state-of-the-art methods.

cs.IR↗

arXiv2017

Cross-modal Subspace Learning for Fine-grained Sketch-based Image Retrieval

Sketch-based image retrieval (SBIR) is challenging due to the inherent domain-gap between sketch and photo. Compared with pixel-perfect depictions of photos, sketches are iconic renderings of the real world with highly abstract. Therefore, matching sketch and photo directly using low-level visual clues are unsufficient, since a common low-level subspace that traverses semantically across the two modalities is non-trivial to establish. Most existing SBIR studies do not directly tackle this cross-modal problem. This naturally motivates us to explore the effectiveness of cross-modal retrieval methods in SBIR, which have been applied in the image-text matching successfully. In this paper, we introduce and compare a series of state-of-the-art cross-modal subspace learning methods and benchmark them on two recently released fine-grained SBIR datasets. Through thorough examination of the experimental results, we have demonstrated that the subspace learning can effectively model the sketch-photo domain-gap. In addition we draw a few key insights to drive future research.

cs.CV↗

arXiv2017

FairCache: Introducing Fairness to ICN Caching - Technical Report

Information-centric networking extensively uses universal in-network caching. However, developing an efficient and fair collaborative caching algorithm for selfish caches is still an open question. In addition, the communication overhead induced by collaboration is especially poorly understood in a general network setting such as realistic ISP and Autonomous System networks. In this paper, we address these two problems by modeling the in-network caching problem as a Nash bargaining game. We show that the game is a convex optimization problem and further derive the corresponding distributed algorithm. We analytically investigate the collaboration overhead on general graph topologies, and theoretically show that collaboration has to be constrained within a small neighborhood due to its cost growing exponentially. Our proposed algorithm achieves at least 16% performance gain over its competitors on different network topologies in the evaluation, and guarantees provable convergence, Pareto efficiency and proportional fairness.

cs.NI↗

arXiv2017

Forward stimulated Brillouin scattering in silicon microring resonators

Stimulated Brillouin scattering (SBS) has been demonstrated in silicon waveguides in recent years. However, due to the weak interaction between photons and acoustic phonons in these waveguides, long interaction length is typically necessary. Here, we experimentally show that forward stimulated Brillouin scattering in a short interaction length of a 20 um radius silicon microring resonator could give 1.2 dB peak gain at only 10mW coupled pump power. The experimental results demonstrate that both optical and acoustic modes can have efficient interaction in a short interaction length. The observed Brillouin gain varies with coupled pump power in good agreement with theoretical prediction. The work shows the potential of SBS in silicon for moving the demonstrated fiber SBS applications to the integrated silicon photonics platform.

physics.optics↗

arXiv2017

Modeling Temporal Dynamics and Spatial Configurations of Actions Using Two-Stream Recurrent Neural Networks

Recently, skeleton based action recognition gains more popularity due to cost-effective depth sensors coupled with real-time skeleton estimation algorithms. Traditional approaches based on handcrafted features are limited to represent the complexity of motion patterns. Recent methods that use Recurrent Neural Networks (RNN) to handle raw skeletons only focus on the contextual dependency in the temporal domain and neglect the spatial configurations of articulated skeletons. In this paper, we propose a novel two-stream RNN architecture to model both temporal dynamics and spatial configurations for skeleton based action recognition. We explore two different structures for the temporal stream: stacked RNN and hierarchical RNN. Hierarchical RNN is designed according to human body kinematics. We also propose two effective methods to model the spatial structure by converting the spatial graph into a sequence of joints. To improve generalization of our model, we further exploit 3D transformation based data augmentation techniques including rotation and scaling transformation to transform the 3D coordinates of skeletons during training. Experiments on 3D action recognition benchmark datasets show that our method brings a considerable improvement for a variety of actions, i.e., generic actions, interaction activities and gestures.

cs.CV↗

arXiv2017

An in-depth characterisation of Bots and Humans on Twitter

Recent research has shown a substantial active presence of bots in online social networks (OSNs). In this paper we utilise our past work on studying bots (Stweeler) to comparatively analyse the usage and impact of bots and humans on Twitter, one of the largest OSNs in the world. We collect a large-scale Twitter dataset and define various metrics based on tweet metadata. We divide and filter the dataset in four popularity groups in terms of number of followers. Using a human annotation task we assign 'bot' and 'human' ground-truth labels to the dataset, and compare the annotations against an online bot detection tool for evaluation. We then ask a series of questions to discern important behavioural bot and human characteristics using metrics within and among four popularity groups. From the comparative analysis we draw important differences as well as surprising similarities between the two entities, thus paving the way for reliable classification of automated political infiltration, advertisement campaigns, and general bot detection.

cs.SI↗

arXiv2017

NIHAO XII: galactic uniformity in a ΛCDM universe

We use a sample of 83 high-resolution cosmological zoom-in simulations and a semi-analytic model (SAM) to study the stochasticity of galaxy formation in haloes ranging from dwarf to Milky Way masses. Our simulated galaxies reproduce the observed inefficiency of galaxy formation as expressed through the stellar, gas and baryonic Tully-Fisher relations. For HI velocities in the range (70 < V < 220 km/s), the scatter is just 0.08 to 0.14 dex, consistent with the observed intrinsic scatter at these scales. At low velocities (20 < V < 70 km/s), the simulated scatter is 0.2-0.25 dex, which could be tested with future observations. The scatter in the stellar mass versus dark halo velocity relation is constant for 30 < V < 180 km/s, and smaller (~0.17 dex) when using the maximum circular velocity of the dark matter only simulation, Vmax, compared to the virial velocity ($V_{200}$ or $V_{200}^{DMO}$). The scatter in stellar mass is correlated with halo concentration, and is minimized when using a circular velocity at a fixed fraction of the virial radius $\simeq 0.4 R_{200}$ or with $V_α=V_{200}^{DMO} (V_{max}^{DMO} / V_{200}^{DMO})^α$ with α~ 0.7, consistent with constraints from halo clustering. Using the SAM we show the correlation between halo formation time and concentration is essential in order to reproduce this result. This uniformity in galaxy formation efficiency we see in our hydrodynamical simulations and a semi-analytic model proves the simplicity and self-regulating nature of galaxy formation in a ΛCold Dark Matter universe.

astro-ph.GA↗

arXiv2017

BOTDA using OFDM channel estimation

A novel Brillouin optical time-domain analysis (BOTDA) system is proposed using intensity-modulated optical orthogonal frequency division multiplexing probe signal and direct detection (IM-DD-OOFDM) without frequency sweep operation. The influence of peak to average power ratio (PAPR) of OFDM probe signal on the recovery of Brillouin gain spectrum (BGS) is analyzed in theory and experiment. The complex BGS is reconstructed by channel estimation algorithm and Brillouin frequency shift (BFS) is located by curve fitting of intensity spectrum. The IM-DD-OOFDM BOTDA is demonstrated experimentally with 25m spatial resolution over 2 km standard single mode fiber.

physics.ins-det↗

arXiv2017

Multi-behavioral Sequential Prediction with Recurrent Log-bilinear Model

With the rapid growth of Internet applications, sequential prediction in collaborative filtering has become an emerging and crucial task. Given the behavioral history of a specific user, predicting his or her next choice plays a key role in improving various online services. Meanwhile, there are more and more scenarios with multiple types of behaviors, while existing works mainly study sequences with a single type of behavior. As a widely used approach, Markov chain based models are based on a strong independence assumption. As two classical neural network methods for modeling sequences, recurrent neural networks cannot well model short-term contexts, and the log-bilinear model is not suitable for long-term contexts. In this paper, we propose a Recurrent Log-BiLinear (RLBL) model. It can model multiple types of behaviors in historical sequences with behavior-specific transition matrices. RLBL applies a recurrent structure for modeling long-term contexts. It models several items in each hidden layer and employs position-specific transition matrices for modeling short-term contexts. Moreover, considering continuous time difference in behavioral history is a key factor for dynamic prediction, we further extend RLBL and replace position-specific transition matrices with time-specific transition matrices, and accordingly propose a Time-Aware Recurrent Log-BiLinear (TA-RLBL) model. Experimental results show that the proposed RLBL model and TA-RLBL model yield significant improvements over the competitive compared methods on three datasets, i.e., Movielens-1M dataset, Global Terrorism Database and Tmall dataset with different numbers of behavior types.

cs.IR↗

arXiv2017

NIHAO VII: Predictions for the galactic baryon budget in dwarf to Milky Way mass haloes

We use the NIHAO galaxy formation simulations to make predictions for the baryonic budget in present day galaxies ranging from dwarf to Milky Way masses. The sample is made of 88 independent high resolution cosmological zoom-in simulations. NIHAO galaxies reproduce key properties of observed galaxies, such as the stellar mass vs halo mass and cold gas vs stellar mass relations. Thus they make plausible predictions for the baryon budget. We present the mass fractions of stars, cold gas ($T<10^4$K), cool gas ($10^4 < T < 10^5$K), warm-hot gas ($10^5 < T < 5\times10^6$K), and hot gas (T$> 5\times10^6$K) inside the virial radius, $R_{200}$. Compared to the predicted baryon mass, using the dark halo mass and the universal baryon fraction, $f_{\rm b}\equiv Ω_{\rm b}/Ω_{\rm m}=0.15$, we find that all of our haloes are missing baryons. The missing mass has been relocated past 2 virial radii, and cool gas dominates the corona at low mass (M$_{200} < 3 \times 10^{11} M_\odot$) while the warm-hot gas dominates at high mass (M$_{200} > 3 \times 10^{11} M_\odot$). Haloes of mass $\sim 10^{10} M_\odot$ are missing $\sim 90\%$ of their baryons. More massive haloes ($\sim 10^{12} M_\odot$) retain a higher fraction of their baryons, with $\sim 30\%$ missing, consistent with recent observational estimates. Moreover, these more massive haloes reproduce the observed fraction of cold, warm-hot and hot gas. The fraction of cool gas we predict ($0.11\pm0.06$) is significantly lower than the observation from COS-HALOs (0.3-0.47), but agrees with the alternative analysis of Stern et al. 2016.

astro-ph.GA↗

arXiv2016

Millimeter Wave Communications with OAM-SM Scheme for Future Mobile Networks

The orbital angular momentum (OAM) technique provides a new degree of freedom for information transmissions in millimeter wave communications. Considering the spatial distribution characteristics of OAM beams, a new OAM spatial modulation (OAM-SM) millimeter wave communication system is first proposed for future mobile networks. Furthermore, the capacity, average bit error probability and energy efficiency of OAM-SM millimeter wave communication systems are analytically derived for performance analysis. Compared with the conventional multi-input multi-output (MIMO) millimeter wave communication systems, the maximum capacity and energy efficiency of OAM-SM millimeter wave communication systems are improved by 36% and 472.3%, respectively. Moreover, numerical results indicate that the proposed OAM-SM millimeter wave communication systems are more robust to path-loss attenuations than the conventional MIMO millimeter wave communication systems, which makes it suitable for long-range transmissions. Therefore, OAM-SM millimeter wave communication systems provide a great growth space for future mobile networks.

cs.NI↗