arXiv subjects

Jie Yang

Publications and source records attributed to Jie Yang.

At least 631 records · Page 35Linked to original sources

arXiv2017

Interacting Attention-gated Recurrent Networks for Recommendation

Capturing the temporal dynamics of user preferences over items is important for recommendation. Existing methods mainly assume that all time steps in user-item interaction history are equally relevant to recommendation, which however does not apply in real-world scenarios where user-item interactions can often happen accidentally. More importantly, they learn user and item dynamics separately, thus failing to capture their joint effects on user-item interactions. To better model user and item dynamics, we present the Interacting Attention-gated Recurrent Network (IARN) which adopts the attention model to measure the relevance of each time step. In particular, we propose a novel attention scheme to learn the attention scores of user and item history in an interacting way, thus to account for the dependencies between user and item dynamics in shaping user-item interactions. By doing so, IARN can selectively memorize different time steps of a user's history when predicting her preferences over different items. Our model can therefore provide meaningful interpretations for recommendation results, which could be further enhanced by auxiliary features. Extensive validation on real-world datasets shows that IARN consistently outperforms state-of-the-art methods.

cs.IR↗

arXiv2017

Sparse Data Driven Mesh Deformation

Example-based mesh deformation methods are powerful tools for realistic shape editing. However, existing techniques typically combine all the example deformation modes, which can lead to overfitting, i.e. using a overly complicated model to explain the user-specified deformation. This leads to implausible or unstable deformation results, including unexpected global changes outside the region of interest. To address this fundamental limitation, we propose a sparse blending method that automatically selects a smaller number of deformation modes to compactly describe the desired deformation. This along with a suitably chosen deformation basis including spatially localized deformation modes leads to significant advantages, including more meaningful, reliable, and efficient deformations because fewer and localized deformation modes are applied. To cope with large rotations, we develop a simple but effective representation based on polar decomposition of deformation gradients, which resolves the ambiguity of large global rotations using an as-consistent-as-possible global optimization. This simple representation has a closed form solution for derivatives, making it efficient for sparse localized representation and thus ensuring interactive performance. Experimental results show that our method outperforms state-of-the-art data-driven mesh deformation methods, for both quality of results and efficiency.

cs.GR↗

arXiv2017

Combining Discrete and Neural Features for Sequence Labeling

Neural network models have recently received heated research attention in the natural language processing community. Compared with traditional models with discrete features, neural models have two main advantages. First, they take low-dimensional, real-valued embedding vectors as inputs, which can be trained over large raw data, thereby addressing the issue of feature sparsity in discrete models. Second, deep neural networks can be used to automatically combine input features, and including non-local features that capture semantic patterns that cannot be expressed using discrete indicator features. As a result, neural network models have achieved competitive accuracies compared with the best discrete models for a range of NLP tasks. On the other hand, manual feature templates have been carefully investigated for most NLP tasks over decades and typically cover the most useful indicator pattern for solving the problems. Such information can be complementary the features automatically induced from neural networks, and therefore combining discrete and neural features can potentially lead to better accuracy compared with models that leverage discrete or neural features only. In this paper, we systematically investigate the effect of discrete and neural feature combination for a range of fundamental NLP tasks based on sequence labeling, including word segmentation, POS tagging and named entity recognition for Chinese and English, respectively. Our results on standard benchmarks show that state-of-the-art neural models can give accuracies comparable to the best discrete models in the literature for most tasks and combing discrete and neural features unanimously yield better results.

cs.CL↗

arXiv2017

Beamspace Channel Estimation in mmWave Systems via Cosparse Image Reconstruction Technique

This paper considers the beamspace channel estimation problem in 3D lens antenna array under a millimeter-wave communication system. We analyze the focusing capability of the 3D lens antenna array and the sparsity of the beamspace channel response matrix. Considering the analysis, we observe that the channel matrix can be treated as a 2D natural image; that is, the channel is sparse, and the changes between adjacent elements are subtle. Thus, for the channel estimation, we incorporate an image reconstruction technique called sparse non-informative parameter estimator-based cosparse analysis AMP for imaging (SCAMPI) algorithm. The SCAMPI algorithm is faster and more accurate than earlier algorithms such as orthogonal matching pursuit and support detection algorithms. To further improve the SCAMPI algorithm, we model the channel distribution as a generic Gaussian mixture (GM) probability and embed the expectation maximization learning algorithm into the SCAMPI algorithm to learn the parameters in the GM probability. We show that the GM probability outperforms the common uniform distribution used in image reconstruction. We also propose a phase-shifter-reduced selection network structure to decrease the power consumption of the system and prove that the SCAMPI algorithm is robust even if the number of phase shifters is reduced by 10%.

cs.IT↗

arXiv2017

Neural Reranking for Named Entity Recognition

We propose a neural reranking system for named entity recognition (NER). The basic idea is to leverage recurrent neural network models to learn sentence-level patterns that involve named entity mentions. In particular, given an output sentence produced by a baseline NER model, we replace all entity mentions, such as \textit{Barack Obama}, into their entity types, such as \textit{PER}. The resulting sentence patterns contain direct output information, yet is less sparse without specific named entities. For example, "PER was born in LOC" can be such a pattern. LSTM and CNN structures are utilised for learning deep representations of such sentences for reranking. Results show that our system can significantly improve the NER accuracies over two different baselines, giving the best reported results on a standard benchmark.

cs.CL↗

arXiv2017

BaMF$_4$ (M = Mn, Co, Ni): New Electrode Materials for Hybrid Supercapacitor with Layered Polar Structure

To pursuit high electrochemical performance of supercapacitors based on Faradaic charge-transfer with redox reaction or absorption/desorption effect, the intercalation efficiency of electrolyte ions into electrode materials is a crucial prerequisite to surpass the pure surface capacity with extra bulk contribution. Here we report layered barium transition metal fluorides, BaMF4 (M = Mn, Co, Ni) to be a series of new electrode materials applied in standard three-electrode configuration. Benefiting from the efficient immersing of electrolyte ions, these materials own prominent specific capacitance. Electrochemical characterizations demonstrate that all the BaMF4 electrodes show both capacitive behavior and Faradaic redox reactions in the cyclic voltammograms, and ability of charge storage by charging-discharging cycling with high cycling stability. Particularly, BaCoF4 shows the the highest specific capacitance of 360 F g-1 at current density of 0.6 A g-1, even the particle size is far beyond nanometer scale. In addition, first principles calculations reveal the possible underlying mechanisms.

cond-mat.mtrl-sci↗

arXiv2017

Universal Dependencies Parsing for Colloquial Singaporean English

Singlish can be interesting to the ACL community both linguistically as a major creole based on English, and computationally for information extraction and sentiment analysis of regional social media. We investigate dependency parsing of Singlish by constructing a dependency treebank under the Universal Dependencies scheme, and then training a neural network model by integrating English syntactic knowledge into a state-of-the-art parser trained on the Singlish treebank. Results show that English knowledge can lead to 25% relative error reduction, resulting in a parser of 84.47% accuracies. To the best of our knowledge, we are the first to use neural stacking to improve cross-lingual dependency parsing on low-resource languages. We make both our annotation and parser available for further research.

cs.CL↗

arXiv2017

Neural Word Segmentation with Rich Pretraining

Neural word segmentation research has benefited from large-scale raw texts by leveraging them for pretraining character and word embeddings. On the other hand, statistical segmentation research has exploited richer sources of external information, such as punctuation, automatic segmentation and POS. We investigate the effectiveness of a range of external training sources for neural word segmentation by building a modular segmentation model, pretraining the most important submodule using rich external sources. Results show that such pretraining significantly improves the model, leading to accuracies competitive to the best methods on six benchmarks.

cs.CL↗

arXiv2017

Robust Guided Image Filtering

The process of using one image to guide the filtering process of another one is called Guided Image Filtering (GIF). The main challenge of GIF is the structure inconsistency between the guidance image and the target image. Besides, noise in the target image is also a challenging issue especially when it is heavy. In this paper, we propose a general framework for Robust Guided Image Filtering (RGIF), which contains a data term and a smoothness term, to solve the two issues mentioned above. The data term makes our model simultaneously denoise the target image and perform GIF which is robust against the heavy noise. The smoothness term is able to make use of the property of both the guidance image and the target image which is robust against the structure inconsistency. While the resulting model is highly non-convex, it can be solved through the proposed Iteratively Re-weighted Least Squares (IRLS) in an efficient manner. For challenging applications such as guided depth map upsampling, we further develop a data-driven parameter optimization scheme to properly determine the parameter in our model. This optimization scheme can help to preserve small structures and sharp depth edges even for a large upsampling factor (8x for example). Moreover, the specially designed structure of the data term and the smoothness term makes our model perform well in edge-preserving smoothing for single-image tasks (i.e., the guidance image is the target image itself). This paper is an extension of our previous work [1], [2].

cs.CV↗

arXiv2017

Semi-supervised Learning for Discrete Choice Models

We introduce a semi-supervised discrete choice model to calibrate discrete choice models when relatively few requests have both choice sets and stated preferences but the majority only have the choice sets. Two classic semi-supervised learning algorithms, the expectation maximization algorithm and the cluster-and-label algorithm, have been adapted to our choice modeling problem setting. We also develop two new algorithms based on the cluster-and-label algorithm. The new algorithms use the Bayesian Information Criterion to evaluate a clustering setting to automatically adjust the number of clusters. Two computational studies including a hotel booking case and a large-scale airline itinerary shopping case are presented to evaluate the prediction accuracy and computational effort of the proposed algorithms. Algorithmic recommendations are rendered under various scenarios.

stat.ML↗

arXiv2017

On the Improvement of Quality and Reliability of Trust Cues in Micro-task Crowdsourcing (Position paper)

Micro-task crowdsourcing has become a successful mean to obtain high-quality data from a large crowd of diverse people. In this context, trust between all the involved actors (i.e. requesters, workers, and platform owners) is a critical factor for acceptance and long-term success. As actors have no expectation for "real life" meetings, thus trust can only be attributed through computer-mediated trust cues like workers qualifications and requester ratings. Such cues are often the result of technical or social assessments that are performed in isolation, considering only a subset of relevant properties, and with asynchronous and asymmetrical interactions. In this paper, we advocate for a new generation of micro-task crowdsourcing systems that pursue an holistic understanding of trust, by offering an open, transparent, privacy-friendly, and socially-aware view on the all the actors of a micro-task crowdsourcing environment.

cs.SI↗

arXiv2017

Scalable Nearest Neighbor Search based on kNN Graph

Nearest neighbor search is known as a challenging issue that has been studied for several decades. Recently, this issue becomes more and more imminent in viewing that the big data problem arises from various fields. In this paper, a scalable solution based on hill-climbing strategy with the support of k-nearest neighbor graph (kNN) is presented. Two major issues have been considered in the paper. Firstly, an efficient kNN graph construction method based on two means tree is presented. For the nearest neighbor search, an enhanced hill-climbing procedure is proposed, which sees considerable performance boost over original procedure. Furthermore, with the support of inverted indexing derived from residue vector quantization, our method achieves close to 100% recall with high speed efficiency in two state-of-the-art evaluation benchmarks. In addition, a comparative study on both the compressional and traditional nearest neighbor search methods is presented. We show that our method achieves the best trade-off between search quality, efficiency and memory complexity.

cs.CV↗

arXiv2016

From Motion Blur to Motion Flow: a Deep Learning Solution for Removing Heterogeneous Motion Blur

Removing pixel-wise heterogeneous motion blur is challenging due to the ill-posed nature of the problem. The predominant solution is to estimate the blur kernel by adding a prior, but the extensive literature on the subject indicates the difficulty in identifying a prior which is suitably informative, and general. Rather than imposing a prior based on theory, we propose instead to learn one from the data. Learning a prior over the latent image would require modeling all possible image content. The critical observation underpinning our approach is thus that learning the motion flow instead allows the model to focus on the cause of the blur, irrespective of the image content. This is a much easier learning task, but it also avoids the iterative process through which latent image priors are typically applied. Our approach directly estimates the motion flow from the blurred image through a fully-convolutional deep neural network (FCN) and recovers the unblurred image from the estimated motion flow. Our FCN is the first universal end-to-end mapping from the blurred image to the dense motion flow. To train the FCN, we simulate motion flows to generate synthetic blurred-image-motion-flow pairs thus avoiding the need for human labeling. Extensive experiments on challenging realistic blurred images demonstrate that the proposed method outperforms the state-of-the-art.

cs.CV↗

arXiv2016

Explaining Radiological Emphysema Subtypes with Unsupervised Texture Prototypes: MESA COPD Study

Pulmonary emphysema is traditionally subcategorized into three subtypes, which have distinct radiological appearances on computed tomography (CT) and can help with the diagnosis of chronic obstructive pulmonary disease (COPD). Automated texture-based quantification of emphysema subtypes has been successfully implemented via supervised learning of these three emphysema subtypes. In this work, we demonstrate that unsupervised learning on a large heterogeneous database of CT scans can generate texture prototypes that are visually homogeneous and distinct, reproducible across subjects, and capable of predicting accurately the three standard radiological subtypes. These texture prototypes enable automated labeling of lung volumes, and open the way to new interpretations of lung CT scans with finer subtyping of emphysema.

cs.CV↗

arXiv2016

An Affine-Invariant Bayesian Cluster Process

In order to identify clusters of objects with features transformed by unknown affine transformations, we develop a Bayesian cluster process which is invariant with respect to certain linear transformations of the feature space and able to cluster data without knowing the number of clusters in advance. Specifically, our proposed method can identify clusters invariant to orthogonal transformations under model I, invariant to scaling-coordinate orthogonal transformations under model II, or invariant to arbitrary non-singular linear transformations under model III. The proposed split-merge algorithm leads to an irreducible and aperiodic Markov chain, which is also efficient at identifying clusters reasonably well for various applications. We illustrate the applications of our approach to both synthetic and real data such as leukemia gene expression data for model I; wine data and two half-moons benchmark data for model II; three-dimensional Denmark road geographic coordinate system data and an arbitrary non-singular transformed two half-moons data for model III. These examples show that the proposed method could be widely applied in many fields, especially for finding the number of clusters and identifying clusters of samples of interest in aerial photography and genomic data.

stat.ME↗

arXiv2016

Charged spinning black holes as accelerators of spinning particles

It is well known that some black holes can act as accelerators for particles without spin. Recently, there are some works considering collision of two spinning particles in the background of Schwarzschild and Kerr black holes and it was shown that {the center-of-mass energy of the test particles is related to the spin}. In this paper we extend the results to some more general cases. We consider Kerr-Newman black holes as accelerators for spinning particles. We derive the center-of-mass energy of the spinning particles and use numerical method to investigate how the center-of-mass energy is affected by the properties of the black holes and spinning particles.

gr-qc↗

arXiv2016

A 5.4 Gbps real time quantum random number generator with compact implementation

We present a random number generation scheme based on measuring the phase fluctuations of a laser with a simple and compact experimental setup. A simple model is established to analyze the randomness and the simulation result based on this model fits well with the experiment data. After the analog to digital sampling and suitable randomness extraction integrated in the field programmable gate array, the final random bits are delivered to a PC, realizing a 5.4 Gbps real time quantum random number generation. The final random bit sequences have passed all the NIST and DIEHARD tests.

quant-ph↗

arXiv2016

Diffractive Imaging of Coherent Nuclear Motion in Isolated Molecules

Observing the motion of the nuclear wavepackets during a molecular reaction, in both space and time, is crucial for understanding and controlling the outcome of photoinduced chemical reactions. We have imaged the motion of a vibrational wavepacket in isolated iodine molecules using ultrafast electron diffraction with relativistic electrons. The time-varying interatomic distance was measured with a precision 0.07 Å and temporal resolution of 230 fs full-width at half-maximum (FWHM). The method is not only sensitive to the position but also the shape of the nuclear wavepacket.

physics.chem-ph↗