arXiv subjects

Yang Yang

Publications and source records attributed to Yang Yang.

At least 1,117 records · Page 62Linked to original sources

arXiv2018

Does Higher Order LSTM Have Better Accuracy for Segmenting and Labeling Sequence Data?

Existing neural models usually predict the tag of the current token independent of the neighboring tags. The popular LSTM-CRF model considers the tag dependencies between every two consecutive tags. However, it is hard for existing neural models to take longer distance dependencies of tags into consideration. The scalability is mainly limited by the complex model structures and the cost of dynamic programming during training. In our work, we first design a new model called "high order LSTM" to predict multiple tags for the current token which contains not only the current tag but also the previous several tags. We call the number of tags in one prediction as "order". Then we propose a new method called Multi-Order BiLSTM (MO-BiLSTM) which combines low order and high order LSTMs together. MO-BiLSTM keeps the scalability to high order models with a pruning technique. We evaluate MO-BiLSTM on all-phrase chunking and NER datasets. Experiment results show that MO-BiLSTM achieves the state-of-the-art result in chunking and highly competitive results in two NER datasets.

cs.CL↗

arXiv2018

r-Instance Learning for Missing People Tweets Identification

The number of missing people (i.e., people who get lost) greatly increases in recent years. It is a serious worldwide problem, and finding the missing people consumes a large amount of social resources. In tracking and finding these missing people, timely data gathering and analysis actually play an important role. With the development of social media, information about missing people can get propagated through the web very quickly, which provides a promising way to solve the problem. The information in online social media is usually of heterogeneous categories, involving both complex social interactions and textual data of diverse structures. Effective fusion of these different types of information for addressing the missing people identification problem can be a great challenge. Motivated by the multi-instance learning problem and existing social science theory of "homophily", in this paper, we propose a novel r-instance (RI) learning model.

cs.SI↗

arXiv2018

Understanding and Monitoring Human Trafficking via Social Sensors: A Sociological Approach

Human trafficking is a serious social problem, and it is challenging mainly because of its difficulty in collecting and organizing related information. With the increasing popularity of social media platforms, it provides us a novel channel to tackle the problem of human trafficking through detecting and analyzing a large amount of human trafficking related information. Existing supervised learning methods cannot be directly applied to this problem due to the distinct characteristics of the social media data. First, the short, noisy, and unstructured textual information makes traditional learning algorithms less effective in detecting human trafficking related tweets. Second, complex social interactions lead to a high-dimensional feature space and thus present great computational challenges. In the meanwhile, social sciences theories such as homophily have been well established and achieved success in various social media mining applications. Motivated by the sociological findings, in this paper, we propose to investigate whether the Network Structure Information (NSI) could be potentially helpful for the human trafficking problem. In particular, a novel mathematical optimization framework is proposed to integrate the network structure into content modeling. Experimental results on a real-world dataset demonstrate the effectiveness of our proposed framework in detecting human trafficking related information.

cs.SI↗

arXiv2018

Optimization of Weighted Individual Energy Efficiencies in Interference Network

This paper studies the maximization of the weighted sum energy efficiency (WSEE). We derive a first-order optimal algorithm applicable to a wide class of communication scenarios exhibiting very fast convergence. We also discuss how to leverage monotonic optimization and fractional programming to obtain a global optimal solution at the cost of higher computational complexity. The WSEE of interference networks is studied in detail with an application to relay-assisted multi-cell communication. This scenario is modeled as a non-regenerative multi-way relay channel and the achievable rate region is derived. We apply the proposed algorithm to this scenario and compare its performance to the global optimal algorithm. The results indicate that the proposed algorithm often achieves the global optimal solution and is close to it otherwise. Convergence is achieved within 10 iterations, while the global optimal solution may require more than $10^6$ iterations.

cs.IT↗

arXiv2018

Small vulnerable sets determine large network cascades in power grids

The understanding of cascading failures in complex systems has been hindered by the lack of realistic large-scale modeling and analysis that can account for variable system conditions. Here, using the North American power grid, we identify, quantify, and analyze the set of network components that are vulnerable to cascading failures under any out of multiple conditions. We show that the vulnerable set consists of a small but topologically central portion of the network and that large cascades are disproportionately more likely to be triggered by initial failures close to this set. These results elucidate aspects of the origins and causes of cascading failures relevant for grid design and operation, and demonstrate vulnerability analysis methods that are applicable to a wider class of cascade-prone networks.

physics.soc-ph↗

arXiv2018

A hybrid inverse problem in the fluorescence ultrasound modulated optical tomography in the diffusive regime

We investigate a hybrid inverse problem in fluorescence ultrasound modulated optical tomography (fUMOT) in the diffusive regime. We prove that the absorption coefficient of the fluorophores at the excitation frequency and the quantum efficiency coefficient can be uniquely and stably reconstructed from boundary measurement of the photon currents, provided that some background medium parameters are known. Reconstruction algorithms are proposed and numerically implemented as well.

math.AP↗

arXiv2018

To Stay or to Leave: Churn Prediction for Urban Migrants in the Initial Period

In China, 260 million people migrate to cities to realize their urban dreams. Despite that these migrants play an important role in the rapid urbanization process, many of them fail to settle down and eventually leave the city. The integration process of migrants thus raises an important issue for scholars and policymakers. In this paper, we use Shanghai as an example to investigate migrants' behavior in their first weeks and in particular, how their behavior relates to early departure. Our dataset consists of a one-month complete dataset of 698 telecommunication logs between 54 million users, plus a novel and publicly available housing price data for 18K real estates in Shanghai. We find that migrants who end up leaving early tend to neither develop diverse connections in their first weeks nor move around the city. Their active areas also have higher housing prices than that of staying migrants. We formulate a churn prediction problem to determine whether a migrant is going to leave based on her behavior in the first few days. The prediction performance improves as we include data from more days. Interestingly, when using the same features, the classifier trained from only the first few days is already as good as the classifier trained using full data, suggesting that the performance difference mainly lies in the difference between features.

cs.SI↗

arXiv2018

Granular-composite-like electrical transport properties of polycrystalline cubic TaN$_{x}$ thin films prepared by rf sputtering method

We have systematically investigated the electrical transport properties of polycrystalline TaN$_x$ ($0.83$$\lesssim$$x$$\lesssim$1.32) films with rocksalt structure from 300 down to 2 K. It is found that the conductivity varies linearly with $\ln T$ from $\sim$6 K to $\sim$30 K, which does not originate from the conventional two dimensional weak-localization or electron-electron interaction effects, but can be well explained by the intergrain Coulomb effect which was theoretically proposed in the granular metals. While the fluctuation-induced tunneling conduction process dominates the temperature behaviors of the conductivities (resistivities) above $\sim$60 K. Normal state to superconductive state transition is observed in the $x$$\gtrsim$1.04 films in low temperature regime. The superconductivity can still be retained at a field of 9 T. The upper critical field increases linearly with decreasing temperature in the vicinity of the superconductive transition temperature, which is the typical feature of granular superconductors or dirty type-II superconductors. The granular-composite-like electrical transport properties of the polycrystalline TaN$_x$ films are related to their microstructure, in which the TaN$_x$ grains with high conductivity are separated by the poorly conductive amorphous transition layers (grain boundaries).

cond-mat.mes-hall↗

arXiv2018

On an inverse source problem for the Biot's equations in electro-seismic imaging

Electro-seismic imaging is a novel hybrid imaging modality in geophysical exploration. This paper concerns an inverse source problem for Biot's equations that arise in electro-seismic imaging. Using the time reversal method, we derive an explicit reconstruction formula, which immediately gives the uniqueness and stability of the reconstructed solution.

math.AP↗

arXiv2018

Energy efficiency optimization in MIMO interference channels: A successive pseudoconvex approximation approach

In this paper, we consider the (global and sum) energy efficiency optimization problem in downlink multi-input multi-output multi-cell systems, where all users suffer from multi-user interference. This is a challenging problem due to several reasons: 1) it is a nonconvex fractional programming problem, 2) the transmission rate functions are characterized by (complex-valued) transmit covariance matrices, and 3) the processing-related power consumption may depend on the transmission rate. We tackle this problem by the successive pseudoconvex approximation approach, and we argue that pseudoconvex optimization plays a fundamental role in designing novel iterative algorithms, not only because every locally optimal point of a pseudoconvex optimization problem is also globally optimal, but also because a descent direction is easily obtained from every optimal point of a pseudoconvex optimization problem. The proposed algorithms have the following advantages: 1) fast convergence as the structure of the original optimization problem is preserved as much as possible in the approximate problem solved in each iteration, 2) easy implementation as each approximate problem is suitable for parallel computation and its solution has a closed-form expression, and 3) guaranteed convergence to a stationary point or a Karush-Kuhn-Tucker point. The advantages of the proposed algorithm are also illustrated numerically.

math.OC↗

arXiv2018

CHANG-ES XI: Circular Polarization in the Cores of Nearby Galaxies

We detect 5 galaxies in the CHANG-ES (Continuum Halos in Nearby Galaxies -- an EVLA Survey) sample that show circular polarization (CP) at L-band in our high resolution data sets. Two of the galaxies (NGC~4388 and NGC~4845) show strong Stokes $V/I\,\equiv\,m_C\,\sim\,2$\%, two (NGC~660 and NGC~3628) have values of $m_C\sim \,0.3$\%, and NGC~3079 is a marginal detection at $m_C\sim \,0.2$\%. The two strongest $m_C$ galaxies also have the most luminous X-ray cores and the strongest internal absorption in X-rays. We have expanded on our previous Faraday conversion interpretation and analysis and provide analytical expressions for the expected $V$ signal for a general case in which the cosmic ray electron energy spectral index can take on any value. We provide examples as to how such expressions could be used to estimate magnetic field strengths and the lower energy cutoff for CR electrons. Four out of our detections are {\it resolved}, showing unique structures, including a {\it jet} in NGC~4388 and a CP `conversion disk' in NGC~4845. The conversion disk is inclined to the galactic disk but is perpendicular to a possible outflow direction. Such CP structures have never before been seen in any galaxy to our knowledge. None of the galaxy cores show linear polarization at L-band. Thus CP may provide a unique probe of physical conditions deep into radio AGNs.

astro-ph.GA↗

arXiv2018

Apically Dominant Mechanism for Improving Catalytic Activities of N-Doped Carbon Nanotube Arrays in Rechargeable Zinc-Air Battery

The oxygen reduction (ORR) and oxygen evolution reactions (OER) in Zn-air batteries (ZABs) require highly efficient, cost-effective and stable electrocatalysts as replacements to traditionally high cost, inconsistently stable and low poison resistant Platinum group metals (PGM) catalysts. Although, nitrogen-doped carbon nanotube (NCNT) arrays have been developed over recent decades through various advanced technologies are now capable of catalyzing ORR efficiently, their underdeveloped bifunctional property, hydrophobic surface, and detrimental preparation strategy are found to limit practical large-scale commercialization for effective rechargeable ZABs. Here, we have demonstrated fabrication of a three-dimensional (3D) nickel foam supported NCNT arrays with CoNi nanoparticles (NPs) encapsulated within the apical domain (denoted as CoNi@NCNT/NF) that exhibits excellent bifunctional catalytic performance toward both ORR (onset potential of 0.97 V vs. RHE) and OER (overpotential of 1.54 V vs. RHE at 10 mA cm$^{-2}$). We further examined the practicability of this CoNi@NCNT/NF material being used as an air electrode for rechargeable ZAB coin cell and pouch cell systems. The ZAB coin cell showed a peak power density of 108 mW cm$^{-2}$ with an energy density of 845 Wh kg$_{Zn}^{-1}$ and robust rechargeability over 28h under ambient conditions, which exceeds the performance of PGM catalysts and leading non-PGM electrocatalysts. In addition, density functional theory (DFT) calculations revealed that the ORR and OER catalytic performance of the CoNi@NCNT/NF electrode are mainly derived from the d-orbitals from the CoNi NPs encapsulated within the apical dominant end of the NCNTs.

physics.app-ph↗

arXiv2017

Cascading Failures as Continuous Phase-Space Transitions

In network systems, a local perturbation can amplify as it propagates, potentially leading to a large-scale cascading failure. Here we derive a continuous model to advance our understanding of cascading failures in power-grid networks. The model accounts for both the failure of transmission lines and the desynchronization of power generators, and incorporates the transient dynamics between successive steps of the cascade. In this framework, we show that a cascade event is a phase-space transition from an equilibrium state with high energy to an equilibrium state with lower energy, which can be suitably described in closed form using a global Hamiltonian-like function. From this function we show that a perturbed system cannot always reach the equilibrium state predicted by quasi-steady-state cascade models, which would correspond to a reduced number of failures, and may instead undergo a larger cascade. We also show that in the presence of two or more perturbations, the outcome depends strongly on the order and timing of the individual perturbations. These results offer new insights into the current understanding of cascading dynamics, with potential implications for control interventions.

physics.soc-ph↗

arXiv2017

Deep Learning Scaling is Predictable, Empirically

Deep learning (DL) creates impactful advances following a virtuous recipe: model architecture search, creating large training data sets, and scaling computation. It is widely believed that growing training sets and models should improve accuracy and result in better products. As DL application domains grow, we would like a deeper understanding of the relationships between training set size, computational scale, and model accuracy improvements to advance the state-of-the-art. This paper presents a large scale empirical characterization of generalization error and model size growth as training sets grow. We introduce a methodology for this measurement and test four machine learning domains: machine translation, language modeling, image processing, and speech recognition. Our empirical results show power-law generalization error scaling across a breadth of factors, resulting in power-law exponents---the "steepness" of the learning curve---yet to be explained by theoretical work. Further, model improvements only shift the error but do not appear to affect the power-law exponent. We also show that model size scales sublinearly with data size. These scaling relationships have significant implications on deep learning research, practice, and systems. They can assist model debugging, setting accuracy targets, and decisions about data set growth. They can also guide computing system design and underscore the importance of continued computational scaling.

cs.LG↗

arXiv2017

Collaborative Filtering with Social Exposure: A Modular Approach to Social Recommendation

This paper is concerned with how to make efficient use of social information to improve recommendations. Most existing social recommender systems assume people share similar preferences with their social friends. Which, however, may not hold true due to various motivations of making online friends and dynamics of online social networks. Inspired by recent causal process based recommendations that first model user exposures towards items and then use these exposures to guide rating prediction, we utilize social information to capture user exposures rather than user preferences. We assume that people get information of products from their online friends and they do not have to share similar preferences, which is less restrictive and seems closer to reality. Under this new assumption, in this paper, we present a novel recommendation approach (named SERec) to integrate social exposure into collaborative filtering. We propose two methods to implement SERec, namely social regularization and social boosting, each with different ways to construct social exposures. Experiments on four real-world datasets demonstrate that our methods outperform the state-of-the-art methods on top-N recommendations. Further study compares the robustness and scalability of the two proposed methods.

cs.IR↗

arXiv2017

Representation Learning for Scale-free Networks

Network embedding aims to learn the low-dimensional representations of vertexes in a network, while structure and inherent properties of the network is preserved. Existing network embedding works primarily focus on preserving the microscopic structure, such as the first- and second-order proximity of vertexes, while the macroscopic scale-free property is largely ignored. Scale-free property depicts the fact that vertex degrees follow a heavy-tailed distribution (i.e., only a few vertexes have high degrees) and is a critical property of real-world networks, such as social networks. In this paper, we study the problem of learning representations for scale-free networks. We first theoretically analyze the difficulty of embedding and reconstructing a scale-free network in the Euclidean space, by converting our problem to the sphere packing problem. Then, we propose the "degree penalty" principle for designing scale-free property preserving network embedding algorithm: punishing the proximity between high-degree vertexes. We introduce two implementations of our principle by utilizing the spectral techniques and a skip-gram model respectively. Extensive experiments on six datasets show that our algorithms are able to not only reconstruct heavy-tailed distributed degree distribution, but also outperform state-of-the-art embedding models in various network mining tasks, such as vertex classification and link prediction.

cs.SI↗

arXiv2017

Urban Dreams of Migrants: A Case Study of Migrant Integration in Shanghai

Unprecedented human mobility has driven the rapid urbanization around the world. In China, the fraction of population dwelling in cities increased from 17.9% to 52.6% between 1978 and 2012. Such large-scale migration poses challenges for policymakers and important questions for researchers. To investigate the process of migrant integration, we employ a one-month complete dataset of telecommunication metadata in Shanghai with 54 million users and 698 million call logs. We find systematic differences between locals and migrants in their mobile communication networks and geographical locations. For instance, migrants have more diverse contacts and move around the city with a larger radius than locals after they settle down. By distinguishing new migrants (who recently moved to Shanghai) from settled migrants (who have been in Shanghai for a while), we demonstrate the integration process of new migrants in their first three weeks. Moreover, we formulate classification problems to predict whether a person is a migrant. Our classifier is able to achieve an F1-score of 0.82 when distinguishing settled migrants from locals, but it remains challenging to identify new migrants because of class imbalance. This classification setup holds promise for identifying new migrants who will successfully integrate into locals (new migrants that misclassified as locals).

cs.CY↗

arXiv2017

A Parallel Best-Response Algorithm with Exact Line Search for Nonconvex Sparsity-Regularized Rank Minimization

In this paper, we propose a convergent parallel best-response algorithm with the exact line search for the nondifferentiable nonconvex sparsity-regularized rank minimization problem. On the one hand, it exhibits a faster convergence than subgradient algorithms and block coordinate descent algorithms. On the other hand, its convergence to a stationary point is guaranteed, while ADMM algorithms only converge for convex problems. Furthermore, the exact line search procedure in the proposed algorithm is performed efficiently in closed-form to avoid the meticulous choice of stepsizes, which is however a common bottleneck in subgradient algorithms and successive convex approximation algorithms. Finally, the proposed algorithm is numerically tested.

cs.DC↗