arXiv subjects

Ran Xu

Publications and source records attributed to Ran Xu.

139 records · Page 8Linked to original sources

arXiv2019

Context-aware Active Multi-Step Reinforcement Learning

Reinforcement learning has attracted great attention recently, especially policy gradient algorithms, which have been demonstrated on challenging decision making and control tasks. In this paper, we propose an active multi-step TD algorithm with adaptive stepsizes to learn actor and critic. Specifically, our model consists of two components: active stepsize learning and adaptive multi-step TD algorithm. Firstly, we divide the time horizon into chunks and actively select state and action inside each chunk. Then given the selected samples, we propose the adaptive multi-step TD, which generalizes TD($λ$), but adaptively switch on/off the backups from future returns of different steps. Particularly, the adaptive multi-step TD introduces a context-aware mechanism, here a binary classifier, which decides whether or not to turn on its future backups based on the context changes. Thus, our model is kind of combination of active learning and multi-step TD algorithm, which has the capacity for learning off-policy without the need of importance sampling. We evaluate our approach on both discrete and continuous space tasks in an off-policy setting respectively, and demonstrate competitive results compared to other reinforcement learning baselines.

cs.LG↗

arXiv2019

A novel linear battery energy storage system (BESS) life loss calculation model for BESS-integrated wind farm in scheduled power tracking

Recently, rapid development of battery technology makes it feasible to integrate renewable generations with battery energy storage system (BESS). The consideration of BESS life loss for different BESS application scenarios is economic imperative. In this paper, a novel linear BESS life loss calculation model for BESS-integrated wind farm in scheduled power tracking is proposed. Firstly, based on the life cycle times-depth of discharge (DOD) relation-curve, the BESS life loss coefficient for unit throughput energy with different state of charge (SOC) can be determined from the life cycle times-DOD relation-curve fitting function directly. Secondly, as unidirectional variation of SOC in a single time step, the BESS life loss can be calculated through integration of the life loss coefficient-SOC relation function. A linear BESS life loss calculation model is established through self-optimal piecewise linearization of the primitive function of the life loss coefficient-SOC relation function. Thirdly, the proposed life loss calculation model is incorporated in the BESS-integrated wind farm scheduled power tracking optimization. Case studies demonstrate that with the proposed method, the BESS life loss item can be incorporated in the optimization model effectively, and the scheduled power tracking cost of the BESS-integrated wind farm can be determined and optimized more comprehensively.

eess.SP↗

arXiv2019

TempoCave: Visualizing Dynamic Connectome Datasets to Support Cognitive Behavioral Therapy

We introduce TempoCave, a novel visualization application for analyzing dynamic brain networks, or connectomes. TempoCave provides a range of functionality to explore metrics related to the activity patterns and modular affiliations of different regions in the brain. These patterns are calculated by processing raw data retrieved functional magnetic resonance imaging (fMRI) scans, which creates a network of weighted edges between each brain region, where the weight indicates how likely these regions are to activate synchronously. In particular, we support the analysis needs of clinical psychologists, who examine these modular affiliations and weighted edges and their temporal dynamics, utilizing them to understand relationships between neurological disorders and brain activity, which could have a significant impact on the way in which patients are diagnosed and treated. We summarize the core functionality of TempoCave, which supports a range of comparative tasks, and runs both in a desktop mode and in an immersive mode. Furthermore, we present a real-world use case that analyzes pre- and post-treatment connectome datasets from 27 subjects in a clinical study investigating the use of cognitive behavior therapy to treat major depression disorder, indicating that TempoCave can provide new insight into the dynamic behavior of the human brain.

cs.HC↗

arXiv2019

Estimating Social Influence Using Latent Space Adjusted Approach in R

Social influence, sometimes referred to as spillover or contagion, have been extensively studied in various empirical social network research. However, there are various estimation challenges in identifying social influence effects, as they are often entangled with other factors, such as homophily in the selection process, the individual's preference for the same social settings, etc. Methods currently available either do not solve these problems or require strong assumptions. Recent works by Xu 2018 and others show that a latent-space adjusted approach based on the latent space model has potential to disentangle the influence from other processes, and the simulation evidence shows the approach performs better than other state-of-the-art approaches in terms of recovering the true social influence effect when there is an unobserved trait co-determining influence and selection. In this paper we illustrate how latent space adjusted approach accounts for bias in the estimation of the social influence effect, and demonstrate how this approach can be implemented to estimate various social influence models with an empirical example in R.

cs.SI↗

arXiv2018

Asymptotic Correlation Structure of Discounted Incurred But Not Reported Claims under Fractional Poisson Arrival Process

This paper studies the joint moments of a compound discounted renewal process observed at different times with each arrival removed from the system after a random delay. This process can be used to describe the aggregate (discounted) Incurred But Not Reported claims in insurance and also the total number of customers in an infinite server queue. It is shown that the joint moments can be obtained recursively in terms of the renewal density, from which the covariance and correlation structures are derived. In particular, the fractional Poisson process defined via the renewal approach is also considered. Furthermore, the asymptotic behaviour of covariance and correlation coefficient of the aforementioned quantities is analyzed as the time horizon goes to infinity. Special attention is paid to the cases of exponential and Pareto delays.

math.PR↗

arXiv2015

Collecting and Annotating the Large Continuous Action Dataset

We make available to the community a new dataset to support action-recognition research. This dataset is different from prior datasets in several key ways. It is significantly larger. It contains streaming video with long segments containing multiple action occurrences that often overlap in space and/or time. All actions were filmed in the same collection of backgrounds so that background gives little clue as to action class. We had five humans replicate the annotation of temporal extent of action occurrences labeled with their class and measured a surprisingly low level of intercoder agreement. A baseline experiment shows that recent state-of-the-art methods perform poorly on this dataset. This suggests that this will be a challenging dataset to foster advances in action-recognition research. This manuscript serves to describe the novel content and characteristics of the LCA dataset, present the design decisions made when filming the dataset, and document the novel methods employed to annotate the dataset.

cs.CV↗

arXiv2015

Sequential Labeling with online Deep Learning

Deep learning has attracted great attention recently and yielded the state of the art performance in dimension reduction and classification problems. However, it cannot effectively handle the structured output prediction, e.g. sequential labeling. In this paper, we propose a deep learning structure, which can learn discriminative features for sequential labeling problems. More specifically, we add the inter-relationship between labels in our deep learning structure, in order to incorporate the context information from the sequential data. Thus, our model is more powerful than linear Conditional Random Fields (CRFs) because the objective function learns latent non-linear features so that target labeling can be better predicted. We pretrain the deep structure with stacked restricted Boltzmann machines (RBMs) for feature learning and optimize our objective function with online learning algorithm, a mixture of perceptron training and stochastic gradient descent. We test our model on different challenge tasks, and show that our model outperforms significantly over the completive baselines.

cs.LG↗

arXiv2014

Compositional Structure Learning for Action Understanding

The focus of the action understanding literature has predominately been classification, how- ever, there are many applications demanding richer action understanding such as mobile robotics and video search, with solutions to classification, localization and detection. In this paper, we propose a compositional model that leverages a new mid-level representation called compositional trajectories and a locally articulated spatiotemporal deformable parts model (LALSDPM) for fully action understanding. Our methods is advantageous in capturing the variable structure of dynamic human activity over a long range. First, the compositional trajectories capture long-ranging, frequently co-occurring groups of trajectories in space time and represent them in discriminative hierarchies, where human motion is largely separated from camera motion; second, LASTDPM learns a structured model with multi-layer deformable parts to capture multiple levels of articulated motion. We implement our methods and demonstrate state of the art performance on all three problems: action detection, localization, and recognition.

cs.CV↗

arXiv2013

A hybrid molecular dynamics/atomic-scale finite element method for quasi-static atomistic simulations at finite temperature

In this paper, a hybrid quasi-static atomistic simulation method at finite temperature is developed, which combines the advantages of MD for thermal equilibrium and atomic-scale finite element method (AFEM) for efficient equilibration. Some temperature effects are embedded in static AFEM simulation by applying the virtual and equivalent thermal disturbance forces extracted from MD. Alternatively performing MD and AFEM can quickly obtain a series of thermodynamic equilibrium configurations such that a quasi-static process is modeled. Moreover, a stirring-accelerated MD/AFEM fast relaxation approach is proposed, in which the atomic forces and velocities are randomly exchanged to artificially accelerate the "slow processes" such as mechanical wave propagation and thermal diffusion. The efficiency of the proposed methods is demonstrated by numerical examples on single wall carbon nanotubes.

physics.atom-ph↗

arXiv2012

Scalable hierarchical parallel algorithm for the solution of super large-scale sparse linear equations

The parallel linear equations solver capable of effectively using 1000+ processors becomes the bottleneck of large-scale implicit engineering simulations. In this paper, we present a new hierarchical parallel master-slave-structural iterative algorithm for the solution of super large-scale sparse linear equations in distributed memory computer cluster. Through alternatively performing global equilibrium computation and local relaxation, our proposed algorithm will reach the specific accuracy requirement in a few of iterative steps. Moreover, each set/slave-processor majorly communicate with its nearest neighbors, and the transferring data between sets/slave-processors and master is always far below the set-neighbor communication. The corresponding algorithm for implicit finite element analysis has been implemented based on MPI library, and a super large 2-dimension square system of triangle-lattice truss structure under random static loads is simulated with over one billion degrees of freedom and up to 2001 processors on "Exploration 100" cluster in Tsinghua University. The numerical experiments demonstrate that this algorithm has excellent parallel efficiency and high scalability, and it may have broad application in other implicit simulations.

physics.comp-ph↗

arXiv2012

Random Forests for Metric Learning with Implicit Pairwise Position Dependence

Metric learning makes it plausible to learn distances for complex distributions of data from labeled data. However, to date, most metric learning methods are based on a single Mahalanobis metric, which cannot handle heterogeneous data well. Those that learn multiple metrics throughout the space have demonstrated superior accuracy, but at the cost of computational efficiency. Here, we take a new angle to the metric learning problem and learn a single metric that is able to implicitly adapt its distance function throughout the feature space. This metric adaptation is accomplished by using a random forest-based classifier to underpin the distance function and incorporate both absolute pairwise position and standard relative position into the representation. We have implemented and tested our method against state of the art global and multi-metric methods on a variety of data sets. Overall, the proposed method outperforms both types of methods in terms of accuracy (consistently ranked first) and is an order of magnitude faster than state of the art multi-metric methods (16x faster in the worst case).

stat.ML↗

arXiv2010

A Discrete Time Markov Chain Model for High Throughput Bidirectional Fano Decoders

The bidirectional Fano algorithm (BFA) can achieve at least two times decoding throughput compared to the conventional unidirectional Fano algorithm (UFA). In this paper, bidirectional Fano decoding is examined from the queuing theory perspective. A Discrete Time Markov Chain (DTMC) is employed to model the BFA decoder with a finite input buffer. The relationship between the input data rate, the input buffer size and the clock speed of the BFA decoder is established. The DTMC based modelling can be used in designing a high throughput parallel BFA decoding system. It is shown that there is a tradeoff between the number of BFA decoders and the input buffer size, and an optimal input buffer size can be chosen to minimize the hardware complexity for a target decoding throughput in designing a high throughput parallel BFA decoding system.

cs.IT↗

arXiv2009

Kinetic Energy-Based Temperature Computation in Non-Equilibrium Molecular Dynamics Simulation

The average kinetic energy is widely used to characterize temperature in molecular dynamics (MD) simulation. In this letter, the applicability of three types of average kinetic energy as measures of temperature is investigated, i.e., the total kinetic energy, kinetic energy without the centroid translation part, and thermal disturbance kinetic energy. Our MD simulations indicate that definitions of temperature based on the kinetic energy including rigid translational or rotational motion may yield unrealistic results. In contrast, the thermal disturbance kinetic energy has wider applicability to temperature computation in non-equilibrium molecular dynamics simulation. If small samples need to be used for local temperature, then a calibration approach is proposed to eliminate the sample-size dependence of the average disturbance kinetic energy.

physics.comp-ph↗