arXiv subjects

Heinz Koeppl

Publications and source records attributed to Heinz Koeppl.

At least 91 records · Page 5Linked to original sources

arXiv2020

The Hawkes Edge Partition Model for Continuous-time Event-based Temporal Networks

We propose a novel probabilistic framework to model continuous-time interaction events data. Our goal is to infer the \emph{implicit} community structure underlying the temporal interactions among entities, and also to exploit how the community structure influences the interaction dynamics among these nodes. To this end, we model the reciprocating interactions between individuals using mutually-exciting Hawkes processes. The base rate of the Hawkes process for each pair of individuals is built upon the latent representations inferred using the hierarchical gamma process edge partition model (HGaP-EPM). In particular, our model allows the interaction dynamics between each pair of individuals to be modulated by their respective affiliated communities. Moreover, our model can flexibly incorporate the auxiliary individuals' attributes, or covariates associated with interaction events. Efficient Gibbs sampling and Expectation-Maximization algorithms are developed to perform inference via Pólya-Gamma data augmentation strategy. Experimental results on real-world datasets demonstrate that our model not only achieves competitive performance for temporal link prediction compared with state-of-the-art methods, but also discovers interpretable latent structure behind the observed temporal interactions.

cs.SI↗

arXiv2020

Traveling Bands, Clouds, and Vortices of Chiral Active Matter

We consider stochastic dynamics of self-propelled particles with nonlocal normalized alignment interactions subject to phase lag. The role of the lag is to indirectly generate chirality into particle motion. To understand large scale behavior, we derive a continuum description of an active Brownian particle (ABP) flow with macroscopic scaling in the form of a partial differential equation (PDE) for a one-particle probability density function (DF). Due to indirect chirality, we find a new spatially homogeneous nonstationary analytic solution for this class of equations. Our development of kinetic and hydrodynamic theories towards such a solution reveals the existence of a wide variety of spatially nonhomogeneous patterns reminiscent of the traveling bands, clouds, and vortical structures of linear active matter. Our model may thereby serve as the basis for understanding the nature of chiral active media and designing multiagent swarms with designated behavior.

nlin.AO↗

arXiv2019

Scalable Structure Learning of Continuous-Time Bayesian Networks from Incomplete Data

Continuous-time Bayesian Networks (CTBNs) represent a compact yet powerful framework for understanding multivariate time-series data. Given complete data, parameters and structure can be estimated efficiently in closed-form. However, if data is incomplete, the latent states of the CTBN have to be estimated by laboriously simulating the intractable dynamics of the assumed CTBN. This is a problem, especially for structure learning tasks, where this has to be done for each element of a super-exponentially growing set of possible structures. In order to circumvent this notorious bottleneck, we develop a novel gradient-based approach to structure learning. Instead of sampling and scoring all possible structures individually, we assume the generator of the CTBN to be composed as a mixture of generators stemming from different structures. In this framework, structure learning can be performed via a gradient-based optimization of mixture weights. We combine this approach with a new variational method that allows for a closed-form calculation of this mixture marginal likelihood. We show the scalability of our method by learning structures of previously inaccessible sizes from synthetic and real-world data.

stat.ML↗

arXiv2019

Correlation Priors for Reinforcement Learning

Many decision-making problems naturally exhibit pronounced structures inherited from the characteristics of the underlying environment. In a Markov decision process model, for example, two distinct states can have inherently related semantics or encode resembling physical state configurations. This often implies locally correlated transition dynamics among the states. In order to complete a certain task in such environments, the operating agent usually needs to execute a series of temporally and spatially correlated actions. Though there exists a variety of approaches to capture these correlations in continuous state-action domains, a principled solution for discrete environments is missing. In this work, we present a Bayesian learning framework based on Pólya-Gamma augmentation that enables an analogous reasoning in such cases. We demonstrate the framework on a number of common decision-making related problems, such as imitation learning, subgoal extraction, system identification and Bayesian reinforcement learning. By explicitly modeling the underlying correlation structures of these problems, the proposed approach yields superior predictive performance compared to correlation-agnostic models, even when trained on data sets that are an order of magnitude smaller in size.

cs.LG↗

arXiv2019

Moment-Based Variational Inference for Markov Jump Processes

We propose moment-based variational inference as a flexible framework for approximate smoothing of latent Markov jump processes. The main ingredient of our approach is to partition the set of all transitions of the latent process into classes. This allows to express the Kullback-Leibler divergence between the approximate and the exact posterior process in terms of a set of moment functions that arise naturally from the chosen partition. To illustrate possible choices of the partition, we consider special classes of jump processes that frequently occur in applications. We then extend the results to parameter inference and demonstrate the method on several examples.

cs.LG↗

arXiv2019

CBA: Contextual Quality Adaptation for Adaptive Bitrate Video Streaming (Extended Version)

Recent advances in quality adaptation algorithms leave adaptive bitrate (ABR) streaming architectures at a crossroads: When determining the sustainable video quality one may either rely on the information gathered at the client vantage point or on server and network assistance. The fundamental problem here is to determine how valuable either information is for the adaptation decision. This problem becomes particularly hard in future Internet settings such as Named Data Networking (NDN) where the notion of a network connection does not exist. In this paper, we provide a fresh view on ABR quality adaptation for QoE maximization, which we formalize as a decision problem under uncertainty, and for which we contribute a sparse Bayesian contextual bandit algorithm denoted CBA. This allows taking high-dimensional streaming context information, including client-measured variables and network assistance, to find online the most valuable information for the quality adaptation. Since sparse Bayesian estimation is computationally expensive, we develop a fast new inference scheme to support online video adaptation. We perform an extensive evaluation of our adaptation algorithm in the particularly challenging setting of NDN, where we use an emulation testbed to demonstrate the efficacy of CBA compared to state-of-the-art algorithms.

cs.MM↗

arXiv2019

Context in Synthetic Biology: Memory Effects of Environments with Mono-molecular Reactions

Synthetic biology aims at designing modular genetic circuits that can be assembled according to the desired function. When embedded in a cell, a circuit module becomes a small subnetwork within a larger environmental network, and its dynamics is therefore affected by potentially unknown interactions with the environment. It is well-known that the presence of the environment not only causes extrinsic noise but also memory effects, which means that the dynamics of the subnetwork is affected by its past states via a memory function that is characteristic of the environment. We study several generic scenarios for the coupling between a small module and a larger environment, with the environment consisting of a chain of mono-molecular reactions. By mapping the dynamics of this coupled system onto random walks, we are able to give exact analytical expressions for the arising memory functions. Hence, our results give insights into the possible types of memory functions and thereby help to better predict subnetwork dynamics.

q-bio.MN↗

arXiv2018

A Comprehensive Analysis of Swarming-based Live Streaming to Leverage Client Heterogeneity

Due to missing IP multicast support on an Internet scale, over-the-top media streams are delivered with the help of overlays as used by content delivery networks and their peer-to-peer (P2P) extensions. In this context, mesh/pull-based swarming plays an important role either as pure streaming approach or in combination with tree/push mechanisms. However, the impact of realistic client populations with heterogeneous resources is not yet fully understood. In this technical report, we contribute to closing this gap by mathematically analysing the most basic scheduling mechanisms latest deadline first (LDF) and earliest deadline first (EDF) in a continuous time Markov chain framework and combining them into a simple, yet powerful, mixed strategy to leverage inherent differences in client resources. The main contributions are twofold: (1) a mathematical framework for swarming on random graphs is proposed with a focus on LDF and EDF strategies in heterogeneous scenarios; (2) a mixed strategy, named SchedMix, is proposed that leverages peer heterogeneity. The proposed strategy, SchedMix is shown to outperform the other two strategies using different abstractions: a mean-field theoretic analysis of buffer probabilities, simulations of a stochastic model on random graphs, and a full-stack implementation of a P2P streaming system.

cs.NI↗

arXiv2018

Inverse Reinforcement Learning via Nonparametric Spatio-Temporal Subgoal Modeling

Advances in the field of inverse reinforcement learning (IRL) have led to sophisticated inference frameworks that relax the original modeling assumption of observing an agent behavior that reflects only a single intention. Instead of learning a global behavioral model, recent IRL methods divide the demonstration data into parts, to account for the fact that different trajectories may correspond to different intentions, e.g., because they were generated by different domain experts. In this work, we go one step further: using the intuitive concept of subgoals, we build upon the premise that even a single trajectory can be explained more efficiently locally within a certain context than globally, enabling a more compact representation of the observed behavior. Based on this assumption, we build an implicit intentional model of the agent's goals to forecast its behavior in unobserved situations. The result is an integrated Bayesian prediction framework that significantly outperforms existing IRL solutions and provides smooth policy estimates consistent with the expert's plan. Most notably, our framework naturally handles situations where the intentions of the agent change over time and classical IRL algorithms fail. In addition, due to its probabilistic nature, the model can be straightforwardly applied in active learning scenarios to guide the demonstration process of the expert.

cs.LG↗

arXiv2018

Cluster Variational Approximations for Structure Learning of Continuous-Time Bayesian Networks from Incomplete Data

Continuous-time Bayesian networks (CTBNs) constitute a general and powerful framework for modeling continuous-time stochastic processes on networks. This makes them particularly attractive for learning the directed structures among interacting entities. However, if the available data is incomplete, one needs to simulate the prohibitively complex CTBN dynamics. Existing approximation techniques, such as sampling and low-order variational methods, either scale unfavorably in system size, or are unsatisfactory in terms of accuracy. Inspired by recent advances in statistical physics, we present a new approximation scheme based on cluster-variational methods significantly improving upon existing variational approximations. We can analytically marginalize the parameters of the approximate CTBN, as these are of secondary importance for structure learning. This recovers a scalable scheme for direct structure learning from incomplete and noisy time-series data. Our approach outperforms existing methods in terms of scalability.

stat.ML↗

arXiv2018

Self-propelled chimeras

The synchronization of self-propelled particles (SPPs) is a fascinating instance of emergent behavior in living and man-made systems, such as colonies of bacteria, flocks of birds, robot ensembles, and many others. The recent discovery of chimera states in coupled oscillators opens up new perspectives and indicates that other emergent behaviors may exist for SPPs. Indeed, for a minimal extension of the classical Vicsek model we show the existence of chimera states for SPPs, i.e., one group of particles synchronizes while others wander around chaotically. Compared to chimeras in coupled oscillators where the site position is fixed, SPPs give rise to new distinctive forms of chimeric behavior. We emphasize that the found behavior is directly implied by the structure of the deterministic equation of motion and is not caused by exogenous stochastic excitation. In the scaling limit of infinitely many particles, we show that the chimeric state persists. Our findings provide the starting point for the search or elicitation of chimeric states in real world SPP systems.

nlin.AO↗

arXiv2018

Collapsed Variational Inference for Nonparametric Bayesian Group Factor Analysis

Group factor analysis (GFA) methods have been widely used to infer the common structure and the group-specific signals from multiple related datasets in various fields including systems biology and neuroimaging. To date, most available GFA models require Gibbs sampling or slice sampling to perform inference, which prevents the practical application of GFA to large-scale data. In this paper we present an efficient collapsed variational inference (CVI) algorithm for the nonparametric Bayesian group factor analysis (NGFA) model built upon an hierarchical beta Bernoulli process. Our CVI algorithm proceeds by marginalizing out the group-specific beta process parameters, and then approximating the true posterior in the collapsed space using mean field methods. Experimental results on both synthetic and real-world data demonstrate the effectiveness of our CVI algorithm for the NGFA compared with state-of-the-art GFA methods.

cs.LG↗

arXiv2018

Hybrid Master Equation for Jump-Diffusion Approximation of Biomolecular Reaction Networks

Cellular reactions have multi-scale nature in the sense that the abundance of molecular species and the magnitude of reaction rates can vary in a wide range. This diversity leads to hybrid models that combine deterministic and stochastic modeling approaches. To reveal this multi-scale nature, we proposed jump-diffusion approximation in a previous study. The key idea behind the model was to partition reactions into fast and slow groups, and then to combine Markov chain updating scheme for the slow set with diffusion (Langevin) approach updating scheme for the fast set. Then, the state vector of the model was defined as the summation of the random time change model and the solution of the Langevin equation. In this study, we have proved that the joint probability density function of the jump-diffusion approximation over the reaction counting process satisfies the hybrid master equation, which is the summation of the chemical master equation and the Fokker-Planck equation. To solve the hybrid master equation, we propose an algorithm using the moments of reaction counters of fast reactions given the reaction counters of slow reactions. Then, we solve a constrained optimization problem for each conditional probability density at the time point of interest utilizing the maximum entropy approach. Based on the multiplication rule for joint probability density functions, we construct the solution of the hybrid master equation. To show the efficiency of the method, we implement it to a canonical model of gene regulation.

math.PR↗

arXiv2018

Bounds on the spectral radius of real-valued non-negative Kernels on measurable spaces

In this short technical note, we extend a recently published result [Liao2017] on the Perron root (or the spectral radius) of non-negative matrices to real-valued non-negative kernels on an arbitrary measurable space $(\mathrm{E}, \mathcal{E})$. To be precise, for any real-valued non-negative kernel $K : \mathrm{E}\times \mathcal{E} \rightarrow \mathbb{R}$, we prove that the spectral radius $ρ(K)$ of $K$ satisfies $$ \inf_{x \in \mathrm{E} } \frac{ \mathcal{R} K \cdotp L (x) }{ \mathcal{R} L (x) } \le ρ(K) \le \sup_{x \in \mathrm{E} } \frac{ \mathcal{R} K\cdotp L (x) }{ \mathcal{R} L (x) }, $$ where $L$ is an arbitrary Kernel on $(\mathrm{E}, \mathcal{E})$, which is integrable with respect to the left eigenmeasure of $K$ and satisfies $ \mathcal{R} L (x) >0 $ for all $x \in \mathrm{E}$, and the operator $\mathcal{R}$ is defined by $\mathcal{R}L (x) :=\int_{\mathrm{E}} L(x, \mathrm{d}y) $.

math.PR↗

arXiv2018

A Poisson Gamma Probabilistic Model for Latent Node-group Memberships in Dynamic Networks

We present a probabilistic model for learning from dynamic relational data, wherein the observed interactions among networked nodes are modeled via the Bernoulli Poisson link function, and the underlying network structure are characterized by nonnegative latent node-group memberships, which are assumed to be gamma distributed. The latent memberships evolve according to Markov processes. The optimal number of latent groups can be determined by data itself. The computational complexity of our method scales with the number of non-zero links, which makes it scalable to large sparse dynamic relational data. We present batch and online Gibbs sampling algorithms to perform model inference. Finally, we demonstrate the model's performance on both synthetic and real-world datasets compared to state-of-the-art methods.

cs.SI↗

arXiv2018

Marginal process framework: A model reduction tool for Markov jump processes

Markov jump process models have many applications across science. Often, these models are defined on a state-space of product form and only one of the components of the process is of direct interest. In this paper, we extend the marginal process framework, which provides a marginal description of the component of interest, to the case of fully coupled processes. We use entropic matching to obtain a finite-dimensional approximation of the filtering equation, which governs the transition rates of the marginal process. The resulting equations can be seen as a combination of two projection operations applied to the full master equation, so that we obtain a principled model reduction framework. We demonstrate the resulting reduced description on the totally asymmetric exclusion process. An important class of Markov jump processes are stochastic reaction networks, which have applications in chemical and biomolecular kinetics, ecological models and models of social networks. We obtain a particularly simple instantiation of the marginal process framework for mass-action systems by using product-Poisson distributions for the approximate solution of the filtering equation. We investigate the resulting approximate marginal process analytically and numerically.

q-bio.QM↗

arXiv2018

Approximate lumpability for Markovian agent-based models using local symmetries

We study a Markovian agent-based model (MABM) in this paper. Each agent is endowed with a local state that changes over time as the agent interacts with its neighbours. The neighbourhood structure is given by a graph. In a recent paper [Simon et al. 2011], the authors used the automorphisms of the underlying graph to generate a lumpable partition of the joint state space ensuring Markovianness of the lumped process for binary dynamics. However, many large random graphs tend to become asymmetric rendering the automorphism-based lumping approach ineffective as a tool of model reduction. In order to mitigate this problem, we propose a lumping method based on a notion of local symmetry, which compares only local neighbourhoods of vertices. Since local symmetry only ensures approximate lumpability, we quantify the approximation error by means of Kullback-Leibler divergence rate between the original Markov chain and a lifted Markov chain. We prove the approximation error decreases monotonically. The connections to fibrations of graphs are also discussed.

math.PR↗

arXiv2017

Collaborative Uploading in Heterogeneous Networks: Optimal and Adaptive Strategies

Collaborative uploading describes a type of crowdsourcing scenario in networked environments where a device utilizes multiple paths over neighboring devices to upload content to a centralized processing entity such as a cloud service. Intermediate devices may aggregate and preprocess this data stream. Such scenarios arise in the composition and aggregation of information, e.g., from smartphones or sensors. We use a queuing theoretic description of the collaborative uploading scenario, capturing the ability to split data into chunks that are then transmitted over multiple paths, and finally merged at the destination. We analyze replication and allocation strategies that control the mapping of data to paths and provide closed-form expressions that pinpoint the optimal strategy given a description of the paths' service distributions. Finally, we provide an online path-aware adaptation of the allocation strategy that uses statistical inference to sequentially minimize the expected waiting time for the uploaded data. Numerical results show the effectiveness of the adaptive approach compared to the proportional allocation and a variant of the join-the-shortest-queue allocation, especially for bursty path conditions.

cs.PF↗