arXiv ScienceSearch

arXiv subjects

Markus Siegle

Publications and source records attributed to Markus Siegle.

8 recordsLinked to original sources

Finding Minimal Clusters in st-DAGs

Directed Acylic Graphs with a single entry vertex and a single exit vertex (st-DAGs) have many applications. For instance, they are frequently used for modelling flow problems or precedence conditions among tasks, work packages, etc.. This paper presents an algorithm for finding special types of subgraphs in such st-DAGs, called clusters. Knowing the clusters of a given st-DAG is very useful during DAG analysis. Clusters are characterized by a kind of synchronizing behaviour at their entry border and at their exit border. In this context, we introduce the notion of syncpoint, a type of synchronisation point within a DAG, and for a given st-DAG we construct a second DAG, called MSP-DAG, whose edges are given by the precedence relation among maximum size syncpoints (MSPs). Our new cluster finding algorithm searches for clusters between potential pairs of enclosing MSPs. The efficiency of the algorithm stems from the fact that it works on the MSP-DAG, which is usually much smaller than the original st-DAG. The paper includes a thorough complexity analysis of the algorithm's runtime, which turns out to be quadratic in the number of DAG vertices and exponential in the number of MSP-DAG vertices. There is also a section reporting on experiments with randomly generated DAGs, which shows the practical applicability of the algorithm and confirm our theoretical findings.

cs.DM

The Arnoldi Aggregation for Approximate Transient Distributions of Markov Chains

The paper proposes a new aggregation method, based on the Arnoldi iteration, for computing approximate transient distributions of Markov chains. This aggregation is not partition-based, which means that an aggregate state may represent any portion of any original state, leading to a reduced system which is not a Markov chain. Results on exactness (in case the algorithm finds an invariant Krylov subspace) and minimality of the size of the Arnoldi aggregation are proven. For practical use, a heuristic is proposed for deciding when to stop expanding the state space once a certain accuracy has been reached. Apart from the theory, the paper also includes an extensive empirical section where the new aggregation algorithm is tested on several models and compared to a lumping-based state space reduction scheme.

math.PR

Formal Approximations of the Transient Distributions of the M/G/1 Workload Process

This paper calculates transient distributions of a special class of Markov processes with continuous state space and in continuous time, up to an explicit error bound. We approximate specific queues on R with one-sided L\'evy input, such as the M/G/1 workload process, with a finite-state Markov chain. The transient distribution of the original process is approximated by a distribution with a density which is piecewise constant on the state space. Easy-to-calculate error bounds for the difference between the approximated and actual transient distributions are provided in the Wasserstein distance. Our method is fast: to achieve a practically useful error bound, it usually requires only a few seconds or at most minutes of computation time.

math.PR

Formal Error Bounds for the State Space Reduction of Markov Chains

We study the approximation of a Markov chain on a reduced state space, for both discrete- and continuous-time Markov chains. In this context, we extend the existing theory of formal error bounds for the approximated transient distributions. As a special case, we consider aggregated (or lumped) Markov chains, where the state space reduction is achieved by partitioning the state space into macro states. In the discrete-time setting, we bound the stepwise increment of the error, and in the continuous-time setting, we bound the rate at which the error grows. In addition, the same error bounds can also be applied to bound how far an approximated stationary distribution is from stationarity. Subsequently, we compare these error bounds with relevant concepts from the literature, such as exact and ordinary lumpability, as well as deflatability and aggregatability. These concepts define stricter than necessary conditions to identify settings in which the aggregation error is zero. We also consider possible algorithms for finding suitable aggregations for which the formal error bounds are low, and we analyse first experiments with these algorithms on a range of different models.

math.PR

Rate Lifting for Stochastic Process Algebra: Exploiting Structural Properties

This report presents an algorithm for determining the unknown rates in the sequential processes of a Stochastic Process Algebra model, provided that the rates in the combined flat model are given. Such a rate lifting is useful for model reengineering and model repair. Technically, the algorithm works by solving systems of nonlinear equations and, if necessary, adjusting the model`s synchronisation structure without changing its transition system. This report contains the complete pseudo-code of the algorithm. The approach taken by the algorithm exploits some structural properties of Stochastic Process Algebra systems, which are formulated here for the first time and could be very beneficial also in other contexts.

cs.PF

Rate Reduction for State-labelled Markov Chains with Upper Time-bounded CSL Requirements

This paper presents algorithms for identifying and reducing a dedicated set of controllable transition rates of a state-labelled continuous-time Markov chain model. The purpose of the reduction is to make states to satisfy a given requirement, specified as a CSL upper time-bounded Until formula. We distinguish two different cases, depending on the type of probability bound. A natural partitioning of the state space allows us to develop possible solutions, leading to simple algorithms for both cases.

eess.SY

Markov Automata: Deciding Weak Bisimulation by means of non-naively Vanishing States

This paper develops a decision algorithm for weak bisimulation on Markov Automata (MA). For that purpose, different notions of vanishing state (a concept known from the area of Generalised Stochastic Petri Nets) are defined. Vanishing states are shown to be essential for relating the concepts of (state-based) naive weak bisimulation and (distribution-based) weak bisimulation. The bisimulation algorithm presented here follows the partition-refinement scheme and has exponential time complexity.

cs.LO

Lattice structures for bisimilar Probabilistic Automata

The paper shows that there is a deep structure on certain sets of bisimilar Probabilistic Automata (PA). The key prerequisite for these structures is a notion of compactness of PA. It is shown that compact bisimilar PA form lattices. These results are then used in order to establish normal forms not only for finite automata, but also for infinite automata, as long as they are compact.

cs.FL