arXiv · 1005.0949
The compositional construction of Markov processes II
Abstract
In an earlier paper we introduced a notion of Markov automaton, together with parallel operations which permit the compositional description of Markov processes. We illustrated by showing how to describe a system of n dining philosophers, and we observed that Perron-Frobenius theory yields a proof that the probability of reaching deadlock tends to one as the number of steps goes to infinity. In this paper we add sequential operations to the algebra (and the necessary structure to support them). The extra operations permit the description of hierarchical systems, and ones with evolving geometry.
Explore related subjects
Keep this discovery
L. de Francesco Albasini, N. Sabadini, R. F. C. Walters. 2010-05-06. The compositional construction of Markov processes II. https://arxiv.org/abs/1005.0949
Cite the original work for its findings. Save a collection to share your selection of sources.