Aggregation Algorithms for Perturbed Markov Chains with Applications to Networks Modeling

Anna Gambin, Piotr Krzyżanowski, Piotr Pokarowski
2008 SIAM Journal on Scientific Computing  
A powerly perturbed Markov chain (MC) is a family of finite MCs given by transition probability matrices P (ε) = (p ij (ε)) (or generators for continuous-time MCs) such that In the simplest case we have popular nearly completely decomposable (NCD) chains. It has been shown by directed forest expansions that solutions of linear systems related to P (ε) have a form x i (ε) = α i ε a i + o(ε a i ) for some vectors α = (α i ) and a = (a i ). Many characteristics of MCs such as stationary
more » ... ns, mean passage times, or limiting matrices can be defined in this way. We present efficient combinatorial aggregation algorithms for computing a and α. The algorithms rely on grouping the states of MCs in such a way that the probability of changing the state inside the group is of a greater order of magnitude than the interactions between groups. In contrast to existing methods, our approach is based on a combinatorial framework and can be seen as an algorithmization of the famous matrix tree theorem. We establish some preliminary results on the complexity of our algorithms. Numerical experiments on several network models, such as queueing systems or the Google problem, show the potential applicability of the method in real-life problems.
doi:10.1137/050624716 fatcat:4zkekifzvrf5zdwdyd45w6r3iq