Long-run Satisfaction of Path Properties

Christel Baier, Nathalie Bertrand, Jakob Piribauer, Ocan Sankur
2019 2019 34th Annual ACM/IEEE Symposium on Logic in Computer Science (LICS)  
The paper introduces the concepts of long-run frequency of path properties for paths in Kripke structures, and their generalization to long-run probabilities for schedulers in Markov decision processes. We then study the natural optimization problem of computing the optimal values of these measures, when ranging over all paths or all schedulers, and the corresponding decision problem when given a threshold. The main results are as follows. For (repeated) reachability and other simple
more » ... r simple properties, optimal long-run probabilities and corresponding optimal memoryless schedulers are computable in polynomial time. When it comes to constrained reachability properties, memoryless schedulers are no longer sufficient, even in the non-probabilistic setting. Nevertheless, optimal long-run probabilities for constrained reachability are computable in pseudo-polynomial time in the probabilistic setting and in polynomial time for Kripke structures. Finally for co-safety properties expressed by NFA, we give an exponential-time algorithm to compute the optimal long-run frequency, and prove the PSPACEcompleteness of the threshold problem.
doi:10.1109/lics.2019.8785672 dblp:conf/lics/Baier0PS19 fatcat:2yem222adfdbjiztnr4dvlipkq