Control of stochastic discrete event systems modeled by probabilistic languages

R. Kumar, V.K. Garg
2001 IEEE Transactions on Automatic Control  
In earlier papers [7, 6, 5] we introduced the formalism of probabilistic languages for modeling the stochastic qualitative behavior of discrete event systems (DESs). In this paper we study their supervisory control where the control is exercised by dynamically disabling certain controllable events thereby nulling the occurrence probabilities of disabled events, and increasing the occurrence probabilities of enabled events proportionately. This is a special case of "probabilistic supervision"
more » ... tic supervision" introduced in [15]. The control objective is to design a supervisor such that the controlled system never executes any illegal traces (their occurrence probability is zero), and legal traces occur with minimum pre-specified occurrence probabilities. In other words, the probabilistic language of the controlled system lies within a pre-specified range, where the upper bound is a "non-probabilistic language" representing a legality constraint. We provide a condition for the existence of a supervisor. We also present an algorithm to test this existence condition when the probabilistic languages are regular (so that they admit probabilistic automata representation with finitely many states). Next we give a technique to compute a maximally permissive supervisor on-line.
doi:10.1109/9.917660 fatcat:ebs227inarh7hebtrdack7socy