Risk-aware path planning using hirerachical constrained Markov Decision Processes

Seyedshams Feyzabadi, Stefano Carpin
2014 2014 IEEE International Conference on Automation Science and Engineering (CASE)  
Next generation industrial plants will feature mobile robots (e.g., autonomous forklifts) moving side by side with humans. In these scenarios, robots must not only maximize efficiency, but must also mitigate risks. In this paper we study the problem of risk-aware path planning, i.e., the problem of computing shortest paths in stochastic environments while ensuring that average risk is bounded. Our method is based on the framework of constrained Markov Decision Processes (CMDP). To
more » ... the intrinsic computational complexity of CMDPs, we propose a hierarchical method that is suboptimal but obtains significant speedups. Simulation results in factory-like environments illustrate how the hierarchical method compares with the non hierarchical one. S. Feyzabadi and S. Carpin are with the
doi:10.1109/coase.2014.6899341 dblp:conf/case/FeyzabadiC14 fatcat:kwi426e4sfdgtladmasybmqlma