Learning Optimal Policies in Markov Decision Processes with Value Function Discovery?

Martijn Onderwater, Sandjai Bhulai, Rob van der Mei
2015 Performance Evaluation Review  
In this paper we describe recent progress in our work on Value Function Discovery (vfd), a novel method for discovery of value functions for Markov Decision Processes (mdps). In a previous paper we described how vfd discovers algebraic descriptions of value functions (and the corresponding policies) using ideas from the Evolutionary Algorithm field. A special feature of vfd is that the descriptions include the model parameters of the mdp. We extend that work and show how additional information
more » ... bout the structure of the mdp can be included in vfd. This alternative use of vfd still yields near-optimal policies, and is much faster. Besides increased performance and improved run times, this approach illustrates that vfd is not restricted to learning value functions and can be applied more generally.
doi:10.1145/2825236.2825239 fatcat:frnnhlofcnhzdcdtejcnqh2fsq