Learning drivers for TORCS through imitation using supervised methods

Luigi Cardamone, Daniele Loiacono, Pier Luca Lanzi
2009 2009 IEEE Symposium on Computational Intelligence and Games  
In this paper, we apply imitation learning to develop drivers for The Open Racing Car Simulator (TORCS). Our approach can be classified as a direct method in that it applies supervised learning to learn car racing behaviors from the data collected from other drivers. In the literature, this approach is known to have led to extremely poor performance with drivers capable of completing only very small parts of a track. In this paper we show that, by using high-level information about the track
more » ... about the track ahead of the car and by predicting high-level actions, it is possible to develop drivers with performances that in some cases are only 15% lower than the performance of the fastest driver available in TORCS. Our experimental results suggest that our approach can be effective in developing drivers with good performance in non-trivial tracks using a very limited amount of data and computational resources. We analyze the driving behavior of the controllers developed using our approach and identify perceptual aliasing as one of the factors which can limit performance of our approach. Luigi Cardamone (cardamone@elet.polimi.it), Daniele Loiacono (loia-cono@elet.polimi.it) and Pier Luca Lanzi (lanzi@elet.polimi.it) are with the
doi:10.1109/cig.2009.5286480 dblp:conf/cig/CardamoneLL09 fatcat:jewvxvdxzrf5plvtsrrujzevjm