Learning Multiple Models of Non-linear Dynamics for Control Under Varying Contexts [chapter]

Georgios Petkos, Marc Toussaint, Sethu Vijayakumar
2006 Lecture Notes in Computer Science  
For stationary systems, efficient techniques for adaptive motor control exist which learn the system's inverse dynamics online and use this single model for control. However, in realistic domains the system dynamics often change depending on an external unobserved context, for instance the work load of the system or contact conditions with other objects. A solution to context-dependent control is to learn multiple inverse models for different contexts and to infer the current context by
more » ... g the experienced dynamics. Previous multiple model approaches have only been tested on linear systems. This paper presents an efficient multiple model approach for non-linear dynamics, which can bootstrap context separation from context-unlabeled data and realizes simultaneous online context estimation, control, and training of multiple inverse models. The approach formulates a consistent probabilistic model used to infer the unobserved context and uses Locally Weighted Projection Regression as an efficient online regressor which provides local confidence bounds estimates used for inference.
doi:10.1007/11840817_93 fatcat:xxknbi4q6reopnxg6zbz4db6ay