PROGRESS: Progressive Reinforcement-Learning-Based Surrogate Selection [chapter]

Stefan Hess, Tobias Wagner, Bernd Bischl
2013 Lecture Notes in Computer Science  
In most engineering problems, experiments for evaluating the performance of different setups are time consuming, expensive, or even both. Therefore, sequential experimental designs have become an indispensable technique for optimizing the objective functions of these problems. In this context, most of the problems can be considered as a black-box. Specifically, no function properties are known a priori to select best suited surrogate model class. Therefore, we propose a new ensemble-based
more » ... ch which is capable of identifying the best surrogate model during the optimization process by using reinforcement learning techniques. The procedure is general and can be applied to arbitrary ensembles of surrogate models. Results are provided on 24 well-known black-box functions to show that the progressive procedure is capable of selecting suitable models from the ensemble and that it can compete with state-of-the-art methods for sequential optimization.
doi:10.1007/978-3-642-44973-4_13 fatcat:doz2wrmfgjbbnpbvkawwnqo75q