Pareto Evolution and Co-Evolution in Cognitive Neural Agents Synthesis for Tic-Tac-Toe

Yi Jack Yau, Jason Teo, Patricia Anthony
2007 2007 IEEE Symposium on Computational Intelligence and Games  
Although a number of multi-objective evolutionary algorithms (MOEAs) have been proposed over the last two decades, very few studies have utilized MOEAs for game agent synthesis. Recently, we have suggested a co-evolutionary implementation using the Pareto Evolutionary Programming (PEP) algorithm. This paper describes a series of experiments using PEP for evolving artificial neural networks (ANNs) that act as game-playing agents. Three systems are compared: (i) a canonical PEP system, (ii) a
more » ... volving PEP system (PCEP) with 3 different setups, and (iii) a co-evolving PEP system that uses an archive (PCEP-A) with 3 different setups. The aim of this study is to provide insights on the effects of including co-evolutionary techniques on a MOEA by investigating and comparing these 3 different approaches in evolving intelligent agents as both first and second players in a deterministic zerosum board game. The results indicate that the canonical PEP system outperformed both co-evolutionary PEP systems as it was able to evolve ANN agents with higher quality game-playing performance as both first and second game players. Hence, this study shows that a canonical MOEA without co-evolution is desirable for the synthesis of cognitive game AI agents.
doi:10.1109/cig.2007.368113 dblp:conf/cig/YauTA07 fatcat:yy3645vkk5adrasot3opwqttf4