An analysis of massively distributed evolutionary algorithms
IEEE Congress on Evolutionary Computation
Computational science is placing new demands on optimization algorithms as the size of data sets and the computational complexity of scientific models continue to increase. As these complex models have many local minima, evolutionary algorithms (EAs) are very useful for quickly finding optimal solutions in these challenging search spaces. In addition to the complex search spaces involved, calculating the objective function can be extremely demanding computationally. Because of this, distributed
... computation is a necessity. In order to address these computational demands, top-end distributed computing systems are surpassing hundreds of thousands of computing hosts; and as in the case of Internet based volunteer computing systems, they can also be highly heterogeneous and faulty. This work examines asynchronous strategies for distributed EAs using simulated computing environments, showing that they can scale to hundreds of thousands of computing hosts while being highly resilient to heterogeneous and faulty computing environments, something not possible for traditional distributed EAs, which require synchronization. While not only providing insight as to how asynchronous EAs perform on distributed computing environments with different latencies and heterogeneity, simulation also serves as a sanity check in that live systems typically require problems with high computation to communication ratios and traditional benchmark problems cannot be used meaningfully due to their low computation time.