Large Elasticsearch cluster management

Pablo Saiz, Ulrich Schwickerath, C. Doglioni, D. Kim, G.A. Stewart, L. Silvestris, P. Jackson, W. Kamleh
2020 EPJ Web of Conferences  
The Centralised Elasticsearch Service at CERN runs the infrastructure to provide Elasticsearch clusters for more than 100 different use cases. This contribution presents how the infrastructure is managed, covering the resource distribution, instance creation, cluster monitoring and user support. The contribution will present the components that have been identified as critical in order to share resources and minimise the amount of clusters and machines needed to run the service. In particular,
more » ... ll the automation for the instance configuration, including index template management, backups and visualisation settings, will be explained in detail.
doi:10.1051/epjconf/202024507021 fatcat:3tsjrlwibnbj3ak62zefig5a2y