Anomaly detection using Unsupervised Machine Learning for Grid computing site operation

Tomoe Kishimoto, Junichi Tnaka, Tetsuro Mashimo, Ryu Sawada, Koji Terashi, Michiru Kaneda, Masahiko Saito, Nagataka Matsui, C. Doglioni, D. Kim, G.A. Stewart, L. Silvestris (+2 others)
2020 EPJ Web of Conferences  
A Grid computing site is composed of various services including Grid middleware, such as Computing Element and Storage Element. Text logs produced by the services provide useful information for understanding the status of the services. However, it is a time-consuming task for site administrators to monitor and analyze the service logs every day. Therefore, a support framework has been developed to ease the site administrator's work. The framework detects anomaly logs using Machine Learning
more » ... iques and alerts site administrators. The framework has been examined using real service logs at the Tokyo Tier2 site, which is one of the Worldwide LHC Computing Grid sites. In this paper, a method of the anomaly detection in the framework and its performances at the Tokyo Tier2 site are reported.
doi:10.1051/epjconf/202024507016 fatcat:5tcwyjs62jeyzkpe7n5f7v3cci