Exploiting CRIC to streamline the configuration management of glideinWMS factories for CMS support

CMS Collaboration
2019 Zenodo  
GlideinWMS is a workload management and provisioning system that allows sharing computing resources distributed over independent sites. Based on the requests made by glideinWMS Frontends, a dynamically sized pool of resources is created by glideinWMS pilot Factories via pilot job submission to resource sites' computing elements. More than 400 computing elements (CE) are currently serving more than 10 virtual organizations through glideinWMS, with CMS being the biggest user with 230 CEs. The
more » ... th 230 CEs. The complex configurations of the parameters definining resource requests, as submitted to those CEs, have been historically managed by manually editing a set of different xml files. New possibilities arise with CMS adopting the Computing Resource Information Catalogue (CRIC), an information system that collects, aggregates, stores, and exposes, among other things, computing resource data coming from various data providers. The talk will describe the challenges faced when CMS started to use CRIC to automatically generate the glideinWMS factory configurations. The architecture of the prototype, and the ancillary tools developed to ease this transition, will be discussed. Finally, future plans and milestones will be outlined.
doi:10.5281/zenodo.3598807 fatcat:diiolv3yevcqfijc7potbte7om