Integrating network and transfer metrics to optimize transfer efficiency and experiment workflows

S. McKee, M. Babik, S. Campana, A. Di Girolamo, T. Wildish, J. Closier, S. Roiser, C. Grigoras, I. Vukotic, M. Salichos, Kaushik De, V. Garonne (+22 others)
<span title="2015-12-23">2015</span> <i title="IOP Publishing"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/wxgp7pobnrfetfizidmpebi4qy" style="color: black;">Journal of Physics, Conference Series</a> </i> &nbsp;
The Worldwide LHC Computing Grid relies on the network as a critical part of its infrastructure and therefore needs to guarantee effective network usage and prompt detection and resolution of any network issues, including connection failures, congestion, traffic routing, etc. The WLCG Network and Transfer Metrics project aims to integrate and combine all network-related monitoring data collected by the WLCG infrastructure. This includes FTS monitoring information, monitoring data from the
more &raquo; ... federation, as well as results of the perfSONAR tests. The main challenge consists of further integrating and analyzing this information in order to allow the optimizing of data transfers and workload management systems of the LHC experiments. In this contribution, we present our activity in commissioning WLCG perfSONAR network and integrating network and transfer metrics: We motivate the need for the network performance monitoring, describe the main use cases of the LHC experiments as well as status and evolution in the areas of configuration and capacity management, datastore and analytics, including integration of transfer and network metrics and operations and support.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1088/1742-6596/664/5/052003">doi:10.1088/1742-6596/664/5/052003</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/fuegrox22bh25gbizuihcffavm">fatcat:fuegrox22bh25gbizuihcffavm</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20191119021453/http://cds.cern.ch/record/2134580/files/Integrating%20network%20and%20transfer%20metrics%20to%20optimize%20transfer%20efficiency%20and%20experiment%20workflows.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/46/3b/463b10df25cea8ce0e356c807f4fcfd0d6c72ea1.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1088/1742-6596/664/5/052003"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> iop.org </button> </a>