Filters








900 Hits in 5.3 sec

The GridPP DIRAC project - DIRAC for non-LHC communities

D Bauer, D Colling, R Currie, S Fayer, A Huffman, J Martyniak, D Rand, A Richards
2015 Journal of Physics, Conference Series  
The GridPP consortium in the UK is currently testing a multi-VO DIRAC service aimed at non-LHC VOs.  ...  The aim of the GridPP DIRAC project is to provide an easily adaptable toolkit for such VOs in order to lower the threshold for access to distributed resources such as Grid and cloud computing.  ...  Initially the LHC experiments used the EMI-WMS and LFC for their workload and data management on the Grid.  ... 
doi:10.1088/1742-6596/664/6/062036 fatcat:rl6ct4olprbipecczz6dilqyli

GridPP DIRAC: Supporting non-LHC VOs on LHC centric resources

D Bauer, S Fayer
2017 Journal of Physics, Conference Series  
To allow non-LHC communities access to the primarily LHC dominated resources of the grid, the GridPP consortium in the UK maintains a multi-VO DIRAC service for this user-base.  ...  After an extensive testing phase, this service has been in production for the last two years and has been fully integrated into the user communities' workflows.  ...  GridPP DIRAC The DIRAC workload management system (see figure 1 ) is a pilot based framework.  ... 
doi:10.1088/1742-6596/898/5/052003 fatcat:ot7fvanlxbcyxl3up55yruxbjq

Integration of PanDA workload management system with Titan supercomputer at OLCF

K. De, A. Klimentov, D. Oleynik, S. Panitkin, A. Petrosyan, J. Schovancova, A. Vaniachine, T. Wenaus
2015 Journal of Physics, Conference Series  
The PanDA (Production and Distributed Analysis) workload management system (WMS) was developed to meet the scale and complexity of LHC distributed computing for the ATLAS experiment.  ...  This implementation was tested with a variety of Monte-Carlo workloads on Titan and is being tested on several other supercomputing platforms.  ...  The system has been developed to meet the growing ATLAS production and analysis requirements for a data-driven workload management system capable of operating at LHC data processing scale.  ... 
doi:10.1088/1742-6596/664/9/092020 fatcat:ccmfxxjcrvfqfcflop3xv5o7fu

Testing and integrating the WLCG/EGEE middleware in the LHC computing

S Campana, A D Girolamo, E Lanciotti, P M Lorenzo, N Magini, V Miccio, R Santinelli, A Sciabà
2008 Journal of Physics, Conference Series  
One activity is the evaluation of the gLite workload management system (WMS) to assess its adequacy for the needs of the LHC computing in terms of functionality, reliability and scalability.  ...  The SAM system is widely used in the EGEE operations to identify malfunctions in Grid services, but it can be adapted to perform the same function on experiment-specific services.  ...  in using a reliable workload management system like DIRAC, which provides a more effective monitoring of the progress of Grid jobs.  ... 
doi:10.1088/1742-6596/119/6/062020 fatcat:ecn2ngmr7nachgly4zfhza5ode

Enabling Data Intensive Science on Supercomputers for High Energy Physics R&D Projects in HL-LHC Era

Alexei Klimentov, Douglas Benjamin, Alessandro Di Girolamo, Kaushik De, Johannes Elmsheuser, Andrej Filipcic, Andrey Kiryanov, Danila Oleynik, Jack C. Wells, Andrey Zarochentsev, Xin Zhao, Gh. Adam (+2 others)
2020 EPJ Web of Conferences  
Through the workload management system PanDA and the distributed data management system Rucio, ATLAS provides seamless access to hundreds of WLCG grid and cloud based resources that are distributed worldwide  ...  The ATLAS experiment at CERN's Large Hadron Collider uses theWorldwide LHC Computing Grid, the WLCG, for its distributed computing infrastructure.  ...  Acknowledgments This work was funded in part by the U. S. Department of Energy, Office of Science, High Energy Physics and Advanced Scientific Computing under Contracts No.  ... 
doi:10.1051/epjconf/202022601007 fatcat:gzu3plwuu5haxisxrdm76l5ifq

Evolution of the open-source data management system Ru-cio for LHC Run-3 and beyond ATLAS

Martin Barisits, Thomas Beermann, Joaquin Bogado, Vincent Garonne, Tomas Javurek, Mario Lassnig, Andrea Manzi, Edoardo Martelli, Cedric Serfon, Tobias Wegner, Xin Zhao, A. Forti (+4 others)
2019 EPJ Web of Conferences  
Rucio, the distributed data management system of the ATLAS experiment already manages more than 400 Petabytes of physics data on the grid.  ...  Rucio was incrementally improved throughout LHC Run-2 and is currently being prepared for the HL-LHC era of the experiment.  ...  aware service components • Full workload aware system components ○ Based on the backlog and priority, service components increase their instances and split the workload accordingly ○ Provide a constant  ... 
doi:10.1051/epjconf/201921404054 fatcat:dkj3u2gpfrctnljb2fenappnpy

ATLAS and LHC computing on CRAY

F G Sciacca, S Haug
2017 Journal of Physics, Conference Series  
This solution still needs testing at a scale and 124 perhaps consequent optimisation. 125 4.1.4. Workload management integration.  ...  In addition, the di↵erent memory requirements 103 and management strategies of each experiment are quite orthogonal between each other, making 104 sharing the system between the three of them particularly  ...  In a second phase, the experiment 49 specific workload integration has been addressed, including the problem of co-existence of the can be seen in Fig. 1, and a be noted that these tests have been  ... 
doi:10.1088/1742-6596/898/8/082004 fatcat:uigofa7pbvdgbos5sbggufyouu

Integration of Russian Tier-1 Grid Center with High Performance Computers at NRC-KI for LHC experiments and beyond HENP

A Belyaev, A Berezhnaya, L Betev, P Buncic, K De, D Drizhuk, A Klimentov, Y Lazin, I Lyalin, R Mashinistov, A Novikov, D Oleynik (+6 others)
2015 Journal of Physics, Conference Series  
The Tier-1 facility at Kurchatov Institute (NRC-KI) in Moscow is a part of WLCG and it will process, simulate and store up to 10% of total data obtained from ALICE, ATLAS and LHCb experiments.  ...  The need for simulation, data processing and analysis would overwhelm the expected capacity of grid infrastructure computing facilities deployed by the Worldwide LHC Computing Grid (WLCG).  ...  This work was funded in part by the U.S.  ... 
doi:10.1088/1742-6596/664/9/092018 fatcat:lkw2kwzecfbavbwiw2mxjpr46u

Next Generation Workload Management System For Big Data on Heterogeneous Distributed Computing

A Klimentov, P Buncic, K De, S Jha, T Maeno, R Mount, P Nilsson, D Oleynik, S Panitkin, A Petrosyan, R J Porter, K F Read (+3 others)
2015 Journal of Physics, Conference Series  
The ATLAS experiment uses PanDA (Production and Data Analysis) Workload Management System (WMS) for managing the workflow for all data processing on hundreds of data centers.  ...  Experiments at the LHC explore the fundamental nature of matter and the basic forces that shape our universe, and were recently credited for the discovery of a Higgs boson.  ...  A sophisticated Workload Management System (WMS) is needed to manage the distribution and processing of such data.  ... 
doi:10.1088/1742-6596/608/1/012040 fatcat:hrrzru5bzvb2xaiyhrgipyxt3y

GridPP: the UK grid for particle physics

D. Britton, A.J. Cass, P.E.L. Clarke, J. Coles, D.J. Colling, A.T. Doyle, N.I. Geddes, J.C. Gordon, R.W.L. Jones, D.P. Kelsey, S.L. Lloyd, R.P. Middleton (+3 others)
2009 Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences  
We describe the development of the UK component (GridPP) of this Grid from a prototype system to a full exploitation Grid for real data analysis.  ...  The startup of the Large Hadron Collider (LHC) at CERN, Geneva presents a huge challenge in processing and analysing the vast amounts of scientific data that will be produced.  ...  The CMS collaboration and Rob Lambert are thanked for making available the results of their simulations.  ... 
doi:10.1098/rsta.2009.0036 pmid:19451101 fatcat:ig2kam6wtvbsfmql4bzurtaakq

CRIC: a unified information system for WLCG and beyond

Alexey Anisenkov, Julia Andreeva, Alessandro Di Girolamo, Panos Paparrigopoulos, Aresh Vedaee, A. Forti, L. Betev, M. Litmaath, O. Smirnova, P. Hristov
2019 EPJ Web of Conferences  
CRIC represents teevolution of ATLAS Grid Information System (AGIS) into the common experiment independent high-level information framework.  ...  The Worldwide LHC Computing Grid (WLCG) is an innovative distributed environment which is deployed through the use of grid computing technologiesin order to provide computing and storage resources to the  ...  Some are coupled with experiment data management and workload management systems and have to be handled in the experiment plugins.  ... 
doi:10.1051/epjconf/201921403003 fatcat:n4zhwpmdlzg5rm4f3gabezlxze

Computing for the Large Hadron Collider

Ian Bird
2011 Annual Review of Nuclear and Particle Science  
In this review, I discuss the rationale for the design of a distributed system and describe how this environment was constructed and deployed through the use of grid computing technologies.  ...  can make excellent use of the infrastructure, and (c) the computing system has enabled physics output in a very short time.  ...  Workload management. Workload management is provided by a general service that provides brokering capabilities to locate resources on the grid that satisfy the needs of a particular job.  ... 
doi:10.1146/annurev-nucl-102010-130059 fatcat:6vq4ykilu5antdlnyd63vqvvja

Job monitoring on the WLCG scope: Current status and new strategy

Julia Andreeva, Max Boehm, Sergey Belov, James Casey, Frantisek Dvorak, Benjamin Gaidioz, Edward Karavakis, Olga Kodolova, Lukasz Kokoszkiewicz, Ales Krenek, Elisa Lanciotti, Gerhild Maier (+9 others)
2010 Journal of Physics, Conference Series  
Reliable monitoring of the job processing on the WLCG scope is a complicated task due to the complexity of the infrastructure itself and the diversity of the currently used job submission methods.  ...  Job processing and data transfer are the main computing activities on the WLCG infrastructure.  ...  progress on the distributed infrastructure, the LHC experiments developed the experiment-specific workload management systems.  ... 
doi:10.1088/1742-6596/219/6/062002 fatcat:xukivh6sqzbszpun7sbtwjn7l4

Ten years of European Grids: What have we learnt?

Stephen Burke
2011 Journal of Physics, Conference Series  
In particular it considers the middleware technologies used for data management, workload management, information systems and security, and the difficulties of operating a highly distributed worldwide  ...  This paper discusses the history of both middleware development and Grid operations in these projects, and in particular the impact on the development of the LHC Computing Grid.  ...  Also, in practice the LHC experiments have preferred to develop their own workload management systems, generally based on the concept of "pilot jobs", which pull the real jobs from a central queue.  ... 
doi:10.1088/1742-6596/331/6/062003 fatcat:yzxeqtd2kfb7namg4xr43rsmum

CMS multicore scheduling strategy

Antonio Pérez-Calero Yzquierdo, Jose Hernández, Burt Holzman, Krista Majewski, Alison McCrea
2014 Journal of Physics, Conference Series  
In this presentation, we will present the experiences made with the multi-core scheduling modes and give an outlook of further developments working towards the restart of the LHC in 2015. Abstract.  ...  CMS is following all of these approaches and has a comprehensive strategy to schedule multi-core jobs on the GRID based on the glideIn WMS submission infrastructure.  ...  Acknowledgments The Port dInformació Científica (PIC) is maintained through a collaboration between the  ... 
doi:10.1088/1742-6596/513/3/032074 fatcat:h2bwdd6uxvfbbmko4rieg7l64y
« Previous Showing results 1 — 15 out of 900 results