Filters








219 Hits in 2.0 sec

gLite Job Provenance [chapter]

František Dvořák, Daniel Kouřil, Aleš Křenek, Luděk Matyska, Miloš Mulač, Jan Pospíšil, Miroslav Ruda, Zdeněk Salvet, Jiří Sitera, Michal Voců
2006 Lecture Notes in Computer Science  
The Job Provenance (JP) service is designed to automate keeping track of computations on large scale Grids, giving thus users a tool to correctly archive information about their jobs and to re-submit any  ...  The scalable architecture, capable to handle millions of jobs in a single JP installation, and integrated into the EGEE gLite middleware environment is presented.  ...  Fig. 1 depicts basic gLite middleware components and their interaction with the Job Provenance.  ... 
doi:10.1007/11890850_25 fatcat:nhnabbeew5ashivh7dxe2ohj44

Logging And Bookkeeping, Administrator'S Guide

Zdenek Sustr
2013 Zenodo  
Logging and Bookkeeping (LB for short) is a Grid service that keeps a short-term trace of Grid jobs as they are processed by individual Grid components  ...  (formerly glite-security-gsoap-plugin) where all glite-lbjp-common-* packages are common both to L&B and Job Provenance (JP).  ...  and glite-jp-client are needed (default: false) • GLITE_LB_EXPORT_JPPS -Job Provenance Primary Storage where to export purged jobs, required if export to JP is enabled • GLITE_LB_RTM_ENABLED -enable settings  ... 
doi:10.5281/zenodo.6841 fatcat:nrywixpx35gsrpq5yg27vo5s44

Medical image processing workflow support on the EGEE grid with taverna

Ketan Maheshwari, Carole Goble, Paolo Missier, Johan Montagnat
2009 2009 22nd IEEE International Symposium on Computer-Based Medical Systems  
This is achieved through a novel Taverna gLite activity plugin that makes the interface between the multi-threaded, centralized workflow enactor and the massively distributed, batch-oriented grid infrastructure  ...  T2 task as a gLite job.  ...  Figure 1 . 1 Interaction of the T2 gLite Plugin with gLite during job submission 2 . 2 Add gLite processor(s) to the workflow.3. Set/configure the properties of the gLite processor. 4 .  ... 
doi:10.1109/cbms.2009.5255332 dblp:conf/cbms/MaheshwariGMM09 fatcat:6sgrqp7xzbgl5kpjn7wk5rigr4

Grid Interoperation with ARC middleware for the CMS experiment

Erik Edelmann, Laurence Field, Jaime Frey, Michael Grønager, Kalle Happonen, Daniel Johansson, Josva Kleist, Jukka Klem, Jesper Koivumäki, Tomas Lindén, Antti Pirinen, Di Qing
2010 Journal of Physics, Conference Series  
The major grid middleware stacks used for CMS computing are gLite, Open Science Grid (OSG) and ARC (Advanced Resource Connector).  ...  In order to provide the Tier2 services for CMS, HIP uses tools and components from both ARC and gLite grid middleware stacks.  ...  The second issue with executing gLite jobs on ARC clusters, is that unlike the ARC middleware, gLite jobs expects to find a gLite worker node environment when the jobs are being executed.  ... 
doi:10.1088/1742-6596/219/6/062016 fatcat:wbohu2mdkbczlh3twgszwzkfee

Programming the Grid with gLite*

E. Laure, S. M. Fisher, A. Frohner, C. Grandi, P. Kunszt, A. Krenek, O. Mulmo, F. Pacini, F. Prelz, J. White, M. Barroso, P. Buncic (+3 others)
2006 Computational Methods in Science and Technology  
In this paper we describe the middleware (gLite) and services deployed on the EGEE Grid infrastructure and explain how applications can interface to them.  ...  Depending on the flavor of middleware services these infrastructures deploy (for instance Condor, gLite, Globus, UNICORE, to name only a few) different interfaces to program the Grid infrastructures are  ...  The authors would like to thank all the members of the teams for their commitment to gLite and their contributions to the overall gLite effort.  ... 
doi:10.12921/cmst.2006.12.01.33-45 fatcat:fbxa5usdnfeodiuaddy3btoanq

Wms Command Line Interface Guide

Marco Cecchi
2013 Zenodo  
The presence of this attribute activates Job Provenance support: WMS will upload job sandbox files on the specified server. • * PerusalFileEnable: Determines, for the job being submitted, whether the job  ...  <jdlfile> • glite-wms-delegate-proxy <delegationId> INFSO-RI-508833 PUBLIC 7/59 • glite-wms-job-list-match <jdlfile> • glite-wms-job-cancel <jobIds> • glite-wms-job-output <jobIds> • glite-wms-job-perusal  ...  . • The Arguments attribute in the JDL allows the user to specify all the command line arguments needed to start the job They have to be specified as a single string, e.g. the job sum that is started with  ... 
doi:10.5281/zenodo.6866 fatcat:pbvilwtttbgbzdfogddav4bmge

Logging And Bookkeeping, User'S Guide

Zdenek Sustr
2013 Zenodo  
Logging and Bookkeeping (LB for short) is a Grid service that keeps a short-term trace of Grid jobs as they are processed by individual Grid components  ...  This functionality is being replaced by the direct download of all the relevant data from the Job Provenance.  ...  Without a Job Provenance, the data from the L&B must be copied in a controlled way and made available in an environment where even non-indexed queries can be asked.  ... 
doi:10.5281/zenodo.6844 fatcat:6xvcjrvlyjbb3mr3fxzpslpp5q

The gLite Workload Management System

Cecchi Marco, Capannini Fabio, Dorigo Alvise, Ghiselli Antonia, Gianelle Alessio, Giacomini Francesco, Maraschini Alessandro, Molinari Elisabetta, Monforte Salvatore, Petronzio Luca
2010 Journal of Physics, Conference Series  
Future developments of the gLite WMS will be focused on reducing external software dependency, improving portability, robustness and usability.  ...  The gLite Workload Management System (WMS) is a collection of components that provide the service responsible for distributing and managing tasks across computing and storage resources available on a Grid  ...  As of Easter 2007, the gLite WMS has proven to fulfill the performance and stability requirements expressed earlier this year by the acceptance criteria of the CMS and ATLAS experiments: a single WMS machine  ... 
doi:10.1088/1742-6596/219/6/062039 fatcat:3o3j3wurjvhahclyr4tj5cmtby

The gLite workload management system

P Andreetto, S Andreozzi, G Avellino, S Beco, A Cavallini, M Cecchi, V Ciaschini, A Dorise, F Giacomini, A Gianelle, U Grandinetti, A Guarise (+21 others)
2008 Journal of Physics, Conference Series  
Future developments of the gLite WMS will be focused on reducing external software dependency, improving portability, robustness and usability.  ...  The gLite Workload Management System (WMS) is a collection of components that provide the service responsible for distributing and managing tasks across computing and storage resources available on a Grid  ...  As of Easter 2007, the gLite WMS has proven to fulfill the performance and stability requirements expressed earlier this year by the acceptance criteria of the CMS and ATLAS experiments: a single WMS machine  ... 
doi:10.1088/1742-6596/119/6/062007 fatcat:svjr6omyejd5lc4t2syvdb4rye

Interoperation of world-wide production e-Science infrastructures

M. Riedel, E. Laure, Th. Soddemann, L. Field, J. P. Navarro, J. Casey, M. Litmaath, J. Ph. Baud, B. Koblitz, C. Catlett, D. Skow, C. Zheng (+76 others)
2009 Concurrency and Computation  
Another useful test is the use of remote procedures to extract provenance metadata and load the provenance metadata into a collection.  ...  A scientist of the EGEE infrastructure uses a gLite User Interface (gLite UI) to submit the job that is intended to run on a computing resource managed by UNICORE.  ... 
doi:10.1002/cpe.1402 fatcat:n4tkgxbqjbhdxixldqmbwqjive

Hiding the Complexity: Building a Distributed ATLAS Tier-2 with a Single Resource Interface using ARC Middleware

S Purdie, G Stewart, M Kenyon, S Skipsey, A Washbrook, W Bhimji, A Filipčič
2011 Journal of Physics, Conference Series  
The job is then launched in the batch system and accesses data locally.  ...  As jobs are taken from the ATLAS PanDA framework, they are dispatched to the computing cluster with the fastest response time.  ...  ARC ARC middleware [2] does a number of things differently from gLite middleware, but the key aspect for this work is the manner in which jobs data requirements are handled, and the local cache.  ... 
doi:10.1088/1742-6596/331/7/072029 fatcat:rdp4sfbgn5duxn44yoxxlf6g4a

Initializing a National Grid Infrastructure Lessons Learned from the Swiss National Grid Association Seed Project

Nabil Abdennadher, Peter Engel, Derek Feichtinger, Dean Flanders, Placi Flury, Sigve Haug, Pascal Jermini, Sergio Maffioletti, Cesare Pautasso, Heinz Stockinger, Wibke Sudholt, Michela Thiemard (+2 others)
2008 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid (CCGRID)  
This has also been proven true in our experience.  ...  Experience: Installing a gLite user interface (UI) needed for submitting jobs is relatively straightforward, but a large effort is required from the resource providers for installing and running the gLite  ... 
doi:10.1109/ccgrid.2008.62 dblp:conf/ccgrid/AbdennadherEFFFHJMPSSTWW08 fatcat:lx2rp2us6jhrdocc2ijsqceyhi

ENABLING GENERIC DISTRIBUTED COMPUTING INFRASTRUCTURE COMPATIBILITY FOR WORKFLOW MANAGEMENT SYSTEMS

M. Kozlovszky, K. Karoczkai, I. Marton, A. Balasko, A. Marosi, P. Kacsuk
2012 Computer Science  
The generic DCI Bridge service enables the execution of jobs onto the existing major DCI platforms (such as Service Grids (Globus Toolkit 2 and 4, gLite, ARC, UNICORE), Desktop Grids, Web services, or  ...  In this paper we are specifying a concept how to enable generic DCI compatibility for grid workflow management systems (such as ASKALON, MOTEUR, gUSE/WS-PGRADE, etc.) on job and indirectly on workflow  ...  Authentication/Authorisation Inputs & executables MyProxy WFI JSDL BES I Q Job gLite Job WFI BES Input Queue Job refs. Submission controll Job refs.  ... 
doi:10.7494/csci.2012.13.3.61 fatcat:7tckyjocsrcwzpgohkbkyjtmuy

DCI Bridge: Executing WS-PGRADE Workflows in Distributed Computing Infrastructures [chapter]

Miklos Kozlovszky, Krisztián Karóczkai, István Márton, Péter Kacsuk, Tibor Gottdank
2014 Science Gateways for Distributed Computing Infrastructures  
The generic DCI Bridge service seamlessly enables the execution of workflows (and jobs) on major DCI platforms such as ARC, Globus, gLite, UNICORE, SGE, PBS, as well as web services or clouds.  ...  The DCI Bridge is already a proven concept.  ...  This is particularly useful in the case of gLite resources, where it often happens that the job is finished but it takes a long time to get the status and result via the gLite middleware.  ... 
doi:10.1007/978-3-319-11268-8_4 fatcat:g6fuqzrecfga3dxlhgdowc7x5y

Multi-scale Real-Time Grid Monitoring with Job Stream Mining

Xiangliang Zhang, Michèle Sebag, Cécile Germain-Renaud
2009 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid  
The GSTRAP system, embedding the STRAP Data Streaming algorithm, provides manageable and understandable views of the computational workload based on gLite reporting services.  ...  They aim at job lifecycles (e.g., Job Provenance [13] and the gLite Logging and Bookkeeping service [3] ) or service and machine availability (e.g., SAM [14] , Lemon [15] and GMS [16] ).  ...  These resources are integrated within the gLite middleware [3] , and EGEE currently supports up to 300,000 jobs per day on a 24×7 basis.  ... 
doi:10.1109/ccgrid.2009.20 dblp:conf/ccgrid/ZhangSG09 fatcat:xla6pkflqvazxlrxqf7zgn2lpq
« Previous Showing results 1 — 15 out of 219 results