Filters








122,992 Hits in 4.1 sec

Moving the California distributed CMS XCache from bare metal into containers using Kubernetes

Edgar Fajardo, Matevz Tadel, Justas Balcas, Alja Tadel, Frank Würthwein, Diego Davila, Jonathan Guiang, Igor Sfiligoi, C. Doglioni, D. Kim, G.A. Stewart, L. Silvestris (+2 others)
2020 EPJ Web of Conferences  
UCSD and Caltech Tier2 centers have joined their disk systems into a single logical caching system, with worker nodes from both sites accessing data from disks at either site.  ...  The University of California system maintains excellent networking between its campuses and a number of other Universities in California, including Caltech, most of them being connected at 100 Gbps.  ...  Acknowledgement The authors would like to thank the different funding agencies for this work, in particular the National Science Foundation through the following grants: OAC-1541349, MPS-1148698, OAC-1836650  ... 
doi:10.1051/epjconf/202024504042 fatcat:rnnc73edjbghhb362uy46lovgy

Moving the California distributed CMS xcache from bare metal into containers using Kubernetes [article]

Edgar Fajardo, Matevz Tadel, Justas Balcas, Alja Tadel, Frank Wuerthwein, Diego Davila, Jonathan Guiang, Igor Sfiligoi
2020 arXiv   pre-print
UCSD and Caltech have thus joined their disk systems into a single logical xcache system, with worker nodes from both sites accessing data from disks at either site.  ...  The University of California system has excellent networking between all of its campuses as well as a number of other Universities in CA, including Caltech, most of them being connected at 100 Gbps.  ...  Acknowledgement The authors would like to thank the different funding agencies for this work, in particular the National Science Foundation through the following grants: OAC-1541349, MPS-1148698, OAC-1836650  ... 
arXiv:2003.02319v1 fatcat:6236oblqendjzmxunwgqoxeuvy

Using Xrootd to Federate Regional Storage

L Bauerdick, D Benjamin, K Bloom, B Bockelman, D Bradley, S Dasu, M Ernst, R Gardner, A Hanushevsky, H Ito, D Lesny, P McGuigan (+10 others)
2012 Journal of Physics, Conference Series  
For ATLAS, the global-to-local mapping is based on a heuristic-based lookup from the site's local file catalog, while CMS does the mapping based on translations given in a configuration file.  ...  ATLAS has developed a mapping of VOMS roles to specific file system authorizations, while CMS has developed callouts to the site's mapping service.  ...  Acknowledgements The AAA and FAX systems span many people, locations, and projects. We gratefully acknowledge the support of the Department of Energy (grant DE-FG02-95ER40899) and the National Science  ... 
doi:10.1088/1742-6596/396/4/042009 fatcat:as4h5gvdgne27lhm7mrwmnxmzi

Xrootd Monitoring for the CMS Experiment

L A T Bauerdick, K Bloom, B Bockelman, D C Bradley, S Dasu, I Sfiligoi, A Tadel, M Tadel, F Wuerthwein, A Yagil
2012 Journal of Physics, Conference Series  
During spring and summer of 2011, CMS deployed Xrootd-based access for all US T1 and T2 sites. This allows for remote access to all experiment data on disk in the US.  ...  It currently provides a real-time view of the system usage and can store data into ROOT files for detailed analysis.  ...  We do not currently test whether authenticated, but non-CMS users can access the infrastructure. Checking file-system accessibility. For each file tested, only the first kilobyte of data is read.  ... 
doi:10.1088/1742-6596/396/4/042058 fatcat:o5d56vmu4vd3bjxgbjw5o5xfii

Any Data, Any Time, Anywhere: Global Data Access for Science [article]

Kenneth Bloom, Tommaso Boccali, Brian Bockelman, Daniel Bradley, Sridhara Dasu, Jeff Dost, Federica Fanzago, Igor Sfiligoi, Alja Mrak Tadel, Matevz Tadel, Carl Vuosalo, Frank Würthwein, Avi Yagil, Marian Zvada
2015 arXiv   pre-print
However, achieving efficient data access becomes quite difficult when many independent storage sites are involved because users are burdened with learning the intricacies of accessing each system and keeping  ...  We present how one HEP experiment, the Compact Muon Solenoid (CMS), is utilizing the AAA infrastructure and some simple performance metrics.  ...  This work is supported in part by the National Science Foundation through awards PHY-1104664, PHY-1104549 and PHY-1104664.  ... 
arXiv:1508.01443v1 fatcat:esxahxfm2bf3jnqhbmun2nthsm

CMS Distributed Computing Integration in the LHC sustained operations era

C Grandi, B Bockelman, D Bonacorsi, I Fisk, I González Caballero, F Farina, J M Hernández, S Padhi, S Sarkar, A Sciabà, I Sfiligoi, F Spiga (+3 others)
2011 Journal of Physics, Conference Series  
After many years of preparation the CMS computing system has reached a situation where stability in operations limits the possibility to introduce innovative features.  ...  Examples are: adequate authorization to control and prioritize the access to storage and computing resources; improved monitoring to investigate problems and identify bottlenecks on the infrastructure;  ...  The process (shown in figure 2 ) is transparent and remote access may happen in case a file is not found locally.  ... 
doi:10.1088/1742-6596/331/6/062032 fatcat:gixopkrds5cfxhjuvhwpza44lu

CMS Use of a Data Federation

Kenneth Bloom
2014 Journal of Physics, Conference Series  
CMS began with a relatively modest set of use-cases for recovery of failed local file opens, debugging and visualization.  ...  Looking forward we see potential in using the federation to provide more flexibility in the location workflows are executed as the difference between local access and wide area access are diminished by  ...  This work is supported in part by the National Science Foundation through awards PHY-1104664, PHY-1104549 and PHY-1104664.  ... 
doi:10.1088/1742-6596/513/4/042005 fatcat:mj3hh7x5a5dmvikh55nbu6wjaa

The CMS analysis chain in a distributed environment

T. Barrass, D. Bonacorsi, G. Ciraolo, M. Corvo, N. De Filippis, G. Donvito, L. Faina, A. Fanfani, F. Fanzago, C. Grandi, V. Innocente, S. Lacaprara (+8 others)
2006 Nuclear Instruments and Methods in Physics Research Section A : Accelerators, Spectrometers, Detectors and Associated Equipment  
An overview of the current implementation and of the interactions between the previous components of the CMS analysis system is presented in this work.  ...  The job monitoring and the output management are implemented as the last part of the analysis chain.  ...  Acknowledgements We wish to thank all the people who provided feedback during the development and the deployment of the CMS analysis tools. Special thanks to V.  ... 
doi:10.1016/j.nima.2005.11.124 fatcat:2d6yutb27baptkfuomqjloe4aa

Distributed computing grid experiences in CMS

J. Andreeva, A. Anjum, T. Barrass, D. Bonacorsi, J. Bunn, P. Capiluppi, M. Corvo, N. Darmenov, N. De Filippis, F. Donno, G. Donvito, G. Eulisse (+21 others)
2005 IEEE Transactions on Nuclear Science  
To continue to provide scalable access from anywhere in the world to the data, CMS is developing a layer of software that uses Grid tools to gain access to data and resources, and that aims to provide  ...  The CMS experiment is currently developing a computing system capable of serving, processing and archiving the large number of events that will be generated when the CMS detector starts taking data.  ...  distributed computing and data access system.  ... 
doi:10.1109/tns.2005.852755 fatcat:rnyhhbnwt5dlragtifrc3gjo6e

Lustre filesystem for CMS storage element (SE)

Y Wu, B Kim, P Avery, Y Fu, D Bourilkov, C Taylor, C Prescott, J Rodriguez
2011 Journal of Physics, Conference Series  
We then present benchmark performance figures and IO rates from the CMS analysis jobs and the WAN data transfer performance that are conducted on the Lustre SE.  ...  Acknowledgments The authors want to thank the CMS colleagues Daniele Bonacorsi and Wolf Behrenhoff for their help with the presentation.  ...  This resulted in a series of monitoring analysis.  ... 
doi:10.1088/1742-6596/331/5/052034 fatcat:24u4gxacfvgerdt45kvvhylvkm

The Data Quality Monitoring Software for the CMS experiment at the LHC

L. Borrello
2014 2014 IEEE Nuclear Science Symposium and Medical Imaging Conference (NSS/MIC)  
The Data Quality Monitoring (DQM) Software is a central tool in the CMS experiment.  ...  more sophisticated methods for evaluating dataquality, as well as advancing the DQM system to provide quality assessments of various Monte Carlo simulations versus data distributions, monitoring changes  ...  In order to have an efficient and robust system, status of each application is monitored using a daemon that allows an easy access to event rate, log file and other information useful to check if the application  ... 
doi:10.1109/nssmic.2014.7431053 fatcat:uy5njyip3fesncsifmhxfwicby

CMS data quality monitoring: Systems and experiences

L Tuura, A Meyer, I Segoni, G Della Ricca
2010 Journal of Physics, Conference Series  
In the last two years the CMS experiment has commissioned a full end to end data quality monitoring system in tandem with progress in the detector commissioning.  ...  We present the data quality monitoring and certification systems in place, from online data taking to delivering certified data sets for physics analyses, release validation and offline re-reconstruction  ...  Acknowledgments The authors thank the numerous members of CMS collaboration who have contributed the development and operation of the DQM system.  ... 
doi:10.1088/1742-6596/219/7/072020 fatcat:y6zt3llu5nentlbc4zz4jhicsm

XRootD popularity on hadoop clusters

Marco Meoni, Tommaso Boccali, Nicolò Magini, Luca Menichetti, Domenico Giordano
2017 Journal of Physics, Conference Series  
Both processing jobs and storage systems have been instrumented to report file accesses back to the monitoring system.  ...  Since 2011, the CMS Popularity [3] service has been monitoring the access to datasets.  ... 
doi:10.1088/1742-6596/898/7/072027 fatcat:4sjeq7a4m5bw7kjk5cxstjmpna

Controlled overflowing of data-intensive jobs from oversubscribed sites

I Sfiligoi, F Wuerthwein, B Bockelman, D C Bradley, M Tadel, K Bloom, J Letts, A Mrak Tadel
2012 Journal of Physics, Conference Series  
The major limiting factor for remote data access is the ability of the source storage system to serve such data, so the number of jobs accessing it must be carefully controlled.  ...  The major limiting factor for remote data access is the ability of the source storage system to serve such data, so the number of jobs accessing it must be carefully controlled.  ...  The adopted solution The solution adopted by CMS to control the remote access to data is based on glideinWMS, a Condor based pilot system, which was already in use for several years by the CMS analysis  ... 
doi:10.1088/1742-6596/396/3/032102 fatcat:mm6tfqr5x5e6rhlun2zb3wtggu

Deploying a new realtime XRootD-v5 based monitoring framework for GridPP

Robert Currie, Wenlong Yuan, C. Biscarat, S. Campana, B. Hegner, S. Roiser, C.I. Rovelli, G.A. Stewart
2021 EPJ Web of Conferences  
This monitoring solution is built upon experiences presented by CMS in setting up a similar service as part of their AAA system.  ...  The result of this work is an interactive dashboard system which enables administrators to access real-time metrics on the performance of their lightweight storage systems.  ...  Figure 3 , shows access patterns of files from these different storage servers. This information is similar to metrics made available to CMS through the AAA service.  ... 
doi:10.1051/epjconf/202125102052 fatcat:3iajgplc4bfkhdclyrnacpc4jm
« Previous Showing results 1 — 15 out of 122,992 results