Writing ROOT Data in Parallel with TBufferMerger

Guilherme Amadio, Philippe Canal, Enrico Guiraud, Danilo Piparo, P. Hristov, A. Forti, O. Smirnova, M. Litmaath, L. Betev
2019 EPJ Web of Conferences  
Experiments at the Large Hadron Collider (LHC) produce tens of petabytes of new data in ROOT format per year that need to be processed and analysed. In the next decade, following the planned upgrades of the LHC and its detectors, this data production rate is expected to increase at least ten-fold. Therefore, optimizing the ROOT I/O subsystem is of critical importance to the success of the LHC physics programme. This contribution presents ROOT's approach for writing data from multiple threads to
more » ... multiple threads to a single output file in an efficient way. Technical aspects of the implementation—the TBufferMerger class—and programming model examples are described. Measurements of runtime performance and the overall improvement relative to the case of serial data writing are also discussed.
doi:10.1051/epjconf/201921405037 fatcat:vix6rsio7vhypchu4ym7yblas4