Using Solid State Disk Array as a Cache for LHC ATLAS Data Analysis

W Yang, A B Hanushevsky, R P Mount
2014 Journal of Physics, Conference Series  
User data analysis in high energy physics presents a challenge to spinning--disk based storage systems. The analysis is data intense, yet reads are small, sparse and cover a large volume of data files. It is also unpredictable due to users' response to storage performance. We describe here a system with an array of Solid State Disk as a non--conven@onal, standalone file level cache in front of the spinning disk storage to help improve the performance of LHC ATLAS user analysis at SLAC. The
more » ... m uses a long period of data access records to make caching decisions. It can also use informa@on from other sources such as a work-flow management system. We evaluate the performance of the system both in terms of caching and its impact on user analysis jobs. The system currently uses Xrootd technology, but the technique can be applied to any storage system.
doi:10.1088/1742-6596/513/4/042035 fatcat:lobhtkovfzgl3fxfiocekfouja