A big data analytics framework for scientific data management

Sandro Fiore, Cosimo Palazzo, Alessandro D'Anca, Ian Foster, Dean N. Williams, Giovanni Aloisio
2013 2013 IEEE International Conference on Big Data  
The Ophidia project is a research effort addressing big data analytics requirements, issues, and challenges for eScience. We present here the Ophidia analytics framework, which is responsible for atomically processing, transforming and manipulating array-based data. This framework provides a common way to run on large clusters analytics tasks applied to big datasets. The paper highlights the design principles, algorithm, and most relevant implementation aspects of the Ophidia analytics
more » ... analytics framework. Some experimental results, related to a couple of data analytics operators in a real cluster environment, are also presented.
doi:10.1109/bigdata.2013.6691720 dblp:conf/bigdataconf/FiorePDFWA13 fatcat:pnacibksqvfsvatduk2rytqyt4