HOBBIT: A platform for benchmarking Big Linked Data

Michael Röder, Denis Kuchelev, Axel-Cyrille Ngonga Ngomo, Paul Groth
2019 Data Science  
Editor: Paul Groth (https://orcid.org/0000-0003-0183-6910) Solicited reviews: Victor de Boer (https://orcid.org/0000-0001-9079-039X); Laura Rettig (https://orcid.org/0000-0002-9765-0549) Abstract. An increasing number of solutions aim to support the steady increase of the number of requirements and requests for Linked Data at scale. This plethora of solutions leads to a growing need for objective means that facilitate the selection of adequate solutions for particular use cases. We hence
more » ... HOBBIT, a distributed benchmarking platform designed for the unified execution of benchmarks for Linked Data solutions. The HOBBIT benchmarking platform is based on the FAIR principles and is the first benchmarking platform able to scale up to benchmarking real-world scenarios for Big Linked Data solutions. Our online instance of the platform has more than 300 registered users and offers more than 40 benchmarks. It has been used in eleven benchmarking challenges and for more than 13000 experiments. We give an overview of the results achieved during 2 of these challenges and point to some of the novel insights that were gained from the results of the platform. HOBBIT is open-source and available at http://github.com/hobbit-project. This article is published online with Open Access and distributed under the terms of the Creative Commons Attribution License (CC BY 4.0). 2451-8484 © 2019 -IOS Press and the authors. 1 Code and dataset generators available at http://github.com/hobbit-project. Project homepage at https://project-hobbit.eu/. 2 http://master.project-hobbit.eu 3 http://www.seals-project.eu/ 11 Our endpoint can be found at https://db.project-hobbit.eu/sparql. 12 Namely, RDF [5], PROV-O [25], Data Cube [12] and XSD [7]. 13 The formal specification of the ontology can be found at https://github.com/hobbit-project/ontology.
doi:10.3233/ds-190021 fatcat:7mdqdkdo4vdhvawzzju744t4vq