Report on the Evaluation-as-a-Service (EaaS) Expert Workshop

Frank Hopfgartner, Jimmy Lin, Krisztian Balog, Ivan Eggel, Allan Hanbury, Henning Müller, Noriko Kando, Simon Mercer, Jayashree Kalpathy-Cramer, Martin Potthast, Tim Gollub, Anastasia Krithara
2015 SIGIR Forum  
In this report, we summarize the outcome of the "Evaluation-as-a-Service" workshop that was held on the 5th and 6th March 2015 in Sierre, Switzerland. The objective of the meeting was to bring together initiatives that use cloud infrastructures, virtual machines, APIs (Application Programming Interface) and related projects that provide evaluation of information retrieval or machine learning tools as a service. 1 http://elias-network.eu/ 2 http://visceral.eu/
doi:10.1145/2795403.2795416 fatcat:fvruambvbjfqbpoigzfuxsq5ey