The repeatability experiment of SIGMOD 2008

I. Manolescu, D. Shasha, L. Afanasiev, A. Arion, J. Dittrich, S. Manegold, N. Polyzotis, K. Schnaitter, P. Senellart, S. Zoupanos
2008 SIGMOD record  
SIGMOD 2008 was the first database conference that offered to test submitters' programs against their data to verify the experiments published. This paper discusses the rationale for this effort, the community's reaction, our experiences, and advice for future similar efforts.
doi:10.1145/1374780.1374791 fatcat:5ooocambjjh4pkkzxqmizmwh6e