Promoting Insight-Based Evaluation of Visualizations: From Contest to Benchmark Repository

C. Plaisant, J.-D. Fekete, G. Grinstein
2008 IEEE Transactions on Visualization and Computer Graphics  
Information Visualization (InfoVis) is now an accepted and growing field but questions remain about the best uses for and the maturity of novel visualizations. Usability studies and controlled experiments are helpful but generalization is difficult. We believe that the systematic development of benchmarks will facilitate the comparison of techniques and help identify their strengths under different conditions. We were involved in the organization and management of three information
more » ... contests for the 2003, 2004 and 2005 IEEE Information Visualization Symposia, which requested teams to report on insights gained while exploring data. We give a summary of the state of the art of evaluation in information visualization, describe the three contests, summarize their results, discuss outcomes and lessons learned, and conjecture the future of visualization contests. All materials produced by the contests are archived in the Information Visualization Benchmark Repository.
doi:10.1109/tvcg.2007.70412 pmid:17993707 fatcat:saiz6tzturakxeufufwjhnhdjm