Evaluating Information Visualization via the Interplay of Heuristic Evaluation and Question-Based Scoring

Marti A. Hearst, Paul Laskowski, Luis Silva
2016 Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16  
Figure 1 . Three visualizations of the same dataset (from the game show Jeopardy!), designed to be of (a) low, (b) high, and (c) middling usability. ABSTRACT In an instructional setting it can be difficult to accurately assess the quality of information visualizations of several variables. Instead of a standard design critique, an alternative is to ask potential readers of the chart to answer questions about it. A controlled study with 47 participants shows a good correlation between aggregated
more » ... novice heuristic evaluation scores and results of answering questions about the data, suggesting that the two forms of assessment can be complementary. Using both metrics in parallel can yield further benefits; discrepancies between them may reveal incorrect application of heuristics or other issues.
doi:10.1145/2858036.2858280 dblp:conf/chi/HearstLS16 fatcat:qdd2zre6brhplmuhltngien57u