Evaluating an ambient display for the home

Sunny Consolvo, Jeffrey Towle
2005 CHI '05 extended abstracts on Human factors in computing systems - CHI '05  
We present our experiences with evaluating an ambient display for the home using two different evaluation techniques: the recently proposed 'Heuristic Evaluation of Ambient Displays' and an in situ, 3-week long, Wizard of Oz evaluation. We compare the list of usability violations found in the heuristic evaluation to the set of problems that were discovered in the in situ evaluation. Overall, the 'Heuristic Evaluation of Ambient Displays' was effective -75% of known usability problems were found
more » ... problems were found by eight evaluators (39-55% were found by 3-5 evaluators). However, the most severe usability problem found in the in situ evaluation was not identified in the heuristic evaluation. Because the problem directly violated one of the heuristics, we believe that the problem is not with the heuristics, but rather that evaluators have minimal experience with ambient displays for the home.
doi:10.1145/1056808.1056902 dblp:conf/chi/ConsolvoT05 fatcat:slbercmkcjasrcntubhgrbsmye