Skill Progression in Scratch Revisited

J. Nathan Matias, Sayamindu Dasgupta, Benjamin Mako Hill
2016 Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16  
The Scratch environment exemplifies a tool+community approach to teaching elementary programming skills, as it includes a website where users can publish, discuss, and organize animations that are programs. To explore this environment's effectiveness for helping people to develop programming skills, we performed a quantitative analysis of 250 randomly-selected users' data, including over 1000 of their animations. We measured skill based on four models that had proven useful in prior empirical
more » ... n prior empirical studies. Overall, we found mixed results about the environment's effectiveness. Among users who do not drop out, we found an increasing progression in social skills. However, we also observed an extremely high drop-out rate. Moreover, we observed a flat or decreasing level of demonstrated skill on virtually every measure. These results call into question whether simply combining an animation tool and an online community is sufficient for keeping people engaged long enough to learn elementary programming skills.
doi:10.1145/2858036.2858349 dblp:conf/chi/MatiasDH16 fatcat:kfbedoxiezhgvcesrcvnpypnfy