Evaluating the validity and applicability of automated essay scoring in two massive open online courses

Erin Dawna Reilly, Rose Eleanore Stafford, Kyle Marie Williams, Stephanie Brooks Corliss
2014 International Review of Research in Open and Distance Learning  
<p>The use of massive open online courses (MOOCs) to expand students' access to higher education has raised questions regarding the extent to which this course model can provide and assess authentic, higher level student learning. In response to this need, MOOC platforms have begun utilizing automated essay scoring (AES) systems that allow students to engage in critical writing and free-response activities. However, there is a lack of research investigating the validity of such systems in
more » ... This research examined the effectiveness of an AES tool to score writing assignments in two MOOCs. Results indicated that some significant differences existed between Instructor grading, AES-Holistic scores, and AES-Rubric Total scores within two MOOC courses. However, use of the AES system may still be useful given instructors' assessment needs and intent. Findings from this research have implications for instructional technology administrators, educational designers, and instructors implementing AES learning activities in MOOC courses.</p>
doi:10.19173/irrodl.v15i5.1857 fatcat:yxbnl6a5pjgildcdsk4fqcqnpm