It's Written on Your Face: Detecting Affective States from Facial Expressions while Learning Computer Programming [chapter]

Nigel Bosch, Yuxuan Chen, Sidney D'Mello
<span title="">2014</span> <i title="Springer International Publishing"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/2w3awgokqne6te4nvlofavy5a4" style="color: black;">Lecture Notes in Computer Science</a> </i> &nbsp;
We built detectors capable of automatically recognizing affective states of novice computer programmers from student-annotated videos of their faces recorded during an introductory programming tutoring session. We used the Computer Expression Recognition Toolbox (CERT) to track facial features based on the Facial Action Coding System, and machine learning techniques to build classification models. Confusion/Uncertainty and Frustration were distinguished from all other affective states in a
more &raquo; ... nt-independent fashion at levels above chance (Cohen's kappa = .22 and .23, respectively), but detection accuracies for Boredom, Flow/Engagement, and Neutral were lower (kappas = .04, .11, and .07). We discuss the differences between detection of spontaneous versus fixed (polled) judgments as well as the features used in the models.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1007/978-3-319-07221-0_5">doi:10.1007/978-3-319-07221-0_5</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/tbjs3nkr4ncl3goqif6ktpoq3e">fatcat:tbjs3nkr4ncl3goqif6ktpoq3e</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20180205072914/http://pnigel.com:80/papers/bosch-ml-its14.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/55/b1/55b1825b59010ca698b2d8275d677084344414fb.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1007/978-3-319-07221-0_5"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> springer.com </button> </a>