A review of motion analysis methods for human Nonverbal Communication Computing

Dimitris Metaxas, Shaoting Zhang
<span title="">2013</span> <i title="Elsevier BV"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/z7tk7kanxjcz7hgk77ae6t3ofy" style="color: black;">Image and Vision Computing</a> </i> &nbsp;
Human Nonverbal Communication Computing aims to investigate how people exploit nonverbal aspects of their communication to coordinate their activities and social relationships. Nonverbal behavior plays important roles in message production and processing, relational communication, social interaction and networks, deception and impression management, and emotional expression. This is a fundamental yet challenging research topic. To effectively analyze Nonverbal Communication Computing, motion
more &raquo; ... lysis methods have been widely investigated and employed. In this paper, we introduce the concept and applications of Nonverbal Communication Computing and also review some of the motion analysis methods employed in this area. They include face tracking, expression recognition, body reconstruction, and group activity analysis. In addition, we also discuss some open problems and the future directions of this area. © 2013 Published by Elsevier B.V. Introduction Understanding how people exploit nonverbal aspects of their communication to coordinate their activities and social relationships is a fundamental scientific challenge. Deeper insights into nonverbal communication can have a profound impact on how we link theories of perception, learning, cognition and action to models of interactions and groups at the social level. Models of nonverbal behaviors in interaction are essential for collaboration tools, human-computer and virtual interaction and other assistive technologies designed to support people in real-world activities. This knowledge is also useful to develop models of the deficits of specific populations, such as autistic children, and interventions that bring them into fuller participation in communities. In general, nonverbal communication research offers high-level principles that might explain how people organize, display, adapt and understand such behaviors for communicative purposes and social goals. However, the specifics are generally not fully understood, nor is the way to translate these principles into algorithms and computer-aided communication technologies such as intelligent agents. To model such complex dynamic processes effectively, novel computer vision and learning algorithms are needed that take into account both the heterogeneity and the dynamicity intrinsic to behavior data. As one of the most active research areas in computer vision, human motion analysis has become a widely-used tool in this area. It uses image sequences to detect and track people, and 0262-8856/$see front matter
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1016/j.imavis.2013.03.005">doi:10.1016/j.imavis.2013.03.005</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/ylxt5bph2jfgrfd5a4c22qn66u">fatcat:ylxt5bph2jfgrfd5a4c22qn66u</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20150117052002/http://research.rutgers.edu:80/~shaoting/paper/IVC_review.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/88/a9/88a9b3043a951c622667dcd5f70acd2c850b3950.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1016/j.imavis.2013.03.005"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> elsevier.com </button> </a>