An Emotional Recognition System for Facial Expressions with Surface Common Features

Maierdan Maimaitimin, Keigo Watanabe, Shoichi Maeyama
<span title="2016-10-18">2016</span> <i title="Engineering Faculty of Hasanuddin University"> <a target="_blank" rel="noopener" href="" style="color: black;">International Journal on Smart Material and Mechatronics</a> </i> &nbsp;
In this paper, the recognition problem of facial expressions, which is based on 3D surface common features, is addressed by using a deep learning structure. A face in 3D is captured by a 3D sensor, where the raw data is provided in a point cloud structure. A geometric attribute map that is a surface common feature is obtained from such 3D point cloud data. Then, a set of maps are fed into a convolution neural network (CNN), which is pre-trained by an auto-encoder in previous work. The CNN is
more &raquo; ... d to predict the activity and arousal parameters of each part on the face. At the last layer of the whole network, such parameters are used to predict the current facial expression. Note here that as the database, there are six different facial expressions such as angry, fear, happy, etc., captured from 30 peoples in 230 frames, and it is more than 40 thousand sets in total. As a result, the CNN with pre-training on surface common features outperforms the hand-crafted descriptors in the same experimental condition. Index Terms-Surface common features, deep learning, facial expressions.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="">doi:10.20342/ijsmm.3.2.192</a> <a target="_blank" rel="external noopener" href="">fatcat:tncqhmgxnbculhbyjw2hsixuie</a> </span>
<a target="_blank" rel="noopener" href=";download=7145-ijsmm-vol3-no2-192-Merdan.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href=""> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> Publisher / </button> </a>