Capturing Global Semantic Relationships for Facial Action Unit Recognition

Ziheng Wang, Yongqiang Li, Shangfei Wang, Qiang Ji
<span title="">2013</span> <i title="IEEE"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/753trptklbb4nj6jquqadzwwdu" style="color: black;">2013 IEEE International Conference on Computer Vision</a> </i> &nbsp;
In this paper we tackle the problem of facial action unit (AU) recognition by exploiting the complex semantic relationships among AUs, which carry crucial top-down information yet have not been thoroughly exploited. Towards this goal, we build a hierarchical model that combines the bottom-level image features and the top-level AU relationships to jointly recognize AUs in a principled manner. The proposed model has two major advantages over existing methods. 1) Unlike methods that can only
more &raquo; ... e local pair-wise AU dependencies, our model is developed upon the restricted Boltzmann machine and therefore can exploit the global relationships among AUs. 2) Although AU relationships are influenced by many related factors such as facial expressions, these factors are generally ignored by the current methods. Our model, however, can successfully capture them to more accurately characterize the AU relationships. Efficient learning and inference algorithms of the proposed model are also developed. Experimental results on benchmark databases demonstrate the effectiveness of the proposed approach in modelling complex AU relationships as well as its superior AU recognition performance over existing approaches.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/iccv.2013.410">doi:10.1109/iccv.2013.410</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/iccv/WangLWJ13.html">dblp:conf/iccv/WangLWJ13</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/zgzol76gy5balc5onhqr74ubbi">fatcat:zgzol76gy5balc5onhqr74ubbi</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20170813035311/https://www.ecse.rpi.edu/~cvrl/zihengwang/papers/iccv2013.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/8a/d9/8ad9f8cbd995da714ec6477b1c27c2446bed733d.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/iccv.2013.410"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>