Audio-driven human body motion analysis and synthesis

F. Ofli, C. Canton-Ferrer, J. Tilmanne, Y. Demir, E. Bozkurt, Y. Yemez, E. Erzin, A. M. Tekalp
<span title="">2008</span> <i title="IEEE"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/2omreisfsje33bgvx3orrdifre" style="color: black;">Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing</a> </i> &nbsp;
This paper presents a framework for audio-driven human body motion analysis and synthesis. We address the problem in the context of a dance performance, where gestures and movements of the dancer are mainly driven by a musical piece and characterized by the repetition of a set of dance !gures. The system is trained in a supervised manner using the multiview video recordings of the dancer. The human body posture is extracted from multiview video information without any human intervention using a
more &raquo; ... novel marker-based algorithm based on annealing particle !ltering. Audio is analyzed to extract beat and tempo information. The joint analysis of audio and motion features provides a correlation model that is then used to animate a dancing avatar when driven with any musical piece of the same genre. Results are provided showing the effectiveness of the proposed algorithm.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/icassp.2008.4518089">doi:10.1109/icassp.2008.4518089</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/icassp/OfliCTDBYET08.html">dblp:conf/icassp/OfliCTDBYET08</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/73prooupprfn7icvfmifvhfusi">fatcat:73prooupprfn7icvfmifvhfusi</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20120124173044/http://tcts.fpms.ac.be/publications/papers/2008/icassp08_foccfjtydebyyeeamt.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/79/80/7980df3ef3b7c26e3ca6e240f33bf835c2f4929c.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/icassp.2008.4518089"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>