Interpreting strokes on paper with a mobile assistant

Theophanis Tsandilas
<span title="">2012</span> <i title="ACM Press"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/w3p3hxsu4bckbpebzlol6wmmq4" style="color: black;">Proceedings of the 25th annual ACM symposium on User interface software and technology - UIST &#39;12</a> </i> &nbsp;
Figure 1. Writing music with an Anoto pen and a smartphone. (a) Handwritten score translated by the device. (b) Correcting the recognition of a note over a small plastic sheet. (c) Guiding the interpretation of strokes with the left hand. ABSTRACT Digital pen technology has allowed for the easy transfer of pen data from paper to the computer. However, linking handwritten content with the digital world remains a hard problem as it requires the translation of unstructured and highly personal
more &raquo; ... ularies into structured ones that computers can easily understand and process. Automatic recognition can help to this direction, but as it is not always reliable, solutions require the active cooperation between users and recognition algorithms. This work examines the use of portable touch-screen devices in connection with pen and paper to help users direct and refine the interpretation of their strokes on paper. We explore four techniques of bimanual interaction that combine touch and pen-writing, where user attention is divided between the original strokes on paper and their interpretation by the electronic device. We demonstrate the techniques through a mobile interface for writing music that complements the automatic recognition with interactive user-driven interpretation. An experiment evaluates the four techniques and provides insights about their strengths and limitations.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/2380116.2380155">doi:10.1145/2380116.2380155</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/uist/Tsandilas12.html">dblp:conf/uist/Tsandilas12</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/qzjd4tbw7fh6fboni5j3pmt4yi">fatcat:qzjd4tbw7fh6fboni5j3pmt4yi</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20121115084457/http://hal.archives-ouvertes.fr/docs/00/72/28/10/PDF/uist2012-hal.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/d7/12/d71299bd6cf3c62b8ab8c2bd6284a59beae5e3cb.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/2380116.2380155"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> acm.org </button> </a>