The Fundamental Issues of Pen-Based Interaction with Tablet Devices

Michelle K Annett
2014
Although pens and paper are pervasive in the analog world, their digital counterparts, styli and tablets, have yet to achieve the same adoption or frequency of use. Digital styli should provide a natural, intuitive method to take notes, annotate, and sketch, but have yet to reach their full potential. There has been surprisingly little research focused on understanding why inking experiences differ so vastly between analog and digital media and amongst various styli themselves. To enrich our
more » ... wledge on the stylus experience, this thesis contributes a foundational understanding of the factors implicated in the varied experiences found within the stylus ecosystem today. The thesis first reports on an exploratory study utilizing traditional pen and paper and tablets and styli that observed quantitative and behavioural data, in addition to preferential opinions, to understand current inking experiences. The exploration uncovered the significant impact latency, unintended touch, and stylus accuracy have on the user experience, whilst also determining the increasing importance of stylus and device aesthetics and stroke beautification. The observed behavioural adaptations and quantitative measurements dictated the direction of the research presented herein. A systematic approach was then taken to gather a deeper understanding of device latency and stylus accuracy. A series of experiments garnered insight into latency and accuracy, examining the underlying elements that result in the lackluster experiences found today. The results underscored the importance of visual feedback, user expectations, and perceptual limitations on user performance and satisfaction. The proposed Latency Perception iii Model has provided a cohesive understanding of touch-and pen-based latency perception, and a solid foundation upon which future explorations of latency can occur. The thesis also presents an in-depth exploration of unintended touch. The data collection and analysis underscored the importance of stylus information and the use of additional data sources for solving unintended touch. The behavioral observations reemphasized the importance of designing devices and interfaces that support natural, fluid interaction and suggested hardware and software advancements necessary in the future. The commentary on the interaction -rejection dichotomy should be of great value to developers of unintended touch solutions along with designers of next-generation interaction techniques and styli. The thesis then concludes with a commentary on the areas of the stylus ecosystem that would benefit from increased attention and focus in the years to come and future technological advancements that could present interesting challenges in the future. iv Preface This thesis is an original work by Michelle Annett. The research projects, of which this thesis is a part, received "The art challenges the technology, and the technology inspires the art" -John Lasseter vii Acknowledgements First off, my advisor Walter F. Bischof deserves my utmost appreciation and gratitude. Walter, you have shared your research experience and psychological knowledge with me on a daily basis, teaching me everything I know about statistics and experimental methodologies (ahem, effect sizes!) Although I still despise your red pen, your attention to detail and inquisitive nature helped shape the writer and researcher that I am today. I know that I would not be anywhere close to where I am if it were not for your high standards and constant pursuit of research excellence. Regardless of how wacky or non-traditional Fraser's and my ideas were (e.g., "We want to build a talking monkey Walter", "Walter, we're going to build a Smell-o-Vision interface"), you never wavered in your support of Fraser and me. You let me spread my wings and go experience industry, first in Toronto, at Autodesk Research, and then again in Redmond, at Microsoft Research. You have always encouraged me to take research risks and immerse myself in projects I enjoyed, no matter how many times I changed my dissertation topic! Although Fraser and I still love our mac and cheese, we will always cherish the culinary adventures you took us on and the magic of a Swiss Raclette! Eine Minute auf der Lippe, ein Leben lang auf der Hüfte!
doi:10.7939/r3q23r65d fatcat:ejwd6snd2jcmbmblhtlitettsy