Informing intelligent user interfaces by inferring affective states from body postures in ubiquitous computing environments

Chiew Seng Sean Tan, Johannes Schöning, Kris Luyten, Karin Coninx
2013 Proceedings of the 2013 international conference on Intelligent user interfaces - IUI '13  
Intelligent User Interfaces can benefit from having knowledge on the user's emotion. However, current implementations to detect affective states, are often constraining the user's freedom of movement by instrumenting her with sensors. This prevents affective computing from being deployed in naturalistic and ubiquitous computing contexts. In this paper, we present a novel system called mASqUE, which uses a set of association rules to infer someone's affective state from their body postures. This
more » ... body postures. This is done without any user instrumentation and using off-the-shelf and non-expensive commodity hardware: a depth camera tracks the body posture of the users and their postures are also used as an indicator of their openness. By combining the posture information with physiological sensors measurements we were able to mine a set of association rules relating postures to affective states. We demonstrate the possibility of inferring affective states from body postures in ubiquitous computing environments and our study also provides insights how this opens up new possibilities for IUI to access the affective states of users from body postures in a nonintrusive way. [28] . With the increase of computational power that is available in our environments and the quality of sensors, ubiquitous systems that are embedded in our environment can take better decisions on how to support our daily routines and activities. This is exactly the context-awareness that has been most prominently advocated by Dey et al. [12] to frame interaction within the situation of the user. Although the context of use in general has been widely explored to improve usability of Ubicomp systems, we argue further improvements can be accomplished by taking into account the context of the user, more specifically the affective state of a user. For interaction in an Ubicomp environment, a system, that detects the affective states of the users, should maintain the freedom of movement of the users by not instrumenting them with additional sensors. MOTIVATION Weiser's vision of ubiquitous computing [35] is not longer a vision as pointed out by Abowd [1] and Rogers
doi:10.1145/2449396.2449427 dblp:conf/iui/TanSLC13 fatcat:6femjtb5bncw5ox4576muorxwm