Multimodal Diaries

Fernando De la Torre, Carlos Agell
2007 Multimedia and Expo, 2007 IEEE International Conference on  
Time management is an important aspect of a successful professional life. In order to have a better understanding of where our time goes, we propose a system that summarizes the user's daily activity (e.g. sleeping, walking, working on the computer, talking, ...) using all-day multimodal data recordings. Two main novelties are proposed: • A system that combines both physical and contextual awareness hardware and software. It records synchronized audio, video, body sensors, GPS and computer
more » ... oring data. • A semi-supervised temporal clustering (SSTC) algorithm that accurately and efficiently groups large amounts of multimodal data into different activities. The effectiveness and accuracy of our SSTC is demonstrated in synthetic and real examples of activity segmentation from multimodal data gathered over long periods of time.
doi:10.1109/icme.2007.4284781 dblp:conf/icmcs/TorreA07 fatcat:qskydoskhjf5ddmcgki7bw53r4