Social interactions: A first-person perspective

A. Fathi, J. K. Hodgins, J. M. Rehg
2012 2012 IEEE Conference on Computer Vision and Pattern Recognition  
This paper presents a method for the detection and recognition of social interactions in a day-long first-person video of a social event, like a trip to an amusement park. The location and orientation of faces are estimated and used to compute the line of sight for each face. The context provided by all the faces in a frame is used to convert the lines of sight into locations in space to which individuals attend. Further, individuals are assigned roles based on their patterns of attention. The
more » ... oles and locations of individuals are analyzed over time to detect and recognize the types of social interactions. In addition to patterns of face locations and attention, the head movements of the first-person can provide additional useful cues as to their attentional focus. We demonstrate encouraging results on detection and recognition of social interactions in first-person videos captured from multiple days of experience in amusement parks.
doi:10.1109/cvpr.2012.6247805 dblp:conf/cvpr/FathiHR12 fatcat:mvijo7nawncv3cusfhogtfuc3e