Person-Independent 3D Gaze Estimation Using Face Frontalization

Laszlo A. Jeni, Jeffrey F. Cohn
2016 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)  
Figure 1 : From a 2D image of a person's face (a) a dense, part-based 3D deformable model is aligned (b) to reconstruct a partial frontal view of the face (c). Binary features are extracted around eye and pupil markers (d) for the 3D gaze calculation (e). Abstract Person-independent and pose-invariant estimation of eye-gaze is important for situation analysis and for automated video annotation. We propose a fast cascade regression based method that first estimates the location of a dense set of
more » ... markers and their visibility, then reconstructs face shape by fitting a part-based 3D model. Next, the reconstructed 3D shape is used to estimate a canonical view of the eyes for 3D gaze estimation. The model operates in a feature space that naturally encodes local ordinal properties of pixel intensities leading to photometric invariant estimation of gaze. To evaluate the algorithm in comparison with alternative approaches, three publicly-available databases were used, Boston University Head Tracking, Multi-View Gaze and CAVE Gaze datasets. Precision for head pose and gaze averaged 4 degrees or less for pitch, yaw, and roll. The algorithm outperformed alternative methods in both datasets.
doi:10.1109/cvprw.2016.104 dblp:conf/cvpr/JeniC16 fatcat:mxtg73svizhprlo7bugq26edei