Decision Anticipation for Driving Assistance Systems

Pierluigi Vito Amadori, Tobias Fischer, Ruohan Wang, Yiannis Demiris
2020 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC)  
Anticipating the correctness of imminent driver decisions is a crucial challenge in advanced driving assistance systems and has the potential to lead to more reliable and safer human-robot interactions. In this paper, we address the task of decision correctness prediction in a driver-in-the-loop simulated environment using unobtrusive physiological signals, namely, eye gaze and head pose. We introduce a sequence-to-sequence based deep learning model to infer the driver's likelihood of making
more » ... rect/wrong decisions based on the corresponding cognitive state. We provide extensive experimental studies over multiple baseline classification models on an eye gaze pattern and head pose dataset collected from simulated driving. Our results show strong correlates between the physiological data and decision correctness, and that the proposed sequential model reliably predicts decision correctness from the driver with 80% precision and 72% recall. We also demonstrate that our sequential model performs well in scenarios where early anticipation of correctness is critical, with accurate predictions up to two seconds before a decision is performed.
doi:10.1109/itsc45102.2020.9294216 fatcat:5l7lfem335gypeeuqu6ghg5g54