Gaze-based Intention Anticipation over Driving Manoeuvres in Semi-Autonomous Vehicles

Wu, Min and Louw, Tyron and Lahijanian, Morteza and Ruan, Wenjie and Huang, Xiaowei and Merat, Natasha and Kwiatkowska, Marta (2020) Gaze-based Intention Anticipation over Driving Manoeuvres in Semi-Autonomous Vehicles. In: 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) :. IEEE, CHN, pp. 6210-6216. ISBN 9781728140049

[thumbnail of Gaze-based Intention Anticipation over Driving Manoeuvres in Semi-Autonomous Vehicles]
Text (Gaze-based Intention Anticipation over Driving Manoeuvres in Semi-Autonomous Vehicles)
wllrhmk_19.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.

Download (3MB)


Anticipating a human collaborator’s intention enables safe and efficient interaction between a human and an autonomous system. Specifically, in the context of semiautonomous driving, studies have revealed that correct and timely prediction of the driver’s intention needs to be an essential part of Advanced Driver Assistance System (ADAS) design. To this end, we propose a framework that exploits drivers’ timeseries eye gaze and fixation patterns to anticipate their real-time intention over possible future manoeuvres, enabling a smart and collaborative ADAS that can aid drivers to overcome safetycritical situations. The method models human intention as the latent states of a hidden Markov model and uses probabilistic dynamic time warping distributions to capture the temporal characteristics of the observation patterns of the drivers. The method is evaluated on a data set of 124 experiments from 75 drivers collected in a safety-critical semi-autonomous driving scenario. The results illustrate the efficacy of the framework by correctly anticipating the drivers’ intentions about 3 seconds beforehand with over 90% accuracy.

Item Type:
Contribution in Book/Report/Proceedings
Additional Information:
©2019 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
ID Code:
Deposited By:
Deposited On:
24 Sep 2019 12:55
Last Modified:
09 Jan 2024 00:39