Weighted Pointer : Error-aware Gaze-based Interaction through Fallback Modalities

Sidenmark, Ludwig and Parent, Mark and Wu, Chi-Hao and Chan, Joannes and Glueck, Michael and Wigdor, Daniel and Grossman, Tovi and Giordano, Marcello (2022) Weighted Pointer : Error-aware Gaze-based Interaction through Fallback Modalities. IEEE Transactions on Visualization and Computer Graphics, 28 (11). pp. 3585-3595. ISSN 1077-2626

Text (Weighted_Pointer_Preprint)
Weighted_Pointer_Preprint.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.
Download (6MB)

Abstract

Gaze-based interaction is a fast and ergonomic type of hands-free interaction that is often used with augmented and virtual reality when pointing at targets. Such interaction, however, can be cumbersome whenever user, tracking, or environmental factors cause eye tracking errors. Recent research has suggested that fallback modalities could be leveraged to ensure stable interaction irrespective of the current level of eye tracking error. This work thus presents Weighted Pointer interaction, a collection of error-aware pointing techniques that determine whether pointing should be performed by gaze, a fallback modality, or a combination of the two, depending on the level of eye tracking error that is present. These techniques enable users to accurately point at targets when eye tracking is accurate and inaccurate. A virtual reality target selection study demonstrated that Weighted Pointer techniques were more performant and preferred over techniques that required the use of manual modality switching.