Weighted Pointer : Error-aware Gaze-based Interaction through Fallback Modalities

Sidenmark, Ludwig and Parent, Mark and Wu, Chi-Hao and Chan, Joannes and Glueck, Michael and Wigdor, Daniel and Grossman, Tovi and Giordano, Marcello (2022) Weighted Pointer : Error-aware Gaze-based Interaction through Fallback Modalities. IEEE Transactions on Visualization and Computer Graphics, 28 (11). pp. 3585-3595. ISSN 1077-2626

[thumbnail of Weighted_Pointer_Preprint]
Text (Weighted_Pointer_Preprint)
Weighted_Pointer_Preprint.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.

Download (6MB)


Gaze-based interaction is a fast and ergonomic type of hands-free interaction that is often used with augmented and virtual reality when pointing at targets. Such interaction, however, can be cumbersome whenever user, tracking, or environmental factors cause eye tracking errors. Recent research has suggested that fallback modalities could be leveraged to ensure stable interaction irrespective of the current level of eye tracking error. This work thus presents Weighted Pointer interaction, a collection of error-aware pointing techniques that determine whether pointing should be performed by gaze, a fallback modality, or a combination of the two, depending on the level of eye tracking error that is present. These techniques enable users to accurately point at targets when eye tracking is accurate and inaccurate. A virtual reality target selection study demonstrated that Weighted Pointer techniques were more performant and preferred over techniques that required the use of manual modality switching.

Item Type:
Journal Article
Journal or Publication Title:
IEEE Transactions on Visualization and Computer Graphics
Additional Information:
©2022 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Uncontrolled Keywords:
?? signal processingcomputer graphics and computer-aided designsoftwarecomputer vision and pattern recognition ??
ID Code:
Deposited By:
Deposited On:
29 Jul 2022 09:10
Last Modified:
20 Apr 2024 02:27