Gaze + Pinch interaction in virtual reality

Pfeuffer, Ken and Mayer, Benedikt and Mardanbegi, Diako and Gellersen, Hans (2017) Gaze + Pinch interaction in virtual reality. In: SUI 2017 - Proceedings of the 2017 Symposium on Spatial User Interaction :. SUI 2017 - Proceedings of the 2017 Symposium on Spatial User Interaction . Association for Computing Machinery, Inc, GBR, pp. 99-108. ISBN 9781450354868

Full text not available from this repository.


Virtual reality affords experimentation with human abilities beyond what’s possible in the real world, toward novel senses of interaction. In many interactions, the eyes naturally point at objects of interest while the hands skilfully manipulate in 3D space. We explore a particular combination for virtual reality, the Gaze + Pinch interaction technique. It integrates eye gaze to select targets, and indirect freehand gestures to manipulate them. This keeps the gesture use intuitive like direct physical manipulation, but the gesture’s effect can be applied to any object the user looks at - whether located near or far. In this paper, we describe novel interaction concepts and an experimental system prototype that bring together interaction technique variants, menu interfaces, and applications into one unified virtual experience. Proof-of-concept application examples were developed and informally tested, such as 3D manipulation, scene navigation, and image zooming, illustrating a range of advanced interaction capabilities on targets at any distance, without relying on extra controller devices.

Item Type:
Contribution in Book/Report/Proceedings
Additional Information:
Publisher Copyright: © 2017 Association for Computing Machinery. Copyright: Copyright 2017 Elsevier B.V., All rights reserved.
Uncontrolled Keywords:
?? eye trackingfreehand gesturegazeinteraction techniquemenumultimodal interfacepinchvirtual realityhuman-computer interaction ??
ID Code:
Deposited By:
Deposited On:
29 Jun 2021 14:10
Last Modified:
16 Jul 2024 05:03