Three-point interaction:combining bi-manual direct touch with gaze

Simeone, Adalberto L. and Bulling, Andreas and Alexander, Jason and Gellersen, Hans (2016) Three-point interaction:combining bi-manual direct touch with gaze. In: AVI '16 Proceedings of the International Working Conference on Advanced Visual Interfaces. ACM, New York, pp. 168-175. ISBN 9781450341318

PDF (AVI2016_3Point_Interaction)
AVI2016_2.pdf - Accepted Version
Available under License None.

Download (509kB)


The benefits of two-point interaction for tasks that require users to simultaneously manipulate multiple entities or dimensions are widely known. Two-point interaction has become common, e.g., when zooming or pinching using two fingers on a smartphone. We propose a novel interaction technique that implements three-point interaction by augmenting two-finger direct touch with gaze as a third input channel. We evaluate two key characteristics of our technique in two multi-participant user studies. In the first, we used the technique for object selection. In the second, we evaluate it in a 3D matching task that requires simultaneous continuous input from fingers and the eyes. Our results show that in both cases participants learned to interact with three input channels without cognitive or mental overload. Participants' performance tended towards fast selection times in the first study and exhibited parallel interaction in the second. These results are promising and show that there is scope for additional input channels beyond two-point interaction.

Item Type:
Contribution in Book/Report/Proceedings
Additional Information:
© 2016 Copyright held by the owner/author(s). Publication rights licensed to ACM. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in AVI '16 Proceedings of the International Working Conference on Advanced Visual Interfaces
ID Code:
Deposited By:
Deposited On:
01 Jun 2016 15:26
Last Modified:
15 Sep 2023 01:55