Motion Correlation: Selecting Objects by Matching Their Movement : Selecting Objects by Matching Their Movement

Velloso, Eduardo and Carter, Marcus and Newn, Joshua and Abreu Esteves, Augusto Emanuel and Clarke, Christopher and Gellersen, Hans-Werner Georg (2017) Motion Correlation: Selecting Objects by Matching Their Movement : Selecting Objects by Matching Their Movement. ACM Transactions on Computer-Human Interaction (TOCHI), 24 (3): 22. ISSN 1073-0516

[thumbnail of MotionCorrelation]
PDF (MotionCorrelation)
0_Master_Document.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.

Download (8MB)


Selection is a canonical task in user interfaces, commonly supported by presenting objects for acquisition by pointing. In this article, we consider motion correlation as an alternative for selection. The principle is to represent available objects by motion in the interface, have users identify a target by mimicking its specific motion, and use the correlation between the system’s output with the user’s input to determine the selection. The resulting interaction has compelling properties, as users are guided by motion feedback, and only need to copy a presented motion. Motion correlation has been explored in earlier work but only recently begun to feature in holistic interface designs. We provide a first comprehensive review of the principle, and present an analysis of five previously published works, in which motion correlation underpinned the design of novel gaze and gesture interfaces for diverse application contexts. We derive guidelines for motion correlation algorithms, motion feedback, choice of modalities, overall design of motion correlation interfaces, and identify opportunities and challenges identified for future research and design.

Item Type:
Journal Article
Journal or Publication Title:
ACM Transactions on Computer-Human Interaction (TOCHI)
Additional Information:
c 2017 ACM This is the author’s version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in ACM Transactions on Computer-Human Interaction, 24, 3 2017
Uncontrolled Keywords:
?? human-computer interaction ??
ID Code:
Deposited By:
Deposited On:
16 Oct 2017 15:44
Last Modified:
12 Apr 2024 00:28