Harris, Daniel and Potts, Dominic and Houben, Steven (2022) User-Elicited Surface and Motion Gestures for Object Manipulation in Mobile Augmented Reality. In: MobileHCI '22: Adjunct Publication of the 24th International Conference on Human-Computer Interaction with Mobile Devices and Services. MobileHCI 2022 Adjunct - Publication of the 24th ACM International Conference on Human-Computer Interaction with Mobile Devices and Services . ACM, New York, 13:1-13:6. ISBN 9781450393416
Full text not available from this repository.Abstract
Recent advancements in mobile and AR technology can facilitate powerful and practical solutions for six degrees of freedom (6DOF) manipulation of 3D objects on mobile devices. However, existing 6DOF manipulation research typically focuses on surface gestures, relying on widgets for modal interaction to segment manipulations and degrees of freedom at the cost of efficiency and intuitiveness. In this paper, we explore a combination of surface and motion gestures to present an implicit modal interaction method for 6DOF manipulation of 3D objects in Mobile Augmented Reality (MAR). We conducted a guessability study that focused on key object manipulations, resulting in a set of user-defined motion and surface gestures. Our results indicate that user-defined gestures both have reasonable degrees of agreement whilst also being easy to use. Additionally, we present a prototype system that makes use of a consensus set of gestures that leverage user mobility for manipulating virtual objects in MAR.