Generalizing wave gestures from sparse examples for real-time character control

Rhodin, Helge and Tompkin, James and Kim, Kwang In and de Aguiar, Edilson and Pfister, Hanspeter and Seidel, Hans-Peter and Theobalt, Christian (2015) Generalizing wave gestures from sparse examples for real-time character control. ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 34 (6). ISSN 0730-0301

[thumbnail of Rhodin_GeneralizingWaveGestures_SIGAsia2015]
PDF (Rhodin_GeneralizingWaveGestures_SIGAsia2015)
Rhodin_GeneralizingWaveGestures_SIGAsia2015.pdf - Accepted Version

Download (8MB)


Motion-tracked real-time character control is important for games and VR, but current solutions are limited: retargeting is hard for non-human characters, with locomotion bound to the sensing volume; and pose mappings are ambiguous and not robust with consumer trackers, with dynamic motion properties unwieldy. We robustly estimate wave properties — amplitude, frequency, and phase — for a set of interactively-defined gestures, by mapping user motions to a low-dimensional independent representation. The mapping both separates simultaneous or intersecting gestures, and extrapolates gesture variations from single training examples. For animation control, e.g., locomotion, wave properties map naturally to stride length, step frequency, and progression, and allow smooth animation from standing, to walking, to running. Simultaneous gestures are disambiguated successfully. Interpolating out-of-phase locomotions is hard, e.g., quadruped legs between walks and runs, so we introduce a new time-interpolation scheme to reduce artifacts. These improvements to real-time motion-tracked character control are particularly important for common cyclic animations, which we validate in a user study, with versatility to apply to part and full body motions across a variety of sensors.

Item Type:
Journal Article
Journal or Publication Title:
ACM Transactions on Graphics (Proc. SIGGRAPH Asia)
Additional Information:
Date of Acceptance: 31/08/2015
Uncontrolled Keywords:
ID Code:
Deposited By:
Deposited On:
27 Oct 2015 15:36
Last Modified:
18 Sep 2023 00:55