Scale Impacts Elicited Gestures for Manipulating Holograms: Implications for AR Gesture Design

Tran Pham , Jo Vermeulen , Anthony Tang , Lindsay MacDonald Vermeulen

dis-2018-pham.pdf

Abstract

Because gesture design for augmented reality (AR) remains idiosyncratic, people cannot necessarily use gestures learned in one AR application in another. To design discoverable gestures, we need to understand what gestures people expect to use. We explore how the scale of AR affects the gestures people expect to use to interact with 3D holograms. Using an elicitation study, we asked participants to generate gestures in response to holographic task referents, where we varied the scale of holograms from desktop-scale to room-scale objects. We found that the scale of objects and scenes in the AR experience moderates the generated gestures. Most gestures were informed by physical interaction, and when people interacted from a distance, they sought a good perspective on the target object before and during the interaction. These results suggest that gesture designers need to account for scale, and should not simply reuse gestures across different hologram sizes.

Keywords:  Augmented RealityGesturesGesture ElicitationHololens

Reference

Tran Pham, Jo Vermeulen, Anthony Tang, Lindsay MacDonald VermeulenScale Impacts Elicited Gestures for Manipulating Holograms: Implications for AR Gesture DesignIn Proceedings of the ACM on Designing Interactive Systems Conference (DIS '18)ACM, New York, NY, USA  Page: 1-14.  DOI: https://doi.org/10.1145/3196709.3196719