Abstract

This thesis explores novel uses of physicality and cross-device interaction with augmented reality through three different research prototypes. (1) Augmented Math leverages the physical world as a basis for generating augmentations through an AI-assisted method that allows educators to create interactive math content from static diagrams. (2) HoloTouch enables users to physically interact with holograms by repurposing personal devices like smartphones as tangible input tools. (3) HoloDevice explores how AR can transform remote collaboration by simulating co-located interactions through holographic representations of users and their devices. These systems were developed through iterative prototyping, collaborative design discussions, user studies, and interviews. Together, they demonstrate how novel interaction techniques grounded in physical and cross-device affordances can enhance usability and engagement in AR environments.

Reference