The WizARd and Apprentice: An Augmented Reality Expert Capture System
Ada Yi Zhao, Suibi Che-Chuan Weng, Ella Grace Finstuen, Haifeng Chen, Lu-An Tang, Kai Ishikawa, Ellen Yi-Luen Do
23rd IEEE International Symposium on Mixed and Augmented Reality (ISMAR '24 Adjunct)
Abstract
Learning to perform physical tasks is ubiquitous yet challenging without expert guidance. While Augmented Reality (AR) has been adopted to overlay instructions directly onto the physical context, the natural authoring of such content remains unexplored. To address this, we developed WizARd and Apprentice, an AR expert capture system for training novices using an AR headset. WizARd and Apprentice tracks and records expert demonstrations and moving objects, leveraging the natural synchronization of speech and action to identify key steps and automatically create spatial markers.