Abstract:
AR-Mentor is a wearable real time Augmented Reality (AR) mentoring system
that is configured to assist in maintenance and repair tasks of complex
machinery, such as vehicles, appliances, and industrial machinery. The system
combines a wearable Optical-See-Through (OST) display device with high
precision 6-Degree-Of-Freedom (DOF) pose tracking and a virtual personal
assistant (VPA) with natural language, verbal conversational interaction,
providing guidance to the user in the form of visual, audio and locational
cues. The system is designed to be heads-up and hands-free allowing the user
to freely move about the maintenance or training environment and receive
globally aligned and context aware visual and audio instructions (animations,
symbolic icons, text, multimedia content, speech). The user can interact with
the system, ask questions and get clarifications and specific guidance for
the task at hand. A pilot application with AR-Mentor was successfully
developed to instruct a novice to perform an advanced 33-step maintenance
task on a training vehicle. The initial live training tests demonstrate that
AR-Mentor is able to help and serve as an assistant to an instructor, freeing
him or her to cover more students and to focus on higher-order teaching.