Visual Cues in Augmented Reality Piano Playing

Abstract

We present an augmented reality (AR) piano-playing system investigating the effectiveness of three visual cue strategies for guided key-press interaction. Using a within-subjects design, we evaluated reaction time, error rate, mental workload, and system usability. Although key-pressing performance yielded no statistically significant differences, descriptive trends and qualitative feedback indicate that complex multi-target visual cues impose higher cognitive demand. Spatial alignment limitations further impacted accuracy, highlighting the necessity of high-precision tracking and contextual visual aids for AR instrument learning.