ABSTRACT

This chapter describes the proposed implementation of an augmented musical reality system that will help increase comradery through musical interaction, with a focus on comradery between people who are separated geographically and who hold different political, social, and financial backgrounds. As stated, this will be done by introducing smart connected pianos to urban and suburban environments allowing residence to play music with each other even if they are in different communities. The pianos will be outfitted with persistent real-time audio, visual, and haptic feedback via remotely actuated keys. Emotions are expressed through music via many different musical features, and many studies focused on music emotion recognition have shown good progress. The chapter hypothesizes that the correctness of the audio and visual feedback will improve the seamlessness of interaction between users at each piano location. To achieve persistent real-time low-latency communication we will borrow from our prior work in cloud-robotics.