This AR App For Oculus Quest Will Teach You Piano

Dominik Hackl is getting ready to launch the first playable demo of the app called Magic Keys for Oculus Quest.

Recently, Facebook allowed developers to use cameras in Oculus Quest to create AR apps, and here's a great example of how you can use this ability. Magic Keys is an Augmented Reality/Mixed Reality app for Oculus Quest that can teach you simple piano pieces and techniques within just minutes in a way similar to Guitar Hero games. Basically, you can play simple pieces even if you don't have any prior practice or experience.

"I started working on this project about two years ago, initially intended to be a small AR app running on a tablet," wrote
Dominik Hackl. "After it turned out that it could be of actual use, I ported the application to the HoloLens alongside with some major improvements. I continued to add features and tried to enhance the visualization of the music but I was greatly limited by the small field-of-view of the HoloLens."

Then in early 2019, the developer started using Magic Leap One which allowed adding new features, including in-app feedback on note hits or misses (using MIDI input and output). In 2021, Oculus Quest released its Passthrough API, which allowed the developer to continue the project.

Hackl noted that his ultimate goal is to "develop a fully-featured Virtual Piano Teacher." Learn more about the project here.

Also, don't forget to join our new Reddit page, our new Telegram channel, follow us on Instagram and Twitter, where we are sharing breakdowns, the latest news, awesome artworks, and more.

This AR App For Oculus Quest Will Teach You Piano

Join discussion

Comments 0

You might also like

We need your consent