Learn To Draw On Paper In Mixed Reality With This Meta Quest 3 App

VR Software Developer Stephen Rogers has presented Pencil, this year's Meta Presence Platform Hackathon winner, a Meta Quest 3 app for drawing in mixed reality on real paper with step-by-step art lessons and pose references.

Pencil is the winner of the Meta Presence Platform Hackathon 2024, a mixed reality educational app for Meta Quest 3 that teaches you how to draw on real paper, presented by Stephen Rogers and his teammates Bill Ramsour, Gabriel Williams, and Ian MacKenzie.

In Pencil, you'll be drawing on top of real paper following step-by-step instructions, building your own reference scenes and poses, or drawing in free mode.

Here are the app's key features:

  • Multi-modal input is used to track the position/rotation of the paper, while the other controller is a virtual camera
  • Voice SDK: text-to-speech narration & voice commands
  • Body API: strike a pose to draw whatever form you want
  • Depth API: hand occlusion

Image Credits: Pencil

Image Credits: Pencil

If you own a Meta Quest 3 and are interested in trying out this curious project, join the dedicated Discord channel where the app demo will be shared shortly.

Join the Pencil Discord here. Also, join our 80 Level Talent platform and our Telegram channel, follow us on InstagramTwitter, and LinkedIn, where we share breakdowns, the latest news, awesome artworks, and more.

Join discussion

Comments 0

    You might also like

    We need your consent

    We use cookies on this website to make your browsing experience better. By using the site you agree to our use of cookies.Learn more