Pencil is the winner of the Meta Presence Platform Hackathon 2024, a mixed reality educational app for Meta Quest 3 that teaches you how to draw on real paper, presented by Stephen Rogers and his teammates Bill Ramsour, Gabriel Williams, and Ian MacKenzie.
In Pencil, you'll be drawing on top of real paper following step-by-step instructions, building your own reference scenes and poses, or drawing in free mode.
Here are the app's key features:
- Multi-modal input is used to track the position/rotation of the paper, while the other controller is a virtual camera
- Voice SDK: text-to-speech narration & voice commands
- Body API: strike a pose to draw whatever form you want
- Depth API: hand occlusion