Meta Quest Pro Got Body, Face & Eye Tracking APIs

But it seems the Body Tracking API provides just a "simulated upper-body skeleton."

Meta has released a Body Tracking API for its Quest and Quest Pro as part of the Movement SDK, including eye and face tracking for the latter. However, it seems that legs are still not included in Body Tracking and the image shared by Oculus on Twitter is not exactly what the company offers right now.

A Meta spokesperson confirmed to UploadVR that the Body Tracking API provides a "simulated upper-body skeleton" based on your head and hand positions. So it's not exactly tracking, and it doesn’t include the legs. "Body poses are tracked as an abstract series of points which the Body Tracking API maps onto a set of body joints for a humanoid character rig," states the API description. The spokesperson also described the Body Tracking technology as a combination of inverse kinematics (IK) and machine learning (ML).

At the same time, Eye Tracking API does detect eye movement, and Face Tracking API does provide facial movements facial muscles movements, relying on Quest Pro's inward-facing cameras.

Earlier, Meta introduced a framework capable of creating full-body avatars for VR and even teased legs coming to Horizon Worlds, so we will probably see the tech in the Body Tracking API in the future.

Check out the Movement SDK for Unity here and don't forget to join our Reddit page and our Telegram channel, follow us on Instagram and Twitter, where we share breakdowns, the latest news, awesome artworks, and more. 

Join discussion

Comments 0

    You might also like

    We need your consent

    We use cookies on this website to make your browsing experience better. By using the site you agree to our use of cookies.Learn more