The system takes predicted 3D landmarks and calculates simple Euler rotations and blendshape face values.
Kalidokit is a blendshape and kinematics solver for Mediapipe/Tensorflow.js face, eyes, pose, and hand tracking models, that is compatible with Facemesh, Blazepose, Handpose, and Holistic. The developer of the solution noted it takes predicted 3D landmarks and calculates simple Euler rotations and blendshape face values.
The open-source solver was designed specifically for rigging 3D VRM models and Live2D avatars. You can find the code on GitHub here or follow the developer on Twitter.
There's also a free web-based version available if you want to test the system. You can find it here. Don't forget to join our new Reddit page, our new Telegram channel, follow us on Instagram and Twitter, where we are sharing breakdowns, the latest news, awesome artworks, and more.