LogInThe AI for the tool has been trained on an Amateur Drawings Dataset, built by the team.
The Meta AI Research team has released Animated Drawings, a cool AI-powered tool that will let you animate simple and non-realistic drawings and doodles.
First unveiled back in 2021 as a demo, the tool utilizes an Amateur Drawings Dataset, built by the team using the results provided by the users of its demo version, enabling one to make almost any child-drawn character move, dance, perform various activities, and more. Additionally, the system incorporates repurposed computer vision models trained on photographs of real-world objects.
"We structured the task of generating an animation from a single drawing of a figure as a series of subtasks: human figure detection, segmentation, pose estimation, and animation," commented the team. "After someone uses our demo to upload a drawing, they have the option to adjust the detected bounding box, segmentation mask, and joint locations, and choose an action to animate.
Our system incorporates repurposed computer vision models trained on photographs of real-world objects. Because the domain of drawings, including that of children, is significantly different in appearance, we fine-tune the models using the Amateur Drawings Dataset.
With this dataset and animation code, we believe that the domain of amateur drawings can inspire a new generation of creators with its expressive and accessible possibilities. We hope they will be an asset to other researchers interested in exploring potential applications for their work."
Additionally, the team has released a large dataset of around 180,000 annotated amateur drawings to "help other AI researchers and creators to innovate further". You can learn more about Animated Drawings here and try it yourself over here.
Also, don't forget to join our 80 Level Talent platform and our Telegram channel, follow us on Instagram and Twitter, where we share breakdowns, the latest news, awesome artworks, and more.