Here's the next big thing for Instagram and Facebook.
You've probably already heard about Nerfies. The tech, being developed by the University of Washington and the Google Research team, is based on NeRF (Neural Radiance Field) which allows users to take 3D selfies. Users are offered to record a video from as many angles as possible and then this recording is turned into an image that you can explore just like a 3D scene. Basically, this is the next big Instagram and Facebook update.
"Our approach augments neural radiance fields (NeRF) by optimizing an additional continuous volumetric deformation field that warps each observed point into a canonical 5D NeRF," wrote the team. "We observe that these NeRF-like deformation fields are prone to local minima, and propose a coarse-to-fine optimization method for coordinate-based models that allows for more robust optimization."
Check out a quick overview below:
The tech has been in development for a long time now, but the latest results appear to be quite impressive. You can learn more about the tech and get started on GitHub.