New Software Converts 360 Videos Into 3D Models

Maxime Lhuillier demonstrated a technology that is capable of creating a 3D model of a space from a 360 video taken by a simple camera.

Maxime Lhuillier from CNRS/Institut Pascal/UCA demonstrated a technology that is capable of creating a 3D model of a space from a 360 video taken by a simple camera. Sounds crazy, right?

The process is very simple. Maxime Lhuillier used a Garmin Virb 360 camera to record a 360 video.  Then, the software generated a 3D model of a space as complex as a forest using that recording. Yes, the image quality is poor compared to results given by professional cameras. What is more, backlit portions of the videos have less visible detail after image compression. Still, just think about converting a 360 video into a 3D model with a simple laptop!

There are several limitations, though. A scene should be static with sufficient texture and light. Also, the camera motion must be slow enough and you should walk slowly. The idea here is not to get a perfect 3D scene, but to visualize a space using consumer cameras.

Check out these two models generated from videos taken by a 360 camera rig consisting of four helmet-mounted Gopro Hero 3 cameras recording video at 100 fps with frame-accurate synchronization:

Forest, helmet-held 360 camera by Maxime Lhuillier on Sketchfab

2.5km street, helmet-held 360 camera by Maxime Lhuillier on Sketchfab

The software and method are still in the works and the team is working hard to improve the results. You cannot try the software for yourself right now, so stay tuned for more details!

Published 19 November 2017
Arti Sergeev
Business Head