New Software Converts 360 Videos Into 3D Models

Maxime Lhuillier demonstrated a technology that is capable of creating a 3D model of a space from a 360 video taken by a simple camera.

Maxime Lhuillier from CNRS/Institut Pascal/UCA demonstrated a technology that is capable of creating a 3D model of a space from a 360 video taken by a simple camera. Sounds crazy, right?

The process is very simple. Maxime Lhuillier used a Garmin Virb 360 camera to record a 360 video.  Then, the software generated a 3D model of a space as complex as a forest using that recording. Yes, the image quality is poor compared to results given by professional cameras. What is more, backlit portions of the videos have less visible detail after image compression. Still, just think about converting a 360 video into a 3D model with a simple laptop!

There are several limitations, though. A scene should be static with sufficient texture and light. Also, the camera motion must be slow enough and you should walk slowly. The idea here is not to get a perfect 3D scene, but to visualize a space using consumer cameras.

Check out these two models generated from videos taken by a 360 camera rig consisting of four helmet-mounted Gopro Hero 3 cameras recording video at 100 fps with frame-accurate synchronization:

Forest, helmet-held 360 camera by Maxime Lhuillier on Sketchfab

2.5km street, helmet-held 360 camera by Maxime Lhuillier on Sketchfab

The software and method are still in the works and the team is working hard to improve the results. You cannot try the software for yourself right now, so stay tuned for more details!

Join discussion

Comments 1

  • MeFeu

    That's basically what you can already do with photogrammetry. Just export your video into one file per frames, make photogrammetry out of it, and voilà. Nothing groundbreaking imo.

    0

    MeFeu

    ·6 years ago·

You might also like

We need your consent

We use cookies on this website to make your browsing experience better. By using the site you agree to our use of cookies.Learn more