New Software Converts 360 Videos Into 3D Models
Subscribe:  iCal  |  Google Calendar
7, Mar — 1, Jun
York US   26, Mar — 29, Mar
Boston US   28, Mar — 1, Apr
Anaheim US   29, Mar — 1, Apr
RALEIGH US   30, Mar — 1, Apr
Latest comments

Those animations look amazing!! Great job!

Very cool review of the making of Spellbreak. Would be even more cool to see some videos inside UE4 showing how they do a few very specific things unique to them.

This was so helpful for me. I'm hoping to adapt your tutorial to pull off something similar comparing modern satellite imagery with historical maps. No topo, so my steps should be simpler, but I'm a novice with Blender and you've really helped. Thanks!

New Software Converts 360 Videos Into 3D Models
19 November, 2017

Maxime Lhuillier from CNRS/Institut Pascal/UCA demonstrated a technology that is capable of creating a 3D model of a space from a 360 video taken by a simple camera. Sounds crazy, right?

The process is very simple. Maxime Lhuillier used a Garmin Virb 360 camera to record a 360 video.  Then, the software generated a 3D model of a space as complex as a forest using that recording. Yes, the image quality is poor compared to results given by professional cameras. What is more, backlit portions of the videos have less visible detail after image compression. Still, just think about converting a 360 video into a 3D model with a simple laptop!

There are several limitations, though. A scene should be static with sufficient texture and light. Also, the camera motion must be slow enough and you should walk slowly. The idea here is not to get a perfect 3D scene, but to visualize a space using consumer cameras.

Check out these two models generated from videos taken by a 360 camera rig consisting of four helmet-mounted Gopro Hero 3 cameras recording video at 100 fps with frame-accurate synchronization:

The software and method are still in the works and the team is working hard to improve the results. You cannot try the software for yourself right now, so stay tuned for more details!


Leave a Reply

1 Comment threads
0 Thread replies
Most reacted comment
Hottest comment thread
1 Comment authors
MeFeu Recent comment authors

That’s basically what you can already do with photogrammetry. Just export your video into one file per frames, make photogrammetry out of it, and voilà. Nothing groundbreaking imo.