logo80lv
Articlesclick_arrow
Research
Talentsclick_arrow
Events
Workshops
Aboutclick_arrow
profile_loginLogIn

GAN-Based Approach to Disentangle Effects in Time-Lapses

The AI can help you control conditions to make the time-lapse smoother.

Researchers together with NVIDIA presented a GAN-based approach that introduces disentangling time-lapse sequences in a way that allows separate, after-the-fact control of overall effects, like weather, cyclic effects, or any other that can destroy the fluidity of a time-lapse.

The model enables re-rendering the sequences in ways that would not be possible with the input images alone. It can stabilize a long sequence to focus on an object under selectable, consistent weather.

The GANs (Generative Adversarial Networks) are conditioned by the time coordinate of the time-lapse sequence. 

"Our architecture and training procedure are designed so that the networks learn to model random variations, such as weather, using the GAN's latent space, and to disentangle overall trends and cyclic variations by feeding the conditioning time label to the model using Fourier features with specific frequencies."

The approach can amend some of the practical difficulties in capturing long time-lapse sequences, such as temporary occlusions, uneven frame spacing, and missing frames.

Simply put, it allows creating time-lapses in particular conditions without flicker due to random effects, such as weather, as well as cyclic effects, such as the day-night cycle.

You can check out the research and the code on GitHub. Also, don't forget to join our new Reddit pageour new Telegram channel, follow us on Instagram and Twitter, where we are sharing breakdowns, the latest news, awesome artworks, and more.

20 Ropes Curve Brushes all contained within one Multi-mesh brush and Low poly meshes.

Error
(2000-0001)

Join discussion

Comments 0

    You might also like

    A Week After "Basically Announcing" Minecraft 2, Notch Basically Cancels It

    Instead, he and his team will focus on the previously-announced retro-style roguelike.

    Rumor: Possible Release Date for Grand Theft Auto 6 Revealed

    A video game store from Uruguay appears to have disclosed the launch date for the gaming industry's most anticipated title.

    Breaking: Unity Suddenly Lays Off Numerous Developers With a 5 AM Email

    Apparently, the entire Unity Behavior team was cut, alongside many other employees.
    • Dragon VDM Brush Part 2
      by Nicolas Swijngedau

      Perfect to speed up your dragon creation! Get your horns, scales and spikes while they are flaming hot!

      Error
      (2000-0001)
    • 300+ Hard Surface Alphas
      by Mels Mneyan

      Error
      (2000-0001)

    We need your consent

    We use cookies on this website to make your browsing experience better. By using the site you agree to our use of cookies.Learn more

    ×