logo80lv
Articlesclick_arrow
Research
Talentsclick_arrow
Events
Workshops
Aboutclick_arrow
profile_loginLogIn

A New Neural Network For Turning Sketches Into Photos

A group of scientists has introduced a new GAN that can turn your sketches into realistic pictures.

Sheng-Yu Wang, David Bau, and Jun-Yan Zhu have shown a new generative adversarial network that can turn a rough sketch of a cat or a horse into a sample that looks like a real photo. Their method takes in one or a few hand-drawn sketches and customizes an off-the-shelf GAN to match the input sketch. The same noise Z is used for the pre-trained and customized models. While their new model changes an object’s shape and pose, other visual cues such as color, texture, background, are faithfully preserved after the modification.

"In this work, we present a method, GAN Sketching, for rewriting GANs with one or more sketches, to make GANs training easier for novice users. In particular, we change the weights of an original GAN model according to user sketches. We encourage the model’s output to match the user sketches through a cross-domain adversarial loss," comments the team. "Furthermore, we explore different regularization methods to preserve the original model's diversity and image quality. Experiments have shown that our method can mold GANs to match shapes and poses specified by sketches while maintaining realism and diversity."

Some examples created by this GAN:

You can learn more here. Also, don't forget to join our new Reddit pageour new Telegram channel, our Discord, follow us on Instagram and Twitter, where we are sharing breakdowns, the latest news, awesome artworks, and more.

10 textile Nanomesh Brushes all contained within one Multi-mesh brush and Low poly meshes.

Error
(2000-0001)

Join discussion

Comments 0

    You might also like

    Rumor: Possible Release Date for Grand Theft Auto 6 Revealed

    A video game store from Uruguay appears to have disclosed the launch date for the gaming industry's most anticipated title.

    Breaking: Unity Suddenly Lays Off Numerous Developers With a 5 AM Email

    Apparently, the entire Unity Behavior team was cut, alongside many other employees.

    EXCLUSIVE: Unity CEO's Internal Announcement to Staff Amidst the Layoffs

    80 Level has obtained the text of the email sent by Matthew Bromberg to Unity employees, announcing the layoffs and shedding light on Unity's strategy going forward.
    • Ornament Trims V1
      by Jonas Ronnegard

      A set of 60 Ornament trim brushes for ZBrush, all brushes use 2048x2048 16-bit alphas, PSD, Tiff, PNG alphas are also included.

      Error
      (2000-0001)
    • Creature Brush Mega Pack
      by Nicolas Swijngedau

      100 creature mega pack to speed up your concept creation, spice up your creature designs and smooth your workflow!

      Error
      (2000-0001)

    We need your consent

    We use cookies on this website to make your browsing experience better. By using the site you agree to our use of cookies.Learn more

    ×