logo80lv
Articlesclick_arrow
Research
Talentsclick_arrow
Events
Workshops
Aboutclick_arrow
profile_loginLogIn

A Novel Neural Relighting Approach for Rendering Hand Models

The method enables the team to render high-fidelity personalized hands that can be animated in real-time under novel illumination.

A team of researchers from Meta's Reality Labs Research has presented RelightableHands, a new neural relighting approach for rendering high-fidelity personalized hands that can be animated in real-time under novel illumination.

Leveraging the teacher-student framework, with the teacher learning appearance under a single point light from images captured in a light-stage, allowing the team to synthesize hands in arbitrary illuminations albeit with heavy computing, and the student model using the teacher model as training data and directly predicting appearance under natural illuminations in real-time, the team was able to outperform expectations and achieve photo-realistic relighting of two interacting hands at real-time speeds.

"Our approach adopts a teacher-student framework, where the teacher learns appearance under a single point light from images captured in a light-stage, allowing us to synthesize hands in arbitrary illuminations but with heavy compute. Using images rendered by the teacher model as training data, an efficient student model directly predicts appearance under natural illuminations in real-time," writes the team. "To achieve generalization, we condition the student model with physics-inspired illumination features such as visibility, diffuse shading, and specular reflections computed on a coarse proxy geometry, maintaining a small computational overhead. Our key insight is that these features have strong correlation with subsequent global light transport effects, which proves sufficient as conditioning data for the neural relighting network."

You can read the original research paper here. And don't forget to join our 80 Level Talent platformour Reddit page, and our Telegram channel, follow us on Instagram and Twitter, where we share breakdowns, the latest news, awesome artworks, and more.

20 Ropes Curve Brushes all contained within one Multi-mesh brush and Low poly meshes.

Error
(2000-0001)

Join discussion

Comments 0

    You might also like

    A Week After "Basically Announcing" Minecraft 2, Notch Basically Cancels It

    Instead, he and his team will focus on the previously-announced retro-style roguelike.

    Rumor: Possible Release Date for Grand Theft Auto 6 Revealed

    A video game store from Uruguay appears to have disclosed the launch date for the gaming industry's most anticipated title.

    Breaking: Unity Suddenly Lays Off Numerous Developers With a 5 AM Email

    Apparently, the entire Unity Behavior team was cut, alongside many other employees.
    • Filther for Substance
      by Ronan Mahon

      Add fully procedural dirt and filth to any material for a fast and beautiful result that is easily customised.

      Error
      (2000-0001)
    • Insectoid Creature Brush mega Pack
      by Nicolas Swijngedau

      80 insectoid creature mega pack to create a variety of insects and alien creatures in the blink of an eye! Mandibles, horns, limbs, and all the little bits to bring your bugs to life! Just load the brushes, drag them into your scene and you're ready to go!

      Error
      (2000-0001)

    We need your consent

    We use cookies on this website to make your browsing experience better. By using the site you agree to our use of cookies.Learn more

    ×