logo80lv
Articlesclick_arrow
Research
Talentsclick_arrow
Events
Workshops
Aboutclick_arrow
profile_loginLogIn

A Novel Neural Relighting Approach for Rendering Hand Models

The method enables the team to render high-fidelity personalized hands that can be animated in real-time under novel illumination.

A team of researchers from Meta's Reality Labs Research has presented RelightableHands, a new neural relighting approach for rendering high-fidelity personalized hands that can be animated in real-time under novel illumination.

Leveraging the teacher-student framework, with the teacher learning appearance under a single point light from images captured in a light-stage, allowing the team to synthesize hands in arbitrary illuminations albeit with heavy computing, and the student model using the teacher model as training data and directly predicting appearance under natural illuminations in real-time, the team was able to outperform expectations and achieve photo-realistic relighting of two interacting hands at real-time speeds.

"Our approach adopts a teacher-student framework, where the teacher learns appearance under a single point light from images captured in a light-stage, allowing us to synthesize hands in arbitrary illuminations but with heavy compute. Using images rendered by the teacher model as training data, an efficient student model directly predicts appearance under natural illuminations in real-time," writes the team. "To achieve generalization, we condition the student model with physics-inspired illumination features such as visibility, diffuse shading, and specular reflections computed on a coarse proxy geometry, maintaining a small computational overhead. Our key insight is that these features have strong correlation with subsequent global light transport effects, which proves sufficient as conditioning data for the neural relighting network."

You can read the original research paper here. And don't forget to join our 80 Level Talent platformour Reddit page, and our Telegram channel, follow us on Instagram and Twitter, where we share breakdowns, the latest news, awesome artworks, and more.

This project includes assets, maps, materials, Blueprints, and effects created in the Unreal Engine. Each asset was created for realistic AAA quality visuals, style, and budget.

Error
(2000-0001)

Join discussion

Comments 0

    You might also like

    A Week After "Basically Announcing" Minecraft 2, Notch Basically Cancels It

    Instead, he and his team will focus on the previously-announced retro-style roguelike.

    Rumor: Possible Release Date for Grand Theft Auto 6 Revealed

    A video game store from Uruguay appears to have disclosed the launch date for the gaming industry's most anticipated title.

    Breaking: Unity Suddenly Lays Off Numerous Developers With a 5 AM Email

    Apparently, the entire Unity Behavior team was cut, alongside many other employees.
    • Chain Brushes
      by Nicolas Swijngedau

      20 Chains Curve Brushes all contained within one Multi-mesh brush and Low poly meshes.

      Error
      (2000-0001)
    • Camping and Outdoor Props
      by Dekogon

      This project includes assets, maps, materials, Blueprints, and effects created in the Unreal Engine. Each asset was created for realistic AAA quality visuals, style, and budget.

      Error
      (2000-0001)

    We need your consent

    We use cookies on this website to make your browsing experience better. By using the site you agree to our use of cookies.Learn more

    ×