Mesoscopic Facial Geometry Inference Using Deep Neural Networks
Events
Subscribe:  iCal  |  Google Calendar
Moscow RU   16, Oct — 18, Oct
Helsinki FI   17, Oct — 25, Oct
Minsk BY   17, Oct — 19, Oct
London GB   22, Oct — 23, Oct
Singapore SG   23, Oct — 25, Oct
Latest comments

bad management, its your job for stuff like that not to happen, dont put that extra weight on artist because management didn't do your job

by Robert Gardner
3 hours ago

It really is the best game of 2018, Thank you.

"We're saddened if any former members of any studio did not find their time here enjoyable or creatively fulfilling and wish them well with finding an environment more suitable to their temperaments and needs…" Or : We're saddened if any former members of our studio are not happy to have been exploited to enrich us. Awesome !!!! Ok, guys… you have lost one customer !

Mesoscopic Facial Geometry Inference Using Deep Neural Networks
22 June, 2018
News

Take a look at a novel approach to synthesizing facial geometry proposed by researchers from USC Institute for Creative Technologies, University of Southern California, Google, and Pinscreen. The paper studies a learning-based approach for synthesizing facial geometry at medium and fine scales from diffusely-lit facial texture maps. The thing is that the new approach manages to deal with interpreting dark features as concavities such as at moles, hair stubble, and occluded pores.

Abstract

We present a learning-based approach for synthesizing facial geometry at medium and fine scales from diffusely-lit facial texture maps. When applied to an image sequence, the synthesized detail is temporally coherent. Unlike current state-of-the-art methods, which assume ”dark is deep”, our model is trained with measured facial detail collected using polarized gradient illumination in a Light Stage. This enables us to produce plausible facial detail across the entire face, including where previous approaches may incorrectly interpret dark features as concavities such as at moles, hair stubble, and occluded pores. Instead of directly inferring 3D geometry, we propose to encode fine details in high-resolution displacement maps which are learned through a hybrid network adopting the state-of-the-art image-to-image translation network and super-resolution network. To effectively capture geometric detail at both mid- and high frequencies, we factorize the learning into two separate sub-networks, enabling the full range of facial detail to be modeled. Results from our learning-based approach compare favorably with a high-quality active facial scanning technique and require only a single passive lighting condition without a complex scanning setup.

Are you excited? You can find the full paper and study it here

Comments

Leave a Reply

1 Comment on "Mesoscopic Facial Geometry Inference Using Deep Neural Networks"

avatar
raskolnikov
Guest
raskolnikov

AI applications are only beginning to materialize. It’s so exciting what neural networks will do to art workflows in the coming years.

wpDiscuz