Denoising with Kernel Prediction and Asymmetric Loss Functions

Denoising with Kernel Prediction and Asymmetric Loss Functions

Check out a new paper from the Disney’s research team that introduces a modular convolutional architecture for denoising rendered images.

Check out a new paper from the Disney’s research team that introduces a modular convolutional architecture for denoising rendered images. The new method suggests mixing kernel-predicting networks with a number of task-specific modules and optimizing the assembly using an asymmetric loss. The team states that this new approach provides much better results. 

We present a modular convolutional architecture for denoising rendered images. We expand on the capabilities of kernel-predicting networks by combining them with a number of task-specific modules, and optimizing the assembly using an asymmetric loss. The source-aware encoder—the first module in the assembly—extracts low-level features and embeds them into a common feature space, enabling quick adaptation of a trained network to novel data. The spatial and temporal modules extract abstract, high-level features for kernel-based reconstruction, which is performed at three different spatial scales to reduce low-frequency artifacts. The complete network is trained using a class of asymmetric loss functions that are designed to preserve details and provide the user with a direct control over the variancebias trade-off during inference. We also propose an error-predicting module for inferring reconstruction error maps that can be used to drive adaptive sampling. Finally, we present a theoretical analysis of convergence rates of kernel-predicting architectures, shedding light on why kernel prediction performs better than synthesizing the colors directly, complementing the empirical evidence presented in this and previous works. We demonstrate that our networks attain results that compare favorably to state-of-the-art methods in terms of detail preservation, low-frequency noise removal, and temporal stability on a variety of production and academic datasets.

Disney 

You can get more details by following this link (full paper) or attending this year’s SIGGRAPH. 

Join discussion

Comments 0

    You might also like

    We need your consent

    We use cookies on this website to make your browsing experience better. By using the site you agree to our use of cookies.Learn more