DLSS 2.0 – Image Reconstruction for Real-Time Rendering with Deep learning

Game Developers Conference 2020, GPU Technology Conference 2020

In this talk, Edward Liu from NVIDIA Applied Deep Learning Research delves into the latest research progress on Deep Learning Super Sampling (DLSS), which uses deep learning and the NVIDIA Tensor Cores to reconstruct super sampled frames in real time. He discusses and demonstrates why scaling and image reconstruction for real-time rendering is an extremely challenging problem, and examines the cause of common artifacts produced by traditional up-sampling techniques. With this background, Edward then shows how the DLSS, deep learning-based reconstruction algorithm, achieves better image quality with less input samples than traditional techniques. The talk concludes with a walkthrough of DLSS integration in Unreal Engine 4 (UE4).

Video Recording, Slides


Low Sample Count Ray Tracing with NVIDIA’s Ray Tracing Denoisers

SIGGRAPH 2018

In this session, Edward Liu from NVIDIA will demonstrate how state of the art denoising technologies provided in the Gameworks Ray Tracing module will make 1 sample per pixel ray tracing practical in many scenarios in real-time rendering, including area light shadows, ambient occlusion, glossy reflections and even indirect diffuse global illumination. Edward will show that one sample per pixel ray tracing with denoising can achieve much improved realism and fidelity when compared with traditional real-time rendering techniques. These denoisers have been successfully used in all the UE4 based cinematic real-time ray tracing demos released in 2018, including Star Wars Reflections, Porsche 70th anniversary trailer The Speed of Light, Turing architecture launch Project SOL and a few others.

Video Recording


Ray Tracing in Games with NVIDIA RTX

Game Developers Conference 2018

NVIDIA will show how RTX, DXR along with GameWorks, Ray Tracing can revolutionize gaming by significantly boosting the real-time rendering quality as well as accelerating the content creating process.In particular, NVIDIA will show state of the art real-time denoising technologies from GameWorks that will drastically bring down the cost of ray traced rendering of area light soft shadows, ambient occlusions, and glossy reflections so they become practical for real-time rendering. In addition NVIDIA will showcase how RTX and DXR can be used to conveniently implement offline light transport algorithms like path tracing in your game engine, and show the power of that for content creation process. Finally NVIDIA will also provide some tips and guideline for integrating DXR into your engine, and discuss open challenges.

Video Recording, Demo Video


Cinematic Lighting in Unreal Engine

GPU Technology Conference 2018

Join Epic’s Kim Libreri and Marcus Wassmer along with NVIDIA’s Ignacio Llamas and Edward Liu as they provide an in-depth view of the creative and technical aspects of creating photo-realistic cinematic content that runs at real time.

Peek into the future of real-time computer graphics with “Reflections,” the first demonstration of real-time raytracing in Unreal Engine 4 using Microsoft’s new DXR framework and NVIDIA RTX technology for Volta GPUs. The Reflections demo illustrates the next-gen experimental lighting and rendering techniques in Unreal Engine, developed in collaboration with NVIDIA and ILMxLAB.

Demo Video


Accelerating your VR Games with VRWorks

Game Developers Conference 2017 and GPU Technology Conference 2017

Across graphics, audio, video, and physics, the NVIDIA VRWorks suite of technologies helps developers maximize performance and immersion for VR games and applications. This talk will explore the latest features of VRWorks, explain the VR-specific challenges they address, and provide application-level tips and tricks to take full advantage of these features. Special focus will be given to the details and inner workings of our latest VRWorks feature, Lens Matched Shading, along with the latest VRWorks integrations into Unreal Engine and Unity.

Takeaway: Attendees will gain an understanding of the unique challenges of real-time VR gaming and insight into the VRWorks suite of technologies.

Video Recording, Slides


High-Performance, Low-Overhead Rendering with OpenGL and Vulkan

GPU Technology Conference 2016

As advanced games and applications continue to push the performance envelope, developers look to their 3D APIs for improved predictability, threading and reduced CPU load. New extensions to OpenGL and a totally new 3D API Vulkan are answering these requests directly. This session introduces and details both of these approaches a shows how applications can use OpenGL “AZDO” (Approaching Zero Driver Overhead) extensions like NVIDIA’s Command Lists to greatly reduce single-threaded CPU overhead while reusing existing OpenGL code. Going further, the second section introduces the new 3D API from Khronos called Vulkan. Finally, there is a discussion of the tradeoffs of extended OpenGL and AZDO versus Vulkan, and how a developer might choose between them.

Video Recording, Slides