Global Illumination for AR on NVIDIA Shield

Global Illumination for AR on NVIDIA Shield

ObjectiveDevelopment of a Photorealistic AR system which supports global illumination effects in dynamic environments.
DescriptionRealistic light interaction between real and virtual objects is a key factor for photorealistic Augmented Reality (AR). Previous work [1] creates photorealistic AR renderings but is restricted to static scene geometry(left image). The goal of this AR project is building a system which computes global illumination rendering effects for unprepared and dynamic geometry based on modern real-time reconstruction algorithms [2] (right image).



The objective of this project is to port an existing desktop GPU system for AR rendering to the new NVIDIA Shield tablet. Motivated students should be interested in Augmented Reality and GPU (CUDA) programming. Knowledge in computer graphics and programming skills in C++ are required. F


[1] P. Kan and H. Kaufmann, “High-quality reflections, refractions, and caustics in Augmented Reality and their contribution to visual coherence,” in 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Nov., pp. 99–108. 
[2] R. A. Newcombe, S. Izadi, O. Hilliges, D. Molyneaux, D. Kim, A. J. Davison, P. Kohli, J. Shotton, S. Hodges, and A. Fitzgibbon, “KinectFusion: Real-time dense surface mapping and tracking,” 2011.

TeamComputer Graphics
ContactSteinberger Markus
Offered asMaster's thesis