TY - GEN
T1 - Stereoscopic augmented reality with pseudo-realistic global illumination effects
AU - De Sorbier, Francois
AU - Saito, Hideo
PY - 2014/1/1
Y1 - 2014/1/1
N2 - Recently, augmented reality has become very popular and has appeared in our daily life with gaming, guiding systems or mobile phone applications. However, inserting object in such a way their appearance seems natural is still an issue, especially in an unknown environment. This paper presents a framework that demonstrates the capabilities of Kinect for convincing augmented reality in an unknown environment. Rather than pre-computing a reconstruction of the scene like proposed by most of the previous method, we propose a dynamic capture of the scene that allows adapting to live changes of the environment. Our approach, based on the update of an environment map, can also detect the position of the light sources. Combining information from the environment map, the light sources and the camera tracking, we can display virtual objects using stereoscopic devices with global illumination effects such as diffuse and mirror reflections, refractions and shadows in real time.
AB - Recently, augmented reality has become very popular and has appeared in our daily life with gaming, guiding systems or mobile phone applications. However, inserting object in such a way their appearance seems natural is still an issue, especially in an unknown environment. This paper presents a framework that demonstrates the capabilities of Kinect for convincing augmented reality in an unknown environment. Rather than pre-computing a reconstruction of the scene like proposed by most of the previous method, we propose a dynamic capture of the scene that allows adapting to live changes of the environment. Our approach, based on the update of an environment map, can also detect the position of the light sources. Combining information from the environment map, the light sources and the camera tracking, we can display virtual objects using stereoscopic devices with global illumination effects such as diffuse and mirror reflections, refractions and shadows in real time.
KW - Augmented Reality
KW - Depth Camera
KW - Global Illumination
KW - Pseudo-Realism
KW - Real Time
KW - Stereoscopic Rendering
UR - http://www.scopus.com/inward/record.url?scp=84901044922&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84901044922&partnerID=8YFLogxK
U2 - 10.1117/12.2039280
DO - 10.1117/12.2039280
M3 - Conference contribution
AN - SCOPUS:84901044922
SN - 9780819499288
T3 - Proceedings of SPIE - The International Society for Optical Engineering
BT - Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXV
PB - SPIE
T2 - 25th Stereoscopic Displays and Applications Conference, SD and A 2014
Y2 - 3 February 2014 through 5 February 2014
ER -