Stereoscopic augmented reality with pseudo-realistic global illumination effects

Francois De Sorbier; Hideo Saito

doi:10.1117/12.2039280

Stereoscopic augmented reality with pseudo-realistic global illumination effects

Francois De Sorbier, Hideo Saito

Department of Information and Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

Recently, augmented reality has become very popular and has appeared in our daily life with gaming, guiding systems or mobile phone applications. However, inserting object in such a way their appearance seems natural is still an issue, especially in an unknown environment. This paper presents a framework that demonstrates the capabilities of Kinect for convincing augmented reality in an unknown environment. Rather than pre-computing a reconstruction of the scene like proposed by most of the previous method, we propose a dynamic capture of the scene that allows adapting to live changes of the environment. Our approach, based on the update of an environment map, can also detect the position of the light sources. Combining information from the environment map, the light sources and the camera tracking, we can display virtual objects using stereoscopic devices with global illumination effects such as diffuse and mirror reflections, refractions and shadows in real time.

Original language	English
Title of host publication	Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXV
Publisher	SPIE
ISBN (Print)	9780819499288
DOIs	https://doi.org/10.1117/12.2039280
Publication status	Published - 2014 Jan 1
Event	25th Stereoscopic Displays and Applications Conference, SD and A 2014 - San Francisco, CA, United States Duration: 2014 Feb 3 → 2014 Feb 5

Publication series

Name	Proceedings of SPIE - The International Society for Optical Engineering
Volume	9011
ISSN (Print)	0277-786X
ISSN (Electronic)	1996-756X

Other

Other	25th Stereoscopic Displays and Applications Conference, SD and A 2014
Country	United States
City	San Francisco, CA
Period	14/2/3 → 14/2/5

Keywords

Augmented Reality
Depth Camera
Global Illumination
Pseudo-Realism
Real Time
Stereoscopic Rendering

ASJC Scopus subject areas

Electronic, Optical and Magnetic Materials
Condensed Matter Physics
Computer Science Applications
Applied Mathematics
Electrical and Electronic Engineering

Access to Document

10.1117/12.2039280

Fingerprint Dive into the research topics of 'Stereoscopic augmented reality with pseudo-realistic global illumination effects'. Together they form a unique fingerprint.

Cite this

Stereoscopic augmented reality with pseudo-realistic global illumination effects. / De Sorbier, Francois; Saito, Hideo.

Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXV. SPIE, 2014. 90111W (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 9011).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

De Sorbier, F & Saito, H 2014, Stereoscopic augmented reality with pseudo-realistic global illumination effects. in Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXV., 90111W, Proceedings of SPIE - The International Society for Optical Engineering, vol. 9011, SPIE, 25th Stereoscopic Displays and Applications Conference, SD and A 2014, San Francisco, CA, United States, 14/2/3. https://doi.org/10.1117/12.2039280

@inproceedings{4d4289fee44c4d22b82690f7a021e0da,

title = "Stereoscopic augmented reality with pseudo-realistic global illumination effects",

abstract = "Recently, augmented reality has become very popular and has appeared in our daily life with gaming, guiding systems or mobile phone applications. However, inserting object in such a way their appearance seems natural is still an issue, especially in an unknown environment. This paper presents a framework that demonstrates the capabilities of Kinect for convincing augmented reality in an unknown environment. Rather than pre-computing a reconstruction of the scene like proposed by most of the previous method, we propose a dynamic capture of the scene that allows adapting to live changes of the environment. Our approach, based on the update of an environment map, can also detect the position of the light sources. Combining information from the environment map, the light sources and the camera tracking, we can display virtual objects using stereoscopic devices with global illumination effects such as diffuse and mirror reflections, refractions and shadows in real time.",

keywords = "Augmented Reality, Depth Camera, Global Illumination, Pseudo-Realism, Real Time, Stereoscopic Rendering",

author = "{De Sorbier}, Francois and Hideo Saito",

year = "2014",

month = jan,

day = "1",

doi = "10.1117/12.2039280",

language = "English",

isbn = "9780819499288",

series = "Proceedings of SPIE - The International Society for Optical Engineering",

publisher = "SPIE",

booktitle = "Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXV",

note = "25th Stereoscopic Displays and Applications Conference, SD and A 2014 ; Conference date: 03-02-2014 Through 05-02-2014",

}

TY - GEN

T1 - Stereoscopic augmented reality with pseudo-realistic global illumination effects

AU - De Sorbier, Francois

AU - Saito, Hideo

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Recently, augmented reality has become very popular and has appeared in our daily life with gaming, guiding systems or mobile phone applications. However, inserting object in such a way their appearance seems natural is still an issue, especially in an unknown environment. This paper presents a framework that demonstrates the capabilities of Kinect for convincing augmented reality in an unknown environment. Rather than pre-computing a reconstruction of the scene like proposed by most of the previous method, we propose a dynamic capture of the scene that allows adapting to live changes of the environment. Our approach, based on the update of an environment map, can also detect the position of the light sources. Combining information from the environment map, the light sources and the camera tracking, we can display virtual objects using stereoscopic devices with global illumination effects such as diffuse and mirror reflections, refractions and shadows in real time.

AB - Recently, augmented reality has become very popular and has appeared in our daily life with gaming, guiding systems or mobile phone applications. However, inserting object in such a way their appearance seems natural is still an issue, especially in an unknown environment. This paper presents a framework that demonstrates the capabilities of Kinect for convincing augmented reality in an unknown environment. Rather than pre-computing a reconstruction of the scene like proposed by most of the previous method, we propose a dynamic capture of the scene that allows adapting to live changes of the environment. Our approach, based on the update of an environment map, can also detect the position of the light sources. Combining information from the environment map, the light sources and the camera tracking, we can display virtual objects using stereoscopic devices with global illumination effects such as diffuse and mirror reflections, refractions and shadows in real time.

KW - Augmented Reality

KW - Depth Camera

KW - Global Illumination

KW - Pseudo-Realism

KW - Real Time

KW - Stereoscopic Rendering

UR - http://www.scopus.com/inward/record.url?scp=84901044922&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84901044922&partnerID=8YFLogxK

U2 - 10.1117/12.2039280

DO - 10.1117/12.2039280

M3 - Conference contribution

AN - SCOPUS:84901044922

SN - 9780819499288

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXV

PB - SPIE

T2 - 25th Stereoscopic Displays and Applications Conference, SD and A 2014

Y2 - 3 February 2014 through 5 February 2014

ER -