Vision based overlay of a virtual object into real scene for designing room interior

Shunsuke Harasaki, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

In this paper, we introduce a geometric registration method for augmented reality (AR) and an application system, interior simulator, in which a virtual (CG) object can be overlaid into a real world space. Interior simulator is developed as an example of an AR application of the proposed method. Using interior simulator, users can visually simulate the location of virtual furniture and articles in the living room so that they can easily design the living room interior without placing real furniture and articles, by viewing from many different locations and orientations in real-time. In our system, two base images of a real world space are captured from two different views for defining a projective coordinate of object 3D space. Then each projective view of a virtual object in the base images are registered interactively. After such coordinate determination, an image sequence of a real world space is captured by hand-held camera with tracking non-metric measured feature points for overlaying a virtual object. Virtual objects can be overlaid onto the image sequence by taking each relationship between the images. With the proposed system, 3D position tracking device, such as magnetic trackers, are not required for the overlay of virtual objects. Experimental results demonstrate that 3D virtual furniture can be overlaid into an image sequence of the scene of a living room nearly at video rate (20 frames per second).

Original languageEnglish
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
EditorsD.P. Casasent, E L Hall
Pages545-555
Number of pages11
Volume4572
DOIs
Publication statusPublished - 2001
EventIntelligent Robots and Computer Vision XX: Algorithms, Techniques, and Active Vision - Boston, MA, United States
Duration: 2001 Oct 292001 Oct 31

Other

OtherIntelligent Robots and Computer Vision XX: Algorithms, Techniques, and Active Vision
CountryUnited States
CityBoston, MA
Period01/10/2901/10/31

Fingerprint

rooms
Simulators
Augmented reality
simulators
Interiors (building)
Cameras
cameras

Keywords

  • 3D interaction techniques
  • Augmented reality
  • Registration
  • Vision based system

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Condensed Matter Physics

Cite this

Harasaki, S., & Saito, H. (2001). Vision based overlay of a virtual object into real scene for designing room interior. In D. P. Casasent, & E. L. Hall (Eds.), Proceedings of SPIE - The International Society for Optical Engineering (Vol. 4572, pp. 545-555) https://doi.org/10.1117/12.444225

Vision based overlay of a virtual object into real scene for designing room interior. / Harasaki, Shunsuke; Saito, Hideo.

Proceedings of SPIE - The International Society for Optical Engineering. ed. / D.P. Casasent; E L Hall. Vol. 4572 2001. p. 545-555.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Harasaki, S & Saito, H 2001, Vision based overlay of a virtual object into real scene for designing room interior. in DP Casasent & EL Hall (eds), Proceedings of SPIE - The International Society for Optical Engineering. vol. 4572, pp. 545-555, Intelligent Robots and Computer Vision XX: Algorithms, Techniques, and Active Vision, Boston, MA, United States, 01/10/29. https://doi.org/10.1117/12.444225
Harasaki S, Saito H. Vision based overlay of a virtual object into real scene for designing room interior. In Casasent DP, Hall EL, editors, Proceedings of SPIE - The International Society for Optical Engineering. Vol. 4572. 2001. p. 545-555 https://doi.org/10.1117/12.444225
Harasaki, Shunsuke ; Saito, Hideo. / Vision based overlay of a virtual object into real scene for designing room interior. Proceedings of SPIE - The International Society for Optical Engineering. editor / D.P. Casasent ; E L Hall. Vol. 4572 2001. pp. 545-555
@inproceedings{7d0819b5cb5846b48086e646ecd0ae69,
title = "Vision based overlay of a virtual object into real scene for designing room interior",
abstract = "In this paper, we introduce a geometric registration method for augmented reality (AR) and an application system, interior simulator, in which a virtual (CG) object can be overlaid into a real world space. Interior simulator is developed as an example of an AR application of the proposed method. Using interior simulator, users can visually simulate the location of virtual furniture and articles in the living room so that they can easily design the living room interior without placing real furniture and articles, by viewing from many different locations and orientations in real-time. In our system, two base images of a real world space are captured from two different views for defining a projective coordinate of object 3D space. Then each projective view of a virtual object in the base images are registered interactively. After such coordinate determination, an image sequence of a real world space is captured by hand-held camera with tracking non-metric measured feature points for overlaying a virtual object. Virtual objects can be overlaid onto the image sequence by taking each relationship between the images. With the proposed system, 3D position tracking device, such as magnetic trackers, are not required for the overlay of virtual objects. Experimental results demonstrate that 3D virtual furniture can be overlaid into an image sequence of the scene of a living room nearly at video rate (20 frames per second).",
keywords = "3D interaction techniques, Augmented reality, Registration, Vision based system",
author = "Shunsuke Harasaki and Hideo Saito",
year = "2001",
doi = "10.1117/12.444225",
language = "English",
volume = "4572",
pages = "545--555",
editor = "D.P. Casasent and Hall, {E L}",
booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",

}

TY - GEN

T1 - Vision based overlay of a virtual object into real scene for designing room interior

AU - Harasaki, Shunsuke

AU - Saito, Hideo

PY - 2001

Y1 - 2001

N2 - In this paper, we introduce a geometric registration method for augmented reality (AR) and an application system, interior simulator, in which a virtual (CG) object can be overlaid into a real world space. Interior simulator is developed as an example of an AR application of the proposed method. Using interior simulator, users can visually simulate the location of virtual furniture and articles in the living room so that they can easily design the living room interior without placing real furniture and articles, by viewing from many different locations and orientations in real-time. In our system, two base images of a real world space are captured from two different views for defining a projective coordinate of object 3D space. Then each projective view of a virtual object in the base images are registered interactively. After such coordinate determination, an image sequence of a real world space is captured by hand-held camera with tracking non-metric measured feature points for overlaying a virtual object. Virtual objects can be overlaid onto the image sequence by taking each relationship between the images. With the proposed system, 3D position tracking device, such as magnetic trackers, are not required for the overlay of virtual objects. Experimental results demonstrate that 3D virtual furniture can be overlaid into an image sequence of the scene of a living room nearly at video rate (20 frames per second).

AB - In this paper, we introduce a geometric registration method for augmented reality (AR) and an application system, interior simulator, in which a virtual (CG) object can be overlaid into a real world space. Interior simulator is developed as an example of an AR application of the proposed method. Using interior simulator, users can visually simulate the location of virtual furniture and articles in the living room so that they can easily design the living room interior without placing real furniture and articles, by viewing from many different locations and orientations in real-time. In our system, two base images of a real world space are captured from two different views for defining a projective coordinate of object 3D space. Then each projective view of a virtual object in the base images are registered interactively. After such coordinate determination, an image sequence of a real world space is captured by hand-held camera with tracking non-metric measured feature points for overlaying a virtual object. Virtual objects can be overlaid onto the image sequence by taking each relationship between the images. With the proposed system, 3D position tracking device, such as magnetic trackers, are not required for the overlay of virtual objects. Experimental results demonstrate that 3D virtual furniture can be overlaid into an image sequence of the scene of a living room nearly at video rate (20 frames per second).

KW - 3D interaction techniques

KW - Augmented reality

KW - Registration

KW - Vision based system

UR - http://www.scopus.com/inward/record.url?scp=0035768022&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0035768022&partnerID=8YFLogxK

U2 - 10.1117/12.444225

DO - 10.1117/12.444225

M3 - Conference contribution

VL - 4572

SP - 545

EP - 555

BT - Proceedings of SPIE - The International Society for Optical Engineering

A2 - Casasent, D.P.

A2 - Hall, E L

ER -