[POSTER] Rubix: Dynamic spatial augmented reality by extraction of plane regions with a RGB-D camera

Masayuki Sano, Kazuki Matsumoto, Bruce H. Thomas, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Dynamic spatial augmented reality requires accurate real-time 3D pose information of the physical objects that are to be projected onto. Previous depth-based methods for tracking objects required strong features to enable recognition; making it difficult to estimate an accurate 6DOF pose for physical objects with a small set of recognizable features (such as a non-textured cube). We propose a more accurate method with fewer limitations for the pose estimation of a tangible object that has known planar faces and using depth data from an RGB-D camera only. In this paper, the physical object's shape is limited to cubes of different sizes. We apply this new tracking method to achieve dynamic projections onto these cubes. In our method, 3D points from an RGB-D camera are divided into a cluster of planar regions, and the point cloud inside each face of the object is fitted to an already-known geometric model of a cube. With the 6DOF pose of the physical object, SAR generated imagery is then projected correctly onto the physical object. The 6DOF tracking is designed to support tangible interactions with the physical object. We implemented example interactive applications with one or multiple cubes to show the capability of our method.

Original languageEnglish
Title of host publicationProceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages148-151
Number of pages4
ISBN (Print)9781467376600
DOIs
Publication statusPublished - 2015 Nov 11
Event14th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015 - Fukuoka, Japan
Duration: 2015 Sep 292015 Oct 3

Other

Other14th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015
CountryJapan
CityFukuoka
Period15/9/2915/10/3

Keywords

  • RGB-D Camera
  • Six Degree of Freedom Tracking
  • Spatial Augmented Reality

ASJC Scopus subject areas

  • Computer Science Applications
  • Modelling and Simulation
  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of '[POSTER] Rubix: Dynamic spatial augmented reality by extraction of plane regions with a RGB-D camera'. Together they form a unique fingerprint.

  • Cite this

    Sano, M., Matsumoto, K., Thomas, B. H., & Saito, H. (2015). [POSTER] Rubix: Dynamic spatial augmented reality by extraction of plane regions with a RGB-D camera. In Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015 (pp. 148-151). [7328083] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISMAR.2015.43