[POSTER] Rubix: Dynamic spatial augmented reality by extraction of plane regions with a RGB-D camera

Masayuki Sano, Kazuki Matsumoto, Bruce H. Thomas, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Dynamic spatial augmented reality requires accurate real-time 3D pose information of the physical objects that are to be projected onto. Previous depth-based methods for tracking objects required strong features to enable recognition; making it difficult to estimate an accurate 6DOF pose for physical objects with a small set of recognizable features (such as a non-textured cube). We propose a more accurate method with fewer limitations for the pose estimation of a tangible object that has known planar faces and using depth data from an RGB-D camera only. In this paper, the physical object's shape is limited to cubes of different sizes. We apply this new tracking method to achieve dynamic projections onto these cubes. In our method, 3D points from an RGB-D camera are divided into a cluster of planar regions, and the point cloud inside each face of the object is fitted to an already-known geometric model of a cube. With the 6DOF pose of the physical object, SAR generated imagery is then projected correctly onto the physical object. The 6DOF tracking is designed to support tangible interactions with the physical object. We implemented example interactive applications with one or multiple cubes to show the capability of our method.

Original languageEnglish
Title of host publicationProceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages148-151
Number of pages4
ISBN (Print)9781467376600
DOIs
Publication statusPublished - 2015 Nov 11
Event14th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015 - Fukuoka, Japan
Duration: 2015 Sep 292015 Oct 3

Other

Other14th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015
CountryJapan
CityFukuoka
Period15/9/2915/10/3

Fingerprint

Augmented reality
Augmented Reality
Camera
Cameras
Regular hexahedron
Cube
Face
Data Depth
Pose Estimation
Object
Geometric Model
Object Tracking
Point Cloud
Projection
Real-time
Interaction
Estimate

Keywords

  • RGB-D Camera
  • Six Degree of Freedom Tracking
  • Spatial Augmented Reality

ASJC Scopus subject areas

  • Computer Science Applications
  • Modelling and Simulation
  • Computer Graphics and Computer-Aided Design

Cite this

Sano, M., Matsumoto, K., Thomas, B. H., & Saito, H. (2015). [POSTER] Rubix: Dynamic spatial augmented reality by extraction of plane regions with a RGB-D camera. In Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015 (pp. 148-151). [7328083] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISMAR.2015.43

[POSTER] Rubix : Dynamic spatial augmented reality by extraction of plane regions with a RGB-D camera. / Sano, Masayuki; Matsumoto, Kazuki; Thomas, Bruce H.; Saito, Hideo.

Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015. Institute of Electrical and Electronics Engineers Inc., 2015. p. 148-151 7328083.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sano, M, Matsumoto, K, Thomas, BH & Saito, H 2015, [POSTER] Rubix: Dynamic spatial augmented reality by extraction of plane regions with a RGB-D camera. in Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015., 7328083, Institute of Electrical and Electronics Engineers Inc., pp. 148-151, 14th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015, Fukuoka, Japan, 15/9/29. https://doi.org/10.1109/ISMAR.2015.43
Sano M, Matsumoto K, Thomas BH, Saito H. [POSTER] Rubix: Dynamic spatial augmented reality by extraction of plane regions with a RGB-D camera. In Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015. Institute of Electrical and Electronics Engineers Inc. 2015. p. 148-151. 7328083 https://doi.org/10.1109/ISMAR.2015.43
Sano, Masayuki ; Matsumoto, Kazuki ; Thomas, Bruce H. ; Saito, Hideo. / [POSTER] Rubix : Dynamic spatial augmented reality by extraction of plane regions with a RGB-D camera. Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 148-151
@inproceedings{92bfd9724d164ed191164d8a98897042,
title = "[POSTER] Rubix: Dynamic spatial augmented reality by extraction of plane regions with a RGB-D camera",
abstract = "Dynamic spatial augmented reality requires accurate real-time 3D pose information of the physical objects that are to be projected onto. Previous depth-based methods for tracking objects required strong features to enable recognition; making it difficult to estimate an accurate 6DOF pose for physical objects with a small set of recognizable features (such as a non-textured cube). We propose a more accurate method with fewer limitations for the pose estimation of a tangible object that has known planar faces and using depth data from an RGB-D camera only. In this paper, the physical object's shape is limited to cubes of different sizes. We apply this new tracking method to achieve dynamic projections onto these cubes. In our method, 3D points from an RGB-D camera are divided into a cluster of planar regions, and the point cloud inside each face of the object is fitted to an already-known geometric model of a cube. With the 6DOF pose of the physical object, SAR generated imagery is then projected correctly onto the physical object. The 6DOF tracking is designed to support tangible interactions with the physical object. We implemented example interactive applications with one or multiple cubes to show the capability of our method.",
keywords = "RGB-D Camera, Six Degree of Freedom Tracking, Spatial Augmented Reality",
author = "Masayuki Sano and Kazuki Matsumoto and Thomas, {Bruce H.} and Hideo Saito",
year = "2015",
month = "11",
day = "11",
doi = "10.1109/ISMAR.2015.43",
language = "English",
isbn = "9781467376600",
pages = "148--151",
booktitle = "Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - [POSTER] Rubix

T2 - Dynamic spatial augmented reality by extraction of plane regions with a RGB-D camera

AU - Sano, Masayuki

AU - Matsumoto, Kazuki

AU - Thomas, Bruce H.

AU - Saito, Hideo

PY - 2015/11/11

Y1 - 2015/11/11

N2 - Dynamic spatial augmented reality requires accurate real-time 3D pose information of the physical objects that are to be projected onto. Previous depth-based methods for tracking objects required strong features to enable recognition; making it difficult to estimate an accurate 6DOF pose for physical objects with a small set of recognizable features (such as a non-textured cube). We propose a more accurate method with fewer limitations for the pose estimation of a tangible object that has known planar faces and using depth data from an RGB-D camera only. In this paper, the physical object's shape is limited to cubes of different sizes. We apply this new tracking method to achieve dynamic projections onto these cubes. In our method, 3D points from an RGB-D camera are divided into a cluster of planar regions, and the point cloud inside each face of the object is fitted to an already-known geometric model of a cube. With the 6DOF pose of the physical object, SAR generated imagery is then projected correctly onto the physical object. The 6DOF tracking is designed to support tangible interactions with the physical object. We implemented example interactive applications with one or multiple cubes to show the capability of our method.

AB - Dynamic spatial augmented reality requires accurate real-time 3D pose information of the physical objects that are to be projected onto. Previous depth-based methods for tracking objects required strong features to enable recognition; making it difficult to estimate an accurate 6DOF pose for physical objects with a small set of recognizable features (such as a non-textured cube). We propose a more accurate method with fewer limitations for the pose estimation of a tangible object that has known planar faces and using depth data from an RGB-D camera only. In this paper, the physical object's shape is limited to cubes of different sizes. We apply this new tracking method to achieve dynamic projections onto these cubes. In our method, 3D points from an RGB-D camera are divided into a cluster of planar regions, and the point cloud inside each face of the object is fitted to an already-known geometric model of a cube. With the 6DOF pose of the physical object, SAR generated imagery is then projected correctly onto the physical object. The 6DOF tracking is designed to support tangible interactions with the physical object. We implemented example interactive applications with one or multiple cubes to show the capability of our method.

KW - RGB-D Camera

KW - Six Degree of Freedom Tracking

KW - Spatial Augmented Reality

UR - http://www.scopus.com/inward/record.url?scp=84962300911&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84962300911&partnerID=8YFLogxK

U2 - 10.1109/ISMAR.2015.43

DO - 10.1109/ISMAR.2015.43

M3 - Conference contribution

AN - SCOPUS:84962300911

SN - 9781467376600

SP - 148

EP - 151

BT - Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -