A tracking method for 2D canvas in MR-based interactive painting system

Sandy Martedi, Mai Otsuki, Hideo Saito, Maki Sugimoto, Asako Kimura, Fumihisa Shibata

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We have proposed a mixed reality based painting system. In this paper, we tackle a problem in our previous painting system that fully relies on magnetic sensor that is attached on the canvas, the users needed to detach and attach a sensor on the canvas during painting when they want to switch the canvas. Instead of that, in this paper, we aim to automatically detect the shape of the canvas for registration purpose. Using the shape or region detection method such as MSER (maximally stable extremal regions), we detect and track the shape on the canvas on the captured camera image. We then compute the camera pose for virtually overlay the painting result. Using the brush device, we can draw and paint freely on the tracked canvases. We show that using visual based tracking method, we can generate the equivalent result compared to the result of using the sensor.

Original languageEnglish
Title of host publicationProceedings - 2013 International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013
Pages790-794
Number of pages5
DOIs
Publication statusPublished - 2013 Dec 1
Event2013 9th International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013 - Kyoto, Japan
Duration: 2013 Dec 22013 Dec 5

Publication series

NameProceedings - 2013 International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013

Other

Other2013 9th International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013
CountryJapan
CityKyoto
Period13/12/213/12/5

Keywords

  • Augmented reality
  • Interaction
  • Mixed reality
  • Tracking

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Signal Processing

Fingerprint Dive into the research topics of 'A tracking method for 2D canvas in MR-based interactive painting system'. Together they form a unique fingerprint.

  • Cite this

    Martedi, S., Otsuki, M., Saito, H., Sugimoto, M., Kimura, A., & Shibata, F. (2013). A tracking method for 2D canvas in MR-based interactive painting system. In Proceedings - 2013 International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013 (pp. 790-794). [6727278] (Proceedings - 2013 International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013). https://doi.org/10.1109/SITIS.2013.128