A tracking method for 2D canvas in MR-based interactive painting system

Sandy Martedi, Mai Otsuki, Hideo Saito, Maki Sugimoto, Asako Kimura, Fumihisa Shibata

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We have proposed a mixed reality based painting system. In this paper, we tackle a problem in our previous painting system that fully relies on magnetic sensor that is attached on the canvas, the users needed to detach and attach a sensor on the canvas during painting when they want to switch the canvas. Instead of that, in this paper, we aim to automatically detect the shape of the canvas for registration purpose. Using the shape or region detection method such as MSER (maximally stable extremal regions), we detect and track the shape on the canvas on the captured camera image. We then compute the camera pose for virtually overlay the painting result. Using the brush device, we can draw and paint freely on the tracked canvases. We show that using visual based tracking method, we can generate the equivalent result compared to the result of using the sensor.

Original languageEnglish
Title of host publicationProceedings - 2013 International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013
Pages790-794
Number of pages5
DOIs
Publication statusPublished - 2013
Event2013 9th International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013 - Kyoto, Japan
Duration: 2013 Dec 22013 Dec 5

Other

Other2013 9th International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013
CountryJapan
CityKyoto
Period13/12/213/12/5

Fingerprint

Painting
Cameras
Magnetic sensors
Sensors
Brushes
Paint
Switches

Keywords

  • Augmented reality
  • Interaction
  • Mixed reality
  • Tracking

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Signal Processing

Cite this

Martedi, S., Otsuki, M., Saito, H., Sugimoto, M., Kimura, A., & Shibata, F. (2013). A tracking method for 2D canvas in MR-based interactive painting system. In Proceedings - 2013 International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013 (pp. 790-794). [6727278] https://doi.org/10.1109/SITIS.2013.128

A tracking method for 2D canvas in MR-based interactive painting system. / Martedi, Sandy; Otsuki, Mai; Saito, Hideo; Sugimoto, Maki; Kimura, Asako; Shibata, Fumihisa.

Proceedings - 2013 International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013. 2013. p. 790-794 6727278.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Martedi, S, Otsuki, M, Saito, H, Sugimoto, M, Kimura, A & Shibata, F 2013, A tracking method for 2D canvas in MR-based interactive painting system. in Proceedings - 2013 International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013., 6727278, pp. 790-794, 2013 9th International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013, Kyoto, Japan, 13/12/2. https://doi.org/10.1109/SITIS.2013.128
Martedi S, Otsuki M, Saito H, Sugimoto M, Kimura A, Shibata F. A tracking method for 2D canvas in MR-based interactive painting system. In Proceedings - 2013 International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013. 2013. p. 790-794. 6727278 https://doi.org/10.1109/SITIS.2013.128
Martedi, Sandy ; Otsuki, Mai ; Saito, Hideo ; Sugimoto, Maki ; Kimura, Asako ; Shibata, Fumihisa. / A tracking method for 2D canvas in MR-based interactive painting system. Proceedings - 2013 International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013. 2013. pp. 790-794
@inproceedings{9f78330168e3441a9925a53779ef0133,
title = "A tracking method for 2D canvas in MR-based interactive painting system",
abstract = "We have proposed a mixed reality based painting system. In this paper, we tackle a problem in our previous painting system that fully relies on magnetic sensor that is attached on the canvas, the users needed to detach and attach a sensor on the canvas during painting when they want to switch the canvas. Instead of that, in this paper, we aim to automatically detect the shape of the canvas for registration purpose. Using the shape or region detection method such as MSER (maximally stable extremal regions), we detect and track the shape on the canvas on the captured camera image. We then compute the camera pose for virtually overlay the painting result. Using the brush device, we can draw and paint freely on the tracked canvases. We show that using visual based tracking method, we can generate the equivalent result compared to the result of using the sensor.",
keywords = "Augmented reality, Interaction, Mixed reality, Tracking",
author = "Sandy Martedi and Mai Otsuki and Hideo Saito and Maki Sugimoto and Asako Kimura and Fumihisa Shibata",
year = "2013",
doi = "10.1109/SITIS.2013.128",
language = "English",
isbn = "9781479932115",
pages = "790--794",
booktitle = "Proceedings - 2013 International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013",

}

TY - GEN

T1 - A tracking method for 2D canvas in MR-based interactive painting system

AU - Martedi, Sandy

AU - Otsuki, Mai

AU - Saito, Hideo

AU - Sugimoto, Maki

AU - Kimura, Asako

AU - Shibata, Fumihisa

PY - 2013

Y1 - 2013

N2 - We have proposed a mixed reality based painting system. In this paper, we tackle a problem in our previous painting system that fully relies on magnetic sensor that is attached on the canvas, the users needed to detach and attach a sensor on the canvas during painting when they want to switch the canvas. Instead of that, in this paper, we aim to automatically detect the shape of the canvas for registration purpose. Using the shape or region detection method such as MSER (maximally stable extremal regions), we detect and track the shape on the canvas on the captured camera image. We then compute the camera pose for virtually overlay the painting result. Using the brush device, we can draw and paint freely on the tracked canvases. We show that using visual based tracking method, we can generate the equivalent result compared to the result of using the sensor.

AB - We have proposed a mixed reality based painting system. In this paper, we tackle a problem in our previous painting system that fully relies on magnetic sensor that is attached on the canvas, the users needed to detach and attach a sensor on the canvas during painting when they want to switch the canvas. Instead of that, in this paper, we aim to automatically detect the shape of the canvas for registration purpose. Using the shape or region detection method such as MSER (maximally stable extremal regions), we detect and track the shape on the canvas on the captured camera image. We then compute the camera pose for virtually overlay the painting result. Using the brush device, we can draw and paint freely on the tracked canvases. We show that using visual based tracking method, we can generate the equivalent result compared to the result of using the sensor.

KW - Augmented reality

KW - Interaction

KW - Mixed reality

KW - Tracking

UR - http://www.scopus.com/inward/record.url?scp=84894196075&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84894196075&partnerID=8YFLogxK

U2 - 10.1109/SITIS.2013.128

DO - 10.1109/SITIS.2013.128

M3 - Conference contribution

AN - SCOPUS:84894196075

SN - 9781479932115

SP - 790

EP - 794

BT - Proceedings - 2013 International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013

ER -