TY - GEN
T1 - A tracking method for 2D canvas in MR-based interactive painting system
AU - Martedi, Sandy
AU - Otsuki, Mai
AU - Saito, Hideo
AU - Sugimoto, Maki
AU - Kimura, Asako
AU - Shibata, Fumihisa
PY - 2013/12/1
Y1 - 2013/12/1
N2 - We have proposed a mixed reality based painting system. In this paper, we tackle a problem in our previous painting system that fully relies on magnetic sensor that is attached on the canvas, the users needed to detach and attach a sensor on the canvas during painting when they want to switch the canvas. Instead of that, in this paper, we aim to automatically detect the shape of the canvas for registration purpose. Using the shape or region detection method such as MSER (maximally stable extremal regions), we detect and track the shape on the canvas on the captured camera image. We then compute the camera pose for virtually overlay the painting result. Using the brush device, we can draw and paint freely on the tracked canvases. We show that using visual based tracking method, we can generate the equivalent result compared to the result of using the sensor.
AB - We have proposed a mixed reality based painting system. In this paper, we tackle a problem in our previous painting system that fully relies on magnetic sensor that is attached on the canvas, the users needed to detach and attach a sensor on the canvas during painting when they want to switch the canvas. Instead of that, in this paper, we aim to automatically detect the shape of the canvas for registration purpose. Using the shape or region detection method such as MSER (maximally stable extremal regions), we detect and track the shape on the canvas on the captured camera image. We then compute the camera pose for virtually overlay the painting result. Using the brush device, we can draw and paint freely on the tracked canvases. We show that using visual based tracking method, we can generate the equivalent result compared to the result of using the sensor.
KW - Augmented reality
KW - Interaction
KW - Mixed reality
KW - Tracking
UR - http://www.scopus.com/inward/record.url?scp=84894196075&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84894196075&partnerID=8YFLogxK
U2 - 10.1109/SITIS.2013.128
DO - 10.1109/SITIS.2013.128
M3 - Conference contribution
AN - SCOPUS:84894196075
SN - 9781479932115
T3 - Proceedings - 2013 International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013
SP - 790
EP - 794
BT - Proceedings - 2013 International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013
T2 - 2013 9th International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2013
Y2 - 2 December 2013 through 5 December 2013
ER -