AR visualization of thermal 3D model by hand-held cameras

Kazuki Matsumoto, Wataru Nakagawa, Hideo Saito, Maki Sugimoto, Takashi Shibata, Shoji Yachida

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

In this paper, we propose a system for AR visualization of thermal distribution on the environment. Our system is based on color 3D model and thermal 3D model of the target scene generated by KinectFusion using a thermal camera coupled with an RGB-D camera. In off-line phase, Viewpoint Generative Learning (VGL) is applied to the colored 3D model for collecting its stable keypoints descriptors. Those descriptors are utilized in camera pose initialization at the start of on-line phase. After that, our proposed camera tracking which combines frame-to-frame camera tracking with VGL based tacking is performed for accurate estimation of the camera pose. From estimated camera pose, the thermal 3D model is finally superimposed to current mobile camera view. As a result, we can observe the wide area thermal map from any viewpoint. Our system is applied for a temperature change visualization system with a thermal camera coupled with an RGB-D camera and it is also enables the smartphone to interactively display thermal distribution of a given scene.

Original languageEnglish
Title of host publicationVISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings
PublisherSciTePress
Pages480-487
Number of pages8
Volume3
ISBN (Print)9789897580918
Publication statusPublished - 2015
Event10th International Conference on Computer Vision Theory and Applications, VISAPP 2015 - Berlin, Germany
Duration: 2015 Mar 112015 Mar 14

Other

Other10th International Conference on Computer Vision Theory and Applications, VISAPP 2015
CountryGermany
CityBerlin
Period15/3/1115/3/14

Fingerprint

Visualization
Cameras
Hot Temperature
Smartphones
Color

Keywords

  • 3D model
  • Augmented reality
  • Camera tracking
  • RGB-D camera
  • Temperature
  • Thermal camera
  • Viewpoint Generative Learning

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Cite this

Matsumoto, K., Nakagawa, W., Saito, H., Sugimoto, M., Shibata, T., & Yachida, S. (2015). AR visualization of thermal 3D model by hand-held cameras. In VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings (Vol. 3, pp. 480-487). SciTePress.

AR visualization of thermal 3D model by hand-held cameras. / Matsumoto, Kazuki; Nakagawa, Wataru; Saito, Hideo; Sugimoto, Maki; Shibata, Takashi; Yachida, Shoji.

VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings. Vol. 3 SciTePress, 2015. p. 480-487.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Matsumoto, K, Nakagawa, W, Saito, H, Sugimoto, M, Shibata, T & Yachida, S 2015, AR visualization of thermal 3D model by hand-held cameras. in VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings. vol. 3, SciTePress, pp. 480-487, 10th International Conference on Computer Vision Theory and Applications, VISAPP 2015, Berlin, Germany, 15/3/11.
Matsumoto K, Nakagawa W, Saito H, Sugimoto M, Shibata T, Yachida S. AR visualization of thermal 3D model by hand-held cameras. In VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings. Vol. 3. SciTePress. 2015. p. 480-487
Matsumoto, Kazuki ; Nakagawa, Wataru ; Saito, Hideo ; Sugimoto, Maki ; Shibata, Takashi ; Yachida, Shoji. / AR visualization of thermal 3D model by hand-held cameras. VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings. Vol. 3 SciTePress, 2015. pp. 480-487
@inproceedings{e771d0f4f554490caa3dc637f70e34de,
title = "AR visualization of thermal 3D model by hand-held cameras",
abstract = "In this paper, we propose a system for AR visualization of thermal distribution on the environment. Our system is based on color 3D model and thermal 3D model of the target scene generated by KinectFusion using a thermal camera coupled with an RGB-D camera. In off-line phase, Viewpoint Generative Learning (VGL) is applied to the colored 3D model for collecting its stable keypoints descriptors. Those descriptors are utilized in camera pose initialization at the start of on-line phase. After that, our proposed camera tracking which combines frame-to-frame camera tracking with VGL based tacking is performed for accurate estimation of the camera pose. From estimated camera pose, the thermal 3D model is finally superimposed to current mobile camera view. As a result, we can observe the wide area thermal map from any viewpoint. Our system is applied for a temperature change visualization system with a thermal camera coupled with an RGB-D camera and it is also enables the smartphone to interactively display thermal distribution of a given scene.",
keywords = "3D model, Augmented reality, Camera tracking, RGB-D camera, Temperature, Thermal camera, Viewpoint Generative Learning",
author = "Kazuki Matsumoto and Wataru Nakagawa and Hideo Saito and Maki Sugimoto and Takashi Shibata and Shoji Yachida",
year = "2015",
language = "English",
isbn = "9789897580918",
volume = "3",
pages = "480--487",
booktitle = "VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings",
publisher = "SciTePress",

}

TY - GEN

T1 - AR visualization of thermal 3D model by hand-held cameras

AU - Matsumoto, Kazuki

AU - Nakagawa, Wataru

AU - Saito, Hideo

AU - Sugimoto, Maki

AU - Shibata, Takashi

AU - Yachida, Shoji

PY - 2015

Y1 - 2015

N2 - In this paper, we propose a system for AR visualization of thermal distribution on the environment. Our system is based on color 3D model and thermal 3D model of the target scene generated by KinectFusion using a thermal camera coupled with an RGB-D camera. In off-line phase, Viewpoint Generative Learning (VGL) is applied to the colored 3D model for collecting its stable keypoints descriptors. Those descriptors are utilized in camera pose initialization at the start of on-line phase. After that, our proposed camera tracking which combines frame-to-frame camera tracking with VGL based tacking is performed for accurate estimation of the camera pose. From estimated camera pose, the thermal 3D model is finally superimposed to current mobile camera view. As a result, we can observe the wide area thermal map from any viewpoint. Our system is applied for a temperature change visualization system with a thermal camera coupled with an RGB-D camera and it is also enables the smartphone to interactively display thermal distribution of a given scene.

AB - In this paper, we propose a system for AR visualization of thermal distribution on the environment. Our system is based on color 3D model and thermal 3D model of the target scene generated by KinectFusion using a thermal camera coupled with an RGB-D camera. In off-line phase, Viewpoint Generative Learning (VGL) is applied to the colored 3D model for collecting its stable keypoints descriptors. Those descriptors are utilized in camera pose initialization at the start of on-line phase. After that, our proposed camera tracking which combines frame-to-frame camera tracking with VGL based tacking is performed for accurate estimation of the camera pose. From estimated camera pose, the thermal 3D model is finally superimposed to current mobile camera view. As a result, we can observe the wide area thermal map from any viewpoint. Our system is applied for a temperature change visualization system with a thermal camera coupled with an RGB-D camera and it is also enables the smartphone to interactively display thermal distribution of a given scene.

KW - 3D model

KW - Augmented reality

KW - Camera tracking

KW - RGB-D camera

KW - Temperature

KW - Thermal camera

KW - Viewpoint Generative Learning

UR - http://www.scopus.com/inward/record.url?scp=84939522452&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84939522452&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84939522452

SN - 9789897580918

VL - 3

SP - 480

EP - 487

BT - VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings

PB - SciTePress

ER -