AR visualization of thermal 3D model by hand-held cameras

Kazuki Matsumoto, Wataru Nakagawa, Hideo Saito, Maki Sugimoto, Takashi Shibata, Shoji Yachida

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

In this paper, we propose a system for AR visualization of thermal distribution on the environment. Our system is based on color 3D model and thermal 3D model of the target scene generated by KinectFusion using a thermal camera coupled with an RGB-D camera. In off-line phase, Viewpoint Generative Learning (VGL) is applied to the colored 3D model for collecting its stable keypoints descriptors. Those descriptors are utilized in camera pose initialization at the start of on-line phase. After that, our proposed camera tracking which combines frame-to-frame camera tracking with VGL based tacking is performed for accurate estimation of the camera pose. From estimated camera pose, the thermal 3D model is finally superimposed to current mobile camera view. As a result, we can observe the wide area thermal map from any viewpoint. Our system is applied for a temperature change visualization system with a thermal camera coupled with an RGB-D camera and it is also enables the smartphone to interactively display thermal distribution of a given scene.

Original languageEnglish
Title of host publicationVISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings
PublisherSciTePress
Pages480-487
Number of pages8
Volume3
ISBN (Print)9789897580918
Publication statusPublished - 2015
Event10th International Conference on Computer Vision Theory and Applications, VISAPP 2015 - Berlin, Germany
Duration: 2015 Mar 112015 Mar 14

Other

Other10th International Conference on Computer Vision Theory and Applications, VISAPP 2015
CountryGermany
CityBerlin
Period15/3/1115/3/14

Keywords

  • 3D model
  • Augmented reality
  • Camera tracking
  • RGB-D camera
  • Temperature
  • Thermal camera
  • Viewpoint Generative Learning

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'AR visualization of thermal 3D model by hand-held cameras'. Together they form a unique fingerprint.

  • Cite this

    Matsumoto, K., Nakagawa, W., Saito, H., Sugimoto, M., Shibata, T., & Yachida, S. (2015). AR visualization of thermal 3D model by hand-held cameras. In VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings (Vol. 3, pp. 480-487). SciTePress.