Semantic Object Selection and Detection for Diminished Reality Based on SLAM with Viewpoint Class

Yoshikatsu Nakajima, Shohei Mori, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)

Abstract

We propose a novel diminished reality method which is able to (i) automatically recognize the region to be diminished, (ii) work with a single RGB-D sensor, and (iii) work without pre-processing to generate a 3D model of the target scene by utilizing SLAM, segmentation, and recognition framework. Especially, regarding the recognition of the area to be diminished, our method is able to maintain high accuracy no matter how the camera moves by distributing the viewpoints for each object uniformly and aggregating recognition results from each distributed viewpoint as the same weight. These advantages are demonstrated on the UW RGB-D Dataset and Scenes.

Original languageEnglish
Title of host publicationAdjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017
EditorsWolfgang Broll, Holger Regenbrecht, Gerd Bruder, Myriam Servieres, Maki Sugimoto, J Edward Swan
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages338-343
Number of pages6
ISBN (Electronic)9780769563275
DOIs
Publication statusPublished - 2017 Oct 27
Event16th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017 - Nantes, France
Duration: 2017 Oct 92017 Oct 13

Publication series

NameAdjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017

Other

Other16th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017
Country/TerritoryFrance
CityNantes
Period17/10/917/10/13

Keywords

  • Convolutional Neural Network
  • Diminished Reality
  • Object Recognition
  • SLAM
  • Segmentation

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Media Technology
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Semantic Object Selection and Detection for Diminished Reality Based on SLAM with Viewpoint Class'. Together they form a unique fingerprint.

Cite this