DetectFusion: Detecting and segmenting both known and unknown dynamic objects in real-time slam

Ryo Hachiuma, Christian Pirchheim, Dieter Schmalstieg, Hideo Saito

研究成果: Paper査読

1 被引用数 (Scopus)

抄録

We present DetectFusion, an RGB-D SLAM system that runs in real time and can robustly handle semantically known and unknown objects that can move dynamically in the scene. Our system detects, segments and assigns semantic class labels to known objects in the scene, while tracking and reconstructing them even when they move independently in front of the monocular camera. In contrast to related work, we achieve real-time computational performance on semantic instance segmentation with a novel method combining 2D object detection and 3D geometric segmentation. In addition, we propose a method for detecting and segmenting the motion of semantically unknown objects, thus further improving the accuracy of camera tracking and map reconstruction. We show that our method performs on par or better than previous work in terms of localization and object reconstruction accuracy, while achieving about 20 fps even if the objects are segmented in each frame.

本文言語English
出版ステータスPublished - 2020
イベント30th British Machine Vision Conference, BMVC 2019 - Cardiff, United Kingdom
継続期間: 2019 9 92019 9 12

Conference

Conference30th British Machine Vision Conference, BMVC 2019
CountryUnited Kingdom
CityCardiff
Period19/9/919/9/12

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

フィンガープリント 「DetectFusion: Detecting and segmenting both known and unknown dynamic objects in real-time slam」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル