Semantic Segmentation of 3D Point Cloud to Virtually Manipulate Real Living Space

Yuki Ishikawa, Ryo Hachiuma, Naoto Ienaga, Wakaba Kuno, Yuta Sugiura, Hideo Saito

研究成果: Conference contribution

5 被引用数 (Scopus)

抄録

This paper presents a method for the virtual manipulation of real living space using semantic segmentation of a 3D point cloud captured in the real world. We applied PointNet to segment each piece of furniture from the point cloud of a real indoor environment captured by moving a RGB-D camera. For semantic segmentation, we focused on local geometric information not used in PointNet, and we proposed a method to refine the class probability of labels attached to each point in PointNet's output. The effectiveness of our method was experimentally confirmed. We then created 3D models of real-world furniture using a point cloud with corrected labels, and we virtually manipulated real living space using Dollhouse VR, a layout system.

本文言語English
ホスト出版物のタイトルProceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019
編集者Dongdong Weng, Liwei Chan, Youngho Lee, Xiaohui Liang, Nobuchika Sakata
出版社Institute of Electrical and Electronics Engineers Inc.
ISBN(電子版)9781728115719
DOI
出版ステータスPublished - 2019 5 7
イベント12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019 - Ikoma, Nara, Japan
継続期間: 2019 3 282019 3 29

出版物シリーズ

名前Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019

Conference

Conference12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019
国/地域Japan
CityIkoma, Nara
Period19/3/2819/3/29

ASJC Scopus subject areas

  • 教育
  • 社会学および政治科学
  • 通信
  • マーケティング
  • 戦略と経営
  • コンピュータ ネットワークおよび通信
  • 情報システムおよび情報管理
  • 社会心理学

フィンガープリント

「Semantic Segmentation of 3D Point Cloud to Virtually Manipulate Real Living Space」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル