Silhouette-Based 3D Human Pose Estimation Using a Single Wrist-Mounted 360° Camera

Ryosuke Hori, Ryo Hachiuma, Mariko Isogawa, Dan Mikami, Hideo Saito

研究成果: Article査読

抄録

In this paper, we propose a framework for 3D human pose estimation using a single 360° camera mounted on the user's wrist. Perceiving a 3D human pose with such a simple setup has remarkable potential for various applications (e. g., daily-living activity monitoring, motion analysis for sports training). However, no existing method has tackled this task due to the difficulty of estimating a human pose from a single camera image in which only a part of the human body is captured, and because of a lack of training data. We propose a method for translating wrist-mounted 360° camera images into 3D human poses. Since we are the first to try this task, we cannot use existing datasets. To address this issue, we use synthetic data to build our own dataset. This solution, however, creates a different problem, that of a domain gap between synthetic data for training and real image data for inference. To resolve this problem, we propose silhouette-based synthetic data generation created for this task. Extensive experiments comparing our method with several baseline methods demonstrated the effectiveness of our silhouette-based pose estimation approach.

本文言語English
ページ(範囲)54957-54968
ページ数12
ジャーナルIEEE Access
10
DOI
出版ステータスPublished - 2022

ASJC Scopus subject areas

  • コンピュータ サイエンス(全般)
  • 材料科学(全般)
  • 工学(全般)

フィンガープリント

「Silhouette-Based 3D Human Pose Estimation Using a Single Wrist-Mounted 360° Camera」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル