SILHOUETTE-BASED SYNTHETIC DATA GENERATION FOR 3D HUMAN POSE ESTIMATION WITH A SINGLE WRIST-MOUNTED 360° CAMERA

Ryosuke Hori, Ryo Hachiuma, Hideo Saito, Mariko Isogawa, Dan Mikami

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we propose a framework for 3D human pose estimation with a single 360 camera mounted on the user’s wrist. Perceiving a 3D human pose with such a simple setting has remarkable potential for various applications (e.g., daily-living activity monitoring, motion analysis for sports enhancement). However, no existing work has tackled this task due to the difficulty of estimating a human pose from a single camera image in which only a part of the human body is captured and the lack of training data. Therefore, we propose an effective method for translating wrist-mounted 360 camera images into 3D human poses. We also propose silhouette-based synthetic data generation dedicated to this task, which enables us to bridge the domain gap between real-world data and synthetic data. We achieved higher estimation accuracy quantitatively and qualitatively compared with other baseline methods.

Original languageEnglish
Title of host publication2021 IEEE International Conference on Image Processing, ICIP 2021 - Proceedings
PublisherIEEE Computer Society
Pages1304-1308
Number of pages5
ISBN (Electronic)9781665441155
DOIs
Publication statusPublished - 2021
Event2021 IEEE International Conference on Image Processing, ICIP 2021 - Anchorage, United States
Duration: 2021 Sep 192021 Sep 22

Publication series

NameProceedings - International Conference on Image Processing, ICIP
Volume2021-September
ISSN (Print)1522-4880

Conference

Conference2021 IEEE International Conference on Image Processing, ICIP 2021
Country/TerritoryUnited States
CityAnchorage
Period21/9/1921/9/22

Keywords

  • 360 camera
  • 3D human pose estimation
  • Data synthesis
  • Domain adaptation
  • Silhouette

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Signal Processing

Fingerprint

Dive into the research topics of 'SILHOUETTE-BASED SYNTHETIC DATA GENERATION FOR 3D HUMAN POSE ESTIMATION WITH A SINGLE WRIST-MOUNTED 360° CAMERA'. Together they form a unique fingerprint.

Cite this