People Removal Using Edge and Depth Information

Shunsuke Yae, Masaaki Ikehara

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we propose a people removal method from a single image for privacy and other reasons using a three-stage network of depth estimation, semantic segmentation, and inpainting, as shown in Fig. 1. In this three-stage network, we improve semantic segmentation for detecting people. We focus on a special situation of a person and construct a network. It is known that the accuracy of conventional methods can be improved by using edge information. The accuracy of segmentation can be further improved by increasing the accuracy of the edge map. In addition, edge detection does not work well when the person and the background are of the similar color, because edge detects the brightness change of the image. Therefore, in this paper, an adversarial loss function for edge maps is proposed. In addition, since an image with people is expected to have a depth difference from the background image, we use a trained depth estimation network to include the depth image in the input. In this way, it is possible to construct a network for people removal with a high accuracy both quantitatively and qualitatively.

Original languageEnglish
Title of host publication2022 IEEE International Conference on Consumer Electronics, ICCE 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665441544
DOIs
Publication statusPublished - 2022
Event2022 IEEE International Conference on Consumer Electronics, ICCE 2022 - Virtual, Online, United States
Duration: 2022 Jan 72022 Jan 9

Publication series

NameDigest of Technical Papers - IEEE International Conference on Consumer Electronics
Volume2022-January
ISSN (Print)0747-668X

Conference

Conference2022 IEEE International Conference on Consumer Electronics, ICCE 2022
Country/TerritoryUnited States
CityVirtual, Online
Period22/1/722/1/9

Keywords

  • Depth estimation
  • Inpainting
  • Semantic segmentation

ASJC Scopus subject areas

  • Industrial and Manufacturing Engineering
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'People Removal Using Edge and Depth Information'. Together they form a unique fingerprint.

Cite this