Mask Optimization for Image Inpainting

Mariko Isogawa, Dan Mikami, Daisuke Iwai, Hideaki Kimata, Kosuke Sato

Research output: Contribution to journalArticlepeer-review

11 Citations (Scopus)


This paper proposes a novel approach to image inpainting that optimizes the shape of masked regions given by users. In image inpainting, which removes and restores unwanted regions in images, users draw masks to specify the regions. However, it is widely known that the users typically need to adjust the masked region by trial and error until they obtain the desired natural inpainting result, because inpainting quality is significantly affected by even a slight change in the mask. This manual masking takes a great deal of users' working time and requires considerable input. To reduce the human labor required, we propose a method for masked region optimization so that good inpainting results can be automatically obtained. To this end, our approach estimates 'naturalness of inpainting' for all super pixels in inpainted images and reforms an original mask on a super-pixel basis, so that the naturalness of the inpainting result is improved. The efficacy of this approach does not depend on inpainting algorithms, thus it can be applied for every inpainting method as a plug-in. To demonstrate the effectiveness of our approach, we test our algorithm with varied images and show that it outperforms the existing inpainting methods without masked region reformation.

Original languageEnglish
Article number8502030
Pages (from-to)69728-69741
Number of pages14
JournalIEEE Access
Publication statusPublished - 2018
Externally publishedYes


  • Inpainting
  • learning-to-rank
  • segmentation
  • super pixel

ASJC Scopus subject areas

  • Computer Science(all)
  • Materials Science(all)
  • Engineering(all)


Dive into the research topics of 'Mask Optimization for Image Inpainting'. Together they form a unique fingerprint.

Cite this