Single Image Raindrop Removal Using a Non-local Operator and Feature Maps in the Frequency Domain

Shinya Ezumi, Masaaki Ikehara

研究成果: Article査読

抄録

Taking a photo on a rainy day may result in a photo with raindrops. Images containing raindrops have a significant impact on the visual impression and accuracy when applied to image recognition systems. Thus, an automatic high-quality raindrop removal method is desired for outdoor image processing systems as well as for acquiring good-looking images. Several existing methods have been proposed to tackle this problem, but they often fail to keep global consistency and generate unnatural patterns. In this paper, we tackle this problem by introducing a non-local operator. The non-local operator combines features in distant locations with matrix multiplication and enables consistency in distant locations. In addition, high-frequency components such as edges are more affected in images with raindrops. Inspired by the nature that high-frequency components can be separated from other components in the frequency domain, we also propose to process feature maps in the frequency domain, which are obtained by the fast Fourier transform operation and processed by several convolution layers. Experimental results show that our method effectively removes raindrops and achieves state-of-the-art performance.

本文言語English
ページ(範囲)1
ページ数1
ジャーナルIEEE Access
DOI
出版ステータスAccepted/In press - 2022

ASJC Scopus subject areas

  • コンピュータ サイエンス(全般)
  • 材料科学(全般)
  • 工学(全般)
  • 電子工学および電気工学

フィンガープリント

「Single Image Raindrop Removal Using a Non-local Operator and Feature Maps in the Frequency Domain」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル