GAN-Based Rain Noise Removal from Single-Image Considering Rain Composite Models

Takuro Matsui, Masaaki Ikehara

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)

Abstract

Under severe weather conditions, outdoor images or videos captured by cameras can be affected by heavy rain and fog. For example, on a rainy day, autonomous vehicles have difficulty determining how to navigate due to the degraded visual quality of images. In this paper, we address a single-image rain removal problem (de-raining). As compared to video-based methods, single-image based methods are challenging because of the lack of temporal information. Although many existing methods have tackled these challenges, they suffer from overfitting, over-smoothing, and unnatural hue change. To solve these problems, we propose a GAN-based de-raining method. The optimal generator is determined by experimental comparisons. To train the generator, we learn the mapping between rainy and residual images from the training dataset. Besides, we synthesize a variety of rainy images to train our network. In particular, we focus on not only the orientations and scales of rain streaks but also the rainy image composite models. Our experimental results show that our method is suitable for a wide range of rainy images. Our method also achieves better performance on both synthetic and real-world images than state-of-the-art methods in terms of quantitative and visual performances.

Original languageEnglish
Article number9016251
Pages (from-to)40892-40900
Number of pages9
JournalIEEE Access
Volume8
DOIs
Publication statusPublished - 2020

Keywords

  • Generative adversarial network
  • deep learning
  • image restoration
  • residual learning
  • single-image de-raining

ASJC Scopus subject areas

  • Computer Science(all)
  • Materials Science(all)
  • Engineering(all)

Fingerprint Dive into the research topics of 'GAN-Based Rain Noise Removal from Single-Image Considering Rain Composite Models'. Together they form a unique fingerprint.

Cite this