360-Degree Image Completion by Two-Stage Conditional Gans

Naofumi Akimoto, Seito Kasai, Masaki Hayashi, Yoshimitsu Aoki

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    The latest generative adversarial networks (GANs) can generate realistic high resolution images. However, to the best of our knowledge, there are no GANs for generating 360-degree images. Therefore, this paper proposes the novel problem setting that by using a known area from the 360-degree image as an input, the remainder of the image can be completed with the GANs. To do so, we propose the approach of two-stage generation using network architecture with series-parallel dilated convolution layers. Moreover, we present how to rearrange images for data augmentation, simplify the problem, and make inputs for training the 2nd stage generator. Our experiments show that these methods generate the distortion seen in 360-degree images in the outlines of buildings and roads, and their boundaries are clearer than those of baseline methods. Furthermore, we discuss and clarify the difficulty of our proposed problem. Our work is the first step towards GANs predicting an unseen area within a 360-degree space.

    Original languageEnglish
    Title of host publication2019 IEEE International Conference on Image Processing, ICIP 2019 - Proceedings
    PublisherIEEE Computer Society
    Pages4704-4708
    Number of pages5
    ISBN (Electronic)9781538662496
    DOIs
    Publication statusPublished - 2019 Sep
    Event26th IEEE International Conference on Image Processing, ICIP 2019 - Taipei, Taiwan, Province of China
    Duration: 2019 Sep 222019 Sep 25

    Publication series

    NameProceedings - International Conference on Image Processing, ICIP
    Volume2019-September
    ISSN (Print)1522-4880

    Conference

    Conference26th IEEE International Conference on Image Processing, ICIP 2019
    CountryTaiwan, Province of China
    CityTaipei
    Period19/9/2219/9/25

    Keywords

    • 360 degrees
    • extrapolation
    • Generative adversarial networks
    • image completion

    ASJC Scopus subject areas

    • Software
    • Computer Vision and Pattern Recognition
    • Signal Processing

    Fingerprint Dive into the research topics of '360-Degree Image Completion by Two-Stage Conditional Gans'. Together they form a unique fingerprint.

  • Cite this

    Akimoto, N., Kasai, S., Hayashi, M., & Aoki, Y. (2019). 360-Degree Image Completion by Two-Stage Conditional Gans. In 2019 IEEE International Conference on Image Processing, ICIP 2019 - Proceedings (pp. 4704-4708). [8803435] (Proceedings - International Conference on Image Processing, ICIP; Vol. 2019-September). IEEE Computer Society. https://doi.org/10.1109/ICIP.2019.8803435