Removing fences from sweep motion videos using global 3D reconstruction and fence-aware light field rendering

Chanya Lueangwattana; Shohei Mori; Hideo Saito

doi:10.1007/s41095-018-0126-8

Removing fences from sweep motion videos using global 3D reconstruction and fence-aware light field rendering

Chanya Lueangwattana, Shohei Mori, Hideo Saito

Department of Information and Computer Science

Research output: Contribution to journal › Article › peer-review

Abstract

Diminishing the appearance of a fence in an image is a challenging research area due to the characteristics of fences (thinness, lack of texture, etc.) and the need for occluded background restoration. In this paper, we describe a fence removal method for an image sequence captured by a user making a sweep motion, in which occluded background is potentially observed. To make use of geometric and appearance information such as consecutive images, we use two well-known approaches: structure from motion and light field rendering. Results using real image sequences show that our method can stably segment fences and preserve background details for various fence and background combinations. A new video without the fence, with frame coherence, can be successfully provided.

Original language	English
Pages (from-to)	21-32
Number of pages	12
Journal	Computational Visual Media
Volume	5
Issue number	1
DOIs	https://doi.org/10.1007/s41095-018-0126-8
Publication status	Published - 2019 Mar 1

Keywords

diminished reality (DR)
fence
light field rendering (LFR)
structure from motion (SfM)
video
video repair

ASJC Scopus subject areas

Computer Vision and Pattern Recognition
Computer Graphics and Computer-Aided Design
Artificial Intelligence

Access to Document

10.1007/s41095-018-0126-8

Cite this

@article{ec0a8edafc7f4af0ac2b54b622a526df,

title = "Removing fences from sweep motion videos using global 3D reconstruction and fence-aware light field rendering",

abstract = "Diminishing the appearance of a fence in an image is a challenging research area due to the characteristics of fences (thinness, lack of texture, etc.) and the need for occluded background restoration. In this paper, we describe a fence removal method for an image sequence captured by a user making a sweep motion, in which occluded background is potentially observed. To make use of geometric and appearance information such as consecutive images, we use two well-known approaches: structure from motion and light field rendering. Results using real image sequences show that our method can stably segment fences and preserve background details for various fence and background combinations. A new video without the fence, with frame coherence, can be successfully provided.",

keywords = "diminished reality (DR), fence, light field rendering (LFR), structure from motion (SfM), video, video repair",

author = "Chanya Lueangwattana and Shohei Mori and Hideo Saito",

note = "Funding Information: from the Japan Society for the Promotion of Science, following Grant No. 16J05114. Publisher Copyright: {\textcopyright} 2018, The Author(s).",

year = "2019",

month = mar,

day = "1",

doi = "10.1007/s41095-018-0126-8",

language = "English",

volume = "5",

pages = "21--32",

journal = "Computational Visual Media",

issn = "2096-0433",

publisher = "Tsinghua University Press",

number = "1",

}

TY - JOUR

T1 - Removing fences from sweep motion videos using global 3D reconstruction and fence-aware light field rendering

AU - Lueangwattana, Chanya

AU - Mori, Shohei

AU - Saito, Hideo

PY - 2019/3/1

Y1 - 2019/3/1

N2 - Diminishing the appearance of a fence in an image is a challenging research area due to the characteristics of fences (thinness, lack of texture, etc.) and the need for occluded background restoration. In this paper, we describe a fence removal method for an image sequence captured by a user making a sweep motion, in which occluded background is potentially observed. To make use of geometric and appearance information such as consecutive images, we use two well-known approaches: structure from motion and light field rendering. Results using real image sequences show that our method can stably segment fences and preserve background details for various fence and background combinations. A new video without the fence, with frame coherence, can be successfully provided.

AB - Diminishing the appearance of a fence in an image is a challenging research area due to the characteristics of fences (thinness, lack of texture, etc.) and the need for occluded background restoration. In this paper, we describe a fence removal method for an image sequence captured by a user making a sweep motion, in which occluded background is potentially observed. To make use of geometric and appearance information such as consecutive images, we use two well-known approaches: structure from motion and light field rendering. Results using real image sequences show that our method can stably segment fences and preserve background details for various fence and background combinations. A new video without the fence, with frame coherence, can be successfully provided.

KW - diminished reality (DR)

KW - fence

KW - light field rendering (LFR)

KW - structure from motion (SfM)

KW - video

KW - video repair

UR - http://www.scopus.com/inward/record.url?scp=85057309626&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85057309626&partnerID=8YFLogxK

U2 - 10.1007/s41095-018-0126-8

DO - 10.1007/s41095-018-0126-8

M3 - Article

AN - SCOPUS:85057309626

VL - 5

SP - 21

EP - 32

JO - Computational Visual Media

JF - Computational Visual Media

SN - 2096-0433

IS - 1

ER -

Removing fences from sweep motion videos using global 3D reconstruction and fence-aware light field rendering

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this