Arbitrary Viewpoint Video Synthesis from Multiple Uncalibrated Cameras

Satoshi Yaguchi, Hideo Saito

Research output: Contribution to journalArticle

19 Citations (Scopus)

Abstract

We propose a method for arbitrary view synthesis from uncalibrated multiple camera system, targeting large spaces such as soccer stadiums. In Projective Grid Space (PGS), which is a three-dimensional space defined by epipolar geometry between two basis cameras in the camera system, we reconstruct three-dimensional shape models from silhouette images. Using the three-dimensional shape models reconstructed in the PGS, we obtain a dense map of the point correspondence between reference images. The obtained correspondence can synthesize the image of arbitrary view between the reference images. We also propose a method for merging the synthesized images with the virtual background scene in the PGS. We apply the proposed methods to image sequences taken by a multiple camera system, which installed in a large concert hall. The synthesized image sequences of virtual camera have enough quality to demonstrate effectiveness of the proposed method.

Original languageEnglish
Pages (from-to)430-439
Number of pages10
JournalIEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Volume34
Issue number1
DOIs
Publication statusPublished - 2004 Feb

Fingerprint

Cameras
Stadiums
Merging
Geometry

Keywords

  • Fundamental matrix
  • Projective geometry
  • Projective grid space
  • Shape from multiple cameras
  • View interpolation
  • Virtual view synthesis

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Artificial Intelligence
  • Human-Computer Interaction

Cite this

Arbitrary Viewpoint Video Synthesis from Multiple Uncalibrated Cameras. / Yaguchi, Satoshi; Saito, Hideo.

In: IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, Vol. 34, No. 1, 02.2004, p. 430-439.

Research output: Contribution to journalArticle

@article{befb144d6691422d81f569cd2433e797,
title = "Arbitrary Viewpoint Video Synthesis from Multiple Uncalibrated Cameras",
abstract = "We propose a method for arbitrary view synthesis from uncalibrated multiple camera system, targeting large spaces such as soccer stadiums. In Projective Grid Space (PGS), which is a three-dimensional space defined by epipolar geometry between two basis cameras in the camera system, we reconstruct three-dimensional shape models from silhouette images. Using the three-dimensional shape models reconstructed in the PGS, we obtain a dense map of the point correspondence between reference images. The obtained correspondence can synthesize the image of arbitrary view between the reference images. We also propose a method for merging the synthesized images with the virtual background scene in the PGS. We apply the proposed methods to image sequences taken by a multiple camera system, which installed in a large concert hall. The synthesized image sequences of virtual camera have enough quality to demonstrate effectiveness of the proposed method.",
keywords = "Fundamental matrix, Projective geometry, Projective grid space, Shape from multiple cameras, View interpolation, Virtual view synthesis",
author = "Satoshi Yaguchi and Hideo Saito",
year = "2004",
month = "2",
doi = "10.1109/TSMCB.2003.817108",
language = "English",
volume = "34",
pages = "430--439",
journal = "IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics",
issn = "1083-4419",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "1",

}

TY - JOUR

T1 - Arbitrary Viewpoint Video Synthesis from Multiple Uncalibrated Cameras

AU - Yaguchi, Satoshi

AU - Saito, Hideo

PY - 2004/2

Y1 - 2004/2

N2 - We propose a method for arbitrary view synthesis from uncalibrated multiple camera system, targeting large spaces such as soccer stadiums. In Projective Grid Space (PGS), which is a three-dimensional space defined by epipolar geometry between two basis cameras in the camera system, we reconstruct three-dimensional shape models from silhouette images. Using the three-dimensional shape models reconstructed in the PGS, we obtain a dense map of the point correspondence between reference images. The obtained correspondence can synthesize the image of arbitrary view between the reference images. We also propose a method for merging the synthesized images with the virtual background scene in the PGS. We apply the proposed methods to image sequences taken by a multiple camera system, which installed in a large concert hall. The synthesized image sequences of virtual camera have enough quality to demonstrate effectiveness of the proposed method.

AB - We propose a method for arbitrary view synthesis from uncalibrated multiple camera system, targeting large spaces such as soccer stadiums. In Projective Grid Space (PGS), which is a three-dimensional space defined by epipolar geometry between two basis cameras in the camera system, we reconstruct three-dimensional shape models from silhouette images. Using the three-dimensional shape models reconstructed in the PGS, we obtain a dense map of the point correspondence between reference images. The obtained correspondence can synthesize the image of arbitrary view between the reference images. We also propose a method for merging the synthesized images with the virtual background scene in the PGS. We apply the proposed methods to image sequences taken by a multiple camera system, which installed in a large concert hall. The synthesized image sequences of virtual camera have enough quality to demonstrate effectiveness of the proposed method.

KW - Fundamental matrix

KW - Projective geometry

KW - Projective grid space

KW - Shape from multiple cameras

KW - View interpolation

KW - Virtual view synthesis

UR - http://www.scopus.com/inward/record.url?scp=0742272556&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0742272556&partnerID=8YFLogxK

U2 - 10.1109/TSMCB.2003.817108

DO - 10.1109/TSMCB.2003.817108

M3 - Article

C2 - 15369084

AN - SCOPUS:0742272556

VL - 34

SP - 430

EP - 439

JO - IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

JF - IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

SN - 1083-4419

IS - 1

ER -