Arbitrary Viewpoint Video Synthesis from Multiple Uncalibrated Cameras

Satoshi Yaguchi, Hideo Saito

研究成果: Article

19 引用 (Scopus)

抄録

We propose a method for arbitrary view synthesis from uncalibrated multiple camera system, targeting large spaces such as soccer stadiums. In Projective Grid Space (PGS), which is a three-dimensional space defined by epipolar geometry between two basis cameras in the camera system, we reconstruct three-dimensional shape models from silhouette images. Using the three-dimensional shape models reconstructed in the PGS, we obtain a dense map of the point correspondence between reference images. The obtained correspondence can synthesize the image of arbitrary view between the reference images. We also propose a method for merging the synthesized images with the virtual background scene in the PGS. We apply the proposed methods to image sequences taken by a multiple camera system, which installed in a large concert hall. The synthesized image sequences of virtual camera have enough quality to demonstrate effectiveness of the proposed method.

元の言語English
ページ(範囲)430-439
ページ数10
ジャーナルIEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
34
発行部数1
DOI
出版物ステータスPublished - 2004 2

Fingerprint

Cameras
Stadiums
Merging
Geometry

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Artificial Intelligence
  • Human-Computer Interaction

これを引用

@article{befb144d6691422d81f569cd2433e797,
title = "Arbitrary Viewpoint Video Synthesis from Multiple Uncalibrated Cameras",
abstract = "We propose a method for arbitrary view synthesis from uncalibrated multiple camera system, targeting large spaces such as soccer stadiums. In Projective Grid Space (PGS), which is a three-dimensional space defined by epipolar geometry between two basis cameras in the camera system, we reconstruct three-dimensional shape models from silhouette images. Using the three-dimensional shape models reconstructed in the PGS, we obtain a dense map of the point correspondence between reference images. The obtained correspondence can synthesize the image of arbitrary view between the reference images. We also propose a method for merging the synthesized images with the virtual background scene in the PGS. We apply the proposed methods to image sequences taken by a multiple camera system, which installed in a large concert hall. The synthesized image sequences of virtual camera have enough quality to demonstrate effectiveness of the proposed method.",
keywords = "Fundamental matrix, Projective geometry, Projective grid space, Shape from multiple cameras, View interpolation, Virtual view synthesis",
author = "Satoshi Yaguchi and Hideo Saito",
year = "2004",
month = "2",
doi = "10.1109/TSMCB.2003.817108",
language = "English",
volume = "34",
pages = "430--439",
journal = "IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics",
issn = "1083-4419",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "1",

}

TY - JOUR

T1 - Arbitrary Viewpoint Video Synthesis from Multiple Uncalibrated Cameras

AU - Yaguchi, Satoshi

AU - Saito, Hideo

PY - 2004/2

Y1 - 2004/2

N2 - We propose a method for arbitrary view synthesis from uncalibrated multiple camera system, targeting large spaces such as soccer stadiums. In Projective Grid Space (PGS), which is a three-dimensional space defined by epipolar geometry between two basis cameras in the camera system, we reconstruct three-dimensional shape models from silhouette images. Using the three-dimensional shape models reconstructed in the PGS, we obtain a dense map of the point correspondence between reference images. The obtained correspondence can synthesize the image of arbitrary view between the reference images. We also propose a method for merging the synthesized images with the virtual background scene in the PGS. We apply the proposed methods to image sequences taken by a multiple camera system, which installed in a large concert hall. The synthesized image sequences of virtual camera have enough quality to demonstrate effectiveness of the proposed method.

AB - We propose a method for arbitrary view synthesis from uncalibrated multiple camera system, targeting large spaces such as soccer stadiums. In Projective Grid Space (PGS), which is a three-dimensional space defined by epipolar geometry between two basis cameras in the camera system, we reconstruct three-dimensional shape models from silhouette images. Using the three-dimensional shape models reconstructed in the PGS, we obtain a dense map of the point correspondence between reference images. The obtained correspondence can synthesize the image of arbitrary view between the reference images. We also propose a method for merging the synthesized images with the virtual background scene in the PGS. We apply the proposed methods to image sequences taken by a multiple camera system, which installed in a large concert hall. The synthesized image sequences of virtual camera have enough quality to demonstrate effectiveness of the proposed method.

KW - Fundamental matrix

KW - Projective geometry

KW - Projective grid space

KW - Shape from multiple cameras

KW - View interpolation

KW - Virtual view synthesis

UR - http://www.scopus.com/inward/record.url?scp=0742272556&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0742272556&partnerID=8YFLogxK

U2 - 10.1109/TSMCB.2003.817108

DO - 10.1109/TSMCB.2003.817108

M3 - Article

C2 - 15369084

AN - SCOPUS:0742272556

VL - 34

SP - 430

EP - 439

JO - IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

JF - IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

SN - 1083-4419

IS - 1

ER -