Real-time video-based rendering from uncalibrated cameras using plane-sweep algorithm

Songkran Jarusirisawad, Vincent Nozick, Hideo Saito

Research output: Contribution to journalArticle

Abstract

In this paper, we present a new online video-based rendering (VBR) method that creates new views of a scene from uncalibrated cameras. Our method does not require information about the cameras intrinsic parameters. For obtaining a geometrical relation among the cameras, we use projective grid space (PGS) which is 3D space defined by epipolar geometry between two basis cameras. The other cameras are registered to the same 3D space by trifocal tensors between these basis cameras. We simultaneously reconstruct and render novel view using our proposed plane-sweep algorithm in PGS. To achieve real-time performance, we implemented the proposed algorithm in graphics processing unit (GPU). We succeed to create novel view images in real-time from uncalibrated cameras and the results show the efficiency of our proposed method.

Original languageEnglish
Pages (from-to)577-585
Number of pages9
JournalJournal of Visual Communication and Image Representation
Volume21
Issue number5-6
DOIs
Publication statusPublished - 2010 Jul

Fingerprint

Cameras
Tensors
Geometry

Keywords

  • Free viewpoint video
  • Graphics processing unit (GPU)
  • Plane-sweep
  • Projective grid space
  • Real-time
  • Uncalibrated cameras
  • Video-based rendering
  • View interpolation

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Media Technology
  • Computer Vision and Pattern Recognition
  • Signal Processing

Cite this

Real-time video-based rendering from uncalibrated cameras using plane-sweep algorithm. / Jarusirisawad, Songkran; Nozick, Vincent; Saito, Hideo.

In: Journal of Visual Communication and Image Representation, Vol. 21, No. 5-6, 07.2010, p. 577-585.

Research output: Contribution to journalArticle

@article{fe3385c74f814f468df4b0538b4eeb68,
title = "Real-time video-based rendering from uncalibrated cameras using plane-sweep algorithm",
abstract = "In this paper, we present a new online video-based rendering (VBR) method that creates new views of a scene from uncalibrated cameras. Our method does not require information about the cameras intrinsic parameters. For obtaining a geometrical relation among the cameras, we use projective grid space (PGS) which is 3D space defined by epipolar geometry between two basis cameras. The other cameras are registered to the same 3D space by trifocal tensors between these basis cameras. We simultaneously reconstruct and render novel view using our proposed plane-sweep algorithm in PGS. To achieve real-time performance, we implemented the proposed algorithm in graphics processing unit (GPU). We succeed to create novel view images in real-time from uncalibrated cameras and the results show the efficiency of our proposed method.",
keywords = "Free viewpoint video, Graphics processing unit (GPU), Plane-sweep, Projective grid space, Real-time, Uncalibrated cameras, Video-based rendering, View interpolation",
author = "Songkran Jarusirisawad and Vincent Nozick and Hideo Saito",
year = "2010",
month = "7",
doi = "10.1016/j.jvcir.2010.01.005",
language = "English",
volume = "21",
pages = "577--585",
journal = "Journal of Visual Communication and Image Representation",
issn = "1047-3203",
publisher = "Academic Press Inc.",
number = "5-6",

}

TY - JOUR

T1 - Real-time video-based rendering from uncalibrated cameras using plane-sweep algorithm

AU - Jarusirisawad, Songkran

AU - Nozick, Vincent

AU - Saito, Hideo

PY - 2010/7

Y1 - 2010/7

N2 - In this paper, we present a new online video-based rendering (VBR) method that creates new views of a scene from uncalibrated cameras. Our method does not require information about the cameras intrinsic parameters. For obtaining a geometrical relation among the cameras, we use projective grid space (PGS) which is 3D space defined by epipolar geometry between two basis cameras. The other cameras are registered to the same 3D space by trifocal tensors between these basis cameras. We simultaneously reconstruct and render novel view using our proposed plane-sweep algorithm in PGS. To achieve real-time performance, we implemented the proposed algorithm in graphics processing unit (GPU). We succeed to create novel view images in real-time from uncalibrated cameras and the results show the efficiency of our proposed method.

AB - In this paper, we present a new online video-based rendering (VBR) method that creates new views of a scene from uncalibrated cameras. Our method does not require information about the cameras intrinsic parameters. For obtaining a geometrical relation among the cameras, we use projective grid space (PGS) which is 3D space defined by epipolar geometry between two basis cameras. The other cameras are registered to the same 3D space by trifocal tensors between these basis cameras. We simultaneously reconstruct and render novel view using our proposed plane-sweep algorithm in PGS. To achieve real-time performance, we implemented the proposed algorithm in graphics processing unit (GPU). We succeed to create novel view images in real-time from uncalibrated cameras and the results show the efficiency of our proposed method.

KW - Free viewpoint video

KW - Graphics processing unit (GPU)

KW - Plane-sweep

KW - Projective grid space

KW - Real-time

KW - Uncalibrated cameras

KW - Video-based rendering

KW - View interpolation

UR - http://www.scopus.com/inward/record.url?scp=77957880679&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77957880679&partnerID=8YFLogxK

U2 - 10.1016/j.jvcir.2010.01.005

DO - 10.1016/j.jvcir.2010.01.005

M3 - Article

VL - 21

SP - 577

EP - 585

JO - Journal of Visual Communication and Image Representation

JF - Journal of Visual Communication and Image Representation

SN - 1047-3203

IS - 5-6

ER -