Real-time video-based rendering from uncalibrated cameras using plane-sweep algorithm

Songkran Jarusirisawad, Vincent Nozick, Hideo Saito

Research output: Contribution to journalArticle

Abstract

In this paper, we present a new online video-based rendering (VBR) method that creates new views of a scene from uncalibrated cameras. Our method does not require information about the cameras intrinsic parameters. For obtaining a geometrical relation among the cameras, we use projective grid space (PGS) which is 3D space defined by epipolar geometry between two basis cameras. The other cameras are registered to the same 3D space by trifocal tensors between these basis cameras. We simultaneously reconstruct and render novel view using our proposed plane-sweep algorithm in PGS. To achieve real-time performance, we implemented the proposed algorithm in graphics processing unit (GPU). We succeed to create novel view images in real-time from uncalibrated cameras and the results show the efficiency of our proposed method.

Original languageEnglish
Pages (from-to)577-585
Number of pages9
JournalJournal of Visual Communication and Image Representation
Volume21
Issue number5-6
DOIs
Publication statusPublished - 2010 Jul 1

Keywords

  • Free viewpoint video
  • Graphics processing unit (GPU)
  • Plane-sweep
  • Projective grid space
  • Real-time
  • Uncalibrated cameras
  • Video-based rendering
  • View interpolation

ASJC Scopus subject areas

  • Signal Processing
  • Media Technology
  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Real-time video-based rendering from uncalibrated cameras using plane-sweep algorithm'. Together they form a unique fingerprint.

  • Cite this