On-line free-viewpoint video: From single to multiple view rendering

Vincent Nozick, Hideo Saito

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

In recent years, many image-based rendering techniques have advanced from static to dynamic scenes and thus become video-based rendering (VBR) methods. But actually, only few of them can render new views on-line. We present a new VBR system that creates new views of a dynamic scene in live. This system provides high quality images and does not require any background subtraction. Our method follows a plane-sweep approach and reaches real-time rendering using consumer graphic hardware, graphics processing unit (GPU). Only one computer is used for both acquisition and rendering. The video stream acquisition is performed by at least 3 webcams. We propose an additional video stream management that extends the number of webcams to 10 or more. These considerations make our system low-cost and hence accessible for everyone. We also present an adaptation of our plane-sweep method to create simultaneously multiple views of the scene in real-time. Our system is especially designed for stereovision using autostereoscopic displays. The new views are computed from 4 webcams connected to a computer and are compressed in order to be transfered to the mobile phone. Due to GPU programming, our method provides up to 16 images of the scene in real-time. The use of both GPU and CPU makes this method work on only one consumer grade computer.

Original languageEnglish
Pages (from-to)257-267
Number of pages11
JournalInternational Journal of Automation and Computing
Volume5
Issue number3
DOIs
Publication statusPublished - 2008 Jul 1

Keywords

  • Autostereoscopic
  • Free-viewpoint video
  • Graphics processing unit (GPU)
  • Stereovision
  • Video-based rendering (VBR)
  • View interpolation
  • Webcam

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Modelling and Simulation
  • Computer Science Applications
  • Applied Mathematics

Fingerprint Dive into the research topics of 'On-line free-viewpoint video: From single to multiple view rendering'. Together they form a unique fingerprint.

  • Cite this