On-line free-viewpoint video: From single to multiple view rendering

Vincent Nozick, Hideo Saito

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

In recent years, many image-based rendering techniques have advanced from static to dynamic scenes and thus become video-based rendering (VBR) methods. But actually, only few of them can render new views on-line. We present a new VBR system that creates new views of a dynamic scene in live. This system provides high quality images and does not require any background subtraction. Our method follows a plane-sweep approach and reaches real-time rendering using consumer graphic hardware, graphics processing unit (GPU). Only one computer is used for both acquisition and rendering. The video stream acquisition is performed by at least 3 webcams. We propose an additional video stream management that extends the number of webcams to 10 or more. These considerations make our system low-cost and hence accessible for everyone. We also present an adaptation of our plane-sweep method to create simultaneously multiple views of the scene in real-time. Our system is especially designed for stereovision using autostereoscopic displays. The new views are computed from 4 webcams connected to a computer and are compressed in order to be transfered to the mobile phone. Due to GPU programming, our method provides up to 16 images of the scene in real-time. The use of both GPU and CPU makes this method work on only one consumer grade computer.

Original languageEnglish
Pages (from-to)257-267
Number of pages11
JournalInternational Journal of Automation and Computing
Volume5
Issue number3
DOIs
Publication statusPublished - 2008 Jul

Fingerprint

Rendering
Graphics Processing Unit
Plane Sweep
Real-time
Mobile phones
Image quality
Program processors
Image-based Rendering
Autostereoscopic Display
Graphics Hardware
Display devices
Background Subtraction
Stereo Vision
Hardware
Mobile Phone
Image Quality
Programming
Graphics processing unit
Costs
Acquisition

Keywords

  • Autostereoscopic
  • Free-viewpoint video
  • Graphics processing unit (GPU)
  • Stereovision
  • Video-based rendering (VBR)
  • View interpolation
  • Webcam

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Science Applications
  • Applied Mathematics
  • Modelling and Simulation

Cite this

On-line free-viewpoint video : From single to multiple view rendering. / Nozick, Vincent; Saito, Hideo.

In: International Journal of Automation and Computing, Vol. 5, No. 3, 07.2008, p. 257-267.

Research output: Contribution to journalArticle

@article{7fa324a7d51643b2ae60870ca258de6b,
title = "On-line free-viewpoint video: From single to multiple view rendering",
abstract = "In recent years, many image-based rendering techniques have advanced from static to dynamic scenes and thus become video-based rendering (VBR) methods. But actually, only few of them can render new views on-line. We present a new VBR system that creates new views of a dynamic scene in live. This system provides high quality images and does not require any background subtraction. Our method follows a plane-sweep approach and reaches real-time rendering using consumer graphic hardware, graphics processing unit (GPU). Only one computer is used for both acquisition and rendering. The video stream acquisition is performed by at least 3 webcams. We propose an additional video stream management that extends the number of webcams to 10 or more. These considerations make our system low-cost and hence accessible for everyone. We also present an adaptation of our plane-sweep method to create simultaneously multiple views of the scene in real-time. Our system is especially designed for stereovision using autostereoscopic displays. The new views are computed from 4 webcams connected to a computer and are compressed in order to be transfered to the mobile phone. Due to GPU programming, our method provides up to 16 images of the scene in real-time. The use of both GPU and CPU makes this method work on only one consumer grade computer.",
keywords = "Autostereoscopic, Free-viewpoint video, Graphics processing unit (GPU), Stereovision, Video-based rendering (VBR), View interpolation, Webcam",
author = "Vincent Nozick and Hideo Saito",
year = "2008",
month = "7",
doi = "10.1007/s11633-008-0257-y",
language = "English",
volume = "5",
pages = "257--267",
journal = "International Journal of Automation and Computing",
issn = "1476-8186",
publisher = "Chinese Academy of Sciences",
number = "3",

}

TY - JOUR

T1 - On-line free-viewpoint video

T2 - From single to multiple view rendering

AU - Nozick, Vincent

AU - Saito, Hideo

PY - 2008/7

Y1 - 2008/7

N2 - In recent years, many image-based rendering techniques have advanced from static to dynamic scenes and thus become video-based rendering (VBR) methods. But actually, only few of them can render new views on-line. We present a new VBR system that creates new views of a dynamic scene in live. This system provides high quality images and does not require any background subtraction. Our method follows a plane-sweep approach and reaches real-time rendering using consumer graphic hardware, graphics processing unit (GPU). Only one computer is used for both acquisition and rendering. The video stream acquisition is performed by at least 3 webcams. We propose an additional video stream management that extends the number of webcams to 10 or more. These considerations make our system low-cost and hence accessible for everyone. We also present an adaptation of our plane-sweep method to create simultaneously multiple views of the scene in real-time. Our system is especially designed for stereovision using autostereoscopic displays. The new views are computed from 4 webcams connected to a computer and are compressed in order to be transfered to the mobile phone. Due to GPU programming, our method provides up to 16 images of the scene in real-time. The use of both GPU and CPU makes this method work on only one consumer grade computer.

AB - In recent years, many image-based rendering techniques have advanced from static to dynamic scenes and thus become video-based rendering (VBR) methods. But actually, only few of them can render new views on-line. We present a new VBR system that creates new views of a dynamic scene in live. This system provides high quality images and does not require any background subtraction. Our method follows a plane-sweep approach and reaches real-time rendering using consumer graphic hardware, graphics processing unit (GPU). Only one computer is used for both acquisition and rendering. The video stream acquisition is performed by at least 3 webcams. We propose an additional video stream management that extends the number of webcams to 10 or more. These considerations make our system low-cost and hence accessible for everyone. We also present an adaptation of our plane-sweep method to create simultaneously multiple views of the scene in real-time. Our system is especially designed for stereovision using autostereoscopic displays. The new views are computed from 4 webcams connected to a computer and are compressed in order to be transfered to the mobile phone. Due to GPU programming, our method provides up to 16 images of the scene in real-time. The use of both GPU and CPU makes this method work on only one consumer grade computer.

KW - Autostereoscopic

KW - Free-viewpoint video

KW - Graphics processing unit (GPU)

KW - Stereovision

KW - Video-based rendering (VBR)

KW - View interpolation

KW - Webcam

UR - http://www.scopus.com/inward/record.url?scp=47249087817&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=47249087817&partnerID=8YFLogxK

U2 - 10.1007/s11633-008-0257-y

DO - 10.1007/s11633-008-0257-y

M3 - Article

AN - SCOPUS:47249087817

VL - 5

SP - 257

EP - 267

JO - International Journal of Automation and Computing

JF - International Journal of Automation and Computing

SN - 1476-8186

IS - 3

ER -