Synthesizing free-viewpoint images from multiple view videos in soccer stadium

Kunihiko Hayashi, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

31 Citations (Scopus)

Abstract

We propose a new method for synthesizing free-viewpoint images from multiple view videos in soccer stadium. The previous method[1] can synthesize virtual viewpoint images at only intermediate viewpoint between real cameras. The previous method estimates only pixel-wise correspondences between input images for synthesizing virtual viewpoint images without a 3D reconstruction. In this paper, we propose a new method that can synthesize virtual viewpoint images at free-viewpoints which are not limited at intermediate viewpoint by reconstructing simple 3D models. To reconstruct the object soccer scene, we perform camera calibration without marker objects because we can save labor to put such objects on the soccer ground. For reconstructing of dynamic regions, we employ a bill-board representation of dynamic regions. The position of the billboard is determined by tracking the players. The billboard representation can realize a simple 3D reconstruction and transform textures into the appropriate appearance of the aspect of dynamic regions at virtual viewpoint. We also introduce the choice of optimal cameras for rendering on the billboard. We choose the optimal camera that has the most similar texture at virtual viewpoint. By applying our method to a soccer scene, we can synthesize free-viewpoint images by employing only pixel values of real images.

Original languageEnglish
Title of host publicationProceedings - Computer Graphics, Imaging and Visualisation
Subtitle of host publicationTechniques and Applications, CGIV'06
Pages220-225
Number of pages6
DOIs
Publication statusPublished - 2006 Dec 1
EventInternational Conference on Computer Graphics, Imaging and Visualisation, CGIV'06 - Sydney, Australia
Duration: 2006 Jul 262006 Jul 28

Publication series

NameProceedings - Computer Graphics, Imaging and Visualisation: Techniques and Applications, CGIV'06
Volume2006

Other

OtherInternational Conference on Computer Graphics, Imaging and Visualisation, CGIV'06
CountryAustralia
CitySydney
Period06/7/2606/7/28

Keywords

  • Calibration
  • Free-viewpoint
  • Homography
  • Image processing
  • Multiple view videos
  • Projective matrix

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Software

Fingerprint Dive into the research topics of 'Synthesizing free-viewpoint images from multiple view videos in soccer stadium'. Together they form a unique fingerprint.

Cite this