Virtual viewpoint replay for a soccer match by view interpolation from multiple cameras

Naho Lnamoto, Hideo Saito

Research output: Contribution to journalArticle

48 Citations (Scopus)

Abstract

This paper presents a novel method for virtual view synthesis that allows viewers to virtually fly through real soccer scenes, which are captured by multiple cameras in a stadium. The proposed method generates images of arbitrary viewpoints by view interpolation of real camera images near the chosen viewpoints. In this method, cameras do not need to be strongly calibrated since projective geometry between cameras is employed for the interpolation. For avoiding the complex and unreliable process of 3-D recovery, object scenes are segmented into several regions according to the geometric property of the scene. Dense correspondence between real views, which is necessary for intermediate view generation, is automatically obtained by applying projective geometry to each region. By superimposing intermediate images for all regions, virtual views for the entire soccer scene are generated. The efforts for camera calibration are reduced and correspondence matching requires no manual operation; hence, the proposed method can be easily applied to dynamic events in a large space. An application for fly-through observations of soccer match replays is introduced along with the algorithm of view synthesis and experimental results. This is a new approach for providing arbitrary views of an entire dynamic event.

Original languageEnglish
Pages (from-to)1155-1166
Number of pages12
JournalIEEE Transactions on Multimedia
Volume9
Issue number6
DOIs
Publication statusPublished - 2007 Oct

Fingerprint

Interpolation
Cameras
Stadiums
Geometry
Calibration
Recovery

Keywords

  • Dynamic event
  • Multiple cameras
  • Projective geometry
  • Soccer match
  • View interpolation
  • Virtual view synthesis

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems
  • Computer Graphics and Computer-Aided Design
  • Software

Cite this

Virtual viewpoint replay for a soccer match by view interpolation from multiple cameras. / Lnamoto, Naho; Saito, Hideo.

In: IEEE Transactions on Multimedia, Vol. 9, No. 6, 10.2007, p. 1155-1166.

Research output: Contribution to journalArticle

@article{de89f3174fe346b2a07cea3d9049368e,
title = "Virtual viewpoint replay for a soccer match by view interpolation from multiple cameras",
abstract = "This paper presents a novel method for virtual view synthesis that allows viewers to virtually fly through real soccer scenes, which are captured by multiple cameras in a stadium. The proposed method generates images of arbitrary viewpoints by view interpolation of real camera images near the chosen viewpoints. In this method, cameras do not need to be strongly calibrated since projective geometry between cameras is employed for the interpolation. For avoiding the complex and unreliable process of 3-D recovery, object scenes are segmented into several regions according to the geometric property of the scene. Dense correspondence between real views, which is necessary for intermediate view generation, is automatically obtained by applying projective geometry to each region. By superimposing intermediate images for all regions, virtual views for the entire soccer scene are generated. The efforts for camera calibration are reduced and correspondence matching requires no manual operation; hence, the proposed method can be easily applied to dynamic events in a large space. An application for fly-through observations of soccer match replays is introduced along with the algorithm of view synthesis and experimental results. This is a new approach for providing arbitrary views of an entire dynamic event.",
keywords = "Dynamic event, Multiple cameras, Projective geometry, Soccer match, View interpolation, Virtual view synthesis",
author = "Naho Lnamoto and Hideo Saito",
year = "2007",
month = "10",
doi = "10.1109/TMM.2007.902832",
language = "English",
volume = "9",
pages = "1155--1166",
journal = "IEEE Transactions on Multimedia",
issn = "1520-9210",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "6",

}

TY - JOUR

T1 - Virtual viewpoint replay for a soccer match by view interpolation from multiple cameras

AU - Lnamoto, Naho

AU - Saito, Hideo

PY - 2007/10

Y1 - 2007/10

N2 - This paper presents a novel method for virtual view synthesis that allows viewers to virtually fly through real soccer scenes, which are captured by multiple cameras in a stadium. The proposed method generates images of arbitrary viewpoints by view interpolation of real camera images near the chosen viewpoints. In this method, cameras do not need to be strongly calibrated since projective geometry between cameras is employed for the interpolation. For avoiding the complex and unreliable process of 3-D recovery, object scenes are segmented into several regions according to the geometric property of the scene. Dense correspondence between real views, which is necessary for intermediate view generation, is automatically obtained by applying projective geometry to each region. By superimposing intermediate images for all regions, virtual views for the entire soccer scene are generated. The efforts for camera calibration are reduced and correspondence matching requires no manual operation; hence, the proposed method can be easily applied to dynamic events in a large space. An application for fly-through observations of soccer match replays is introduced along with the algorithm of view synthesis and experimental results. This is a new approach for providing arbitrary views of an entire dynamic event.

AB - This paper presents a novel method for virtual view synthesis that allows viewers to virtually fly through real soccer scenes, which are captured by multiple cameras in a stadium. The proposed method generates images of arbitrary viewpoints by view interpolation of real camera images near the chosen viewpoints. In this method, cameras do not need to be strongly calibrated since projective geometry between cameras is employed for the interpolation. For avoiding the complex and unreliable process of 3-D recovery, object scenes are segmented into several regions according to the geometric property of the scene. Dense correspondence between real views, which is necessary for intermediate view generation, is automatically obtained by applying projective geometry to each region. By superimposing intermediate images for all regions, virtual views for the entire soccer scene are generated. The efforts for camera calibration are reduced and correspondence matching requires no manual operation; hence, the proposed method can be easily applied to dynamic events in a large space. An application for fly-through observations of soccer match replays is introduced along with the algorithm of view synthesis and experimental results. This is a new approach for providing arbitrary views of an entire dynamic event.

KW - Dynamic event

KW - Multiple cameras

KW - Projective geometry

KW - Soccer match

KW - View interpolation

KW - Virtual view synthesis

UR - http://www.scopus.com/inward/record.url?scp=34648847296&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34648847296&partnerID=8YFLogxK

U2 - 10.1109/TMM.2007.902832

DO - 10.1109/TMM.2007.902832

M3 - Article

AN - SCOPUS:34648847296

VL - 9

SP - 1155

EP - 1166

JO - IEEE Transactions on Multimedia

JF - IEEE Transactions on Multimedia

SN - 1520-9210

IS - 6

ER -