Free viewpoint video synthesis and presentation from multiple sporting videos

Naho Inamoto, Hideo Saito

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

This paper presents a new framework for observation of sporting events using HMD by applying the method of free viewpoint video synthesis for dynamic events to mixed reality. According to the viewpoint position of an observer, a virtual view image is generated by view interpolation among multiple sporting videos captured in a stadium, and then overlaid onto the real world via HMD. This makes the observer feel as if the match is played in front of his/her eyes. The proposed method performs virtual view synthesis and geometric registration between the real world and the virtual view images using projective geometry between cameras, which can be estimated from correspondence of natural feature points. It does not require calibration of multiple cameras imaging the sporting match and HMD camera capturing the real world. In this paper, we have constructed a mixed reality presentation system for a soccer match in order to demonstrate the utility of the proposed method. This system can overlay soccer scenes captured with multiple cameras in a soccer stadium onto a desktop field model with HMD.

Original languageEnglish
Pages (from-to)40-49
Number of pages10
JournalElectronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)
Volume90
Issue number2
DOIs
Publication statusPublished - 2007 Feb

Fingerprint

Helmet mounted displays
Cameras
Stadiums
Interpolation
Calibration
Imaging techniques
Geometry

Keywords

  • Free viewpoint
  • HMD
  • Mixed reality
  • Projective geometry
  • Sports broadcasting

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

@article{5b3a28a634be4c3daa9eb0d5dbc8dc93,
title = "Free viewpoint video synthesis and presentation from multiple sporting videos",
abstract = "This paper presents a new framework for observation of sporting events using HMD by applying the method of free viewpoint video synthesis for dynamic events to mixed reality. According to the viewpoint position of an observer, a virtual view image is generated by view interpolation among multiple sporting videos captured in a stadium, and then overlaid onto the real world via HMD. This makes the observer feel as if the match is played in front of his/her eyes. The proposed method performs virtual view synthesis and geometric registration between the real world and the virtual view images using projective geometry between cameras, which can be estimated from correspondence of natural feature points. It does not require calibration of multiple cameras imaging the sporting match and HMD camera capturing the real world. In this paper, we have constructed a mixed reality presentation system for a soccer match in order to demonstrate the utility of the proposed method. This system can overlay soccer scenes captured with multiple cameras in a soccer stadium onto a desktop field model with HMD.",
keywords = "Free viewpoint, HMD, Mixed reality, Projective geometry, Sports broadcasting",
author = "Naho Inamoto and Hideo Saito",
year = "2007",
month = "2",
doi = "10.1002/ecjc.20311",
language = "English",
volume = "90",
pages = "40--49",
journal = "Electronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)",
issn = "1042-0967",
publisher = "John Wiley and Sons Inc.",
number = "2",

}

TY - JOUR

T1 - Free viewpoint video synthesis and presentation from multiple sporting videos

AU - Inamoto, Naho

AU - Saito, Hideo

PY - 2007/2

Y1 - 2007/2

N2 - This paper presents a new framework for observation of sporting events using HMD by applying the method of free viewpoint video synthesis for dynamic events to mixed reality. According to the viewpoint position of an observer, a virtual view image is generated by view interpolation among multiple sporting videos captured in a stadium, and then overlaid onto the real world via HMD. This makes the observer feel as if the match is played in front of his/her eyes. The proposed method performs virtual view synthesis and geometric registration between the real world and the virtual view images using projective geometry between cameras, which can be estimated from correspondence of natural feature points. It does not require calibration of multiple cameras imaging the sporting match and HMD camera capturing the real world. In this paper, we have constructed a mixed reality presentation system for a soccer match in order to demonstrate the utility of the proposed method. This system can overlay soccer scenes captured with multiple cameras in a soccer stadium onto a desktop field model with HMD.

AB - This paper presents a new framework for observation of sporting events using HMD by applying the method of free viewpoint video synthesis for dynamic events to mixed reality. According to the viewpoint position of an observer, a virtual view image is generated by view interpolation among multiple sporting videos captured in a stadium, and then overlaid onto the real world via HMD. This makes the observer feel as if the match is played in front of his/her eyes. The proposed method performs virtual view synthesis and geometric registration between the real world and the virtual view images using projective geometry between cameras, which can be estimated from correspondence of natural feature points. It does not require calibration of multiple cameras imaging the sporting match and HMD camera capturing the real world. In this paper, we have constructed a mixed reality presentation system for a soccer match in order to demonstrate the utility of the proposed method. This system can overlay soccer scenes captured with multiple cameras in a soccer stadium onto a desktop field model with HMD.

KW - Free viewpoint

KW - HMD

KW - Mixed reality

KW - Projective geometry

KW - Sports broadcasting

UR - http://www.scopus.com/inward/record.url?scp=33751167605&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33751167605&partnerID=8YFLogxK

U2 - 10.1002/ecjc.20311

DO - 10.1002/ecjc.20311

M3 - Article

AN - SCOPUS:33751167605

VL - 90

SP - 40

EP - 49

JO - Electronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)

JF - Electronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)

SN - 1042-0967

IS - 2

ER -