Free viewpoint video synthesis and presentation from multiple sporting videos

Naho Inamoto, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Citations (Scopus)

Abstract

This paper introduces two kinds of free viewpoint observation systems for sporting events captured with uncalibrated multiple cameras in a stadium. In the first system (Viewpoint on Demand System), a user can watch the realistic sporting scenes with the original stadium. In the second system (Mixed Reality Presentation System), a user can virtually watch the scenes overlaid on a desktop stadium model via a video see-through head mounted display (HMD). In the both systems, the user can observe sporting events from his/her favorite viewpoints, where the virtual view images are synthesized and presented by performing view interpolation. As outdoor scenes often have variations in lighting, we develop the systems to handle the changes of lighting condition. If the captured scene contains shadows, we synthesize the virtual view image of the shadows of the background and the foreground independently from real camera images using projective geometry between cameras. The shadows of the foreground objects are then overlaid on the synthesized background of the original stadium or the stadium model in front of the user respectively. The results indicate that the appearance of shadows can produce a realistic mixed reality presentation.

Original languageEnglish
Title of host publicationIEEE International Conference on Multimedia and Expo, ICME 2005
Pages326-329
Number of pages4
DOIs
Publication statusPublished - 2005 Dec 1
EventIEEE International Conference on Multimedia and Expo, ICME 2005 - Amsterdam, Netherlands
Duration: 2005 Jul 62005 Jul 8

Publication series

NameIEEE International Conference on Multimedia and Expo, ICME 2005
Volume2005

Other

OtherIEEE International Conference on Multimedia and Expo, ICME 2005
CountryNetherlands
CityAmsterdam
Period05/7/605/7/8

    Fingerprint

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Inamoto, N., & Saito, H. (2005). Free viewpoint video synthesis and presentation from multiple sporting videos. In IEEE International Conference on Multimedia and Expo, ICME 2005 (pp. 326-329). [1521426] (IEEE International Conference on Multimedia and Expo, ICME 2005; Vol. 2005). https://doi.org/10.1109/ICME.2005.1521426