Free viewpoint video synthesis and presentation from multiple sporting videos

Naho Inamoto, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Citations (Scopus)

Abstract

This paper introduces two kinds of free viewpoint observation systems for sporting events captured with uncalibrated multiple cameras in a stadium. In the first system (Viewpoint on Demand System), a user can watch the realistic sporting scenes with the original stadium. In the second system (Mixed Reality Presentation System), a user can virtually watch the scenes overlaid on a desktop stadium model via a video see-through head mounted display (HMD). In the both systems, the user can observe sporting events from his/her favorite viewpoints, where the virtual view images are synthesized and presented by performing view interpolation. As outdoor scenes often have variations in lighting, we develop the systems to handle the changes of lighting condition. If the captured scene contains shadows, we synthesize the virtual view image of the shadows of the background and the foreground independently from real camera images using projective geometry between cameras. The shadows of the foreground objects are then overlaid on the synthesized background of the original stadium or the stadium model in front of the user respectively. The results indicate that the appearance of shadows can produce a realistic mixed reality presentation.

Original languageEnglish
Title of host publicationIEEE International Conference on Multimedia and Expo, ICME 2005
Pages326-329
Number of pages4
Volume2005
DOIs
Publication statusPublished - 2005
EventIEEE International Conference on Multimedia and Expo, ICME 2005 - Amsterdam, Netherlands
Duration: 2005 Jul 62005 Jul 8

Other

OtherIEEE International Conference on Multimedia and Expo, ICME 2005
CountryNetherlands
CityAmsterdam
Period05/7/605/7/8

Fingerprint

Stadiums
Cameras
Lighting
Interpolation
Display devices
Geometry

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Inamoto, N., & Saito, H. (2005). Free viewpoint video synthesis and presentation from multiple sporting videos. In IEEE International Conference on Multimedia and Expo, ICME 2005 (Vol. 2005, pp. 326-329). [1521426] https://doi.org/10.1109/ICME.2005.1521426

Free viewpoint video synthesis and presentation from multiple sporting videos. / Inamoto, Naho; Saito, Hideo.

IEEE International Conference on Multimedia and Expo, ICME 2005. Vol. 2005 2005. p. 326-329 1521426.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Inamoto, N & Saito, H 2005, Free viewpoint video synthesis and presentation from multiple sporting videos. in IEEE International Conference on Multimedia and Expo, ICME 2005. vol. 2005, 1521426, pp. 326-329, IEEE International Conference on Multimedia and Expo, ICME 2005, Amsterdam, Netherlands, 05/7/6. https://doi.org/10.1109/ICME.2005.1521426
Inamoto N, Saito H. Free viewpoint video synthesis and presentation from multiple sporting videos. In IEEE International Conference on Multimedia and Expo, ICME 2005. Vol. 2005. 2005. p. 326-329. 1521426 https://doi.org/10.1109/ICME.2005.1521426
Inamoto, Naho ; Saito, Hideo. / Free viewpoint video synthesis and presentation from multiple sporting videos. IEEE International Conference on Multimedia and Expo, ICME 2005. Vol. 2005 2005. pp. 326-329
@inproceedings{6d395d4691c74971ad27563347805962,
title = "Free viewpoint video synthesis and presentation from multiple sporting videos",
abstract = "This paper introduces two kinds of free viewpoint observation systems for sporting events captured with uncalibrated multiple cameras in a stadium. In the first system (Viewpoint on Demand System), a user can watch the realistic sporting scenes with the original stadium. In the second system (Mixed Reality Presentation System), a user can virtually watch the scenes overlaid on a desktop stadium model via a video see-through head mounted display (HMD). In the both systems, the user can observe sporting events from his/her favorite viewpoints, where the virtual view images are synthesized and presented by performing view interpolation. As outdoor scenes often have variations in lighting, we develop the systems to handle the changes of lighting condition. If the captured scene contains shadows, we synthesize the virtual view image of the shadows of the background and the foreground independently from real camera images using projective geometry between cameras. The shadows of the foreground objects are then overlaid on the synthesized background of the original stadium or the stadium model in front of the user respectively. The results indicate that the appearance of shadows can produce a realistic mixed reality presentation.",
author = "Naho Inamoto and Hideo Saito",
year = "2005",
doi = "10.1109/ICME.2005.1521426",
language = "English",
isbn = "0780393325",
volume = "2005",
pages = "326--329",
booktitle = "IEEE International Conference on Multimedia and Expo, ICME 2005",

}

TY - GEN

T1 - Free viewpoint video synthesis and presentation from multiple sporting videos

AU - Inamoto, Naho

AU - Saito, Hideo

PY - 2005

Y1 - 2005

N2 - This paper introduces two kinds of free viewpoint observation systems for sporting events captured with uncalibrated multiple cameras in a stadium. In the first system (Viewpoint on Demand System), a user can watch the realistic sporting scenes with the original stadium. In the second system (Mixed Reality Presentation System), a user can virtually watch the scenes overlaid on a desktop stadium model via a video see-through head mounted display (HMD). In the both systems, the user can observe sporting events from his/her favorite viewpoints, where the virtual view images are synthesized and presented by performing view interpolation. As outdoor scenes often have variations in lighting, we develop the systems to handle the changes of lighting condition. If the captured scene contains shadows, we synthesize the virtual view image of the shadows of the background and the foreground independently from real camera images using projective geometry between cameras. The shadows of the foreground objects are then overlaid on the synthesized background of the original stadium or the stadium model in front of the user respectively. The results indicate that the appearance of shadows can produce a realistic mixed reality presentation.

AB - This paper introduces two kinds of free viewpoint observation systems for sporting events captured with uncalibrated multiple cameras in a stadium. In the first system (Viewpoint on Demand System), a user can watch the realistic sporting scenes with the original stadium. In the second system (Mixed Reality Presentation System), a user can virtually watch the scenes overlaid on a desktop stadium model via a video see-through head mounted display (HMD). In the both systems, the user can observe sporting events from his/her favorite viewpoints, where the virtual view images are synthesized and presented by performing view interpolation. As outdoor scenes often have variations in lighting, we develop the systems to handle the changes of lighting condition. If the captured scene contains shadows, we synthesize the virtual view image of the shadows of the background and the foreground independently from real camera images using projective geometry between cameras. The shadows of the foreground objects are then overlaid on the synthesized background of the original stadium or the stadium model in front of the user respectively. The results indicate that the appearance of shadows can produce a realistic mixed reality presentation.

UR - http://www.scopus.com/inward/record.url?scp=33750556816&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33750556816&partnerID=8YFLogxK

U2 - 10.1109/ICME.2005.1521426

DO - 10.1109/ICME.2005.1521426

M3 - Conference contribution

AN - SCOPUS:33750556816

SN - 0780393325

SN - 9780780393325

VL - 2005

SP - 326

EP - 329

BT - IEEE International Conference on Multimedia and Expo, ICME 2005

ER -