Video synthesis of a tennis player's viewpoint from multiple view videos

Kenji Kimura, Hideo Saito

Research output: Contribution to journalArticle

Abstract

We propose a new method for synthesizing player viewpoint images from multiple view tennis videos. Our method uses two key techniques: virtual-view synthesis and player's viewpoint estimation. In the former, we divide the object tennis scene into sub-regions, which are the background, tennis court ground, players, and ball. For each sub-region, a virtual viewpoint image is synthesized by considering the geometrical conditions of each region. Then the virtual viewpoint images of the sub-regions are merged into a virtual viewpoint image of the whole scene. In virtual viewpoint image generation, view interpolation, which is a way of synthesizing images at an intermediate viewpoint to two views of the real object, restricts the viewpoint to a position between the two views. To avoid this restriction, we propose our first key technique, whereby we are able to flexibly position the viewpoint. In our second technique, the viewpoint is computed using epipolar geometry from the center of gravity of a player. By applying the computed player's viewpoint to the former technique, we can synthesize player viewpoint images. Experimental results demonstrate that the proposed method can successfully provide a video of the tennis player's viewpoint from multiple-view video images.

Original languageEnglish
Pages (from-to)1503-1510
Number of pages8
JournalKyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers
Volume58
Issue number10
Publication statusPublished - 2004 Oct

Fingerprint

Tennis courts
Interpolation
Gravitation
Geometry

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Computer Vision and Pattern Recognition

Cite this

@article{8d5aa340dd804ca894f1cb7ea3f5c0fb,
title = "Video synthesis of a tennis player's viewpoint from multiple view videos",
abstract = "We propose a new method for synthesizing player viewpoint images from multiple view tennis videos. Our method uses two key techniques: virtual-view synthesis and player's viewpoint estimation. In the former, we divide the object tennis scene into sub-regions, which are the background, tennis court ground, players, and ball. For each sub-region, a virtual viewpoint image is synthesized by considering the geometrical conditions of each region. Then the virtual viewpoint images of the sub-regions are merged into a virtual viewpoint image of the whole scene. In virtual viewpoint image generation, view interpolation, which is a way of synthesizing images at an intermediate viewpoint to two views of the real object, restricts the viewpoint to a position between the two views. To avoid this restriction, we propose our first key technique, whereby we are able to flexibly position the viewpoint. In our second technique, the viewpoint is computed using epipolar geometry from the center of gravity of a player. By applying the computed player's viewpoint to the former technique, we can synthesize player viewpoint images. Experimental results demonstrate that the proposed method can successfully provide a video of the tennis player's viewpoint from multiple-view video images.",
author = "Kenji Kimura and Hideo Saito",
year = "2004",
month = "10",
language = "English",
volume = "58",
pages = "1503--1510",
journal = "Kyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers",
issn = "1342-6907",
publisher = "Institute of Image Information and Television Engineers",
number = "10",

}

TY - JOUR

T1 - Video synthesis of a tennis player's viewpoint from multiple view videos

AU - Kimura, Kenji

AU - Saito, Hideo

PY - 2004/10

Y1 - 2004/10

N2 - We propose a new method for synthesizing player viewpoint images from multiple view tennis videos. Our method uses two key techniques: virtual-view synthesis and player's viewpoint estimation. In the former, we divide the object tennis scene into sub-regions, which are the background, tennis court ground, players, and ball. For each sub-region, a virtual viewpoint image is synthesized by considering the geometrical conditions of each region. Then the virtual viewpoint images of the sub-regions are merged into a virtual viewpoint image of the whole scene. In virtual viewpoint image generation, view interpolation, which is a way of synthesizing images at an intermediate viewpoint to two views of the real object, restricts the viewpoint to a position between the two views. To avoid this restriction, we propose our first key technique, whereby we are able to flexibly position the viewpoint. In our second technique, the viewpoint is computed using epipolar geometry from the center of gravity of a player. By applying the computed player's viewpoint to the former technique, we can synthesize player viewpoint images. Experimental results demonstrate that the proposed method can successfully provide a video of the tennis player's viewpoint from multiple-view video images.

AB - We propose a new method for synthesizing player viewpoint images from multiple view tennis videos. Our method uses two key techniques: virtual-view synthesis and player's viewpoint estimation. In the former, we divide the object tennis scene into sub-regions, which are the background, tennis court ground, players, and ball. For each sub-region, a virtual viewpoint image is synthesized by considering the geometrical conditions of each region. Then the virtual viewpoint images of the sub-regions are merged into a virtual viewpoint image of the whole scene. In virtual viewpoint image generation, view interpolation, which is a way of synthesizing images at an intermediate viewpoint to two views of the real object, restricts the viewpoint to a position between the two views. To avoid this restriction, we propose our first key technique, whereby we are able to flexibly position the viewpoint. In our second technique, the viewpoint is computed using epipolar geometry from the center of gravity of a player. By applying the computed player's viewpoint to the former technique, we can synthesize player viewpoint images. Experimental results demonstrate that the proposed method can successfully provide a video of the tennis player's viewpoint from multiple-view video images.

UR - http://www.scopus.com/inward/record.url?scp=9944260263&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=9944260263&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:9944260263

VL - 58

SP - 1503

EP - 1510

JO - Kyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers

JF - Kyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers

SN - 1342-6907

IS - 10

ER -