Synthesis of a stroboscopic image from a hand-held camera sequence for a sports analysis

Kunihiro Hasegawa, Hideo Saito

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

This paper presents a method for synthesizing a stroboscopic image of a moving sports player from a hand-held camera sequence. This method has three steps: synthesis of background image, synthesis of stroboscopic image, and removal of player’s shadow. In synthesis of background image step, all input frames masked a bounding box of the player are stitched together to generate a background image. The player is extracted by an HOG-based people detector. In synthesis of stroboscopic image step, the background image, the input frame, and a mask of the player synthesize a stroboscopic image. In removal of shadow step, we remove the player’s shadow which negatively affects an analysis by using mean-shift. In our previous work, synthesis of background image has been timeconsuming. In this paper, by using the bounding box of the player detected by HOG and by subtracting the images for synthesizing a mask, computational speed and accuracy can be improved. These have contributed greatly to the improvement from the previous method. These are main improvements and novelty points from our previous method. In experiments, we confirmed the effectiveness of the proposed method, measured the player’s speed and stride length, and made a footprint image. The image sequence was captured under a simple condition that no other people were in the background and the person controlling the video camera was standing still, such like a motion parallax was not occurred. In addition, we applied the synthesis method to various scenes to confirm its versatility.

Original languageEnglish
Pages (from-to)277-289
Number of pages13
JournalComputational Visual Media
Volume2
Issue number3
DOIs
Publication statusPublished - 2016 Sep 1

Fingerprint

Sports
Cameras
Masks
Video cameras
Detectors
Experiments

Keywords

  • mask
  • sports vision
  • stitching
  • stroboscopic image
  • synthesis

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Cite this

Synthesis of a stroboscopic image from a hand-held camera sequence for a sports analysis. / Hasegawa, Kunihiro; Saito, Hideo.

In: Computational Visual Media, Vol. 2, No. 3, 01.09.2016, p. 277-289.

Research output: Contribution to journalArticle

@article{04f27ddb412f4b6282fba92f28e01942,
title = "Synthesis of a stroboscopic image from a hand-held camera sequence for a sports analysis",
abstract = "This paper presents a method for synthesizing a stroboscopic image of a moving sports player from a hand-held camera sequence. This method has three steps: synthesis of background image, synthesis of stroboscopic image, and removal of player’s shadow. In synthesis of background image step, all input frames masked a bounding box of the player are stitched together to generate a background image. The player is extracted by an HOG-based people detector. In synthesis of stroboscopic image step, the background image, the input frame, and a mask of the player synthesize a stroboscopic image. In removal of shadow step, we remove the player’s shadow which negatively affects an analysis by using mean-shift. In our previous work, synthesis of background image has been timeconsuming. In this paper, by using the bounding box of the player detected by HOG and by subtracting the images for synthesizing a mask, computational speed and accuracy can be improved. These have contributed greatly to the improvement from the previous method. These are main improvements and novelty points from our previous method. In experiments, we confirmed the effectiveness of the proposed method, measured the player’s speed and stride length, and made a footprint image. The image sequence was captured under a simple condition that no other people were in the background and the person controlling the video camera was standing still, such like a motion parallax was not occurred. In addition, we applied the synthesis method to various scenes to confirm its versatility.",
keywords = "mask, sports vision, stitching, stroboscopic image, synthesis",
author = "Kunihiro Hasegawa and Hideo Saito",
year = "2016",
month = "9",
day = "1",
doi = "10.1007/s41095-016-0053-5",
language = "English",
volume = "2",
pages = "277--289",
journal = "Computational Visual Media",
issn = "2096-0433",
publisher = "Tsinghua University Press",
number = "3",

}

TY - JOUR

T1 - Synthesis of a stroboscopic image from a hand-held camera sequence for a sports analysis

AU - Hasegawa, Kunihiro

AU - Saito, Hideo

PY - 2016/9/1

Y1 - 2016/9/1

N2 - This paper presents a method for synthesizing a stroboscopic image of a moving sports player from a hand-held camera sequence. This method has three steps: synthesis of background image, synthesis of stroboscopic image, and removal of player’s shadow. In synthesis of background image step, all input frames masked a bounding box of the player are stitched together to generate a background image. The player is extracted by an HOG-based people detector. In synthesis of stroboscopic image step, the background image, the input frame, and a mask of the player synthesize a stroboscopic image. In removal of shadow step, we remove the player’s shadow which negatively affects an analysis by using mean-shift. In our previous work, synthesis of background image has been timeconsuming. In this paper, by using the bounding box of the player detected by HOG and by subtracting the images for synthesizing a mask, computational speed and accuracy can be improved. These have contributed greatly to the improvement from the previous method. These are main improvements and novelty points from our previous method. In experiments, we confirmed the effectiveness of the proposed method, measured the player’s speed and stride length, and made a footprint image. The image sequence was captured under a simple condition that no other people were in the background and the person controlling the video camera was standing still, such like a motion parallax was not occurred. In addition, we applied the synthesis method to various scenes to confirm its versatility.

AB - This paper presents a method for synthesizing a stroboscopic image of a moving sports player from a hand-held camera sequence. This method has three steps: synthesis of background image, synthesis of stroboscopic image, and removal of player’s shadow. In synthesis of background image step, all input frames masked a bounding box of the player are stitched together to generate a background image. The player is extracted by an HOG-based people detector. In synthesis of stroboscopic image step, the background image, the input frame, and a mask of the player synthesize a stroboscopic image. In removal of shadow step, we remove the player’s shadow which negatively affects an analysis by using mean-shift. In our previous work, synthesis of background image has been timeconsuming. In this paper, by using the bounding box of the player detected by HOG and by subtracting the images for synthesizing a mask, computational speed and accuracy can be improved. These have contributed greatly to the improvement from the previous method. These are main improvements and novelty points from our previous method. In experiments, we confirmed the effectiveness of the proposed method, measured the player’s speed and stride length, and made a footprint image. The image sequence was captured under a simple condition that no other people were in the background and the person controlling the video camera was standing still, such like a motion parallax was not occurred. In addition, we applied the synthesis method to various scenes to confirm its versatility.

KW - mask

KW - sports vision

KW - stitching

KW - stroboscopic image

KW - synthesis

UR - http://www.scopus.com/inward/record.url?scp=85008443313&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85008443313&partnerID=8YFLogxK

U2 - 10.1007/s41095-016-0053-5

DO - 10.1007/s41095-016-0053-5

M3 - Article

AN - SCOPUS:85008443313

VL - 2

SP - 277

EP - 289

JO - Computational Visual Media

JF - Computational Visual Media

SN - 2096-0433

IS - 3

ER -