Prediction of future shot direction using pose and position of tennis player

Tomohiro Shimizu, Ryo Hachiuma, Hideo Saito, Takashi Yoshikawa, Chonho Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we propose a method to predict the future shot direction in a tennis match using pose information and player position. As far as we know, there is no work that deals with such a predictive task, so there is no shot direction dataset as yet. Therefore, using a YouTube tennis match video, we construct an time of impact and shot direction dataset. To reduce annotation costs, we propose a method to automatically label the shot direction. Moreover, we propose a method to predict the future shot direction using the constructed dataset. The shot direction is predicted using LSTM(long short-time memory), from sequential pose information up to the time of impact and the player position. We employ OpenPose to extract the position of skeleton joints. In the experiment, we evaluate the accuracy of shot direction prediction and verify the effectiveness of the proposed method. Since there are no studies that predict future shot direction, we set four baseline methods to evaluate the effectiveness of our proposed method.

Original languageEnglish
Title of host publicationMMSports 2019 - Proceedings of the 2nd International Workshop on Multimedia Content Analysis in Sports, co-located with MM 2019
PublisherAssociation for Computing Machinery, Inc
Pages59-66
Number of pages8
ISBN (Electronic)9781450369114
DOIs
Publication statusPublished - 2019 Oct 15
Event2nd ACM International Workshop on Multimedia Content Analysis in Sports, MMSports 2019, co-located with ACM Multimedia 2019 - Nice, France
Duration: 2019 Oct 25 → …

Publication series

NameMMSports 2019 - Proceedings of the 2nd International Workshop on Multimedia Content Analysis in Sports, co-located with MM 2019

Conference

Conference2nd ACM International Workshop on Multimedia Content Analysis in Sports, MMSports 2019, co-located with ACM Multimedia 2019
CountryFrance
CityNice
Period19/10/25 → …

Keywords

  • Activity recognition in tennis
  • Long short-term memory
  • Shot direction prediction

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Software
  • Media Technology

Fingerprint Dive into the research topics of 'Prediction of future shot direction using pose and position of tennis player'. Together they form a unique fingerprint.

  • Cite this

    Shimizu, T., Hachiuma, R., Saito, H., Yoshikawa, T., & Lee, C. (2019). Prediction of future shot direction using pose and position of tennis player. In MMSports 2019 - Proceedings of the 2nd International Workshop on Multimedia Content Analysis in Sports, co-located with MM 2019 (pp. 59-66). (MMSports 2019 - Proceedings of the 2nd International Workshop on Multimedia Content Analysis in Sports, co-located with MM 2019). Association for Computing Machinery, Inc. https://doi.org/10.1145/3347318.3355523