A method for reconstructing 3D trajectory of ball with unsynchronized cameras

Sho Tamaki, Hideo Saito

Research output: Contribution to journalArticle

Abstract

Ball trajectory is an important performance indicator in ball game. However, Measuring 3D trajectories is often unusable because synchronized cameras and control points inside the playing field are generally required. A method that reconstructs 3D trajectory of ball with unsynchronized cameras is proposed in this paper. Proposed method consists of ball detection, camera calibration, and trajectory reconstruction. At first, ball candidates are detected based on the appearance. For the camera calibration, highly probable balls are extracted from the candidates based on the motion. Imaged ball trajectories are then reconstructed. Next, fundamental matrix is computed from the corresponding points, which are estimated with the ball trajectories, and roughly estimated temporal offset, which is estimated manually. The estimated fundamental matrix is assumed to be inaccurate due to the inaccuracy of the temporal offset. The key feature of this method is to accurately estimate temporal offset and fundamental matrix by optimizing them iteratively based on the error of fundamental matrix. After the calibration, balls are extracted robustly with geometrical and temporal relationship between cameras. A ball trajectory is finally reconstructed as connected trajectories which separated at collisions. It is experimentally demonstrated that the proposed method can calibrate cameras precisely and reconstruct accurate ball trajectories.

Original languageEnglish
Pages (from-to)1157-1165
Number of pages9
JournalSeimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering
Volume80
Issue number12
DOIs
Publication statusPublished - 2014 Dec 1
Externally publishedYes

Fingerprint

Cameras
Trajectories
Calibration

Keywords

  • Ball
  • Calibration
  • Table tennis
  • Trajectory
  • Unsynchronized camera

ASJC Scopus subject areas

  • Mechanical Engineering

Cite this

A method for reconstructing 3D trajectory of ball with unsynchronized cameras. / Tamaki, Sho; Saito, Hideo.

In: Seimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering, Vol. 80, No. 12, 01.12.2014, p. 1157-1165.

Research output: Contribution to journalArticle

@article{7549daa17da24a3eadd5300777821fd7,
title = "A method for reconstructing 3D trajectory of ball with unsynchronized cameras",
abstract = "Ball trajectory is an important performance indicator in ball game. However, Measuring 3D trajectories is often unusable because synchronized cameras and control points inside the playing field are generally required. A method that reconstructs 3D trajectory of ball with unsynchronized cameras is proposed in this paper. Proposed method consists of ball detection, camera calibration, and trajectory reconstruction. At first, ball candidates are detected based on the appearance. For the camera calibration, highly probable balls are extracted from the candidates based on the motion. Imaged ball trajectories are then reconstructed. Next, fundamental matrix is computed from the corresponding points, which are estimated with the ball trajectories, and roughly estimated temporal offset, which is estimated manually. The estimated fundamental matrix is assumed to be inaccurate due to the inaccuracy of the temporal offset. The key feature of this method is to accurately estimate temporal offset and fundamental matrix by optimizing them iteratively based on the error of fundamental matrix. After the calibration, balls are extracted robustly with geometrical and temporal relationship between cameras. A ball trajectory is finally reconstructed as connected trajectories which separated at collisions. It is experimentally demonstrated that the proposed method can calibrate cameras precisely and reconstruct accurate ball trajectories.",
keywords = "Ball, Calibration, Table tennis, Trajectory, Unsynchronized camera",
author = "Sho Tamaki and Hideo Saito",
year = "2014",
month = "12",
day = "1",
doi = "10.2493/jjspe.80.1157",
language = "English",
volume = "80",
pages = "1157--1165",
journal = "Seimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering",
issn = "0912-0289",
publisher = "Japan Society for Precision Engineering",
number = "12",

}

TY - JOUR

T1 - A method for reconstructing 3D trajectory of ball with unsynchronized cameras

AU - Tamaki, Sho

AU - Saito, Hideo

PY - 2014/12/1

Y1 - 2014/12/1

N2 - Ball trajectory is an important performance indicator in ball game. However, Measuring 3D trajectories is often unusable because synchronized cameras and control points inside the playing field are generally required. A method that reconstructs 3D trajectory of ball with unsynchronized cameras is proposed in this paper. Proposed method consists of ball detection, camera calibration, and trajectory reconstruction. At first, ball candidates are detected based on the appearance. For the camera calibration, highly probable balls are extracted from the candidates based on the motion. Imaged ball trajectories are then reconstructed. Next, fundamental matrix is computed from the corresponding points, which are estimated with the ball trajectories, and roughly estimated temporal offset, which is estimated manually. The estimated fundamental matrix is assumed to be inaccurate due to the inaccuracy of the temporal offset. The key feature of this method is to accurately estimate temporal offset and fundamental matrix by optimizing them iteratively based on the error of fundamental matrix. After the calibration, balls are extracted robustly with geometrical and temporal relationship between cameras. A ball trajectory is finally reconstructed as connected trajectories which separated at collisions. It is experimentally demonstrated that the proposed method can calibrate cameras precisely and reconstruct accurate ball trajectories.

AB - Ball trajectory is an important performance indicator in ball game. However, Measuring 3D trajectories is often unusable because synchronized cameras and control points inside the playing field are generally required. A method that reconstructs 3D trajectory of ball with unsynchronized cameras is proposed in this paper. Proposed method consists of ball detection, camera calibration, and trajectory reconstruction. At first, ball candidates are detected based on the appearance. For the camera calibration, highly probable balls are extracted from the candidates based on the motion. Imaged ball trajectories are then reconstructed. Next, fundamental matrix is computed from the corresponding points, which are estimated with the ball trajectories, and roughly estimated temporal offset, which is estimated manually. The estimated fundamental matrix is assumed to be inaccurate due to the inaccuracy of the temporal offset. The key feature of this method is to accurately estimate temporal offset and fundamental matrix by optimizing them iteratively based on the error of fundamental matrix. After the calibration, balls are extracted robustly with geometrical and temporal relationship between cameras. A ball trajectory is finally reconstructed as connected trajectories which separated at collisions. It is experimentally demonstrated that the proposed method can calibrate cameras precisely and reconstruct accurate ball trajectories.

KW - Ball

KW - Calibration

KW - Table tennis

KW - Trajectory

KW - Unsynchronized camera

UR - http://www.scopus.com/inward/record.url?scp=84988925272&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84988925272&partnerID=8YFLogxK

U2 - 10.2493/jjspe.80.1157

DO - 10.2493/jjspe.80.1157

M3 - Article

AN - SCOPUS:84988925272

VL - 80

SP - 1157

EP - 1165

JO - Seimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering

JF - Seimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering

SN - 0912-0289

IS - 12

ER -