Reconstructing the 3D trajectory of a ball with unsynchronized cameras

S. Tamaki, Hideo Saito

研究成果: Article

3 引用 (Scopus)

抄録

The 3D trajectory of the ball is one of the most important performance indicators in ball games. However, it often cannot be measured because of the requirements: synchronized cameras and control points within the playing field. Thus, this paper proposes a method that reconstructs the 3D trajectory of a ball with unsynchronized cameras. The proposed method consists of ball detection, camera calibration, and trajectory reconstruction. At first, ball candidates are detected on the basis of their appearance. Balls are then extracted from the candidates on the basis of their motion. After the extraction, ball trajectories are reconstructed in image spaces. The corresponding points in two views are estimated on the basis of the ball trajectory in image spaces and the temporal offset between cameras, which is supposed to be recorded with a few erroneous frames. The matrix including the geometrical relationship between cameras, namely the fundamental matrix, is then computed from the corresponding points. The estimated one is inaccurate due to the error of the temporal offset. The key feature of this method is to optimize the temporal offset and fundamental matrix simultaneously. After the optimization, the geometrical relationship between cameras is computed from the matrix. Balls are extracted again by using the temporal offsets and the geometrical relationship between cameras. A ball trajectory is finally reconstructed as connected trajectories that are separated at collisions. It is experimentally demonstrated that the proposed method accurately calibrates cameras and successfully reconstructs the 3D trajectory of the ball.

元の言語English
ページ(範囲)51-68
ページ数18
ジャーナルInternational Journal of Computer Science in Sport
14
発行部数1
出版物ステータスPublished - 2015

Fingerprint

Cameras
Trajectories
Calibration

ASJC Scopus subject areas

  • Computer Science(all)
  • Biomedical Engineering

これを引用

@article{a6caef1d3ff84b58a987b8cf734a7a9a,
title = "Reconstructing the 3D trajectory of a ball with unsynchronized cameras",
abstract = "The 3D trajectory of the ball is one of the most important performance indicators in ball games. However, it often cannot be measured because of the requirements: synchronized cameras and control points within the playing field. Thus, this paper proposes a method that reconstructs the 3D trajectory of a ball with unsynchronized cameras. The proposed method consists of ball detection, camera calibration, and trajectory reconstruction. At first, ball candidates are detected on the basis of their appearance. Balls are then extracted from the candidates on the basis of their motion. After the extraction, ball trajectories are reconstructed in image spaces. The corresponding points in two views are estimated on the basis of the ball trajectory in image spaces and the temporal offset between cameras, which is supposed to be recorded with a few erroneous frames. The matrix including the geometrical relationship between cameras, namely the fundamental matrix, is then computed from the corresponding points. The estimated one is inaccurate due to the error of the temporal offset. The key feature of this method is to optimize the temporal offset and fundamental matrix simultaneously. After the optimization, the geometrical relationship between cameras is computed from the matrix. Balls are extracted again by using the temporal offsets and the geometrical relationship between cameras. A ball trajectory is finally reconstructed as connected trajectories that are separated at collisions. It is experimentally demonstrated that the proposed method accurately calibrates cameras and successfully reconstructs the 3D trajectory of the ball.",
keywords = "Ball, Calibration, Table tennis, Trajectory, Unsynchronized camera",
author = "S. Tamaki and Hideo Saito",
year = "2015",
language = "English",
volume = "14",
pages = "51--68",
journal = "International Journal of Computer Science in Sport",
issn = "1684-4769",
publisher = "International Association of Computer Science in Sport",
number = "1",

}

TY - JOUR

T1 - Reconstructing the 3D trajectory of a ball with unsynchronized cameras

AU - Tamaki, S.

AU - Saito, Hideo

PY - 2015

Y1 - 2015

N2 - The 3D trajectory of the ball is one of the most important performance indicators in ball games. However, it often cannot be measured because of the requirements: synchronized cameras and control points within the playing field. Thus, this paper proposes a method that reconstructs the 3D trajectory of a ball with unsynchronized cameras. The proposed method consists of ball detection, camera calibration, and trajectory reconstruction. At first, ball candidates are detected on the basis of their appearance. Balls are then extracted from the candidates on the basis of their motion. After the extraction, ball trajectories are reconstructed in image spaces. The corresponding points in two views are estimated on the basis of the ball trajectory in image spaces and the temporal offset between cameras, which is supposed to be recorded with a few erroneous frames. The matrix including the geometrical relationship between cameras, namely the fundamental matrix, is then computed from the corresponding points. The estimated one is inaccurate due to the error of the temporal offset. The key feature of this method is to optimize the temporal offset and fundamental matrix simultaneously. After the optimization, the geometrical relationship between cameras is computed from the matrix. Balls are extracted again by using the temporal offsets and the geometrical relationship between cameras. A ball trajectory is finally reconstructed as connected trajectories that are separated at collisions. It is experimentally demonstrated that the proposed method accurately calibrates cameras and successfully reconstructs the 3D trajectory of the ball.

AB - The 3D trajectory of the ball is one of the most important performance indicators in ball games. However, it often cannot be measured because of the requirements: synchronized cameras and control points within the playing field. Thus, this paper proposes a method that reconstructs the 3D trajectory of a ball with unsynchronized cameras. The proposed method consists of ball detection, camera calibration, and trajectory reconstruction. At first, ball candidates are detected on the basis of their appearance. Balls are then extracted from the candidates on the basis of their motion. After the extraction, ball trajectories are reconstructed in image spaces. The corresponding points in two views are estimated on the basis of the ball trajectory in image spaces and the temporal offset between cameras, which is supposed to be recorded with a few erroneous frames. The matrix including the geometrical relationship between cameras, namely the fundamental matrix, is then computed from the corresponding points. The estimated one is inaccurate due to the error of the temporal offset. The key feature of this method is to optimize the temporal offset and fundamental matrix simultaneously. After the optimization, the geometrical relationship between cameras is computed from the matrix. Balls are extracted again by using the temporal offsets and the geometrical relationship between cameras. A ball trajectory is finally reconstructed as connected trajectories that are separated at collisions. It is experimentally demonstrated that the proposed method accurately calibrates cameras and successfully reconstructs the 3D trajectory of the ball.

KW - Ball

KW - Calibration

KW - Table tennis

KW - Trajectory

KW - Unsynchronized camera

UR - http://www.scopus.com/inward/record.url?scp=84937042258&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84937042258&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:84937042258

VL - 14

SP - 51

EP - 68

JO - International Journal of Computer Science in Sport

JF - International Journal of Computer Science in Sport

SN - 1684-4769

IS - 1

ER -