On-line video synthesis for removing occluding object via complementary use of multiple handheld cameras

Akihito Enomoto, Hideo Saito

研究成果: Article


We propose the use of an on-line video synthesis system that makes complementary use of multiple handheld cameras and thus removes occluding objects. We assumed that the same scene is captured with multiple handheld cameras, but an object occludes it. First, we used an ARTag marker to calculate a projection matrix, and then we estimated a homography between two captured images that was based on the projection matrix. We used this homography to transform the planar area into the image seen by the viewer. Finally, we blended the pixel value in accordance with the difference of the pixel values of the captured image and of the warped images at the same position. Doing this means that we remove the occluding object that cannot be approximated as a planar area. Our experimental results prove that this system can be used to remove the occluding object in a dynamic scene.

ジャーナルKyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers
出版物ステータスPublished - 2008 6


ASJC Scopus subject areas

  • Media Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering