TY - GEN
T1 - Diminished reality via multiple hand-held cameras
AU - Jarusirisawad, Songkran
AU - Saito, Hideo
PY - 2007/12/1
Y1 - 2007/12/1
N2 - This paper proposes a novel method for calibrating multiple hand-held cameras target for Diminished Reality application. Our method does not require any special markers or information about camera parameters. Projective Grid Space (PGS) which is 3D space defined by epipolar geometry of two basis camera is used for dynamic cameras calibration. Geometrical relations among cameras in PGS are obtained from 2D-2D corresponding points between views. We utilize Scale Invariant Feature Transform (SIFT) for finding corresponding points in natural scene for registering cameras to PGS. Moving object is segmented via graph cut optimization. Finally, the reconstructed visual hull is used to synthesize free viewpoint video in which unwanted or occluding object is deliberately removed. In the experimental results, free viewpoint video without unwanted object which is captured by hand-held cameras is successfully synthesized using the proposed method.
AB - This paper proposes a novel method for calibrating multiple hand-held cameras target for Diminished Reality application. Our method does not require any special markers or information about camera parameters. Projective Grid Space (PGS) which is 3D space defined by epipolar geometry of two basis camera is used for dynamic cameras calibration. Geometrical relations among cameras in PGS are obtained from 2D-2D corresponding points between views. We utilize Scale Invariant Feature Transform (SIFT) for finding corresponding points in natural scene for registering cameras to PGS. Moving object is segmented via graph cut optimization. Finally, the reconstructed visual hull is used to synthesize free viewpoint video in which unwanted or occluding object is deliberately removed. In the experimental results, free viewpoint video without unwanted object which is captured by hand-held cameras is successfully synthesized using the proposed method.
KW - 3D reconstruction
KW - Cameras calibration
KW - Diminished reality
KW - Projective grid space
UR - http://www.scopus.com/inward/record.url?scp=47349107935&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=47349107935&partnerID=8YFLogxK
U2 - 10.1109/ICDSC.2007.4357531
DO - 10.1109/ICDSC.2007.4357531
M3 - Conference contribution
AN - SCOPUS:47349107935
SN - 1424413540
SN - 9781424413546
T3 - 2007 1st ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC
SP - 251
EP - 258
BT - 2007 1st ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC
T2 - 2007 First ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC-07
Y2 - 25 September 2007 through 28 September 2007
ER -