TY - GEN
T1 - 3D PixMix
T2 - 17th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018
AU - Mori, Shohei
AU - Herling, Jan
AU - Broll, Wolfgang
AU - Kawai, Norihiko
AU - Saito, Hideo
AU - Schmalstieg, Dieter
AU - Kalkofen, Denis
N1 - Funding Information:
This work is partly supported by JSPS Kakenhi 16J05114, 17K12729, 18H03273, and 18K11375, and the Austrian Science Fund grant P30694, and FFG grant 859208 (MATAHARI). The authors would like to thank Ms. Mariko Isogawa (Osaka University) for her technical support.
Publisher Copyright:
© 2018 IEEE.
PY - 2018/7/2
Y1 - 2018/7/2
N2 - State of the art methods for diminished reality (DR) propagate pixel information from keyframes to later frames to achieve real-time image inpainting in 3D spaces. However, this approach assumes a planar scene and produces artifacts, if the scene geometry is not sufficiently planar. In this paper, we present 3D PixMix, a new real-time inpainting method that addresses non-planar scenes by considering both color and depth information in the inpainting process. We define cost functions for both the color and the geometric appearance in the inpainting scheme and use an RGB-D sensor for depth fusion using a SLAM. Comparison results against the conventional PixMix show that 3D PixMix obtains the equivalent or even better quality in 3D scenes with additional depth information.
AB - State of the art methods for diminished reality (DR) propagate pixel information from keyframes to later frames to achieve real-time image inpainting in 3D spaces. However, this approach assumes a planar scene and produces artifacts, if the scene geometry is not sufficiently planar. In this paper, we present 3D PixMix, a new real-time inpainting method that addresses non-planar scenes by considering both color and depth information in the inpainting process. We define cost functions for both the color and the geometric appearance in the inpainting scheme and use an RGB-D sensor for depth fusion using a SLAM. Comparison results against the conventional PixMix show that 3D PixMix obtains the equivalent or even better quality in 3D scenes with additional depth information.
KW - Artificial
KW - Augmented
KW - H.5.1 [Information Interfaces and Presentation]
KW - Multimedia Information Systems
KW - Virtual Realities
UR - http://www.scopus.com/inward/record.url?scp=85065548979&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85065548979&partnerID=8YFLogxK
U2 - 10.1109/ISMAR-Adjunct.2018.00020
DO - 10.1109/ISMAR-Adjunct.2018.00020
M3 - Conference contribution
AN - SCOPUS:85065548979
T3 - Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018
SP - 1
EP - 2
BT - Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 16 October 2018 through 20 October 2018
ER -