FusionMLS: Highly dynamic 3D reconstruction with consumer-grade RGB-D cameras

Siim Meerits, Diego Thomas, Vincent Nozick, Hideo Saito

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Multi-view dynamic three-dimensional reconstruction has typically required the use of custom shutter-synchronized camera rigs in order to capture scenes containing rapid movements or complex topology changes. In this paper, we demonstrate that multiple unsynchronized low-cost RGB-D cameras can be used for the same purpose. To alleviate issues caused by unsynchronized shutters, we propose a novel depth frame interpolation technique that allows synchronized data capture from highly dynamic 3D scenes. To manage the resulting huge number of input depth images, we also introduce an efficient moving least squares-based volumetric reconstruction method that generates triangle meshes of the scene. Our approach does not store the reconstruction volume in memory, making it memory-efficient and scalable to large scenes. Our implementation is completely GPU based and works in real time. The results shown herein, obtained with real data, demonstrate the effectiveness of our proposed method and its advantages compared to state-of-the-art approaches.

Original languageEnglish
Pages (from-to)287-303
Number of pages17
JournalComputational Visual Media
Volume4
Issue number4
DOIs
Publication statusPublished - 2018 Dec 1

Keywords

  • 3D reconstruction
  • GPU
  • RGB-D cameras
  • motion capture

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'FusionMLS: Highly dynamic 3D reconstruction with consumer-grade RGB-D cameras'. Together they form a unique fingerprint.

  • Cite this