Depth interpolation using tangent planes on superpixels of a color image

Kiyoshi Matsuo, Yoshimitsu Aoki

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

This paper describes a method for accurately interpolating a low-resolution depth image using a high-resolution color image. In our method, first, tangent planes on each superpixel are estimated from sparse depth information and dense color information. Then, the neighboring superpixels that have smooth-connectable tangent planes are connected, and image segmentation to smooth surfaces is achieved. Finally, the low-resolution depth image is interpolated by using this smooth surface segmentation. In experiments with images from the Middlebury stereo data sets, our method interpolates each image at a high rate, and achieves the lowest error when compared to existing techniques.

Original languageEnglish
Pages (from-to)17-29
Number of pages13
JournalElectronics and Communications in Japan
Volume98
Issue number12
DOIs
Publication statusPublished - 2015 Dec 1

Fingerprint

Tangent plane
Color Image
tangents
interpolation
Interpolation
Interpolate
Color
color
Smooth surface
Image segmentation
Image Segmentation
Lowest
High Resolution
Segmentation
Experiments
Experiment
high resolution

Keywords

  • depth image interpolation
  • image segmentation
  • superpixel

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Computer Networks and Communications
  • Physics and Astronomy(all)
  • Signal Processing
  • Applied Mathematics

Cite this

Depth interpolation using tangent planes on superpixels of a color image. / Matsuo, Kiyoshi; Aoki, Yoshimitsu.

In: Electronics and Communications in Japan, Vol. 98, No. 12, 01.12.2015, p. 17-29.

Research output: Contribution to journalArticle

@article{bc5554c844df48df9c9539f61f0e7503,
title = "Depth interpolation using tangent planes on superpixels of a color image",
abstract = "This paper describes a method for accurately interpolating a low-resolution depth image using a high-resolution color image. In our method, first, tangent planes on each superpixel are estimated from sparse depth information and dense color information. Then, the neighboring superpixels that have smooth-connectable tangent planes are connected, and image segmentation to smooth surfaces is achieved. Finally, the low-resolution depth image is interpolated by using this smooth surface segmentation. In experiments with images from the Middlebury stereo data sets, our method interpolates each image at a high rate, and achieves the lowest error when compared to existing techniques.",
keywords = "depth image interpolation, image segmentation, superpixel",
author = "Kiyoshi Matsuo and Yoshimitsu Aoki",
year = "2015",
month = "12",
day = "1",
doi = "10.1002/ecj.11756",
language = "English",
volume = "98",
pages = "17--29",
journal = "Electronics and Communications in Japan",
issn = "1942-9533",
publisher = "Scripta Technica",
number = "12",

}

TY - JOUR

T1 - Depth interpolation using tangent planes on superpixels of a color image

AU - Matsuo, Kiyoshi

AU - Aoki, Yoshimitsu

PY - 2015/12/1

Y1 - 2015/12/1

N2 - This paper describes a method for accurately interpolating a low-resolution depth image using a high-resolution color image. In our method, first, tangent planes on each superpixel are estimated from sparse depth information and dense color information. Then, the neighboring superpixels that have smooth-connectable tangent planes are connected, and image segmentation to smooth surfaces is achieved. Finally, the low-resolution depth image is interpolated by using this smooth surface segmentation. In experiments with images from the Middlebury stereo data sets, our method interpolates each image at a high rate, and achieves the lowest error when compared to existing techniques.

AB - This paper describes a method for accurately interpolating a low-resolution depth image using a high-resolution color image. In our method, first, tangent planes on each superpixel are estimated from sparse depth information and dense color information. Then, the neighboring superpixels that have smooth-connectable tangent planes are connected, and image segmentation to smooth surfaces is achieved. Finally, the low-resolution depth image is interpolated by using this smooth surface segmentation. In experiments with images from the Middlebury stereo data sets, our method interpolates each image at a high rate, and achieves the lowest error when compared to existing techniques.

KW - depth image interpolation

KW - image segmentation

KW - superpixel

UR - http://www.scopus.com/inward/record.url?scp=84948450774&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84948450774&partnerID=8YFLogxK

U2 - 10.1002/ecj.11756

DO - 10.1002/ecj.11756

M3 - Article

VL - 98

SP - 17

EP - 29

JO - Electronics and Communications in Japan

JF - Electronics and Communications in Japan

SN - 1942-9533

IS - 12

ER -