Estimation of 3D model and object color using multiple color images

Yoshio Nishiyama, Hideo Saito, Shinji Ozawa

Research output: Contribution to journalArticle

Abstract

In this study, the generation of realistic 3D CG images is considered, and in particular, a method is proposed to estimate an object's 3D shape and color from image series taken at fixed positions of the camera and light source while rotating the object. An object placed on a turntable is treated as a set of surface elements each having seven degrees of freedom (DOF). Epipolar plane images (EPI) are analyzed using input image series, and all DOF for each surface element are calculated in order to estimate the 3D shape and colon First, loci drawn by surface elements on the EPI are tracked. Correct tracking is ensured by preventing the influence of fluctuations in object surface reflectivity, and self-occlusions caused by uneven shape. For highly reliable loci, the 3D positions of the surface elements are calculated, while the other surface elements are located by interpolation. In addition, the RGB values of surface elements can be expressed as linear sums of diffuse reflection components and specular reflection components, so that vectors in RGB color space can be separated into those related to the object, and those related to the light source. Color estimation for all surface elements is performed by using a two-color reflection model. In experiments, all surface element DOF were calculated for various objects, and 3D CG images, including those with light source data added, were synthesized successfully, thus demonstrating the effectiveness of the proposed method.

Original languageEnglish
Pages (from-to)49-60
Number of pages12
JournalSystems and Computers in Japan
Volume32
Issue number11
DOIs
Publication statusPublished - 2001 Oct

Fingerprint

Color Image
3D Model
Color
Light sources
3D shape
Degree of freedom
3D Image
Locus
Phonographs
Object
Series
Color Space
Reflectivity
Occlusion
Estimate
Interpolation
Rotating
Camera
Interpolate
Cameras

Keywords

  • 3D CG image
  • 3D shape
  • EPI
  • Multiple color images
  • Object color
  • Surface element

ASJC Scopus subject areas

  • Hardware and Architecture
  • Information Systems
  • Theoretical Computer Science
  • Computational Theory and Mathematics

Cite this

Estimation of 3D model and object color using multiple color images. / Nishiyama, Yoshio; Saito, Hideo; Ozawa, Shinji.

In: Systems and Computers in Japan, Vol. 32, No. 11, 10.2001, p. 49-60.

Research output: Contribution to journalArticle

Nishiyama, Yoshio ; Saito, Hideo ; Ozawa, Shinji. / Estimation of 3D model and object color using multiple color images. In: Systems and Computers in Japan. 2001 ; Vol. 32, No. 11. pp. 49-60.
@article{4b6516182fa040e7ab2b9bd7cb30a2fe,
title = "Estimation of 3D model and object color using multiple color images",
abstract = "In this study, the generation of realistic 3D CG images is considered, and in particular, a method is proposed to estimate an object's 3D shape and color from image series taken at fixed positions of the camera and light source while rotating the object. An object placed on a turntable is treated as a set of surface elements each having seven degrees of freedom (DOF). Epipolar plane images (EPI) are analyzed using input image series, and all DOF for each surface element are calculated in order to estimate the 3D shape and colon First, loci drawn by surface elements on the EPI are tracked. Correct tracking is ensured by preventing the influence of fluctuations in object surface reflectivity, and self-occlusions caused by uneven shape. For highly reliable loci, the 3D positions of the surface elements are calculated, while the other surface elements are located by interpolation. In addition, the RGB values of surface elements can be expressed as linear sums of diffuse reflection components and specular reflection components, so that vectors in RGB color space can be separated into those related to the object, and those related to the light source. Color estimation for all surface elements is performed by using a two-color reflection model. In experiments, all surface element DOF were calculated for various objects, and 3D CG images, including those with light source data added, were synthesized successfully, thus demonstrating the effectiveness of the proposed method.",
keywords = "3D CG image, 3D shape, EPI, Multiple color images, Object color, Surface element",
author = "Yoshio Nishiyama and Hideo Saito and Shinji Ozawa",
year = "2001",
month = "10",
doi = "10.1002/scj.1069",
language = "English",
volume = "32",
pages = "49--60",
journal = "Systems and Computers in Japan",
issn = "0882-1666",
publisher = "John Wiley and Sons Inc.",
number = "11",

}

TY - JOUR

T1 - Estimation of 3D model and object color using multiple color images

AU - Nishiyama, Yoshio

AU - Saito, Hideo

AU - Ozawa, Shinji

PY - 2001/10

Y1 - 2001/10

N2 - In this study, the generation of realistic 3D CG images is considered, and in particular, a method is proposed to estimate an object's 3D shape and color from image series taken at fixed positions of the camera and light source while rotating the object. An object placed on a turntable is treated as a set of surface elements each having seven degrees of freedom (DOF). Epipolar plane images (EPI) are analyzed using input image series, and all DOF for each surface element are calculated in order to estimate the 3D shape and colon First, loci drawn by surface elements on the EPI are tracked. Correct tracking is ensured by preventing the influence of fluctuations in object surface reflectivity, and self-occlusions caused by uneven shape. For highly reliable loci, the 3D positions of the surface elements are calculated, while the other surface elements are located by interpolation. In addition, the RGB values of surface elements can be expressed as linear sums of diffuse reflection components and specular reflection components, so that vectors in RGB color space can be separated into those related to the object, and those related to the light source. Color estimation for all surface elements is performed by using a two-color reflection model. In experiments, all surface element DOF were calculated for various objects, and 3D CG images, including those with light source data added, were synthesized successfully, thus demonstrating the effectiveness of the proposed method.

AB - In this study, the generation of realistic 3D CG images is considered, and in particular, a method is proposed to estimate an object's 3D shape and color from image series taken at fixed positions of the camera and light source while rotating the object. An object placed on a turntable is treated as a set of surface elements each having seven degrees of freedom (DOF). Epipolar plane images (EPI) are analyzed using input image series, and all DOF for each surface element are calculated in order to estimate the 3D shape and colon First, loci drawn by surface elements on the EPI are tracked. Correct tracking is ensured by preventing the influence of fluctuations in object surface reflectivity, and self-occlusions caused by uneven shape. For highly reliable loci, the 3D positions of the surface elements are calculated, while the other surface elements are located by interpolation. In addition, the RGB values of surface elements can be expressed as linear sums of diffuse reflection components and specular reflection components, so that vectors in RGB color space can be separated into those related to the object, and those related to the light source. Color estimation for all surface elements is performed by using a two-color reflection model. In experiments, all surface element DOF were calculated for various objects, and 3D CG images, including those with light source data added, were synthesized successfully, thus demonstrating the effectiveness of the proposed method.

KW - 3D CG image

KW - 3D shape

KW - EPI

KW - Multiple color images

KW - Object color

KW - Surface element

UR - http://www.scopus.com/inward/record.url?scp=0035481677&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0035481677&partnerID=8YFLogxK

U2 - 10.1002/scj.1069

DO - 10.1002/scj.1069

M3 - Article

AN - SCOPUS:0035481677

VL - 32

SP - 49

EP - 60

JO - Systems and Computers in Japan

JF - Systems and Computers in Japan

SN - 0882-1666

IS - 11

ER -