High-resolution image generation from video image sequence by light field

K. Kobayashi, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose a novel method to synthesize high-resolution images by constructing a light field from image sequence taken with a moving video camera. Our method integrates multiple frames from video camera that partly captures the object by constructing a light field which is quite different from general mosaic methods. In case of light field constructed straightforwardly, blur and discontinuity are introduced into generated images by depth variation of the object. In our method, light field is optimized to remove these blur and discontinuity, so that clear images can be generated. The optimized light field is adapted to the depth variation of object surface, but the exact shape of the object is not necessary. Extremely large resolution images that are impractical in the real system can be virtually generated from the light field. Results of the experiment applied to book surface demonstrate the effectiveness of the proposed method.

Original languageEnglish
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
EditorsS.F. El-Hakim, A. Gruen
Pages318-327
Number of pages10
Volume4309
DOIs
Publication statusPublished - 2001
EventVideometrics and Optical Methods for 3D Shape Measurement - San Jose, CA, United States
Duration: 2001 Jan 222001 Jan 23

Other

OtherVideometrics and Optical Methods for 3D Shape Measurement
CountryUnited States
CitySan Jose, CA
Period01/1/2201/1/23

Fingerprint

Image resolution
high resolution
Video cameras
discontinuity
cameras
image resolution
Experiments

Keywords

  • High-resolution image
  • Image mosaicing
  • Image-based rendering
  • Light field
  • Video image sequence

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Condensed Matter Physics

Cite this

Kobayashi, K., & Saito, H. (2001). High-resolution image generation from video image sequence by light field. In S. F. El-Hakim, & A. Gruen (Eds.), Proceedings of SPIE - The International Society for Optical Engineering (Vol. 4309, pp. 318-327) https://doi.org/10.1117/12.410890

High-resolution image generation from video image sequence by light field. / Kobayashi, K.; Saito, Hideo.

Proceedings of SPIE - The International Society for Optical Engineering. ed. / S.F. El-Hakim; A. Gruen. Vol. 4309 2001. p. 318-327.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kobayashi, K & Saito, H 2001, High-resolution image generation from video image sequence by light field. in SF El-Hakim & A Gruen (eds), Proceedings of SPIE - The International Society for Optical Engineering. vol. 4309, pp. 318-327, Videometrics and Optical Methods for 3D Shape Measurement, San Jose, CA, United States, 01/1/22. https://doi.org/10.1117/12.410890
Kobayashi K, Saito H. High-resolution image generation from video image sequence by light field. In El-Hakim SF, Gruen A, editors, Proceedings of SPIE - The International Society for Optical Engineering. Vol. 4309. 2001. p. 318-327 https://doi.org/10.1117/12.410890
Kobayashi, K. ; Saito, Hideo. / High-resolution image generation from video image sequence by light field. Proceedings of SPIE - The International Society for Optical Engineering. editor / S.F. El-Hakim ; A. Gruen. Vol. 4309 2001. pp. 318-327
@inproceedings{eb618db8c2a04d46a81b4cb07fe7f235,
title = "High-resolution image generation from video image sequence by light field",
abstract = "We propose a novel method to synthesize high-resolution images by constructing a light field from image sequence taken with a moving video camera. Our method integrates multiple frames from video camera that partly captures the object by constructing a light field which is quite different from general mosaic methods. In case of light field constructed straightforwardly, blur and discontinuity are introduced into generated images by depth variation of the object. In our method, light field is optimized to remove these blur and discontinuity, so that clear images can be generated. The optimized light field is adapted to the depth variation of object surface, but the exact shape of the object is not necessary. Extremely large resolution images that are impractical in the real system can be virtually generated from the light field. Results of the experiment applied to book surface demonstrate the effectiveness of the proposed method.",
keywords = "High-resolution image, Image mosaicing, Image-based rendering, Light field, Video image sequence",
author = "K. Kobayashi and Hideo Saito",
year = "2001",
doi = "10.1117/12.410890",
language = "English",
volume = "4309",
pages = "318--327",
editor = "S.F. El-Hakim and A. Gruen",
booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",

}

TY - GEN

T1 - High-resolution image generation from video image sequence by light field

AU - Kobayashi, K.

AU - Saito, Hideo

PY - 2001

Y1 - 2001

N2 - We propose a novel method to synthesize high-resolution images by constructing a light field from image sequence taken with a moving video camera. Our method integrates multiple frames from video camera that partly captures the object by constructing a light field which is quite different from general mosaic methods. In case of light field constructed straightforwardly, blur and discontinuity are introduced into generated images by depth variation of the object. In our method, light field is optimized to remove these blur and discontinuity, so that clear images can be generated. The optimized light field is adapted to the depth variation of object surface, but the exact shape of the object is not necessary. Extremely large resolution images that are impractical in the real system can be virtually generated from the light field. Results of the experiment applied to book surface demonstrate the effectiveness of the proposed method.

AB - We propose a novel method to synthesize high-resolution images by constructing a light field from image sequence taken with a moving video camera. Our method integrates multiple frames from video camera that partly captures the object by constructing a light field which is quite different from general mosaic methods. In case of light field constructed straightforwardly, blur and discontinuity are introduced into generated images by depth variation of the object. In our method, light field is optimized to remove these blur and discontinuity, so that clear images can be generated. The optimized light field is adapted to the depth variation of object surface, but the exact shape of the object is not necessary. Extremely large resolution images that are impractical in the real system can be virtually generated from the light field. Results of the experiment applied to book surface demonstrate the effectiveness of the proposed method.

KW - High-resolution image

KW - Image mosaicing

KW - Image-based rendering

KW - Light field

KW - Video image sequence

UR - http://www.scopus.com/inward/record.url?scp=0035054643&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0035054643&partnerID=8YFLogxK

U2 - 10.1117/12.410890

DO - 10.1117/12.410890

M3 - Conference contribution

AN - SCOPUS:0035054643

VL - 4309

SP - 318

EP - 327

BT - Proceedings of SPIE - The International Society for Optical Engineering

A2 - El-Hakim, S.F.

A2 - Gruen, A.

ER -