Real-Time Rendering System of Human Figures from Arbitrary Viewpoints Using Multiple Cameras

Yutaka Kunita, Masahiko Inami, Taro Maeda, Susumu Tachi

Research output: Contribution to journalArticle

Abstract

To enable face-to-face communication between remote users, we developed a prototype system that projects real-time realistic images of human figures into a virtual space. Since real-time responsiveness, in particular, is required for this kind of use, the prototype equipment has the following special features. First, it uses a simple technique that extracts images captured by multiple cameras and projects them onto a plane located in the virtual space. Since the geometric shape of the human figure need not be obtained when using this technique, the required computing power is extremely small. The generated image error becomes large if the subject is not in the vicinity of the virtual plane. We formulated this by defining a fixed range within which the subject should exist as the "equivalent depth of field." Also, among the video signals obtained by the multiple cameras, the implemented system selects only the ones required for image generation and enters them into the computer in terms of scan line units. By selectively discarding information at an early stage in this way, a high-precision image can be generated without degradation even if there are few video-capture boards. These special features enabled us to show the effectiveness of the proposed technique by successfully generating real-time images using a consumer-oriented, low-cost personal computer.

Original languageEnglish
Pages (from-to)91-100
Number of pages10
JournalSystems and Computers in Japan
Volume34
Issue number11
DOIs
Publication statusPublished - 2003 Oct
Externally publishedYes

Fingerprint

Rendering
Figure
Camera
Cameras
Real-time
Arbitrary
Personal computers
Degradation
Communication
Prototype
Depth of Field
Costs
Personal Computer
Human
Unit
Computing
Line
Range of data

Keywords

  • Image-based rendering
  • Mutual telexistence
  • Presence communication
  • Real time
  • Virtual reality

ASJC Scopus subject areas

  • Hardware and Architecture
  • Information Systems
  • Theoretical Computer Science
  • Computational Theory and Mathematics

Cite this

Real-Time Rendering System of Human Figures from Arbitrary Viewpoints Using Multiple Cameras. / Kunita, Yutaka; Inami, Masahiko; Maeda, Taro; Tachi, Susumu.

In: Systems and Computers in Japan, Vol. 34, No. 11, 10.2003, p. 91-100.

Research output: Contribution to journalArticle

Kunita, Yutaka ; Inami, Masahiko ; Maeda, Taro ; Tachi, Susumu. / Real-Time Rendering System of Human Figures from Arbitrary Viewpoints Using Multiple Cameras. In: Systems and Computers in Japan. 2003 ; Vol. 34, No. 11. pp. 91-100.
@article{262064d6102e4466b2a57ba24233c0c5,
title = "Real-Time Rendering System of Human Figures from Arbitrary Viewpoints Using Multiple Cameras",
abstract = "To enable face-to-face communication between remote users, we developed a prototype system that projects real-time realistic images of human figures into a virtual space. Since real-time responsiveness, in particular, is required for this kind of use, the prototype equipment has the following special features. First, it uses a simple technique that extracts images captured by multiple cameras and projects them onto a plane located in the virtual space. Since the geometric shape of the human figure need not be obtained when using this technique, the required computing power is extremely small. The generated image error becomes large if the subject is not in the vicinity of the virtual plane. We formulated this by defining a fixed range within which the subject should exist as the {"}equivalent depth of field.{"} Also, among the video signals obtained by the multiple cameras, the implemented system selects only the ones required for image generation and enters them into the computer in terms of scan line units. By selectively discarding information at an early stage in this way, a high-precision image can be generated without degradation even if there are few video-capture boards. These special features enabled us to show the effectiveness of the proposed technique by successfully generating real-time images using a consumer-oriented, low-cost personal computer.",
keywords = "Image-based rendering, Mutual telexistence, Presence communication, Real time, Virtual reality",
author = "Yutaka Kunita and Masahiko Inami and Taro Maeda and Susumu Tachi",
year = "2003",
month = "10",
doi = "10.1002/scj.1216",
language = "English",
volume = "34",
pages = "91--100",
journal = "Systems and Computers in Japan",
issn = "0882-1666",
publisher = "John Wiley and Sons Inc.",
number = "11",

}

TY - JOUR

T1 - Real-Time Rendering System of Human Figures from Arbitrary Viewpoints Using Multiple Cameras

AU - Kunita, Yutaka

AU - Inami, Masahiko

AU - Maeda, Taro

AU - Tachi, Susumu

PY - 2003/10

Y1 - 2003/10

N2 - To enable face-to-face communication between remote users, we developed a prototype system that projects real-time realistic images of human figures into a virtual space. Since real-time responsiveness, in particular, is required for this kind of use, the prototype equipment has the following special features. First, it uses a simple technique that extracts images captured by multiple cameras and projects them onto a plane located in the virtual space. Since the geometric shape of the human figure need not be obtained when using this technique, the required computing power is extremely small. The generated image error becomes large if the subject is not in the vicinity of the virtual plane. We formulated this by defining a fixed range within which the subject should exist as the "equivalent depth of field." Also, among the video signals obtained by the multiple cameras, the implemented system selects only the ones required for image generation and enters them into the computer in terms of scan line units. By selectively discarding information at an early stage in this way, a high-precision image can be generated without degradation even if there are few video-capture boards. These special features enabled us to show the effectiveness of the proposed technique by successfully generating real-time images using a consumer-oriented, low-cost personal computer.

AB - To enable face-to-face communication between remote users, we developed a prototype system that projects real-time realistic images of human figures into a virtual space. Since real-time responsiveness, in particular, is required for this kind of use, the prototype equipment has the following special features. First, it uses a simple technique that extracts images captured by multiple cameras and projects them onto a plane located in the virtual space. Since the geometric shape of the human figure need not be obtained when using this technique, the required computing power is extremely small. The generated image error becomes large if the subject is not in the vicinity of the virtual plane. We formulated this by defining a fixed range within which the subject should exist as the "equivalent depth of field." Also, among the video signals obtained by the multiple cameras, the implemented system selects only the ones required for image generation and enters them into the computer in terms of scan line units. By selectively discarding information at an early stage in this way, a high-precision image can be generated without degradation even if there are few video-capture boards. These special features enabled us to show the effectiveness of the proposed technique by successfully generating real-time images using a consumer-oriented, low-cost personal computer.

KW - Image-based rendering

KW - Mutual telexistence

KW - Presence communication

KW - Real time

KW - Virtual reality

UR - http://www.scopus.com/inward/record.url?scp=0141637294&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0141637294&partnerID=8YFLogxK

U2 - 10.1002/scj.1216

DO - 10.1002/scj.1216

M3 - Article

AN - SCOPUS:0141637294

VL - 34

SP - 91

EP - 100

JO - Systems and Computers in Japan

JF - Systems and Computers in Japan

SN - 0882-1666

IS - 11

ER -