An overview of augmented visualization

Observing the real world as desired

Shohei Mori, Hideo Saito

Research output: Contribution to journalReview article

Abstract

Over 20 years have passed since a free-viewpoint video technology has been proposed with which a user's viewpoint can be freely set up in a reconstructed three-dimensional space of a target scene photographed by multi-view cameras. This technology allows us to capture and reproduce the real world as recorded. Once we capture the world in a digital form, we can modify it as augmented reality (i.e., placing virtual objects in the digitized real world). Unlike this concept, the augmented world allows us to see through real objects by synthesizing the backgrounds that cannot be observed in our raw perspective directly. The key idea is to generate the background image using multi-view cameras, observing the backgrounds at different positions and seamlessly overlaying the recovered image in our digitized perspective. In this paper, we review such desired view-generation techniques from the perspective of free-view point image generation and discuss challenges and open problems through a case study of our implementations.

Original languageEnglish
JournalAPSIPA Transactions on Signal and Information Processing
Volume7
DOIs
Publication statusPublished - 2018 Jan 1

Fingerprint

Visualization
Cameras
Augmented reality

Keywords

  • Augmented reality
  • Diminished reality
  • Free-view point image generation
  • Human-computer interaction
  • Overview

ASJC Scopus subject areas

  • Signal Processing
  • Information Systems

Cite this

An overview of augmented visualization : Observing the real world as desired. / Mori, Shohei; Saito, Hideo.

In: APSIPA Transactions on Signal and Information Processing, Vol. 7, 01.01.2018.

Research output: Contribution to journalReview article

@article{1bc8dcc9455f49b0b640f64b267fe434,
title = "An overview of augmented visualization: Observing the real world as desired",
abstract = "Over 20 years have passed since a free-viewpoint video technology has been proposed with which a user's viewpoint can be freely set up in a reconstructed three-dimensional space of a target scene photographed by multi-view cameras. This technology allows us to capture and reproduce the real world as recorded. Once we capture the world in a digital form, we can modify it as augmented reality (i.e., placing virtual objects in the digitized real world). Unlike this concept, the augmented world allows us to see through real objects by synthesizing the backgrounds that cannot be observed in our raw perspective directly. The key idea is to generate the background image using multi-view cameras, observing the backgrounds at different positions and seamlessly overlaying the recovered image in our digitized perspective. In this paper, we review such desired view-generation techniques from the perspective of free-view point image generation and discuss challenges and open problems through a case study of our implementations.",
keywords = "Augmented reality, Diminished reality, Free-view point image generation, Human-computer interaction, Overview",
author = "Shohei Mori and Hideo Saito",
year = "2018",
month = "1",
day = "1",
doi = "10.1017/ATSIP.2018.13",
language = "English",
volume = "7",
journal = "APSIPA Transactions on Signal and Information Processing",
issn = "2048-7703",
publisher = "Cambridge University Press",

}

TY - JOUR

T1 - An overview of augmented visualization

T2 - Observing the real world as desired

AU - Mori, Shohei

AU - Saito, Hideo

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Over 20 years have passed since a free-viewpoint video technology has been proposed with which a user's viewpoint can be freely set up in a reconstructed three-dimensional space of a target scene photographed by multi-view cameras. This technology allows us to capture and reproduce the real world as recorded. Once we capture the world in a digital form, we can modify it as augmented reality (i.e., placing virtual objects in the digitized real world). Unlike this concept, the augmented world allows us to see through real objects by synthesizing the backgrounds that cannot be observed in our raw perspective directly. The key idea is to generate the background image using multi-view cameras, observing the backgrounds at different positions and seamlessly overlaying the recovered image in our digitized perspective. In this paper, we review such desired view-generation techniques from the perspective of free-view point image generation and discuss challenges and open problems through a case study of our implementations.

AB - Over 20 years have passed since a free-viewpoint video technology has been proposed with which a user's viewpoint can be freely set up in a reconstructed three-dimensional space of a target scene photographed by multi-view cameras. This technology allows us to capture and reproduce the real world as recorded. Once we capture the world in a digital form, we can modify it as augmented reality (i.e., placing virtual objects in the digitized real world). Unlike this concept, the augmented world allows us to see through real objects by synthesizing the backgrounds that cannot be observed in our raw perspective directly. The key idea is to generate the background image using multi-view cameras, observing the backgrounds at different positions and seamlessly overlaying the recovered image in our digitized perspective. In this paper, we review such desired view-generation techniques from the perspective of free-view point image generation and discuss challenges and open problems through a case study of our implementations.

KW - Augmented reality

KW - Diminished reality

KW - Free-view point image generation

KW - Human-computer interaction

KW - Overview

UR - http://www.scopus.com/inward/record.url?scp=85055292413&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85055292413&partnerID=8YFLogxK

U2 - 10.1017/ATSIP.2018.13

DO - 10.1017/ATSIP.2018.13

M3 - Review article

VL - 7

JO - APSIPA Transactions on Signal and Information Processing

JF - APSIPA Transactions on Signal and Information Processing

SN - 2048-7703

ER -