Transparent cockpit using telexistence

Takura Yanagi, Charith Lasantha Fernando, M. H D Yamen Saraiji, Kouta Minamizawa, Susumu Tachi, Norimasa Kishi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

We propose an indirect-vision, video-see-through augmented reality (AR) cockpit that uses telexistence technology to provide an AR enriched, virtually transparent view of the surroundings through monitors instead of windows. Such a virtual view has the potential to enhance driving performance and experience above conventional glass as well as head-up display equipped cockpits by combining AR overlays with images obtained by future image sensors that are superior to human eyes. As a proof of concept, we replaced the front windshield of an experimental car by a large stereoscopic monitor. A robotic stereo camera pair that mimics the driver's head motions provides stereoscopic images with seamless motion parallax to the monitor. Initial driving tests at moderate speeds on roads within our research facility confirmed the illusion of transparency. We will conduct human factors evaluations after implementing AR functions in order to show whether it is possible to achieve an overall benefit over conventional cockpits in spite of possible conceptual issues like latency, shift of viewpoint and short distance between driver and display.

Original languageEnglish
Title of host publication2015 IEEE Virtual Reality Conference, VR 2015 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages311-312
Number of pages2
ISBN (Print)9781479917273
DOIs
Publication statusPublished - 2015 Aug 25
EventIEEE Virtual Reality Conference, VR 2015 - Arles, France
Duration: 2015 Mar 232015 Mar 27

Other

OtherIEEE Virtual Reality Conference, VR 2015
CountryFrance
CityArles
Period15/3/2315/3/27

Fingerprint

Augmented reality
Display devices
Windshields
Human engineering
Image sensors
Transparency
Robotics
Railroad cars
Cameras
Glass

Keywords

  • Augmented Reality
  • Telexistence
  • Virtual Reality

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Cite this

Yanagi, T., Fernando, C. L., Saraiji, M. H. D. Y., Minamizawa, K., Tachi, S., & Kishi, N. (2015). Transparent cockpit using telexistence. In 2015 IEEE Virtual Reality Conference, VR 2015 - Proceedings (pp. 311-312). [7223420] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/VR.2015.7223420

Transparent cockpit using telexistence. / Yanagi, Takura; Fernando, Charith Lasantha; Saraiji, M. H D Yamen; Minamizawa, Kouta; Tachi, Susumu; Kishi, Norimasa.

2015 IEEE Virtual Reality Conference, VR 2015 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2015. p. 311-312 7223420.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yanagi, T, Fernando, CL, Saraiji, MHDY, Minamizawa, K, Tachi, S & Kishi, N 2015, Transparent cockpit using telexistence. in 2015 IEEE Virtual Reality Conference, VR 2015 - Proceedings., 7223420, Institute of Electrical and Electronics Engineers Inc., pp. 311-312, IEEE Virtual Reality Conference, VR 2015, Arles, France, 15/3/23. https://doi.org/10.1109/VR.2015.7223420
Yanagi T, Fernando CL, Saraiji MHDY, Minamizawa K, Tachi S, Kishi N. Transparent cockpit using telexistence. In 2015 IEEE Virtual Reality Conference, VR 2015 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2015. p. 311-312. 7223420 https://doi.org/10.1109/VR.2015.7223420
Yanagi, Takura ; Fernando, Charith Lasantha ; Saraiji, M. H D Yamen ; Minamizawa, Kouta ; Tachi, Susumu ; Kishi, Norimasa. / Transparent cockpit using telexistence. 2015 IEEE Virtual Reality Conference, VR 2015 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 311-312
@inproceedings{a5acc91713574954a8cf5b008a7ea207,
title = "Transparent cockpit using telexistence",
abstract = "We propose an indirect-vision, video-see-through augmented reality (AR) cockpit that uses telexistence technology to provide an AR enriched, virtually transparent view of the surroundings through monitors instead of windows. Such a virtual view has the potential to enhance driving performance and experience above conventional glass as well as head-up display equipped cockpits by combining AR overlays with images obtained by future image sensors that are superior to human eyes. As a proof of concept, we replaced the front windshield of an experimental car by a large stereoscopic monitor. A robotic stereo camera pair that mimics the driver's head motions provides stereoscopic images with seamless motion parallax to the monitor. Initial driving tests at moderate speeds on roads within our research facility confirmed the illusion of transparency. We will conduct human factors evaluations after implementing AR functions in order to show whether it is possible to achieve an overall benefit over conventional cockpits in spite of possible conceptual issues like latency, shift of viewpoint and short distance between driver and display.",
keywords = "Augmented Reality, Telexistence, Virtual Reality",
author = "Takura Yanagi and Fernando, {Charith Lasantha} and Saraiji, {M. H D Yamen} and Kouta Minamizawa and Susumu Tachi and Norimasa Kishi",
year = "2015",
month = "8",
day = "25",
doi = "10.1109/VR.2015.7223420",
language = "English",
isbn = "9781479917273",
pages = "311--312",
booktitle = "2015 IEEE Virtual Reality Conference, VR 2015 - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Transparent cockpit using telexistence

AU - Yanagi, Takura

AU - Fernando, Charith Lasantha

AU - Saraiji, M. H D Yamen

AU - Minamizawa, Kouta

AU - Tachi, Susumu

AU - Kishi, Norimasa

PY - 2015/8/25

Y1 - 2015/8/25

N2 - We propose an indirect-vision, video-see-through augmented reality (AR) cockpit that uses telexistence technology to provide an AR enriched, virtually transparent view of the surroundings through monitors instead of windows. Such a virtual view has the potential to enhance driving performance and experience above conventional glass as well as head-up display equipped cockpits by combining AR overlays with images obtained by future image sensors that are superior to human eyes. As a proof of concept, we replaced the front windshield of an experimental car by a large stereoscopic monitor. A robotic stereo camera pair that mimics the driver's head motions provides stereoscopic images with seamless motion parallax to the monitor. Initial driving tests at moderate speeds on roads within our research facility confirmed the illusion of transparency. We will conduct human factors evaluations after implementing AR functions in order to show whether it is possible to achieve an overall benefit over conventional cockpits in spite of possible conceptual issues like latency, shift of viewpoint and short distance between driver and display.

AB - We propose an indirect-vision, video-see-through augmented reality (AR) cockpit that uses telexistence technology to provide an AR enriched, virtually transparent view of the surroundings through monitors instead of windows. Such a virtual view has the potential to enhance driving performance and experience above conventional glass as well as head-up display equipped cockpits by combining AR overlays with images obtained by future image sensors that are superior to human eyes. As a proof of concept, we replaced the front windshield of an experimental car by a large stereoscopic monitor. A robotic stereo camera pair that mimics the driver's head motions provides stereoscopic images with seamless motion parallax to the monitor. Initial driving tests at moderate speeds on roads within our research facility confirmed the illusion of transparency. We will conduct human factors evaluations after implementing AR functions in order to show whether it is possible to achieve an overall benefit over conventional cockpits in spite of possible conceptual issues like latency, shift of viewpoint and short distance between driver and display.

KW - Augmented Reality

KW - Telexistence

KW - Virtual Reality

UR - http://www.scopus.com/inward/record.url?scp=84954559170&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84954559170&partnerID=8YFLogxK

U2 - 10.1109/VR.2015.7223420

DO - 10.1109/VR.2015.7223420

M3 - Conference contribution

AN - SCOPUS:84954559170

SN - 9781479917273

SP - 311

EP - 312

BT - 2015 IEEE Virtual Reality Conference, VR 2015 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -