IMMERSIVE SURGICAL NAVIGATION USING SPATIAL INTERACTIVE VIRTUAL REALITY AND HOLOGRAPHIC AUGMENTED REALITY

Maki Sugimoto, Yoshiyuki Shiga, Mitsuhiro Abe, Shuji Kameyama, Takeshi Azuma

Research output: Contribution to journalArticle

Abstract

This paper describes the potential role and limitations of current three-dimensional (3D) virtual reality (VR), augmented reality (AR), and holography for image-guided surgery. We developed a new surgical spatial navigation system using VR, AR, and virtual holography. An interactive stereo display is used to view the interactions between the surgeon and stereo images of the patient’s anatomy depicted on the display by tracking the surgeon’s head and hand/arm positions. Sensing the surgeon’s head position creates motion parallax information, an immersive depth cue that can be added to the binocular parallax already present in the display. The beneficial applications of VR/AR devices (head-mounted devices, 3D tablets, and motion sensors) are also discussed. They allow the user to manipulate the spatial attributes of VR, which can enhance spatial reasoning and AR.

Original languageEnglish
Pages (from-to)387-394
Number of pages8
JournalNihon Geka Gakkai zasshi
Volume117
Issue number5
Publication statusPublished - 2016 Sep 1

Fingerprint

Holography
Head
Computer-Assisted Surgery
Equipment and Supplies
Tablets
Cues
Anatomy
Arm
Hand
Spatial Navigation
Surgeons

ASJC Scopus subject areas

  • Medicine(all)

Cite this

IMMERSIVE SURGICAL NAVIGATION USING SPATIAL INTERACTIVE VIRTUAL REALITY AND HOLOGRAPHIC AUGMENTED REALITY. / Sugimoto, Maki; Shiga, Yoshiyuki; Abe, Mitsuhiro; Kameyama, Shuji; Azuma, Takeshi.

In: Nihon Geka Gakkai zasshi, Vol. 117, No. 5, 01.09.2016, p. 387-394.

Research output: Contribution to journalArticle

Sugimoto, Maki ; Shiga, Yoshiyuki ; Abe, Mitsuhiro ; Kameyama, Shuji ; Azuma, Takeshi. / IMMERSIVE SURGICAL NAVIGATION USING SPATIAL INTERACTIVE VIRTUAL REALITY AND HOLOGRAPHIC AUGMENTED REALITY. In: Nihon Geka Gakkai zasshi. 2016 ; Vol. 117, No. 5. pp. 387-394.
@article{e8f2f43ba5804e57896c6242b8cdb201,
title = "IMMERSIVE SURGICAL NAVIGATION USING SPATIAL INTERACTIVE VIRTUAL REALITY AND HOLOGRAPHIC AUGMENTED REALITY",
abstract = "This paper describes the potential role and limitations of current three-dimensional (3D) virtual reality (VR), augmented reality (AR), and holography for image-guided surgery. We developed a new surgical spatial navigation system using VR, AR, and virtual holography. An interactive stereo display is used to view the interactions between the surgeon and stereo images of the patient’s anatomy depicted on the display by tracking the surgeon’s head and hand/arm positions. Sensing the surgeon’s head position creates motion parallax information, an immersive depth cue that can be added to the binocular parallax already present in the display. The beneficial applications of VR/AR devices (head-mounted devices, 3D tablets, and motion sensors) are also discussed. They allow the user to manipulate the spatial attributes of VR, which can enhance spatial reasoning and AR.",
author = "Maki Sugimoto and Yoshiyuki Shiga and Mitsuhiro Abe and Shuji Kameyama and Takeshi Azuma",
year = "2016",
month = "9",
day = "1",
language = "English",
volume = "117",
pages = "387--394",
journal = "Nihon Geka Gakkai zasshi",
issn = "0301-4894",
publisher = "Nihon Geka Gakkai",
number = "5",

}

TY - JOUR

T1 - IMMERSIVE SURGICAL NAVIGATION USING SPATIAL INTERACTIVE VIRTUAL REALITY AND HOLOGRAPHIC AUGMENTED REALITY

AU - Sugimoto, Maki

AU - Shiga, Yoshiyuki

AU - Abe, Mitsuhiro

AU - Kameyama, Shuji

AU - Azuma, Takeshi

PY - 2016/9/1

Y1 - 2016/9/1

N2 - This paper describes the potential role and limitations of current three-dimensional (3D) virtual reality (VR), augmented reality (AR), and holography for image-guided surgery. We developed a new surgical spatial navigation system using VR, AR, and virtual holography. An interactive stereo display is used to view the interactions between the surgeon and stereo images of the patient’s anatomy depicted on the display by tracking the surgeon’s head and hand/arm positions. Sensing the surgeon’s head position creates motion parallax information, an immersive depth cue that can be added to the binocular parallax already present in the display. The beneficial applications of VR/AR devices (head-mounted devices, 3D tablets, and motion sensors) are also discussed. They allow the user to manipulate the spatial attributes of VR, which can enhance spatial reasoning and AR.

AB - This paper describes the potential role and limitations of current three-dimensional (3D) virtual reality (VR), augmented reality (AR), and holography for image-guided surgery. We developed a new surgical spatial navigation system using VR, AR, and virtual holography. An interactive stereo display is used to view the interactions between the surgeon and stereo images of the patient’s anatomy depicted on the display by tracking the surgeon’s head and hand/arm positions. Sensing the surgeon’s head position creates motion parallax information, an immersive depth cue that can be added to the binocular parallax already present in the display. The beneficial applications of VR/AR devices (head-mounted devices, 3D tablets, and motion sensors) are also discussed. They allow the user to manipulate the spatial attributes of VR, which can enhance spatial reasoning and AR.

UR - http://www.scopus.com/inward/record.url?scp=85055079962&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85055079962&partnerID=8YFLogxK

M3 - Article

VL - 117

SP - 387

EP - 394

JO - Nihon Geka Gakkai zasshi

JF - Nihon Geka Gakkai zasshi

SN - 0301-4894

IS - 5

ER -