Reality Jockey: Lifting the barrier between alternate realities through audio and Haptic feedback

Kevin Fan; Hideyuki Izumi; Yuta Sugiura; Kouta Minamizawa; Sohei Wakisaka; Masahiko Inami; Naotaka Fujii; Susumu Tachi

doi:10.1145/2470654.2481353

Reality Jockey: Lifting the barrier between alternate realities through audio and Haptic feedback

Kevin Fan, Hideyuki Izumi, Yuta Sugiura, Kouta Minamizawa, Sohei Wakisaka, Masahiko Inami, Naotaka Fujii, Susumu Tachi

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Citations (Scopus)

Abstract

We present Reality Jockey, a system that confuses the participant's perception of the reality by mixing in a recorded past-reality. The participant will be immersed in a spatialized 3D sound environment that is a mix of sounds from the reality and from the past. The sound environment from the past is augmented with haptic feedback in cross-modality. The haptic feedback is associated with certain sounds such as the vibration in the table when stuff is placed on the table to make the illusion of it happening in live. The seamless transition between live and past creates immersive experience of past events. The blending of live and past allows interactivity. To validate our system, we conducted user studies on 1) does blending live sensations improve such experiences, and 2) how beneficial is it to provide haptic feedbacks in recorded pasts. Potential applications are suggested to illustrate the significance of Reality Jockey.

Original language	English
Title of host publication	CHI 2013
Subtitle of host publication	Changing Perspectives, Conference Proceedings - The 31st Annual CHI Conference on Human Factors in Computing Systems
Pages	2557-2566
Number of pages	10
DOIs	https://doi.org/10.1145/2470654.2481353
Publication status	Published - 2013
Event	31st Annual CHI Conference on Human Factors in Computing Systems: Changing Perspectives, CHI 2013 - Paris, France Duration: 2013 Apr 27 → 2013 May 2

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Other

Other	31st Annual CHI Conference on Human Factors in Computing Systems: Changing Perspectives, CHI 2013
Country	France
City	Paris
Period	13/4/27 → 13/5/2

Keywords

Cross-modality
Haptic
Illusion
Spatial sound
Substitutional reality

ASJC Scopus subject areas

Software
Human-Computer Interaction
Computer Graphics and Computer-Aided Design

Access to Document

10.1145/2470654.2481353

Fingerprint Dive into the research topics of 'Reality Jockey: Lifting the barrier between alternate realities through audio and Haptic feedback'. Together they form a unique fingerprint.

Cite this

Fan, K., Izumi, H., Sugiura, Y., Minamizawa, K., Wakisaka, S., Inami, M., Fujii, N., & Tachi, S. (2013). Reality Jockey: Lifting the barrier between alternate realities through audio and Haptic feedback. In CHI 2013: Changing Perspectives, Conference Proceedings - The 31st Annual CHI Conference on Human Factors in Computing Systems (pp. 2557-2566). (Conference on Human Factors in Computing Systems - Proceedings). https://doi.org/10.1145/2470654.2481353

Reality Jockey : Lifting the barrier between alternate realities through audio and Haptic feedback. / Fan, Kevin; Izumi, Hideyuki; Sugiura, Yuta ; Minamizawa, Kouta; Wakisaka, Sohei; Inami, Masahiko; Fujii, Naotaka; Tachi, Susumu.

CHI 2013: Changing Perspectives, Conference Proceedings - The 31st Annual CHI Conference on Human Factors in Computing Systems. 2013. p. 2557-2566 (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Fan, K, Izumi, H, Sugiura, Y , Minamizawa, K, Wakisaka, S, Inami, M, Fujii, N & Tachi, S 2013, Reality Jockey: Lifting the barrier between alternate realities through audio and Haptic feedback. in CHI 2013: Changing Perspectives, Conference Proceedings - The 31st Annual CHI Conference on Human Factors in Computing Systems. Conference on Human Factors in Computing Systems - Proceedings, pp. 2557-2566, 31st Annual CHI Conference on Human Factors in Computing Systems: Changing Perspectives, CHI 2013, Paris, France, 13/4/27. https://doi.org/10.1145/2470654.2481353

Fan K, Izumi H, Sugiura Y , Minamizawa K, Wakisaka S, Inami M et al. Reality Jockey: Lifting the barrier between alternate realities through audio and Haptic feedback. In CHI 2013: Changing Perspectives, Conference Proceedings - The 31st Annual CHI Conference on Human Factors in Computing Systems. 2013. p. 2557-2566. (Conference on Human Factors in Computing Systems - Proceedings). https://doi.org/10.1145/2470654.2481353

Fan, Kevin ; Izumi, Hideyuki ; Sugiura, Yuta ; Minamizawa, Kouta ; Wakisaka, Sohei ; Inami, Masahiko ; Fujii, Naotaka ; Tachi, Susumu. / Reality Jockey : Lifting the barrier between alternate realities through audio and Haptic feedback. CHI 2013: Changing Perspectives, Conference Proceedings - The 31st Annual CHI Conference on Human Factors in Computing Systems. 2013. pp. 2557-2566 (Conference on Human Factors in Computing Systems - Proceedings).

@inproceedings{1efa3c5bf8484b4cbc7d68758ec8961e,

title = "Reality Jockey: Lifting the barrier between alternate realities through audio and Haptic feedback",

abstract = "We present Reality Jockey, a system that confuses the participant's perception of the reality by mixing in a recorded past-reality. The participant will be immersed in a spatialized 3D sound environment that is a mix of sounds from the reality and from the past. The sound environment from the past is augmented with haptic feedback in cross-modality. The haptic feedback is associated with certain sounds such as the vibration in the table when stuff is placed on the table to make the illusion of it happening in live. The seamless transition between live and past creates immersive experience of past events. The blending of live and past allows interactivity. To validate our system, we conducted user studies on 1) does blending live sensations improve such experiences, and 2) how beneficial is it to provide haptic feedbacks in recorded pasts. Potential applications are suggested to illustrate the significance of Reality Jockey.",

keywords = "Cross-modality, Haptic, Illusion, Spatial sound, Substitutional reality",

author = "Kevin Fan and Hideyuki Izumi and Yuta Sugiura and Kouta Minamizawa and Sohei Wakisaka and Masahiko Inami and Naotaka Fujii and Susumu Tachi",

note = "Copyright: Copyright 2013 Elsevier B.V., All rights reserved.; 31st Annual CHI Conference on Human Factors in Computing Systems: Changing Perspectives, CHI 2013 ; Conference date: 27-04-2013 Through 02-05-2013",

year = "2013",

doi = "10.1145/2470654.2481353",

language = "English",

isbn = "9781450318990",

series = "Conference on Human Factors in Computing Systems - Proceedings",

pages = "2557--2566",

booktitle = "CHI 2013",

}

TY - GEN

T1 - Reality Jockey

T2 - 31st Annual CHI Conference on Human Factors in Computing Systems: Changing Perspectives, CHI 2013

AU - Fan, Kevin

AU - Izumi, Hideyuki

AU - Sugiura, Yuta

AU - Minamizawa, Kouta

AU - Wakisaka, Sohei

AU - Inami, Masahiko

AU - Fujii, Naotaka

AU - Tachi, Susumu

PY - 2013

Y1 - 2013

N2 - We present Reality Jockey, a system that confuses the participant's perception of the reality by mixing in a recorded past-reality. The participant will be immersed in a spatialized 3D sound environment that is a mix of sounds from the reality and from the past. The sound environment from the past is augmented with haptic feedback in cross-modality. The haptic feedback is associated with certain sounds such as the vibration in the table when stuff is placed on the table to make the illusion of it happening in live. The seamless transition between live and past creates immersive experience of past events. The blending of live and past allows interactivity. To validate our system, we conducted user studies on 1) does blending live sensations improve such experiences, and 2) how beneficial is it to provide haptic feedbacks in recorded pasts. Potential applications are suggested to illustrate the significance of Reality Jockey.

AB - We present Reality Jockey, a system that confuses the participant's perception of the reality by mixing in a recorded past-reality. The participant will be immersed in a spatialized 3D sound environment that is a mix of sounds from the reality and from the past. The sound environment from the past is augmented with haptic feedback in cross-modality. The haptic feedback is associated with certain sounds such as the vibration in the table when stuff is placed on the table to make the illusion of it happening in live. The seamless transition between live and past creates immersive experience of past events. The blending of live and past allows interactivity. To validate our system, we conducted user studies on 1) does blending live sensations improve such experiences, and 2) how beneficial is it to provide haptic feedbacks in recorded pasts. Potential applications are suggested to illustrate the significance of Reality Jockey.

KW - Cross-modality

KW - Haptic

KW - Illusion

KW - Spatial sound

KW - Substitutional reality

UR - http://www.scopus.com/inward/record.url?scp=84877970957&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84877970957&partnerID=8YFLogxK

U2 - 10.1145/2470654.2481353

DO - 10.1145/2470654.2481353

M3 - Conference contribution

AN - SCOPUS:84877970957

SN - 9781450318990

T3 - Conference on Human Factors in Computing Systems - Proceedings

SP - 2557

EP - 2566

BT - CHI 2013

Y2 - 27 April 2013 through 2 May 2013

ER -

Reality Jockey: Lifting the barrier between alternate realities through audio and Haptic feedback

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Cite this