Reality Jockey: Lifting the barrier between alternate realities through audio and Haptic feedback

Kevin Fan, Hideyuki Izumi, Yuta Sugiura, Kouta Minamizawa, Sohei Wakisaka, Masahiko Inami, Naotaka Fujii, Susumu Tachi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

We present Reality Jockey, a system that confuses the participant's perception of the reality by mixing in a recorded past-reality. The participant will be immersed in a spatialized 3D sound environment that is a mix of sounds from the reality and from the past. The sound environment from the past is augmented with haptic feedback in cross-modality. The haptic feedback is associated with certain sounds such as the vibration in the table when stuff is placed on the table to make the illusion of it happening in live. The seamless transition between live and past creates immersive experience of past events. The blending of live and past allows interactivity. To validate our system, we conducted user studies on 1) does blending live sensations improve such experiences, and 2) how beneficial is it to provide haptic feedbacks in recorded pasts. Potential applications are suggested to illustrate the significance of Reality Jockey.

Original languageEnglish
Title of host publicationCHI 2013
Subtitle of host publicationChanging Perspectives, Conference Proceedings - The 31st Annual CHI Conference on Human Factors in Computing Systems
Pages2557-2566
Number of pages10
DOIs
Publication statusPublished - 2013 May 27
Event31st Annual CHI Conference on Human Factors in Computing Systems: Changing Perspectives, CHI 2013 - Paris, France
Duration: 2013 Apr 272013 May 2

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Other

Other31st Annual CHI Conference on Human Factors in Computing Systems: Changing Perspectives, CHI 2013
CountryFrance
CityParis
Period13/4/2713/5/2

Keywords

  • Cross-modality
  • Haptic
  • Illusion
  • Spatial sound
  • Substitutional reality

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of 'Reality Jockey: Lifting the barrier between alternate realities through audio and Haptic feedback'. Together they form a unique fingerprint.

  • Cite this

    Fan, K., Izumi, H., Sugiura, Y., Minamizawa, K., Wakisaka, S., Inami, M., Fujii, N., & Tachi, S. (2013). Reality Jockey: Lifting the barrier between alternate realities through audio and Haptic feedback. In CHI 2013: Changing Perspectives, Conference Proceedings - The 31st Annual CHI Conference on Human Factors in Computing Systems (pp. 2557-2566). (Conference on Human Factors in Computing Systems - Proceedings). https://doi.org/10.1145/2470654.2481353