Extra-normal interactions in mediated virtual environments: An investigation of an audio-visual crossed-sense modality

Benjamin I. Outram, Masashi Nakatani, Kouta Minamizawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Here, we propose that the use of unusual crossed-sense-modality couplings can be exploited to engineer non-realistic but potentially beneficial VEs providing high degrees of interaction and presence, and provide new avenues for enhancing the experience and utility of single- and multi-user VE technologies. We report user's reactions to mediated environments in which the sound of their voice is represented via a frequency-to-color-mapped visualization. Users reported a sense of interaction and enjoyment, but results from a preliminary user study have yet to show a clear link with presence. We discuss the next stages of the research which will investigate how mixed-sense modalities contribute to co-presence and collaboration in multi-user environments.

Original languageEnglish
Title of host publication2016 IEEE Virtual Reality Conference, VR 2016 - Proceedings
PublisherIEEE Computer Society
Pages255-256
Number of pages2
Volume2016-July
ISBN (Electronic)9781509008360
DOIs
Publication statusPublished - 2016 Jul 5
Event18th IEEE Virtual Reality Conference, VR 2016 - Greenville, United States
Duration: 2016 Mar 192016 Mar 23

Other

Other18th IEEE Virtual Reality Conference, VR 2016
CountryUnited States
CityGreenville
Period16/3/1916/3/23

Fingerprint

Virtual reality
Visualization
Acoustic waves
Color
Engineers

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Outram, B. I., Nakatani, M., & Minamizawa, K. (2016). Extra-normal interactions in mediated virtual environments: An investigation of an audio-visual crossed-sense modality. In 2016 IEEE Virtual Reality Conference, VR 2016 - Proceedings (Vol. 2016-July, pp. 255-256). [7504750] IEEE Computer Society. https://doi.org/10.1109/VR.2016.7504750

Extra-normal interactions in mediated virtual environments : An investigation of an audio-visual crossed-sense modality. / Outram, Benjamin I.; Nakatani, Masashi; Minamizawa, Kouta.

2016 IEEE Virtual Reality Conference, VR 2016 - Proceedings. Vol. 2016-July IEEE Computer Society, 2016. p. 255-256 7504750.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Outram, BI, Nakatani, M & Minamizawa, K 2016, Extra-normal interactions in mediated virtual environments: An investigation of an audio-visual crossed-sense modality. in 2016 IEEE Virtual Reality Conference, VR 2016 - Proceedings. vol. 2016-July, 7504750, IEEE Computer Society, pp. 255-256, 18th IEEE Virtual Reality Conference, VR 2016, Greenville, United States, 16/3/19. https://doi.org/10.1109/VR.2016.7504750
Outram BI, Nakatani M, Minamizawa K. Extra-normal interactions in mediated virtual environments: An investigation of an audio-visual crossed-sense modality. In 2016 IEEE Virtual Reality Conference, VR 2016 - Proceedings. Vol. 2016-July. IEEE Computer Society. 2016. p. 255-256. 7504750 https://doi.org/10.1109/VR.2016.7504750
Outram, Benjamin I. ; Nakatani, Masashi ; Minamizawa, Kouta. / Extra-normal interactions in mediated virtual environments : An investigation of an audio-visual crossed-sense modality. 2016 IEEE Virtual Reality Conference, VR 2016 - Proceedings. Vol. 2016-July IEEE Computer Society, 2016. pp. 255-256
@inproceedings{792cd504c00545918e664626c101602d,
title = "Extra-normal interactions in mediated virtual environments: An investigation of an audio-visual crossed-sense modality",
abstract = "Here, we propose that the use of unusual crossed-sense-modality couplings can be exploited to engineer non-realistic but potentially beneficial VEs providing high degrees of interaction and presence, and provide new avenues for enhancing the experience and utility of single- and multi-user VE technologies. We report user's reactions to mediated environments in which the sound of their voice is represented via a frequency-to-color-mapped visualization. Users reported a sense of interaction and enjoyment, but results from a preliminary user study have yet to show a clear link with presence. We discuss the next stages of the research which will investigate how mixed-sense modalities contribute to co-presence and collaboration in multi-user environments.",
author = "Outram, {Benjamin I.} and Masashi Nakatani and Kouta Minamizawa",
year = "2016",
month = "7",
day = "5",
doi = "10.1109/VR.2016.7504750",
language = "English",
volume = "2016-July",
pages = "255--256",
booktitle = "2016 IEEE Virtual Reality Conference, VR 2016 - Proceedings",
publisher = "IEEE Computer Society",

}

TY - GEN

T1 - Extra-normal interactions in mediated virtual environments

T2 - An investigation of an audio-visual crossed-sense modality

AU - Outram, Benjamin I.

AU - Nakatani, Masashi

AU - Minamizawa, Kouta

PY - 2016/7/5

Y1 - 2016/7/5

N2 - Here, we propose that the use of unusual crossed-sense-modality couplings can be exploited to engineer non-realistic but potentially beneficial VEs providing high degrees of interaction and presence, and provide new avenues for enhancing the experience and utility of single- and multi-user VE technologies. We report user's reactions to mediated environments in which the sound of their voice is represented via a frequency-to-color-mapped visualization. Users reported a sense of interaction and enjoyment, but results from a preliminary user study have yet to show a clear link with presence. We discuss the next stages of the research which will investigate how mixed-sense modalities contribute to co-presence and collaboration in multi-user environments.

AB - Here, we propose that the use of unusual crossed-sense-modality couplings can be exploited to engineer non-realistic but potentially beneficial VEs providing high degrees of interaction and presence, and provide new avenues for enhancing the experience and utility of single- and multi-user VE technologies. We report user's reactions to mediated environments in which the sound of their voice is represented via a frequency-to-color-mapped visualization. Users reported a sense of interaction and enjoyment, but results from a preliminary user study have yet to show a clear link with presence. We discuss the next stages of the research which will investigate how mixed-sense modalities contribute to co-presence and collaboration in multi-user environments.

UR - http://www.scopus.com/inward/record.url?scp=84979753785&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84979753785&partnerID=8YFLogxK

U2 - 10.1109/VR.2016.7504750

DO - 10.1109/VR.2016.7504750

M3 - Conference contribution

AN - SCOPUS:84979753785

VL - 2016-July

SP - 255

EP - 256

BT - 2016 IEEE Virtual Reality Conference, VR 2016 - Proceedings

PB - IEEE Computer Society

ER -