Investigating Textual Visual Sound Effects in a Virtual Environment and their impacts on Object Perception and Sound Perception

Thibault Fabre, Adrien Verhulst, Alfonso Balandra, Maki Sugimoto, Masahiko Inami

研究成果: Conference contribution

抄録

In comics, Textual Sound Effects (TE) can describe sounds, but also actions, events, etc. TE could be used in Virtual Environment to efficiently create an easily recognizable scene and add more information to objects at a relatively low design cost. We investigate the impact of TE in a Virtual Environment on objects’ material perception (on category and properties) and on sound perception (on volume [dB] and spatial position). Participants (N=13, repeated measures) categorized metallic and wooden spheres and significantly changed their reaction time depending on the TE congruence with the spheres’ material/sound. They then rated a sphere’s properties (i.e., wetness, warmness, softness, smoothness, and dullness) and significantly changed their rating depending on the TE. When comparing 2 sound volumes, they perceived a sound associated with a shrinking TE as less loud and a sound associated with a growing TE as louder. When locating an audio source location, they located it significantly closer to a TE.

本文言語English
ホスト出版物のタイトルProceedings - 2021 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2021
編集者Maud Marchal, Jonathan Ventura, Anne-Helene Olivier, Lili Wang, Rafael Radkowski
出版社Institute of Electrical and Electronics Engineers Inc.
ページ320-328
ページ数9
ISBN(電子版)9781665401586
DOI
出版ステータスPublished - 2021
イベント20th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2021 - Virtual, Online, Italy
継続期間: 2021 10月 42021 10月 8

出版物シリーズ

名前Proceedings - 2021 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2021

Conference

Conference20th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2021
国/地域Italy
CityVirtual, Online
Period21/10/421/10/8

ASJC Scopus subject areas

  • 人工知能

フィンガープリント

「Investigating Textual Visual Sound Effects in a Virtual Environment and their impacts on Object Perception and Sound Perception」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル