Multimodal literacy: Storytelling across senses

Suana Sanchez, Heng Gu, Kai Steven Kunze, Masahiko Inami

研究成果: Conference contribution

抄録

This paper describes a novel framework for literature that presents the reader with a multimodal experience (visual, haptic and auditory). We present an initial prototype, ex- tending an iPad with a surface vibration transducer for hap- tic feedback to augment the reading of a short story. Text provides the reader with verbal information, whereas other senses perceive the context through non-verbal cues. We use our own framework to create this storytelling across senses, integrating text, sound, animation and tactile sen- sation. We believe with a multi-modal reading experience, users will enjoy reading more, will feel more immersed and remember the narrative better.

本文言語English
ホスト出版物のタイトルUbiComp and ISWC 2015 - Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the Proceedings of the 2015 ACM International Symposium on Wearable Computers
出版社Association for Computing Machinery, Inc
ページ1257-1260
ページ数4
ISBN(印刷版)9781450335751
DOI
出版ステータスPublished - 2015 9 7
イベントACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2015 ACM International Symposium on Wearable Computers, UbiComp and ISWC 2015 - Osaka, Japan
継続期間: 2015 9 72015 9 11

Other

OtherACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2015 ACM International Symposium on Wearable Computers, UbiComp and ISWC 2015
CountryJapan
CityOsaka
Period15/9/715/9/11

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture
  • Software

フィンガープリント 「Multimodal literacy: Storytelling across senses」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル