Multimodal literacy: Storytelling across senses

Suana Sanchez, Heng Gu, Kai Kunze, Masahiko Inami

研究成果: Conference contribution

1 被引用数 (Scopus)

抄録

This paper describes a novel framework for literature that presents the reader with a multimodal experience (visual, haptic and auditory). We present an initial prototype, ex- tending an iPad with a surface vibration transducer for hap- tic feedback to augment the reading of a short story. Text provides the reader with verbal information, whereas other senses perceive the context through non-verbal cues. We use our own framework to create this storytelling across senses, integrating text, sound, animation and tactile sen- sation. We believe with a multi-modal reading experience, users will enjoy reading more, will feel more immersed and remember the narrative better.

本文言語English
ホスト出版物のタイトルUbiComp and ISWC 2015 - Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the Proceedings of the 2015 ACM International Symposium on Wearable Computers
出版社Association for Computing Machinery, Inc
ページ1257-1260
ページ数4
ISBN(電子版)9781450335751
DOI
出版ステータスPublished - 2015 9 7
イベントACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2015 ACM International Symposium on Wearable Computers, UbiComp and ISWC 2015 - Osaka, Japan
継続期間: 2015 9 72015 9 11

出版物シリーズ

名前UbiComp and ISWC 2015 - Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the Proceedings of the 2015 ACM International Symposium on Wearable Computers

Other

OtherACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2015 ACM International Symposium on Wearable Computers, UbiComp and ISWC 2015
国/地域Japan
CityOsaka
Period15/9/715/9/11

ASJC Scopus subject areas

  • コンピュータ ネットワークおよび通信
  • ハードウェアとアーキテクチャ
  • ソフトウェア

フィンガープリント

「Multimodal literacy: Storytelling across senses」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル