An augmented e-reader for multimodal literacy

Heng Gu, Susana Sanchez, Kai Steven Kunze, Masahiko Inami

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

We present an initial prototype to extend a reading tablet for haptic feedback -with a surface vibration transducer. This, in order to transform literature into a multimodal reading experience. In this augmented literature, the text provides its reader with verbal information, while other senses perceive context through non-verbal cues. We use our own framework to design this storytelling across senses integrating text, sound, animation and tactile sensation. The intention is to develop a multimodal storytelling that enhances the readers imagination, improving the reading experience. In this way, we believe, readers will completely immerse into the narrative and enjoy reading more.

Original languageEnglish
Title of host publicationUbiComp and ISWC 2015 - Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the Proceedings of the 2015 ACM International Symposium on Wearable Computers
PublisherAssociation for Computing Machinery, Inc
Pages353-356
Number of pages4
ISBN (Print)9781450335751
DOIs
Publication statusPublished - 2015 Sep 7
EventACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2015 ACM International Symposium on Wearable Computers, UbiComp and ISWC 2015 - Osaka, Japan
Duration: 2015 Sep 72015 Sep 11

Other

OtherACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2015 ACM International Symposium on Wearable Computers, UbiComp and ISWC 2015
CountryJapan
CityOsaka
Period15/9/715/9/11

Keywords

  • Dual-coding
  • Multimodal
  • Reading
  • Valid co-occurrences

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture
  • Software

Fingerprint Dive into the research topics of 'An augmented e-reader for multimodal literacy'. Together they form a unique fingerprint.

  • Cite this

    Gu, H., Sanchez, S., Kunze, K. S., & Inami, M. (2015). An augmented e-reader for multimodal literacy. In UbiComp and ISWC 2015 - Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the Proceedings of the 2015 ACM International Symposium on Wearable Computers (pp. 353-356). Association for Computing Machinery, Inc. https://doi.org/10.1145/2800835.2800897