Embodied reading: A multisensory experience

Susana Sanchez; Tilman Dingler; Heng Gu; Kai Steven Kunze

doi:10.1145/2851581.2892353

Embodied reading: A multisensory experience

Susana Sanchez, Tilman Dingler, Heng Gu, Kai Steven Kunze

Graduate School of Media Design

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Citations (Scopus)

Abstract

Reading fiction is a silent activity, where readers come to know imaginary worlds and characters from the book's pages. However, we perceive the natural world with more than our eyes, and literature should be no different. Thus, an embodied reading experience is proposed, adding sound effects and haptic feedback to allow readers to listen and feel the narrative text. This paper presents a preliminary prototype for multisensory narratives and an experimental methodology to measure embodiment in literature. Results for the subjective assessment of immersion and user experience from 15 participants in three modalities: haptic, sound, both combined are discussed.

Original language	English
Title of host publication	CHI EA 2016: #chi4good - Extended Abstracts, 34th Annual CHI Conference on Human Factors in Computing Systems
Publisher	Association for Computing Machinery
Pages	1459-1466
Number of pages	8
Volume	07-12-May-2016
ISBN (Electronic)	9781450340823
DOIs	https://doi.org/10.1145/2851581.2892353
Publication status	Published - 2016 May 7
Event	34th Annual CHI Conference on Human Factors in Computing Systems, CHI EA 2016 - San Jose, United States Duration: 2016 May 7 → 2016 May 12

Other

Other	34th Annual CHI Conference on Human Factors in Computing Systems, CHI EA 2016
Country	United States
City	San Jose
Period	16/5/7 → 16/5/12

Keywords

Embodied cognition
Haptics
Reading
Sound effects

ASJC Scopus subject areas

Human-Computer Interaction
Computer Graphics and Computer-Aided Design
Software

Access to Document

10.1145/2851581.2892353

Fingerprint Dive into the research topics of 'Embodied reading: A multisensory experience'. Together they form a unique fingerprint.

Cite this

Sanchez, S., Dingler, T., Gu, H., & Kunze, K. S. (2016). Embodied reading: A multisensory experience. In CHI EA 2016: #chi4good - Extended Abstracts, 34th Annual CHI Conference on Human Factors in Computing Systems (Vol. 07-12-May-2016, pp. 1459-1466). Association for Computing Machinery. https://doi.org/10.1145/2851581.2892353

Embodied reading : A multisensory experience. / Sanchez, Susana; Dingler, Tilman; Gu, Heng; Kunze, Kai Steven.

CHI EA 2016: #chi4good - Extended Abstracts, 34th Annual CHI Conference on Human Factors in Computing Systems. Vol. 07-12-May-2016 Association for Computing Machinery, 2016. p. 1459-1466.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Sanchez, S, Dingler, T, Gu, H & Kunze, KS 2016, Embodied reading: A multisensory experience. in CHI EA 2016: #chi4good - Extended Abstracts, 34th Annual CHI Conference on Human Factors in Computing Systems. vol. 07-12-May-2016, Association for Computing Machinery, pp. 1459-1466, 34th Annual CHI Conference on Human Factors in Computing Systems, CHI EA 2016, San Jose, United States, 16/5/7. https://doi.org/10.1145/2851581.2892353

@inproceedings{62fddede72e84ad78543a3b78abf2814,

title = "Embodied reading: A multisensory experience",

abstract = "Reading fiction is a silent activity, where readers come to know imaginary worlds and characters from the book's pages. However, we perceive the natural world with more than our eyes, and literature should be no different. Thus, an embodied reading experience is proposed, adding sound effects and haptic feedback to allow readers to listen and feel the narrative text. This paper presents a preliminary prototype for multisensory narratives and an experimental methodology to measure embodiment in literature. Results for the subjective assessment of immersion and user experience from 15 participants in three modalities: haptic, sound, both combined are discussed.",

keywords = "Embodied cognition, Haptics, Reading, Sound effects",

author = "Susana Sanchez and Tilman Dingler and Heng Gu and Kunze, {Kai Steven}",

year = "2016",

month = may,

day = "7",

doi = "10.1145/2851581.2892353",

language = "English",

volume = "07-12-May-2016",

pages = "1459--1466",

booktitle = "CHI EA 2016: #chi4good - Extended Abstracts, 34th Annual CHI Conference on Human Factors in Computing Systems",

publisher = "Association for Computing Machinery",

note = "34th Annual CHI Conference on Human Factors in Computing Systems, CHI EA 2016 ; Conference date: 07-05-2016 Through 12-05-2016",

}

TY - GEN

T1 - Embodied reading

T2 - 34th Annual CHI Conference on Human Factors in Computing Systems, CHI EA 2016

AU - Sanchez, Susana

AU - Dingler, Tilman

AU - Gu, Heng

AU - Kunze, Kai Steven

PY - 2016/5/7

Y1 - 2016/5/7

N2 - Reading fiction is a silent activity, where readers come to know imaginary worlds and characters from the book's pages. However, we perceive the natural world with more than our eyes, and literature should be no different. Thus, an embodied reading experience is proposed, adding sound effects and haptic feedback to allow readers to listen and feel the narrative text. This paper presents a preliminary prototype for multisensory narratives and an experimental methodology to measure embodiment in literature. Results for the subjective assessment of immersion and user experience from 15 participants in three modalities: haptic, sound, both combined are discussed.

AB - Reading fiction is a silent activity, where readers come to know imaginary worlds and characters from the book's pages. However, we perceive the natural world with more than our eyes, and literature should be no different. Thus, an embodied reading experience is proposed, adding sound effects and haptic feedback to allow readers to listen and feel the narrative text. This paper presents a preliminary prototype for multisensory narratives and an experimental methodology to measure embodiment in literature. Results for the subjective assessment of immersion and user experience from 15 participants in three modalities: haptic, sound, both combined are discussed.

KW - Embodied cognition

KW - Haptics

KW - Reading

KW - Sound effects

UR - http://www.scopus.com/inward/record.url?scp=85014581219&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85014581219&partnerID=8YFLogxK

U2 - 10.1145/2851581.2892353

DO - 10.1145/2851581.2892353

M3 - Conference contribution

AN - SCOPUS:85014581219

VL - 07-12-May-2016

SP - 1459

EP - 1466

BT - CHI EA 2016: #chi4good - Extended Abstracts, 34th Annual CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery

Y2 - 7 May 2016 through 12 May 2016

ER -