Boiling Mind: Amplifying the Audience-Performer Connection through Sonification and Visualization of Heart and Electrodermal Activities

Moe Sugawa, Taichi Furukawa, George Chernyshov, Danny Hynds, Jiawen Han, Marcelo Padovani, DIngding Zheng, Karola Marky, Kai Kunze, Kouta Minamizawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

In stage performances, an invisible wall in front of the stage often weakens the connections between the audience and performers. To amplify this performative connection, we present the concept "Boiling Mind". Our design concept is based on streaming sensor data related to heart and electrodermal activities from audience members and integrating this data into staging elements, such as visual projections, music, and lighting. Thus, the internal states of the audience directly influence the staging. Artists can have a more direct perception of the inner reactions of audience members and can create physical expressions in response to them. In this paper, we present the wearable sensing system as well as design considerations of mapping heart and electrodermal activity to changes in the staging elements. We evaluated our design and setup over three live performances.

Original languageEnglish
Title of host publicationTEI 2021 - Proceedings of the 15th International Conference on Tangible, Embedded, and Embodied Interaction
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9781450382137
DOIs
Publication statusPublished - 2021 Feb 14
Event15th International Conference on Tangible, Embedded, and Embodied Interaction, TEI 2021 - Virtual, Online, Austria
Duration: 2021 Feb 142021 Feb 19

Publication series

NameTEI 2021 - Proceedings of the 15th International Conference on Tangible, Embedded, and Embodied Interaction

Conference

Conference15th International Conference on Tangible, Embedded, and Embodied Interaction, TEI 2021
Country/TerritoryAustria
CityVirtual, Online
Period21/2/1421/2/19

Keywords

  • Audience engagement
  • Embodiment
  • Interactive Dance performance
  • Physiological signals

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design
  • Software

Fingerprint

Dive into the research topics of 'Boiling Mind: Amplifying the Audience-Performer Connection through Sonification and Visualization of Heart and Electrodermal Activities'. Together they form a unique fingerprint.

Cite this