Ambient rhythm-melodic sonification of status information for iot-enabled devices

George Chernyshov, Jiajun Chen, Yenchin Lai, Vontin Noriyasu, Kai Steven Kunze

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper we explore how to embed status information of IoT-enabled devices in the acoustic atmosphere using melodic ambient sounds while limiting obtrusiveness for the user. The user can use arbitrary sound samples to represent the devices he wants to monitor. Our system combines these sound samples into a melodic ambient rhythm that contains information on all the processes or variables that user is monitoring. We focus on continuous rather than binary information (e.g. "monitoring progress status" rather then "new message received"). We evaluate our system in a machine monitoring scenario focusing on 5 distinct machines/processes to monitor with 6 priority levels for each. 9 participants use our system to monitor these processes with an up to 92.44% detection rate, if several levels are combined. Participants had no previous experience with this or similar systems and had only 5-10 minute training session before the tests.

Original languageEnglish
Title of host publicationProceedings IOT 2016 - 6th International Conference on the Internet of Things
PublisherAssociation for Computing Machinery
Pages1-6
Number of pages6
Volume07-09-November-2016
ISBN (Electronic)9781450348140
DOIs
Publication statusPublished - 2016 Nov 7
Event6th International Conference on the Internet of Things, IOT 2016 - Stuttgart, Germany
Duration: 2016 Nov 72016 Nov 9

Other

Other6th International Conference on the Internet of Things, IOT 2016
CountryGermany
CityStuttgart
Period16/11/716/11/9

Keywords

  • Acoustic Atmosphere
  • Interfaces
  • IoT
  • Process monitoring
  • Sonification

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Fingerprint Dive into the research topics of 'Ambient rhythm-melodic sonification of status information for iot-enabled devices'. Together they form a unique fingerprint.

  • Cite this

    Chernyshov, G., Chen, J., Lai, Y., Noriyasu, V., & Kunze, K. S. (2016). Ambient rhythm-melodic sonification of status information for iot-enabled devices. In Proceedings IOT 2016 - 6th International Conference on the Internet of Things (Vol. 07-09-November-2016, pp. 1-6). Association for Computing Machinery. https://doi.org/10.1145/2991561.2991564