Ambient rhythm-melodic sonification of status information for iot-enabled devices

George Chernyshov, Jiajun Chen, Yenchin Lai, Vontin Noriyasu, Kai Steven Kunze

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper we explore how to embed status information of IoT-enabled devices in the acoustic atmosphere using melodic ambient sounds while limiting obtrusiveness for the user. The user can use arbitrary sound samples to represent the devices he wants to monitor. Our system combines these sound samples into a melodic ambient rhythm that contains information on all the processes or variables that user is monitoring. We focus on continuous rather than binary information (e.g. "monitoring progress status" rather then "new message received"). We evaluate our system in a machine monitoring scenario focusing on 5 distinct machines/processes to monitor with 6 priority levels for each. 9 participants use our system to monitor these processes with an up to 92.44% detection rate, if several levels are combined. Participants had no previous experience with this or similar systems and had only 5-10 minute training session before the tests.

Original languageEnglish
Title of host publicationProceedings IOT 2016 - 6th International Conference on the Internet of Things
PublisherAssociation for Computing Machinery
Pages1-6
Number of pages6
Volume07-09-November-2016
ISBN (Electronic)9781450348140
DOIs
Publication statusPublished - 2016 Nov 7
Event6th International Conference on the Internet of Things, IOT 2016 - Stuttgart, Germany
Duration: 2016 Nov 72016 Nov 9

Other

Other6th International Conference on the Internet of Things, IOT 2016
CountryGermany
CityStuttgart
Period16/11/716/11/9

Fingerprint

Acoustic waves
Monitoring
Acoustics
Internet of things

Keywords

  • Acoustic Atmosphere
  • Interfaces
  • IoT
  • Process monitoring
  • Sonification

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Chernyshov, G., Chen, J., Lai, Y., Noriyasu, V., & Kunze, K. S. (2016). Ambient rhythm-melodic sonification of status information for iot-enabled devices. In Proceedings IOT 2016 - 6th International Conference on the Internet of Things (Vol. 07-09-November-2016, pp. 1-6). Association for Computing Machinery. https://doi.org/10.1145/2991561.2991564

Ambient rhythm-melodic sonification of status information for iot-enabled devices. / Chernyshov, George; Chen, Jiajun; Lai, Yenchin; Noriyasu, Vontin; Kunze, Kai Steven.

Proceedings IOT 2016 - 6th International Conference on the Internet of Things. Vol. 07-09-November-2016 Association for Computing Machinery, 2016. p. 1-6.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chernyshov, G, Chen, J, Lai, Y, Noriyasu, V & Kunze, KS 2016, Ambient rhythm-melodic sonification of status information for iot-enabled devices. in Proceedings IOT 2016 - 6th International Conference on the Internet of Things. vol. 07-09-November-2016, Association for Computing Machinery, pp. 1-6, 6th International Conference on the Internet of Things, IOT 2016, Stuttgart, Germany, 16/11/7. https://doi.org/10.1145/2991561.2991564
Chernyshov G, Chen J, Lai Y, Noriyasu V, Kunze KS. Ambient rhythm-melodic sonification of status information for iot-enabled devices. In Proceedings IOT 2016 - 6th International Conference on the Internet of Things. Vol. 07-09-November-2016. Association for Computing Machinery. 2016. p. 1-6 https://doi.org/10.1145/2991561.2991564
Chernyshov, George ; Chen, Jiajun ; Lai, Yenchin ; Noriyasu, Vontin ; Kunze, Kai Steven. / Ambient rhythm-melodic sonification of status information for iot-enabled devices. Proceedings IOT 2016 - 6th International Conference on the Internet of Things. Vol. 07-09-November-2016 Association for Computing Machinery, 2016. pp. 1-6
@inproceedings{a4051f777b394a4c879974b19c1b35ef,
title = "Ambient rhythm-melodic sonification of status information for iot-enabled devices",
abstract = "In this paper we explore how to embed status information of IoT-enabled devices in the acoustic atmosphere using melodic ambient sounds while limiting obtrusiveness for the user. The user can use arbitrary sound samples to represent the devices he wants to monitor. Our system combines these sound samples into a melodic ambient rhythm that contains information on all the processes or variables that user is monitoring. We focus on continuous rather than binary information (e.g. {"}monitoring progress status{"} rather then {"}new message received{"}). We evaluate our system in a machine monitoring scenario focusing on 5 distinct machines/processes to monitor with 6 priority levels for each. 9 participants use our system to monitor these processes with an up to 92.44{\%} detection rate, if several levels are combined. Participants had no previous experience with this or similar systems and had only 5-10 minute training session before the tests.",
keywords = "Acoustic Atmosphere, Interfaces, IoT, Process monitoring, Sonification",
author = "George Chernyshov and Jiajun Chen and Yenchin Lai and Vontin Noriyasu and Kunze, {Kai Steven}",
year = "2016",
month = "11",
day = "7",
doi = "10.1145/2991561.2991564",
language = "English",
volume = "07-09-November-2016",
pages = "1--6",
booktitle = "Proceedings IOT 2016 - 6th International Conference on the Internet of Things",
publisher = "Association for Computing Machinery",

}

TY - GEN

T1 - Ambient rhythm-melodic sonification of status information for iot-enabled devices

AU - Chernyshov, George

AU - Chen, Jiajun

AU - Lai, Yenchin

AU - Noriyasu, Vontin

AU - Kunze, Kai Steven

PY - 2016/11/7

Y1 - 2016/11/7

N2 - In this paper we explore how to embed status information of IoT-enabled devices in the acoustic atmosphere using melodic ambient sounds while limiting obtrusiveness for the user. The user can use arbitrary sound samples to represent the devices he wants to monitor. Our system combines these sound samples into a melodic ambient rhythm that contains information on all the processes or variables that user is monitoring. We focus on continuous rather than binary information (e.g. "monitoring progress status" rather then "new message received"). We evaluate our system in a machine monitoring scenario focusing on 5 distinct machines/processes to monitor with 6 priority levels for each. 9 participants use our system to monitor these processes with an up to 92.44% detection rate, if several levels are combined. Participants had no previous experience with this or similar systems and had only 5-10 minute training session before the tests.

AB - In this paper we explore how to embed status information of IoT-enabled devices in the acoustic atmosphere using melodic ambient sounds while limiting obtrusiveness for the user. The user can use arbitrary sound samples to represent the devices he wants to monitor. Our system combines these sound samples into a melodic ambient rhythm that contains information on all the processes or variables that user is monitoring. We focus on continuous rather than binary information (e.g. "monitoring progress status" rather then "new message received"). We evaluate our system in a machine monitoring scenario focusing on 5 distinct machines/processes to monitor with 6 priority levels for each. 9 participants use our system to monitor these processes with an up to 92.44% detection rate, if several levels are combined. Participants had no previous experience with this or similar systems and had only 5-10 minute training session before the tests.

KW - Acoustic Atmosphere

KW - Interfaces

KW - IoT

KW - Process monitoring

KW - Sonification

UR - http://www.scopus.com/inward/record.url?scp=85001085887&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85001085887&partnerID=8YFLogxK

U2 - 10.1145/2991561.2991564

DO - 10.1145/2991561.2991564

M3 - Conference contribution

AN - SCOPUS:85001085887

VL - 07-09-November-2016

SP - 1

EP - 6

BT - Proceedings IOT 2016 - 6th International Conference on the Internet of Things

PB - Association for Computing Machinery

ER -