EffectON-Enriching impressions of motions and physically changing motions via synchronous sound effects

Shimon Akiyama, Katsunari Sato, Yasutoshi Makino, Takashi Maeno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we introduced EffectON, a system that enables users to hear sound effects, i.e., audio feedbacks, of their routine motions. We believe that there are three main benefits of people hearing sound effects corresponding to their motions: sonification of the motion or action, modification of the impression of motions, and a physical change in the motion itself. The unique hypothesis of this research proposes that by changing the condition of the sound effect itself and its presentation, all the three benefits would have different characteristics. These benefits must be highly subject to the way sound is presented, i.e., it would depend on parameters of sound, such as the length, volume, timing, and type, as well as the conditions of motion chosen (e.g., types, sites, parameters, etc.). We have developed two prototype devices: a step-based device and a knee-bend based device. The report first focuses on the third benefit of physically changing the users' motion by changing the 'duration' of sound effects. To be specific, the step-based device is mainly used in this report to focus on the 'gait,' and four sound effects of two different types and durations were implemented to see if the walking speed of the subjects would change on hearing them. The experimental result showed that users naturally walk faster on hearing shorter duration sounds. This implies that there is great potential for naturally controlling or inducing a certain motion by appropriately choosing the sound effects that correspond with the motion.

Original languageEnglish
Title of host publication6th International Conference on Soft Computing and Intelligent Systems, and 13th International Symposium on Advanced Intelligence Systems, SCIS/ISIS 2012
Pages856-860
Number of pages5
DOIs
Publication statusPublished - 2012
Event2012 Joint 6th International Conference on Soft Computing and Intelligent Systems, SCIS 2012 and 13th International Symposium on Advanced Intelligence Systems, ISIS 2012 - Kobe, Japan
Duration: 2012 Nov 202012 Nov 24

Other

Other2012 Joint 6th International Conference on Soft Computing and Intelligent Systems, SCIS 2012 and 13th International Symposium on Advanced Intelligence Systems, ISIS 2012
CountryJapan
CityKobe
Period12/11/2012/11/24

Fingerprint

Acoustic waves
Audition
Feedback

Keywords

  • sonification
  • sound effect
  • wearable device

ASJC Scopus subject areas

  • Artificial Intelligence
  • Software

Cite this

Akiyama, S., Sato, K., Makino, Y., & Maeno, T. (2012). EffectON-Enriching impressions of motions and physically changing motions via synchronous sound effects. In 6th International Conference on Soft Computing and Intelligent Systems, and 13th International Symposium on Advanced Intelligence Systems, SCIS/ISIS 2012 (pp. 856-860). [6505218] https://doi.org/10.1109/SCIS-ISIS.2012.6505218

EffectON-Enriching impressions of motions and physically changing motions via synchronous sound effects. / Akiyama, Shimon; Sato, Katsunari; Makino, Yasutoshi; Maeno, Takashi.

6th International Conference on Soft Computing and Intelligent Systems, and 13th International Symposium on Advanced Intelligence Systems, SCIS/ISIS 2012. 2012. p. 856-860 6505218.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Akiyama, S, Sato, K, Makino, Y & Maeno, T 2012, EffectON-Enriching impressions of motions and physically changing motions via synchronous sound effects. in 6th International Conference on Soft Computing and Intelligent Systems, and 13th International Symposium on Advanced Intelligence Systems, SCIS/ISIS 2012., 6505218, pp. 856-860, 2012 Joint 6th International Conference on Soft Computing and Intelligent Systems, SCIS 2012 and 13th International Symposium on Advanced Intelligence Systems, ISIS 2012, Kobe, Japan, 12/11/20. https://doi.org/10.1109/SCIS-ISIS.2012.6505218
Akiyama S, Sato K, Makino Y, Maeno T. EffectON-Enriching impressions of motions and physically changing motions via synchronous sound effects. In 6th International Conference on Soft Computing and Intelligent Systems, and 13th International Symposium on Advanced Intelligence Systems, SCIS/ISIS 2012. 2012. p. 856-860. 6505218 https://doi.org/10.1109/SCIS-ISIS.2012.6505218
Akiyama, Shimon ; Sato, Katsunari ; Makino, Yasutoshi ; Maeno, Takashi. / EffectON-Enriching impressions of motions and physically changing motions via synchronous sound effects. 6th International Conference on Soft Computing and Intelligent Systems, and 13th International Symposium on Advanced Intelligence Systems, SCIS/ISIS 2012. 2012. pp. 856-860
@inproceedings{8aaaa121e294443cac5c9f26d187af3b,
title = "EffectON-Enriching impressions of motions and physically changing motions via synchronous sound effects",
abstract = "In this paper, we introduced EffectON, a system that enables users to hear sound effects, i.e., audio feedbacks, of their routine motions. We believe that there are three main benefits of people hearing sound effects corresponding to their motions: sonification of the motion or action, modification of the impression of motions, and a physical change in the motion itself. The unique hypothesis of this research proposes that by changing the condition of the sound effect itself and its presentation, all the three benefits would have different characteristics. These benefits must be highly subject to the way sound is presented, i.e., it would depend on parameters of sound, such as the length, volume, timing, and type, as well as the conditions of motion chosen (e.g., types, sites, parameters, etc.). We have developed two prototype devices: a step-based device and a knee-bend based device. The report first focuses on the third benefit of physically changing the users' motion by changing the 'duration' of sound effects. To be specific, the step-based device is mainly used in this report to focus on the 'gait,' and four sound effects of two different types and durations were implemented to see if the walking speed of the subjects would change on hearing them. The experimental result showed that users naturally walk faster on hearing shorter duration sounds. This implies that there is great potential for naturally controlling or inducing a certain motion by appropriately choosing the sound effects that correspond with the motion.",
keywords = "sonification, sound effect, wearable device",
author = "Shimon Akiyama and Katsunari Sato and Yasutoshi Makino and Takashi Maeno",
year = "2012",
doi = "10.1109/SCIS-ISIS.2012.6505218",
language = "English",
isbn = "9781467327428",
pages = "856--860",
booktitle = "6th International Conference on Soft Computing and Intelligent Systems, and 13th International Symposium on Advanced Intelligence Systems, SCIS/ISIS 2012",

}

TY - GEN

T1 - EffectON-Enriching impressions of motions and physically changing motions via synchronous sound effects

AU - Akiyama, Shimon

AU - Sato, Katsunari

AU - Makino, Yasutoshi

AU - Maeno, Takashi

PY - 2012

Y1 - 2012

N2 - In this paper, we introduced EffectON, a system that enables users to hear sound effects, i.e., audio feedbacks, of their routine motions. We believe that there are three main benefits of people hearing sound effects corresponding to their motions: sonification of the motion or action, modification of the impression of motions, and a physical change in the motion itself. The unique hypothesis of this research proposes that by changing the condition of the sound effect itself and its presentation, all the three benefits would have different characteristics. These benefits must be highly subject to the way sound is presented, i.e., it would depend on parameters of sound, such as the length, volume, timing, and type, as well as the conditions of motion chosen (e.g., types, sites, parameters, etc.). We have developed two prototype devices: a step-based device and a knee-bend based device. The report first focuses on the third benefit of physically changing the users' motion by changing the 'duration' of sound effects. To be specific, the step-based device is mainly used in this report to focus on the 'gait,' and four sound effects of two different types and durations were implemented to see if the walking speed of the subjects would change on hearing them. The experimental result showed that users naturally walk faster on hearing shorter duration sounds. This implies that there is great potential for naturally controlling or inducing a certain motion by appropriately choosing the sound effects that correspond with the motion.

AB - In this paper, we introduced EffectON, a system that enables users to hear sound effects, i.e., audio feedbacks, of their routine motions. We believe that there are three main benefits of people hearing sound effects corresponding to their motions: sonification of the motion or action, modification of the impression of motions, and a physical change in the motion itself. The unique hypothesis of this research proposes that by changing the condition of the sound effect itself and its presentation, all the three benefits would have different characteristics. These benefits must be highly subject to the way sound is presented, i.e., it would depend on parameters of sound, such as the length, volume, timing, and type, as well as the conditions of motion chosen (e.g., types, sites, parameters, etc.). We have developed two prototype devices: a step-based device and a knee-bend based device. The report first focuses on the third benefit of physically changing the users' motion by changing the 'duration' of sound effects. To be specific, the step-based device is mainly used in this report to focus on the 'gait,' and four sound effects of two different types and durations were implemented to see if the walking speed of the subjects would change on hearing them. The experimental result showed that users naturally walk faster on hearing shorter duration sounds. This implies that there is great potential for naturally controlling or inducing a certain motion by appropriately choosing the sound effects that correspond with the motion.

KW - sonification

KW - sound effect

KW - wearable device

UR - http://www.scopus.com/inward/record.url?scp=84877834069&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84877834069&partnerID=8YFLogxK

U2 - 10.1109/SCIS-ISIS.2012.6505218

DO - 10.1109/SCIS-ISIS.2012.6505218

M3 - Conference contribution

SN - 9781467327428

SP - 856

EP - 860

BT - 6th International Conference on Soft Computing and Intelligent Systems, and 13th International Symposium on Advanced Intelligence Systems, SCIS/ISIS 2012

ER -