Analysis of the interaction between image and music focused on physical features

Keiko Sato, Yasue Mitsukura

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Auditory information plays an integral role in AV media because even identical images are perceived differently when they are matched with different music. We now present a few studies in which the changes in subjective impressions of when visual information is matched with auditory information were analyzed on the basis of the physical features. The purpose of this study is to investigate the effects of music on image impressions in terms of physical features of images or music. In this paper, we first elucidate the changes in subjective impressions when the image is presented without music and when it is presented with music using the semantic differential method and factor analysis. Secondly, to clarify the relationship between the impression and physical features, we compare their respective physical features, which include color information, structural information, tempo, tonality, and frequency characteristics with subjective impressions. As a result, the factor analysis extracted two factors: "comfort" and "potency & activity". In the relationship between factors and physical features, red-green characteristic of image was strongly correlated with "comfort". Green element, saturation, and red-green characteristic were correlated with "potency & activity". Moreover, tempo as music feature was related to "potency & activity".

Original languageEnglish
Title of host publication2012 Proceedings of SICE Annual Conference, SICE 2012
PublisherSociety of Instrument and Control Engineers (SICE)
Pages2179-2184
Number of pages6
ISBN (Print)9781467322591
Publication statusPublished - 2012 Jan 1
Event2012 51st Annual Conference on of the Society of Instrument and Control Engineers of Japan, SICE 2012 - Akita, Japan
Duration: 2012 Aug 202012 Aug 23

Publication series

NameProceedings of the SICE Annual Conference

Other

Other2012 51st Annual Conference on of the Society of Instrument and Control Engineers of Japan, SICE 2012
CountryJapan
CityAkita
Period12/8/2012/8/23

Keywords

  • image
  • impression
  • music
  • physical features

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Science Applications
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Analysis of the interaction between image and music focused on physical features'. Together they form a unique fingerprint.

  • Cite this

    Sato, K., & Mitsukura, Y. (2012). Analysis of the interaction between image and music focused on physical features. In 2012 Proceedings of SICE Annual Conference, SICE 2012 (pp. 2179-2184). [6318375] (Proceedings of the SICE Annual Conference). Society of Instrument and Control Engineers (SICE).