Analysis of the interaction between image and music focused on physical features

Keiko Sato, Yasue Mitsukura

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Auditory information plays an integral role in AV media because even identical images are perceived differently when they are matched with different music. We now present a few studies in which the changes in subjective impressions of when visual information is matched with auditory information were analyzed on the basis of the physical features. The purpose of this study is to investigate the effects of music on image impressions in terms of physical features of images or music. In this paper, we first elucidate the changes in subjective impressions when the image is presented without music and when it is presented with music using the semantic differential method and factor analysis. Secondly, to clarify the relationship between the impression and physical features, we compare their respective physical features, which include color information, structural information, tempo, tonality, and frequency characteristics with subjective impressions. As a result, the factor analysis extracted two factors: "comfort" and "potency & activity". In the relationship between factors and physical features, red-green characteristic of image was strongly correlated with "comfort". Green element, saturation, and red-green characteristic were correlated with "potency & activity". Moreover, tempo as music feature was related to "potency & activity".

Original languageEnglish
Title of host publicationProceedings of the SICE Annual Conference
Pages2179-2184
Number of pages6
Publication statusPublished - 2012
Event2012 51st Annual Conference on of the Society of Instrument and Control Engineers of Japan, SICE 2012 - Akita, Japan
Duration: 2012 Aug 202012 Aug 23

Other

Other2012 51st Annual Conference on of the Society of Instrument and Control Engineers of Japan, SICE 2012
CountryJapan
CityAkita
Period12/8/2012/8/23

Fingerprint

Factor analysis
Semantics
Color

Keywords

  • image
  • impression
  • music
  • physical features

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Control and Systems Engineering
  • Computer Science Applications

Cite this

Sato, K., & Mitsukura, Y. (2012). Analysis of the interaction between image and music focused on physical features. In Proceedings of the SICE Annual Conference (pp. 2179-2184). [6318375]

Analysis of the interaction between image and music focused on physical features. / Sato, Keiko; Mitsukura, Yasue.

Proceedings of the SICE Annual Conference. 2012. p. 2179-2184 6318375.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sato, K & Mitsukura, Y 2012, Analysis of the interaction between image and music focused on physical features. in Proceedings of the SICE Annual Conference., 6318375, pp. 2179-2184, 2012 51st Annual Conference on of the Society of Instrument and Control Engineers of Japan, SICE 2012, Akita, Japan, 12/8/20.
Sato K, Mitsukura Y. Analysis of the interaction between image and music focused on physical features. In Proceedings of the SICE Annual Conference. 2012. p. 2179-2184. 6318375
Sato, Keiko ; Mitsukura, Yasue. / Analysis of the interaction between image and music focused on physical features. Proceedings of the SICE Annual Conference. 2012. pp. 2179-2184
@inproceedings{5454dc86056345d0b0e2bbe10e2a3870,
title = "Analysis of the interaction between image and music focused on physical features",
abstract = "Auditory information plays an integral role in AV media because even identical images are perceived differently when they are matched with different music. We now present a few studies in which the changes in subjective impressions of when visual information is matched with auditory information were analyzed on the basis of the physical features. The purpose of this study is to investigate the effects of music on image impressions in terms of physical features of images or music. In this paper, we first elucidate the changes in subjective impressions when the image is presented without music and when it is presented with music using the semantic differential method and factor analysis. Secondly, to clarify the relationship between the impression and physical features, we compare their respective physical features, which include color information, structural information, tempo, tonality, and frequency characteristics with subjective impressions. As a result, the factor analysis extracted two factors: {"}comfort{"} and {"}potency & activity{"}. In the relationship between factors and physical features, red-green characteristic of image was strongly correlated with {"}comfort{"}. Green element, saturation, and red-green characteristic were correlated with {"}potency & activity{"}. Moreover, tempo as music feature was related to {"}potency & activity{"}.",
keywords = "image, impression, music, physical features",
author = "Keiko Sato and Yasue Mitsukura",
year = "2012",
language = "English",
isbn = "9781467322591",
pages = "2179--2184",
booktitle = "Proceedings of the SICE Annual Conference",

}

TY - GEN

T1 - Analysis of the interaction between image and music focused on physical features

AU - Sato, Keiko

AU - Mitsukura, Yasue

PY - 2012

Y1 - 2012

N2 - Auditory information plays an integral role in AV media because even identical images are perceived differently when they are matched with different music. We now present a few studies in which the changes in subjective impressions of when visual information is matched with auditory information were analyzed on the basis of the physical features. The purpose of this study is to investigate the effects of music on image impressions in terms of physical features of images or music. In this paper, we first elucidate the changes in subjective impressions when the image is presented without music and when it is presented with music using the semantic differential method and factor analysis. Secondly, to clarify the relationship between the impression and physical features, we compare their respective physical features, which include color information, structural information, tempo, tonality, and frequency characteristics with subjective impressions. As a result, the factor analysis extracted two factors: "comfort" and "potency & activity". In the relationship between factors and physical features, red-green characteristic of image was strongly correlated with "comfort". Green element, saturation, and red-green characteristic were correlated with "potency & activity". Moreover, tempo as music feature was related to "potency & activity".

AB - Auditory information plays an integral role in AV media because even identical images are perceived differently when they are matched with different music. We now present a few studies in which the changes in subjective impressions of when visual information is matched with auditory information were analyzed on the basis of the physical features. The purpose of this study is to investigate the effects of music on image impressions in terms of physical features of images or music. In this paper, we first elucidate the changes in subjective impressions when the image is presented without music and when it is presented with music using the semantic differential method and factor analysis. Secondly, to clarify the relationship between the impression and physical features, we compare their respective physical features, which include color information, structural information, tempo, tonality, and frequency characteristics with subjective impressions. As a result, the factor analysis extracted two factors: "comfort" and "potency & activity". In the relationship between factors and physical features, red-green characteristic of image was strongly correlated with "comfort". Green element, saturation, and red-green characteristic were correlated with "potency & activity". Moreover, tempo as music feature was related to "potency & activity".

KW - image

KW - impression

KW - music

KW - physical features

UR - http://www.scopus.com/inward/record.url?scp=84869385106&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84869385106&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84869385106

SN - 9781467322591

SP - 2179

EP - 2184

BT - Proceedings of the SICE Annual Conference

ER -