The relationship between effects of music on image impression and musical features

Riyo Ishida, Keiko Sato, Yasue Mitsukura

Research output: Contribution to journalArticle

Abstract

Audio-visual combinations in multimedia contents give us more exciting experiences than only audio or visual information. To support audio-visual video creators, affective impressions of audio-visual contents have been explored to date. However, little research has analyzed in terms of structures or features of audio-visual contents. Revealing relationships between audio-visual impressions and their structures or features can be helpful for video creators. The current study aims to analyze effects of music on image impression in terms of musical features. Specifically, we asked participants to rate impressions for image stimuli at two conditions in which image-only stimuli or music-image combination stimuli were presented. Three factors representing image impressions were extracted by factor analysis, and differences of factor scores between two conditions were calculated to describe impression changes by music. We confirmed relationships between impression changes and musical features (e.g. volume, pitch, and timbre) by ridge regression analysis. As a result, regression analysis accounted for high variances in amount of impression changes and revealed that some musical features influenced on image impressions. This study provides a feasibility of estimating image impressions by musical features.

Original languageEnglish
Pages (from-to)1376-1385
Number of pages10
JournalIEEJ Transactions on Electronics, Information and Systems
Volume136
Issue number9
DOIs
Publication statusPublished - 2016

Fingerprint

Regression analysis
Factor analysis

Keywords

  • Image
  • Impression
  • Music
  • Musical feature
  • Ridge regression analysis

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

The relationship between effects of music on image impression and musical features. / Ishida, Riyo; Sato, Keiko; Mitsukura, Yasue.

In: IEEJ Transactions on Electronics, Information and Systems, Vol. 136, No. 9, 2016, p. 1376-1385.

Research output: Contribution to journalArticle

@article{cabcf5611f21401d9c50d12d0af8629a,
title = "The relationship between effects of music on image impression and musical features",
abstract = "Audio-visual combinations in multimedia contents give us more exciting experiences than only audio or visual information. To support audio-visual video creators, affective impressions of audio-visual contents have been explored to date. However, little research has analyzed in terms of structures or features of audio-visual contents. Revealing relationships between audio-visual impressions and their structures or features can be helpful for video creators. The current study aims to analyze effects of music on image impression in terms of musical features. Specifically, we asked participants to rate impressions for image stimuli at two conditions in which image-only stimuli or music-image combination stimuli were presented. Three factors representing image impressions were extracted by factor analysis, and differences of factor scores between two conditions were calculated to describe impression changes by music. We confirmed relationships between impression changes and musical features (e.g. volume, pitch, and timbre) by ridge regression analysis. As a result, regression analysis accounted for high variances in amount of impression changes and revealed that some musical features influenced on image impressions. This study provides a feasibility of estimating image impressions by musical features.",
keywords = "Image, Impression, Music, Musical feature, Ridge regression analysis",
author = "Riyo Ishida and Keiko Sato and Yasue Mitsukura",
year = "2016",
doi = "10.1541/ieejeiss.136.1376",
language = "English",
volume = "136",
pages = "1376--1385",
journal = "IEEJ Transactions on Electronics, Information and Systems",
issn = "0385-4221",
publisher = "The Institute of Electrical Engineers of Japan",
number = "9",

}

TY - JOUR

T1 - The relationship between effects of music on image impression and musical features

AU - Ishida, Riyo

AU - Sato, Keiko

AU - Mitsukura, Yasue

PY - 2016

Y1 - 2016

N2 - Audio-visual combinations in multimedia contents give us more exciting experiences than only audio or visual information. To support audio-visual video creators, affective impressions of audio-visual contents have been explored to date. However, little research has analyzed in terms of structures or features of audio-visual contents. Revealing relationships between audio-visual impressions and their structures or features can be helpful for video creators. The current study aims to analyze effects of music on image impression in terms of musical features. Specifically, we asked participants to rate impressions for image stimuli at two conditions in which image-only stimuli or music-image combination stimuli were presented. Three factors representing image impressions were extracted by factor analysis, and differences of factor scores between two conditions were calculated to describe impression changes by music. We confirmed relationships between impression changes and musical features (e.g. volume, pitch, and timbre) by ridge regression analysis. As a result, regression analysis accounted for high variances in amount of impression changes and revealed that some musical features influenced on image impressions. This study provides a feasibility of estimating image impressions by musical features.

AB - Audio-visual combinations in multimedia contents give us more exciting experiences than only audio or visual information. To support audio-visual video creators, affective impressions of audio-visual contents have been explored to date. However, little research has analyzed in terms of structures or features of audio-visual contents. Revealing relationships between audio-visual impressions and their structures or features can be helpful for video creators. The current study aims to analyze effects of music on image impression in terms of musical features. Specifically, we asked participants to rate impressions for image stimuli at two conditions in which image-only stimuli or music-image combination stimuli were presented. Three factors representing image impressions were extracted by factor analysis, and differences of factor scores between two conditions were calculated to describe impression changes by music. We confirmed relationships between impression changes and musical features (e.g. volume, pitch, and timbre) by ridge regression analysis. As a result, regression analysis accounted for high variances in amount of impression changes and revealed that some musical features influenced on image impressions. This study provides a feasibility of estimating image impressions by musical features.

KW - Image

KW - Impression

KW - Music

KW - Musical feature

KW - Ridge regression analysis

UR - http://www.scopus.com/inward/record.url?scp=84985905370&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84985905370&partnerID=8YFLogxK

U2 - 10.1541/ieejeiss.136.1376

DO - 10.1541/ieejeiss.136.1376

M3 - Article

AN - SCOPUS:84985905370

VL - 136

SP - 1376

EP - 1385

JO - IEEJ Transactions on Electronics, Information and Systems

JF - IEEJ Transactions on Electronics, Information and Systems

SN - 0385-4221

IS - 9

ER -