A cross-media music retrieval system by converting color changes into tonal changes

Yoshiyuki Kato, Shuichi Kurabayashi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose a cross-media music retrieval system that provides its users with a toolkit for formulating their own query by describing their emotional requirements for changes in mood of music as a sequence of images. To interpret the query, the system uses a metric space to convert the color changes in images into continuous tonal changes in music, and vice versa. The system provides delta functions for music and images to compute the changes as distance values in the metric space. Our system calculates the sentiment-oriented relevance score of the query and music by comparing their computed distance values. The advantage of the system is that it provides a bridge between heterogeneous image and music criteria by converting the visual impressions of images into a time-oriented invisible impression of music. This bridging operation is the foundation of our visual query construction method. This method allows users to search for music by subtly manipulating the form of a query in a trial-and-error manner by detecting the moods of music as color changes in images. This method is suitable for searching for unknown music that satisfies the preferences of users in web-based music resources that store many types of music, but without any publishing information related to the music.

Original languageEnglish
Title of host publicationProceedings - 2014 IEEE 15th International Conference on Mobile Data Management, IEEE MDM 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages349-352
Number of pages4
ISBN (Electronic)9781479957057
DOIs
Publication statusPublished - 2014 Oct 5
Event15th IEEE International Conference on Mobile Data Management, IEEE MDM 2014 - Brisbane, Australia
Duration: 2014 Jul 152014 Jul 18

Publication series

NameProceedings - IEEE International Conference on Mobile Data Management
Volume1
ISSN (Print)1551-6245

Other

Other15th IEEE International Conference on Mobile Data Management, IEEE MDM 2014
CountryAustralia
CityBrisbane
Period14/7/1514/7/18

Keywords

  • Media Retrieval
  • Mood Analysis
  • Multimedia Database
  • User Interface

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint Dive into the research topics of 'A cross-media music retrieval system by converting color changes into tonal changes'. Together they form a unique fingerprint.

  • Cite this

    Kato, Y., & Kurabayashi, S. (2014). A cross-media music retrieval system by converting color changes into tonal changes. In Proceedings - 2014 IEEE 15th International Conference on Mobile Data Management, IEEE MDM 2014 (pp. 349-352). [6916943] (Proceedings - IEEE International Conference on Mobile Data Management; Vol. 1). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/MDM.2014.51