A media-mashup engine with interactive cross-media association and personalization mechanisms

Haruka Fukai, Aya Ichinose, Shuichi Kurabayashi, Yasushi Kiyoki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper proposes a media-mashup engine with interactive cross-media association mechanisms that compute correlation values between image data and music data. The aim of this study is creating a database function for decorating a multimedia data with other types of multimedia data by inspecting the contents of a multimedia data. This media mashup engine has several feature vector spaces for computing correlation between heterogeneous media data. This system utilizes a feature transmission matrix that defines relationship between a feature in a vector space and a feature in another vector space. The important feature of this system is a personalization mechanism for this feature transmission matrix, which reflects individual perceptual preferences for defining the cross-media feature associations. The system provides a real-time feedback mechanism to define a user's individual preference by submitting an existing media data. This paper shows a prototype system that implements the cross-media association functions and personalization mechanisms. This paper shows several experimental results to clarify the effectiveness and feasibility of this system.

Original languageEnglish
Title of host publicationProceedings of the IASTED International Conference on Software Engineering and Applications, SEA 2010
Pages396-403
Number of pages8
DOIs
Publication statusPublished - 2010 Dec 1
EventIASTED International Conference on Software Engineering and Applications, SEA 2010 - Marina del Rey, CA, United States
Duration: 2010 Nov 82010 Nov 10

Publication series

NameProceedings of the IASTED International Conference on Software Engineering and Applications, SEA 2010

Other

OtherIASTED International Conference on Software Engineering and Applications, SEA 2010
CountryUnited States
CityMarina del Rey, CA
Period10/11/810/11/10

Keywords

  • Multimedia systems
  • Music database
  • Personalization
  • Visualization

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'A media-mashup engine with interactive cross-media association and personalization mechanisms'. Together they form a unique fingerprint.

  • Cite this

    Fukai, H., Ichinose, A., Kurabayashi, S., & Kiyoki, Y. (2010). A media-mashup engine with interactive cross-media association and personalization mechanisms. In Proceedings of the IASTED International Conference on Software Engineering and Applications, SEA 2010 (pp. 396-403). (Proceedings of the IASTED International Conference on Software Engineering and Applications, SEA 2010). https://doi.org/10.2316/P.2010.725-052