A media-mashup engine with interactive cross-media association and personalization mechanisms

Haruka Fukai, Aya Ichinose, Shuichi Kurabayashi, Yasushi Kiyoki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper proposes a media-mashup engine with interactive cross-media association mechanisms that compute correlation values between image data and music data. The aim of this study is creating a database function for decorating a multimedia data with other types of multimedia data by inspecting the contents of a multimedia data. This media mashup engine has several feature vector spaces for computing correlation between heterogeneous media data. This system utilizes a feature transmission matrix that defines relationship between a feature in a vector space and a feature in another vector space. The important feature of this system is a personalization mechanism for this feature transmission matrix, which reflects individual perceptual preferences for defining the cross-media feature associations. The system provides a real-time feedback mechanism to define a user's individual preference by submitting an existing media data. This paper shows a prototype system that implements the cross-media association functions and personalization mechanisms. This paper shows several experimental results to clarify the effectiveness and feasibility of this system.

Original languageEnglish
Title of host publicationProceedings of the IASTED International Conference on Software Engineering and Applications, SEA 2010
Pages396-403
Number of pages8
DOIs
Publication statusPublished - 2010
EventIASTED International Conference on Software Engineering and Applications, SEA 2010 - Marina del Rey, CA, United States
Duration: 2010 Nov 82010 Nov 10

Other

OtherIASTED International Conference on Software Engineering and Applications, SEA 2010
CountryUnited States
CityMarina del Rey, CA
Period10/11/810/11/10

Fingerprint

Vector spaces
Engines
Feedback

Keywords

  • Multimedia systems
  • Music database
  • Personalization
  • Visualization

ASJC Scopus subject areas

  • Software

Cite this

Fukai, H., Ichinose, A., Kurabayashi, S., & Kiyoki, Y. (2010). A media-mashup engine with interactive cross-media association and personalization mechanisms. In Proceedings of the IASTED International Conference on Software Engineering and Applications, SEA 2010 (pp. 396-403) https://doi.org/10.2316/P.2010.725-052

A media-mashup engine with interactive cross-media association and personalization mechanisms. / Fukai, Haruka; Ichinose, Aya; Kurabayashi, Shuichi; Kiyoki, Yasushi.

Proceedings of the IASTED International Conference on Software Engineering and Applications, SEA 2010. 2010. p. 396-403.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Fukai, H, Ichinose, A, Kurabayashi, S & Kiyoki, Y 2010, A media-mashup engine with interactive cross-media association and personalization mechanisms. in Proceedings of the IASTED International Conference on Software Engineering and Applications, SEA 2010. pp. 396-403, IASTED International Conference on Software Engineering and Applications, SEA 2010, Marina del Rey, CA, United States, 10/11/8. https://doi.org/10.2316/P.2010.725-052
Fukai H, Ichinose A, Kurabayashi S, Kiyoki Y. A media-mashup engine with interactive cross-media association and personalization mechanisms. In Proceedings of the IASTED International Conference on Software Engineering and Applications, SEA 2010. 2010. p. 396-403 https://doi.org/10.2316/P.2010.725-052
Fukai, Haruka ; Ichinose, Aya ; Kurabayashi, Shuichi ; Kiyoki, Yasushi. / A media-mashup engine with interactive cross-media association and personalization mechanisms. Proceedings of the IASTED International Conference on Software Engineering and Applications, SEA 2010. 2010. pp. 396-403
@inproceedings{76cca4a1e52c4702bcf07586f4e0d855,
title = "A media-mashup engine with interactive cross-media association and personalization mechanisms",
abstract = "This paper proposes a media-mashup engine with interactive cross-media association mechanisms that compute correlation values between image data and music data. The aim of this study is creating a database function for decorating a multimedia data with other types of multimedia data by inspecting the contents of a multimedia data. This media mashup engine has several feature vector spaces for computing correlation between heterogeneous media data. This system utilizes a feature transmission matrix that defines relationship between a feature in a vector space and a feature in another vector space. The important feature of this system is a personalization mechanism for this feature transmission matrix, which reflects individual perceptual preferences for defining the cross-media feature associations. The system provides a real-time feedback mechanism to define a user's individual preference by submitting an existing media data. This paper shows a prototype system that implements the cross-media association functions and personalization mechanisms. This paper shows several experimental results to clarify the effectiveness and feasibility of this system.",
keywords = "Multimedia systems, Music database, Personalization, Visualization",
author = "Haruka Fukai and Aya Ichinose and Shuichi Kurabayashi and Yasushi Kiyoki",
year = "2010",
doi = "10.2316/P.2010.725-052",
language = "English",
isbn = "9780889868786",
pages = "396--403",
booktitle = "Proceedings of the IASTED International Conference on Software Engineering and Applications, SEA 2010",

}

TY - GEN

T1 - A media-mashup engine with interactive cross-media association and personalization mechanisms

AU - Fukai, Haruka

AU - Ichinose, Aya

AU - Kurabayashi, Shuichi

AU - Kiyoki, Yasushi

PY - 2010

Y1 - 2010

N2 - This paper proposes a media-mashup engine with interactive cross-media association mechanisms that compute correlation values between image data and music data. The aim of this study is creating a database function for decorating a multimedia data with other types of multimedia data by inspecting the contents of a multimedia data. This media mashup engine has several feature vector spaces for computing correlation between heterogeneous media data. This system utilizes a feature transmission matrix that defines relationship between a feature in a vector space and a feature in another vector space. The important feature of this system is a personalization mechanism for this feature transmission matrix, which reflects individual perceptual preferences for defining the cross-media feature associations. The system provides a real-time feedback mechanism to define a user's individual preference by submitting an existing media data. This paper shows a prototype system that implements the cross-media association functions and personalization mechanisms. This paper shows several experimental results to clarify the effectiveness and feasibility of this system.

AB - This paper proposes a media-mashup engine with interactive cross-media association mechanisms that compute correlation values between image data and music data. The aim of this study is creating a database function for decorating a multimedia data with other types of multimedia data by inspecting the contents of a multimedia data. This media mashup engine has several feature vector spaces for computing correlation between heterogeneous media data. This system utilizes a feature transmission matrix that defines relationship between a feature in a vector space and a feature in another vector space. The important feature of this system is a personalization mechanism for this feature transmission matrix, which reflects individual perceptual preferences for defining the cross-media feature associations. The system provides a real-time feedback mechanism to define a user's individual preference by submitting an existing media data. This paper shows a prototype system that implements the cross-media association functions and personalization mechanisms. This paper shows several experimental results to clarify the effectiveness and feasibility of this system.

KW - Multimedia systems

KW - Music database

KW - Personalization

KW - Visualization

UR - http://www.scopus.com/inward/record.url?scp=84862275673&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84862275673&partnerID=8YFLogxK

U2 - 10.2316/P.2010.725-052

DO - 10.2316/P.2010.725-052

M3 - Conference contribution

AN - SCOPUS:84862275673

SN - 9780889868786

SP - 396

EP - 403

BT - Proceedings of the IASTED International Conference on Software Engineering and Applications, SEA 2010

ER -