A semantic associative computation method for automatic decorative-multimedia creation with "Kansei" information

Yasushi Kiyoki, Xing Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

In the design of multimedia systems, one of the important issues is how to deal with "Kansei" of human beings. The concept of "Kansei" in Japanese includes several meanings on sensitive recognition, such as "impression," "human senses," "feelings," "sensitivity," "psychological reaction" and "physiological reaction." This paper presents a new concept of "automatic decorative-multimedia creation" and a semantic associative computation method. This method realizes automatic main-media decoration with dynamic sub-media data selection for representing main-media as decorative multimedia. The aim of this method is to create a new field of "automatic decorative-media art" with "semantic associative computing." This paper defines an "automatic media decoration model" with semantic spaces and media-decoration functions. Automatic media decoration is realized by applying the Mathematical Model of Meaning (MMM) to a media-transmission space for computing semantic correlations between main-media objects and sub-media. The process of this dynamic media decoration method consists of the following functions: (1) Extraction of semantic "Kansei" features of "main-media object," such as music, image and video. (2) Mapping of the main-media object onto the media-transmission space between main-media and sub-media. (3) Semantic associative computation of correlations between the main-media object and the features of the sub-media space by MMM, and creating a vector of the main-media object with the features of the sub-media space. (4) Mapping of the vector of the main-media object to the sub-media space, and semantic associative computing between the main-media object and sub-media data. (5) Semantic ranking of sub-media objects as the result of the semantic associative computation, and selects one of the sub-media objects with high correlation values to the target main-media object. (6) Automatic rendering of the target main-media object with the selected sub-media object for decorating the main-media presentation. This paper shows several significant applications of the semantic associative computation method for "automatic decorative-media creation."

Original languageEnglish
Title of host publicationConceptual Modelling 2009 - 6th Asia-Pacific Conference on Conceptual Modelling, APCCM 2009
Publication statusPublished - 2009 Dec 1
Event6th Asia-Pacific Conference on Conceptual Modelling, APCCM 2009 - Wellington, New Zealand
Duration: 2009 Jan 202009 Jan 23

Publication series

NameConferences in Research and Practice in Information Technology Series
Volume96
ISSN (Print)1445-1336

Other

Other6th Asia-Pacific Conference on Conceptual Modelling, APCCM 2009
CountryNew Zealand
CityWellington
Period09/1/2009/1/23

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Hardware and Architecture
  • Information Systems
  • Software

Fingerprint Dive into the research topics of 'A semantic associative computation method for automatic decorative-multimedia creation with "Kansei" information'. Together they form a unique fingerprint.

  • Cite this

    Kiyoki, Y., & Chen, X. (2009). A semantic associative computation method for automatic decorative-multimedia creation with "Kansei" information. In Conceptual Modelling 2009 - 6th Asia-Pacific Conference on Conceptual Modelling, APCCM 2009 (Conferences in Research and Practice in Information Technology Series; Vol. 96).