A semantic associative computation method for automatic decorative-multimedia creation with "Kansei" information

Yasushi Kiyoki, Xing Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

In the design of multimedia systems, one of the important issues is how to deal with "Kansei" of human beings. The concept of "Kansei" in Japanese includes several meanings on sensitive recognition, such as "impression," "human senses," "feelings," "sensitivity," "psychological reaction" and "physiological reaction." This paper presents a new concept of "automatic decorative-multimedia creation" and a semantic associative computation method. This method realizes automatic main-media decoration with dynamic sub-media data selection for representing main-media as decorative multimedia. The aim of this method is to create a new field of "automatic decorative-media art" with "semantic associative computing." This paper defines an "automatic media decoration model" with semantic spaces and media-decoration functions. Automatic media decoration is realized by applying the Mathematical Model of Meaning (MMM) to a media-transmission space for computing semantic correlations between main-media objects and sub-media. The process of this dynamic media decoration method consists of the following functions: (1) Extraction of semantic "Kansei" features of "main-media object," such as music, image and video. (2) Mapping of the main-media object onto the media-transmission space between main-media and sub-media. (3) Semantic associative computation of correlations between the main-media object and the features of the sub-media space by MMM, and creating a vector of the main-media object with the features of the sub-media space. (4) Mapping of the vector of the main-media object to the sub-media space, and semantic associative computing between the main-media object and sub-media data. (5) Semantic ranking of sub-media objects as the result of the semantic associative computation, and selects one of the sub-media objects with high correlation values to the target main-media object. (6) Automatic rendering of the target main-media object with the selected sub-media object for decorating the main-media presentation. This paper shows several significant applications of the semantic associative computation method for "automatic decorative-media creation."

Original languageEnglish
Title of host publicationConferences in Research and Practice in Information Technology Series
Volume96
Publication statusPublished - 2009
Event6th Asia-Pacific Conference on Conceptual Modelling, APCCM 2009 - Wellington, New Zealand
Duration: 2009 Jan 202009 Jan 23

Other

Other6th Asia-Pacific Conference on Conceptual Modelling, APCCM 2009
CountryNew Zealand
CityWellington
Period09/1/2009/1/23

Fingerprint

Semantics
Mathematical models
Multimedia systems

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Hardware and Architecture
  • Information Systems
  • Software

Cite this

Kiyoki, Y., & Chen, X. (2009). A semantic associative computation method for automatic decorative-multimedia creation with "Kansei" information. In Conferences in Research and Practice in Information Technology Series (Vol. 96)

A semantic associative computation method for automatic decorative-multimedia creation with "Kansei" information. / Kiyoki, Yasushi; Chen, Xing.

Conferences in Research and Practice in Information Technology Series. Vol. 96 2009.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kiyoki, Y & Chen, X 2009, A semantic associative computation method for automatic decorative-multimedia creation with "Kansei" information. in Conferences in Research and Practice in Information Technology Series. vol. 96, 6th Asia-Pacific Conference on Conceptual Modelling, APCCM 2009, Wellington, New Zealand, 09/1/20.
Kiyoki Y, Chen X. A semantic associative computation method for automatic decorative-multimedia creation with "Kansei" information. In Conferences in Research and Practice in Information Technology Series. Vol. 96. 2009
Kiyoki, Yasushi ; Chen, Xing. / A semantic associative computation method for automatic decorative-multimedia creation with "Kansei" information. Conferences in Research and Practice in Information Technology Series. Vol. 96 2009.
@inproceedings{b04e17626a2f4b6c98b1712cec6d79f3,
title = "A semantic associative computation method for automatic decorative-multimedia creation with {"}Kansei{"} information",
abstract = "In the design of multimedia systems, one of the important issues is how to deal with {"}Kansei{"} of human beings. The concept of {"}Kansei{"} in Japanese includes several meanings on sensitive recognition, such as {"}impression,{"} {"}human senses,{"} {"}feelings,{"} {"}sensitivity,{"} {"}psychological reaction{"} and {"}physiological reaction.{"} This paper presents a new concept of {"}automatic decorative-multimedia creation{"} and a semantic associative computation method. This method realizes automatic main-media decoration with dynamic sub-media data selection for representing main-media as decorative multimedia. The aim of this method is to create a new field of {"}automatic decorative-media art{"} with {"}semantic associative computing.{"} This paper defines an {"}automatic media decoration model{"} with semantic spaces and media-decoration functions. Automatic media decoration is realized by applying the Mathematical Model of Meaning (MMM) to a media-transmission space for computing semantic correlations between main-media objects and sub-media. The process of this dynamic media decoration method consists of the following functions: (1) Extraction of semantic {"}Kansei{"} features of {"}main-media object,{"} such as music, image and video. (2) Mapping of the main-media object onto the media-transmission space between main-media and sub-media. (3) Semantic associative computation of correlations between the main-media object and the features of the sub-media space by MMM, and creating a vector of the main-media object with the features of the sub-media space. (4) Mapping of the vector of the main-media object to the sub-media space, and semantic associative computing between the main-media object and sub-media data. (5) Semantic ranking of sub-media objects as the result of the semantic associative computation, and selects one of the sub-media objects with high correlation values to the target main-media object. (6) Automatic rendering of the target main-media object with the selected sub-media object for decorating the main-media presentation. This paper shows several significant applications of the semantic associative computation method for {"}automatic decorative-media creation.{"}",
author = "Yasushi Kiyoki and Xing Chen",
year = "2009",
language = "English",
isbn = "9781920682774",
volume = "96",
booktitle = "Conferences in Research and Practice in Information Technology Series",

}

TY - GEN

T1 - A semantic associative computation method for automatic decorative-multimedia creation with "Kansei" information

AU - Kiyoki, Yasushi

AU - Chen, Xing

PY - 2009

Y1 - 2009

N2 - In the design of multimedia systems, one of the important issues is how to deal with "Kansei" of human beings. The concept of "Kansei" in Japanese includes several meanings on sensitive recognition, such as "impression," "human senses," "feelings," "sensitivity," "psychological reaction" and "physiological reaction." This paper presents a new concept of "automatic decorative-multimedia creation" and a semantic associative computation method. This method realizes automatic main-media decoration with dynamic sub-media data selection for representing main-media as decorative multimedia. The aim of this method is to create a new field of "automatic decorative-media art" with "semantic associative computing." This paper defines an "automatic media decoration model" with semantic spaces and media-decoration functions. Automatic media decoration is realized by applying the Mathematical Model of Meaning (MMM) to a media-transmission space for computing semantic correlations between main-media objects and sub-media. The process of this dynamic media decoration method consists of the following functions: (1) Extraction of semantic "Kansei" features of "main-media object," such as music, image and video. (2) Mapping of the main-media object onto the media-transmission space between main-media and sub-media. (3) Semantic associative computation of correlations between the main-media object and the features of the sub-media space by MMM, and creating a vector of the main-media object with the features of the sub-media space. (4) Mapping of the vector of the main-media object to the sub-media space, and semantic associative computing between the main-media object and sub-media data. (5) Semantic ranking of sub-media objects as the result of the semantic associative computation, and selects one of the sub-media objects with high correlation values to the target main-media object. (6) Automatic rendering of the target main-media object with the selected sub-media object for decorating the main-media presentation. This paper shows several significant applications of the semantic associative computation method for "automatic decorative-media creation."

AB - In the design of multimedia systems, one of the important issues is how to deal with "Kansei" of human beings. The concept of "Kansei" in Japanese includes several meanings on sensitive recognition, such as "impression," "human senses," "feelings," "sensitivity," "psychological reaction" and "physiological reaction." This paper presents a new concept of "automatic decorative-multimedia creation" and a semantic associative computation method. This method realizes automatic main-media decoration with dynamic sub-media data selection for representing main-media as decorative multimedia. The aim of this method is to create a new field of "automatic decorative-media art" with "semantic associative computing." This paper defines an "automatic media decoration model" with semantic spaces and media-decoration functions. Automatic media decoration is realized by applying the Mathematical Model of Meaning (MMM) to a media-transmission space for computing semantic correlations between main-media objects and sub-media. The process of this dynamic media decoration method consists of the following functions: (1) Extraction of semantic "Kansei" features of "main-media object," such as music, image and video. (2) Mapping of the main-media object onto the media-transmission space between main-media and sub-media. (3) Semantic associative computation of correlations between the main-media object and the features of the sub-media space by MMM, and creating a vector of the main-media object with the features of the sub-media space. (4) Mapping of the vector of the main-media object to the sub-media space, and semantic associative computing between the main-media object and sub-media data. (5) Semantic ranking of sub-media objects as the result of the semantic associative computation, and selects one of the sub-media objects with high correlation values to the target main-media object. (6) Automatic rendering of the target main-media object with the selected sub-media object for decorating the main-media presentation. This paper shows several significant applications of the semantic associative computation method for "automatic decorative-media creation."

UR - http://www.scopus.com/inward/record.url?scp=84864564856&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84864564856&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84864564856

SN - 9781920682774

VL - 96

BT - Conferences in Research and Practice in Information Technology Series

ER -