TY - GEN
T1 - A semantic associative computation method for automatic decorative-multimedia creation with "Kansei" information
AU - Kiyoki, Yasushi
AU - Chen, Xing
PY - 2009/12/1
Y1 - 2009/12/1
N2 - In the design of multimedia systems, one of the important issues is how to deal with "Kansei" of human beings. The concept of "Kansei" in Japanese includes several meanings on sensitive recognition, such as "impression," "human senses," "feelings," "sensitivity," "psychological reaction" and "physiological reaction." This paper presents a new concept of "automatic decorative-multimedia creation" and a semantic associative computation method. This method realizes automatic main-media decoration with dynamic sub-media data selection for representing main-media as decorative multimedia. The aim of this method is to create a new field of "automatic decorative-media art" with "semantic associative computing." This paper defines an "automatic media decoration model" with semantic spaces and media-decoration functions. Automatic media decoration is realized by applying the Mathematical Model of Meaning (MMM) to a media-transmission space for computing semantic correlations between main-media objects and sub-media. The process of this dynamic media decoration method consists of the following functions: (1) Extraction of semantic "Kansei" features of "main-media object," such as music, image and video. (2) Mapping of the main-media object onto the media-transmission space between main-media and sub-media. (3) Semantic associative computation of correlations between the main-media object and the features of the sub-media space by MMM, and creating a vector of the main-media object with the features of the sub-media space. (4) Mapping of the vector of the main-media object to the sub-media space, and semantic associative computing between the main-media object and sub-media data. (5) Semantic ranking of sub-media objects as the result of the semantic associative computation, and selects one of the sub-media objects with high correlation values to the target main-media object. (6) Automatic rendering of the target main-media object with the selected sub-media object for decorating the main-media presentation. This paper shows several significant applications of the semantic associative computation method for "automatic decorative-media creation."
AB - In the design of multimedia systems, one of the important issues is how to deal with "Kansei" of human beings. The concept of "Kansei" in Japanese includes several meanings on sensitive recognition, such as "impression," "human senses," "feelings," "sensitivity," "psychological reaction" and "physiological reaction." This paper presents a new concept of "automatic decorative-multimedia creation" and a semantic associative computation method. This method realizes automatic main-media decoration with dynamic sub-media data selection for representing main-media as decorative multimedia. The aim of this method is to create a new field of "automatic decorative-media art" with "semantic associative computing." This paper defines an "automatic media decoration model" with semantic spaces and media-decoration functions. Automatic media decoration is realized by applying the Mathematical Model of Meaning (MMM) to a media-transmission space for computing semantic correlations between main-media objects and sub-media. The process of this dynamic media decoration method consists of the following functions: (1) Extraction of semantic "Kansei" features of "main-media object," such as music, image and video. (2) Mapping of the main-media object onto the media-transmission space between main-media and sub-media. (3) Semantic associative computation of correlations between the main-media object and the features of the sub-media space by MMM, and creating a vector of the main-media object with the features of the sub-media space. (4) Mapping of the vector of the main-media object to the sub-media space, and semantic associative computing between the main-media object and sub-media data. (5) Semantic ranking of sub-media objects as the result of the semantic associative computation, and selects one of the sub-media objects with high correlation values to the target main-media object. (6) Automatic rendering of the target main-media object with the selected sub-media object for decorating the main-media presentation. This paper shows several significant applications of the semantic associative computation method for "automatic decorative-media creation."
UR - http://www.scopus.com/inward/record.url?scp=84864564856&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84864564856&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:84864564856
SN - 9781920682774
T3 - Conferences in Research and Practice in Information Technology Series
BT - Conceptual Modelling 2009 - 6th Asia-Pacific Conference on Conceptual Modelling, APCCM 2009
T2 - 6th Asia-Pacific Conference on Conceptual Modelling, APCCM 2009
Y2 - 20 January 2009 through 23 January 2009
ER -