A ‘Kansei’ multimedia and semantic computing system for cross-cultural communication

Shlomo Dubnov, Kevin Burns, Yasushi Kiyoki

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

In the design of multimedia computing systems, one of the most important issues is how to search and analyze media data (images, music, movies and documents), according to user’s impressions and contexts. This paper presents “Kansei-Multimedia Computing System” for realizing international and cross-cultural research environments, as a new platform of multimedia computing system. We introduce a “Kansei” and semantic associative search method based on the “Mathematical Model of Meaning (MMM)”. The concept of “Kansei” includes several meanings on sensitive recognition, such as “emotion”, “impression”, “human senses”, “feelings”, “sensitivity”, “psychological reaction” and “physiological reaction”. MMM realizes “Kansei” processing and semantic associative search for media data, according to user’s impressions and contexts. This model is applied to compute semantic correlations between keywords, images, music, movies and documents dynamically in a context-dependent way. This system based on MMM realizes (1) “Kansei” image and music search and analysis for cooperative creation and manipulation of multimedia objects and (2) Cross-cultural communications with music and images databases.

Original languageEnglish
Title of host publicationSpringerBriefs in Computer Science
PublisherSpringer
Pages1-20
Number of pages20
Edition9783319428710
DOIs
Publication statusPublished - 2016 Jan 1

Publication series

NameSpringerBriefs in Computer Science
Number9783319428710
ISSN (Print)2191-5768
ISSN (Electronic)2191-5776

Fingerprint

Semantics
Mathematical models
Communication
Processing

Keywords

  • Multimedia database
  • Music database
  • Music piece
  • Semantic correlation
  • Semantic space

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Dubnov, S., Burns, K., & Kiyoki, Y. (2016). A ‘Kansei’ multimedia and semantic computing system for cross-cultural communication. In SpringerBriefs in Computer Science (9783319428710 ed., pp. 1-20). (SpringerBriefs in Computer Science; No. 9783319428710). Springer. https://doi.org/10.1007/978-3-319-42873-4_1

A ‘Kansei’ multimedia and semantic computing system for cross-cultural communication. / Dubnov, Shlomo; Burns, Kevin; Kiyoki, Yasushi.

SpringerBriefs in Computer Science. 9783319428710. ed. Springer, 2016. p. 1-20 (SpringerBriefs in Computer Science; No. 9783319428710).

Research output: Chapter in Book/Report/Conference proceedingChapter

Dubnov, S, Burns, K & Kiyoki, Y 2016, A ‘Kansei’ multimedia and semantic computing system for cross-cultural communication. in SpringerBriefs in Computer Science. 9783319428710 edn, SpringerBriefs in Computer Science, no. 9783319428710, Springer, pp. 1-20. https://doi.org/10.1007/978-3-319-42873-4_1
Dubnov S, Burns K, Kiyoki Y. A ‘Kansei’ multimedia and semantic computing system for cross-cultural communication. In SpringerBriefs in Computer Science. 9783319428710 ed. Springer. 2016. p. 1-20. (SpringerBriefs in Computer Science; 9783319428710). https://doi.org/10.1007/978-3-319-42873-4_1
Dubnov, Shlomo ; Burns, Kevin ; Kiyoki, Yasushi. / A ‘Kansei’ multimedia and semantic computing system for cross-cultural communication. SpringerBriefs in Computer Science. 9783319428710. ed. Springer, 2016. pp. 1-20 (SpringerBriefs in Computer Science; 9783319428710).
@inbook{5d164663645549eab8a48ba05cfd34cf,
title = "A ‘Kansei’ multimedia and semantic computing system for cross-cultural communication",
abstract = "In the design of multimedia computing systems, one of the most important issues is how to search and analyze media data (images, music, movies and documents), according to user’s impressions and contexts. This paper presents “Kansei-Multimedia Computing System” for realizing international and cross-cultural research environments, as a new platform of multimedia computing system. We introduce a “Kansei” and semantic associative search method based on the “Mathematical Model of Meaning (MMM)”. The concept of “Kansei” includes several meanings on sensitive recognition, such as “emotion”, “impression”, “human senses”, “feelings”, “sensitivity”, “psychological reaction” and “physiological reaction”. MMM realizes “Kansei” processing and semantic associative search for media data, according to user’s impressions and contexts. This model is applied to compute semantic correlations between keywords, images, music, movies and documents dynamically in a context-dependent way. This system based on MMM realizes (1) “Kansei” image and music search and analysis for cooperative creation and manipulation of multimedia objects and (2) Cross-cultural communications with music and images databases.",
keywords = "Multimedia database, Music database, Music piece, Semantic correlation, Semantic space",
author = "Shlomo Dubnov and Kevin Burns and Yasushi Kiyoki",
year = "2016",
month = "1",
day = "1",
doi = "10.1007/978-3-319-42873-4_1",
language = "English",
series = "SpringerBriefs in Computer Science",
publisher = "Springer",
number = "9783319428710",
pages = "1--20",
booktitle = "SpringerBriefs in Computer Science",
edition = "9783319428710",

}

TY - CHAP

T1 - A ‘Kansei’ multimedia and semantic computing system for cross-cultural communication

AU - Dubnov, Shlomo

AU - Burns, Kevin

AU - Kiyoki, Yasushi

PY - 2016/1/1

Y1 - 2016/1/1

N2 - In the design of multimedia computing systems, one of the most important issues is how to search and analyze media data (images, music, movies and documents), according to user’s impressions and contexts. This paper presents “Kansei-Multimedia Computing System” for realizing international and cross-cultural research environments, as a new platform of multimedia computing system. We introduce a “Kansei” and semantic associative search method based on the “Mathematical Model of Meaning (MMM)”. The concept of “Kansei” includes several meanings on sensitive recognition, such as “emotion”, “impression”, “human senses”, “feelings”, “sensitivity”, “psychological reaction” and “physiological reaction”. MMM realizes “Kansei” processing and semantic associative search for media data, according to user’s impressions and contexts. This model is applied to compute semantic correlations between keywords, images, music, movies and documents dynamically in a context-dependent way. This system based on MMM realizes (1) “Kansei” image and music search and analysis for cooperative creation and manipulation of multimedia objects and (2) Cross-cultural communications with music and images databases.

AB - In the design of multimedia computing systems, one of the most important issues is how to search and analyze media data (images, music, movies and documents), according to user’s impressions and contexts. This paper presents “Kansei-Multimedia Computing System” for realizing international and cross-cultural research environments, as a new platform of multimedia computing system. We introduce a “Kansei” and semantic associative search method based on the “Mathematical Model of Meaning (MMM)”. The concept of “Kansei” includes several meanings on sensitive recognition, such as “emotion”, “impression”, “human senses”, “feelings”, “sensitivity”, “psychological reaction” and “physiological reaction”. MMM realizes “Kansei” processing and semantic associative search for media data, according to user’s impressions and contexts. This model is applied to compute semantic correlations between keywords, images, music, movies and documents dynamically in a context-dependent way. This system based on MMM realizes (1) “Kansei” image and music search and analysis for cooperative creation and manipulation of multimedia objects and (2) Cross-cultural communications with music and images databases.

KW - Multimedia database

KW - Music database

KW - Music piece

KW - Semantic correlation

KW - Semantic space

UR - http://www.scopus.com/inward/record.url?scp=85044920990&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85044920990&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-42873-4_1

DO - 10.1007/978-3-319-42873-4_1

M3 - Chapter

T3 - SpringerBriefs in Computer Science

SP - 1

EP - 20

BT - SpringerBriefs in Computer Science

PB - Springer

ER -