Cross-cultural multimedia computing with impression-based semantic spaces

Yasushi Kiyoki, Shiori Sasaki, Nhung Nguyen Trang, Nguyen Thi Ngoc Diep

Research output: Chapter in Book/Report/Conference proceedingChapter

19 Citations (Scopus)

Abstract

Over the past decade, the rapid progress of multimedia data management technology has realized the large scale of media data transfer and resource-accumulation in the world. The multimedia computing technology has also been creating new information provision environments in the world-wide scope. Innovative integrations of large scale multimedia data management and computing technology will lead to a new information society. In the design of multimedia systems, one of the most important issues is how to search and analyze media data (images, music, movies and documents), according to impressions and contexts. We have proposed and introduced a "Kansei" and semantic associative search method based on our "Mathematical Model of Meaning (MMM) [11], [13], [14]". The concept of "Kansei" includes several meanings on sensitive recognition, such as "impression", "human senses", "feelings", "sensitivity", "psychological reaction" and "physiological reaction". This model realizes "Kansei" processing and semantic associative search for media data, according to user's impressions and contexts. This model is applied to compute semantic correlations between keywords, images, music and documents dynamically in a context-dependent way. The main feature of this model is to realize semantic associative search in the 2000 dimensional orthogonal semantic space with semantic projection functions. This space is created for dynamically computing semantic equivalence or similarity between keywords and media data. We have constructed "Cross-Cultural Multimedia Computing Systems" for sharing and analyzing different cultures with semantic associative functions applied to "cultural & multimedia data," as a new platform of cross-cultural collaborative environments. This environment enables to create a remote, interactive and real-time cultural and academic research exchange among different countries and cultures.

Original languageEnglish
Title of host publicationConceptual Modelling and Its Theoretical Foundations
Subtitle of host publicationEssays Dedicated to Bernhard Thalheim on the Occasion of His 60th Birthday
EditorsAntje Dusterhoft, Meike Klettke, Klaus-Dieter Schewe
Pages316-328
Number of pages13
DOIs
Publication statusPublished - 2012 Mar 5

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume7260 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Cross-cultural multimedia computing with impression-based semantic spaces'. Together they form a unique fingerprint.

  • Cite this

    Kiyoki, Y., Sasaki, S., Trang, N. N., & Diep, N. T. N. (2012). Cross-cultural multimedia computing with impression-based semantic spaces. In A. Dusterhoft, M. Klettke, & K-D. Schewe (Eds.), Conceptual Modelling and Its Theoretical Foundations: Essays Dedicated to Bernhard Thalheim on the Occasion of His 60th Birthday (pp. 316-328). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7260 LNCS). https://doi.org/10.1007/978-3-642-28279-9-21