Impression-aware video stream retrieval system with temporal color-sentiment analysis and visualization

Shuichi Kurabayashi, Yasushi Kiyoki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

To retrieve Web video intuitively, the concept of "impression" is of great importance, because many users consider feelings and moods to be one of the most significant factors motivating them to watch videos. In this paper, we propose an impression-aware video stream retrieval system for querying the visual impression of video streams by analyzing the temporal change in sentiments. As a metric of visual impression, we construct a 180-dimensional vector space called as color-impression space; each dimension corresponds to a specific adjective representing humans' color perception. The main feature of this system is a context-dependent query processing mechanism to generate a ranking by considering the temporal transition of each video's visual impressions on viewers' emotion. We design an impression-aware noise reduction mechanism that dynamically reduces the number on non-zero features for each item mapped in the high-dimensional color-impression space by extracting the dominant salient impression features from a video stream. This system allows users to retrieve videos by submitting emotional queries such as "Find videos whose overall impression is happy and which have several sad and cool scenes". Through this query processing mechanism, users can effectively retrieve videos without requiring detailed information about them.

Original languageEnglish
Title of host publicationDatabase and Expert Systems Applications - 23rd International Conference, DEXA 2012, Proceedings
Pages168-182
Number of pages15
EditionPART 2
DOIs
Publication statusPublished - 2012 Sep 14
Event23rd International Conference on Database and Expert Systems Applications, DEXA 2012 - Vienna, Austria
Duration: 2012 Sep 32012 Sep 6

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 2
Volume7447 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other23rd International Conference on Database and Expert Systems Applications, DEXA 2012
CountryAustria
CityVienna
Period12/9/312/9/6

    Fingerprint

Keywords

  • impression
  • sentiment analysis
  • video-search
  • visualization

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Kurabayashi, S., & Kiyoki, Y. (2012). Impression-aware video stream retrieval system with temporal color-sentiment analysis and visualization. In Database and Expert Systems Applications - 23rd International Conference, DEXA 2012, Proceedings (PART 2 ed., pp. 168-182). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7447 LNCS, No. PART 2). https://doi.org/10.1007/978-3-642-32597-7_15