Impression-aware video stream retrieval system with temporal color-sentiment analysis and visualization

Shuichi Kurabayashi, Yasushi Kiyoki

研究成果: Conference contribution

2 被引用数 (Scopus)

抄録

To retrieve Web video intuitively, the concept of "impression" is of great importance, because many users consider feelings and moods to be one of the most significant factors motivating them to watch videos. In this paper, we propose an impression-aware video stream retrieval system for querying the visual impression of video streams by analyzing the temporal change in sentiments. As a metric of visual impression, we construct a 180-dimensional vector space called as color-impression space; each dimension corresponds to a specific adjective representing humans' color perception. The main feature of this system is a context-dependent query processing mechanism to generate a ranking by considering the temporal transition of each video's visual impressions on viewers' emotion. We design an impression-aware noise reduction mechanism that dynamically reduces the number on non-zero features for each item mapped in the high-dimensional color-impression space by extracting the dominant salient impression features from a video stream. This system allows users to retrieve videos by submitting emotional queries such as "Find videos whose overall impression is happy and which have several sad and cool scenes". Through this query processing mechanism, users can effectively retrieve videos without requiring detailed information about them.

本文言語English
ホスト出版物のタイトルDatabase and Expert Systems Applications - 23rd International Conference, DEXA 2012, Proceedings
ページ168-182
ページ数15
PART 2
DOI
出版ステータスPublished - 2012 9 14
イベント23rd International Conference on Database and Expert Systems Applications, DEXA 2012 - Vienna, Austria
継続期間: 2012 9 32012 9 6

出版物シリーズ

名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
番号PART 2
7447 LNCS
ISSN(印刷版)0302-9743
ISSN(電子版)1611-3349

Other

Other23rd International Conference on Database and Expert Systems Applications, DEXA 2012
CountryAustria
CityVienna
Period12/9/312/9/6

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

フィンガープリント 「Impression-aware video stream retrieval system with temporal color-sentiment analysis and visualization」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル