A context-based whole video retrieval system with dynamic video stream analysis mechanisms

Shuichi Kurabayashi, Taichi Ueno, Yasushi Kiyoki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

11 Citations (Scopus)

Abstract

With the rapid expansion of fictional video contents on WWW, it is important to develop video retrieval mechanisms for fictional video contents, such as TV drama, animations, and movies. This paper proposes a context-based video retrieval system for retrieving an entire video stream, not individual scenes or fragments. The unique feature of this system is a SQL-like contextual multimedia query language, which allows users to express and characterize their queries by using video clips as contexts. It extracts emotive contexts of visual elements from video files by analyzing the coloremotions hidden within video content using methods developed during color psychology research. The system's capabilities enables new ways of querying artistic, visually rich and dynamic video content - something which is not possible by using just a few words. This is done by inspecting the dynamic and time-evolving contexts of video data. A prototype system has been implemented which is applicable to performing queries against television content. This paper clarifies the feasibility of the system by demonstrating the results of several experiments.

Original languageEnglish
Title of host publicationISM 2009 - 11th IEEE International Symposium on Multimedia
Pages505-510
Number of pages6
DOIs
Publication statusPublished - 2009 Dec 1
Event11th IEEE International Symposium on Multimedia, ISM 2009 - San Diego, CA, United States
Duration: 2009 Dec 142009 Dec 16

Publication series

NameISM 2009 - 11th IEEE International Symposium on Multimedia

Other

Other11th IEEE International Symposium on Multimedia, ISM 2009
CountryUnited States
CitySan Diego, CA
Period09/12/1409/12/16

Keywords

  • Context-computing
  • Multimedia database
  • Query language
  • Video search engine
  • Video stream analysis

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Hardware and Architecture
  • Software

Fingerprint Dive into the research topics of 'A context-based whole video retrieval system with dynamic video stream analysis mechanisms'. Together they form a unique fingerprint.

  • Cite this

    Kurabayashi, S., Ueno, T., & Kiyoki, Y. (2009). A context-based whole video retrieval system with dynamic video stream analysis mechanisms. In ISM 2009 - 11th IEEE International Symposium on Multimedia (pp. 505-510). [5363682] (ISM 2009 - 11th IEEE International Symposium on Multimedia). https://doi.org/10.1109/ISM.2009.85