Intelligent active and passive learning for integrated semantic computing for vision data annotation

Irene Erlyn Wina Rachmawan, Yasushi Kiyoki, Xing Chen

研究成果: Conference contribution

抄録

This paper proposes an intelligent control, which generates semantic meanings in natural language descriptions from media data, and discusses its application for semantic image retrieval. The new intelligent control for active and passive learning in the integrated semantic space works in a semantic space that is dynamically formed by the combinations of meaning space attained from the semantic associative calculation and the learned visual feature space derived by deep learning over the media data. Our model is inspired by the human ability to understand the semantic meaning of information by using active and passive learning. To get the query image results with similar semantic meaning, we define two types of knowledge representations: known and unknown semantic. Known semantic, is a set of the comprehensive concepts of meaning that is embedded in the system and used for the semantic associative calculation to construct the meaning space. We associate it with the passive learning. On the other hand, the unknown semantic knowledge is a set of comprehensive concepts of meaning that is not discovered in the system and has to be sought from the pattern of media through statistic and/or learned patterns. This deep active learning can be associated with the active human learning. We describe how the system chooses the subspace from the semantic space through the intelligent control for active and passive learning in the integrated semantic space by slicing, dicing and pivoting dimensions to identify and retrieve the meaning of images. The proposed system is an experimental modular model for database developed to answer the given semantic query in which the axis is represented in the columnar model database. We performed an experimental study on a large image dataset for deep learning. Our model outperforms the state-of-art in annotation. In segmentation, it compares favorably with other methods that use significantly more labeled training data.

本文言語English
ホスト出版物のタイトルProceedings - 14th IEEE International Conference on Semantic Computing, ICSC 2020
出版社Institute of Electrical and Electronics Engineers Inc.
ページ439-444
ページ数6
ISBN(電子版)9781728163321
DOI
出版ステータスPublished - 2020 2月
イベント14th IEEE International Conference on Semantic Computing, ICSC 2020 - San Diego, United States
継続期間: 2020 2月 32020 2月 5

出版物シリーズ

名前Proceedings - 14th IEEE International Conference on Semantic Computing, ICSC 2020

Conference

Conference14th IEEE International Conference on Semantic Computing, ICSC 2020
国/地域United States
CitySan Diego
Period20/2/320/2/5

ASJC Scopus subject areas

  • 人工知能
  • コンピュータ サイエンスの応用
  • コンピュータ ビジョンおよびパターン認識

フィンガープリント

「Intelligent active and passive learning for integrated semantic computing for vision data annotation」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル