Word vectorization using relations among words for neural network

Hajime Hotta, Masanobu Kittaka, Masafumi Hagiwara

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

In this paper, we propose a new vectorization method for a new generation of computational intelligence including neural networks and natural language processing. In recent years, various techniques of word vectorization have been proposed, many of which rely on the preparation of dictionaries. However, these techniques don't consider the symbol grounding problem for unknown types of data, which is one of the most fundamental issues on artificial intelligence. In order to avoid the symbol-grounding problem, pattern processing based methods, such as neural networks, are often used in various studies on self-directive systems and algorithms, and the merit of neural network is not exception in the natural language processing. The proposed method is a converter from one word input to one real-valued vector, whose algorithm is inspired by neural network architecture. he merits of the method are as follows: (1) the method requires no specific knowledge of linguistics e.g. word classes or grammatical one; (2) the method is a sequence learning technique and it can learn additional knowledge. The experiment showed the efficiency of word vectorization in terms of similarity measurement.

Original languageEnglish
Pages (from-to)75-82
Number of pages8
JournalIEEJ Transactions on Electronics, Information and Systems
Volume130
Issue number1
DOIs
Publication statusPublished - 2010

Keywords

  • Natural language processing
  • Neural netowrk
  • Self-organizing map
  • Thesaurus
  • Vectorization

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Word vectorization using relations among words for neural network'. Together they form a unique fingerprint.

  • Cite this