Natural language processing neural network for analogical inference

Masahiro Saito, Masafumi Hagiwara

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

In this paper, we propose a novel neural network which can learn knowledge from natural language documents and can perform analogy. The conventional neural networks can use only the information the networks learned: knowledge acquisition has been a serious problem. The proposed network solves it by using a large scale dictionary named Google N-gram. In the preprocessing, natural language documents are analyzed by a Japanese dependency structure analyzer named Cabocha. The results are used in the network connection learning. In the analogy process, firing patterns of neurons are memorized in memory parts. When a similar firing pattern is appeared, a memorized pattern is retrieved. This process enables analogical inference. Three kinds of experiments were carried out using goo encyclopedia and Wikipedia as knowledge source. Superior performance of the proposed neural network has been confirmed.

Original languageEnglish
Title of host publication2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 International Joint Conference on Neural Networks, IJCNN 2010
DOIs
Publication statusPublished - 2010 Dec 1
Event2010 6th IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 International Joint Conference on Neural Networks, IJCNN 2010 - Barcelona, Spain
Duration: 2010 Jul 182010 Jul 23

Publication series

NameProceedings of the International Joint Conference on Neural Networks

Other

Other2010 6th IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 International Joint Conference on Neural Networks, IJCNN 2010
CountrySpain
CityBarcelona
Period10/7/1810/7/23

    Fingerprint

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Cite this

Saito, M., & Hagiwara, M. (2010). Natural language processing neural network for analogical inference. In 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 International Joint Conference on Neural Networks, IJCNN 2010 [5596742] (Proceedings of the International Joint Conference on Neural Networks). https://doi.org/10.1109/IJCNN.2010.5596742