Improvement of training method for dynamic neural network

Kunihiko Nakazono, Kouhei Ohnishi, Hiroshi Kinjo, Tetsuhiko Yamamoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this research, we propose a dynamic neural network (DNN) with the characteristics of stiffness, viscosity, and inertia and a training algorithm based on the back-propagation (BP) method to include a momentum term. In a previous research, we proposed a training algorithm for the DNN based on the BP method or GA-based training method. However, in the previous method it was necessary to determine the values of the DNN parameters by trial and error. So, the modified BP method and GA-based training method were designed to train not only the connecting weights but also the property parameters of the DNN. We develop the BP method to include a momentum term in order to increase the convergence of the training effect. Simulation results show that the DNN with characteristics of stiffness, viscosity, and inertia trained by the modified BP method to include the momentum term obtains good training performances for time series signals generated from periodic function. In this paper, we compare the DNN with a conventional training method in order to verify the effectiveness of the DNN.

Original languageEnglish
Title of host publicationProceedings of the 12th International Symposium on Artificial Life and Robotics, AROB 12th'07
Pages324-327
Number of pages4
Publication statusPublished - 2007 Dec 1
Event12th International Symposium on Artificial Life and Robotics, AROB 12th'07 - Oita, Japan
Duration: 2007 Jan 252007 Jan 27

Publication series

NameProceedings of the 12th International Symposium on Artificial Life and Robotis, AROB 12th'07

Other

Other12th International Symposium on Artificial Life and Robotics, AROB 12th'07
CountryJapan
CityOita
Period07/1/2507/1/27

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction

Fingerprint Dive into the research topics of 'Improvement of training method for dynamic neural network'. Together they form a unique fingerprint.

  • Cite this

    Nakazono, K., Ohnishi, K., Kinjo, H., & Yamamoto, T. (2007). Improvement of training method for dynamic neural network. In Proceedings of the 12th International Symposium on Artificial Life and Robotics, AROB 12th'07 (pp. 324-327). (Proceedings of the 12th International Symposium on Artificial Life and Robotis, AROB 12th'07).