Theoretical Derivation of Momentum Term in Back-propagation

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Citations (Scopus)

Abstract

This paper explains clearly the theoretical origin of a momentum term in Back-propagation algorithm. We will prove that the Back-propagation algorithm, which has a momentum term, can be derived through the following assumptions: 1) The cost function is {equation presented}, where Ep is the sum of squared error at the output layer. 2) The most recent weights are assumed in calculating E n.

Original languageEnglish
Title of host publicationProceedings - 1992 International Joint Conference on Neural Networks, IJCNN 1992
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages682-686
Number of pages5
ISBN (Electronic)0780305590
DOIs
Publication statusPublished - 1992
Event1992 International Joint Conference on Neural Networks, IJCNN 1992 - Baltimore, United States
Duration: 1992 Jun 71992 Jun 11

Publication series

NameProceedings of the International Joint Conference on Neural Networks
Volume1

Conference

Conference1992 International Joint Conference on Neural Networks, IJCNN 1992
Country/TerritoryUnited States
CityBaltimore
Period92/6/792/6/11

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Theoretical Derivation of Momentum Term in Back-propagation'. Together they form a unique fingerprint.

Cite this