Evolutionary structure optimization of hierarchical neural network for image recognition

Satoru Suzuki, Yasue Mitsukura

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

The purpose of this paper is to optimize the structure of hierarchical neural networks. In this paper, structure optimization is used to represent a neural network by the minimum number of nodes and connections, and is performed by eliminating unnecessary connections from a trained neural network by means of a genetic algorithm. We focus on a neural network specialized for image recognition problems. The flow of the proposed method is as follows. First, the Walsh-Hadamard transform is applied to images for feature extraction. Second, the neural network is trained with the extracted features based on a back-propagation algorithm. After neural network training, unnecessary connections are eliminated from the trained neural network by means of a genetic algorithm. Finally, the neural network is retrained to recover from the degradation caused by connection elimination. In order to validate the usefulness of the proposed method, face recognition and texture classification examples are used. The experimental results indicate that a compact neural network was generated, maintaining the generalization performance by the proposed method.

Original languageEnglish
Pages (from-to)28-36
Number of pages9
JournalElectronics and Communications in Japan
Volume95
Issue number3
DOIs
Publication statusPublished - 2012 Mar 1

    Fingerprint

Keywords

  • face recognition
  • genetic algorithm
  • neural network
  • texture classification

ASJC Scopus subject areas

  • Signal Processing
  • Physics and Astronomy(all)
  • Computer Networks and Communications
  • Electrical and Electronic Engineering
  • Applied Mathematics

Cite this