Visualization of important human motion feature using convolutional neural network

Masashi Fukui, Genki Kokubun, Takahiro Nozaki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Human motion feature extraction is necessary for robot motion generation. In particular, feature extraction methods related to non-periodic motion should be proposed. Recently, the number of the human motion recognition studies utilizing Convolutional Neural Network (CNN) is increasing due to the brilliant ability of extracting and identifying features. CNN has the same or better discrimination ability than humans so that the features extracted by CNN are thought to be useful for human motion understanding. However, since the internal structure of CNN is like a black box, it is difficult to understand the extracted features. In order to understand the features, some visualization methods which are utilized in the image field are applied in this paper. Furthermore, the many conventional studies utilizing the gradient are not preferred for visualizing CNN which recognizes human motion because human motion is sensitive for the object which treated. That is, the gradient method does not work because the value varies greatly depending on the environment even in the same motion. Therefore, new visualizing method without using the gradient is proposed in this paper. The proposed method visualizes CNN focusing part by following the neuron in CNN. Since this method does not require the gradient, the stable and accurate visualization can be performed. The effectiveness is shown by experiments.

Original languageEnglish
Title of host publicationProceedings - 2020 IEEE International Conference on Industrial Technology, ICIT 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages406-411
Number of pages6
ISBN (Electronic)9781728157542
DOIs
Publication statusPublished - 2020 Feb
Event21st IEEE International Conference on Industrial Technology, ICIT 2020 - Buenos Aires, Argentina
Duration: 2020 Feb 262020 Feb 28

Publication series

NameProceedings of the IEEE International Conference on Industrial Technology
Volume2020-February

Conference

Conference21st IEEE International Conference on Industrial Technology, ICIT 2020
CountryArgentina
CityBuenos Aires
Period20/2/2620/2/28

Keywords

  • CNN
  • HAR
  • Human motion
  • Visualization

ASJC Scopus subject areas

  • Computer Science Applications
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Visualization of important human motion feature using convolutional neural network'. Together they form a unique fingerprint.

  • Cite this

    Fukui, M., Kokubun, G., & Nozaki, T. (2020). Visualization of important human motion feature using convolutional neural network. In Proceedings - 2020 IEEE International Conference on Industrial Technology, ICIT 2020 (pp. 406-411). [9067143] (Proceedings of the IEEE International Conference on Industrial Technology; Vol. 2020-February). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICIT45562.2020.9067143