Hierarchical human action recognition around sleeping using obscured posture information

Yuta Kudo, Takehiko Sashida, Yoshimitsu Aoki

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    1 Citation (Scopus)

    Abstract

    This paper presents a new approach for human action recognition around sleeping with the human body parts locations and the positional relationship between human and sleeping environment. Body parts are estimated from the depth image obtained by a time-of-flight (TOF) sensor using oriented 3D normal vector. Issues in action recognition of sleeping situation are the demand of availability in darkness, and hiding of the human body by duvets. Therefore, the extraction of image features is difficult since color and edge features are obscured by covers. Thus, first in our method, positions of four parts of the body (head, torso, thigh, and lower leg) are estimated by using the shape model of bodily surface constructed by oriented 3D normal vector. This shape model can represent the surface shape of rough body, and is effective in robust posture estimation of the body hidden with duvets. Then, action descriptor is extracted from the position of each body part. The descriptor includes temporal variation of each part of the body and spatial vector of position of the parts and the bed. Furthermore, this paper proposes hierarchical action classes and classifiers to improve the indistinct action classification. Classifiers are composed of two layers, and recognize human action by using the action descriptor. First layer focuses on spatial descriptor and classifies action roughly. Second layer focuses on temporal descriptor and classifies action finely. This approach achieves a robust recognition of obscured human by using the posture information and the hierarchical action recognition.

    Original languageEnglish
    Title of host publicationTwelfth International Conference on Quality Control by Artificial Vision
    EditorsFabrice Meriaudeau, Olivier Aubreton
    PublisherSPIE
    ISBN (Electronic)9781628416992
    DOIs
    Publication statusPublished - 2015 Jan 1
    Event12th International Conference on Quality Control by Artificial Vision - Le Creusot, France
    Duration: 2015 Jun 32015 Jun 5

    Publication series

    NameProceedings of SPIE - The International Society for Optical Engineering
    Volume9534
    ISSN (Print)0277-786X
    ISSN (Electronic)1996-756X

    Other

    Other12th International Conference on Quality Control by Artificial Vision
    CountryFrance
    CityLe Creusot
    Period15/6/315/6/5

    Keywords

    • Hierarchical action classes and classifiers
    • Human action recognition
    • Obscured 3D posture information
    • Sleeping situation

    ASJC Scopus subject areas

    • Electronic, Optical and Magnetic Materials
    • Condensed Matter Physics
    • Computer Science Applications
    • Applied Mathematics
    • Electrical and Electronic Engineering

    Fingerprint Dive into the research topics of 'Hierarchical human action recognition around sleeping using obscured posture information'. Together they form a unique fingerprint.

  • Cite this

    Kudo, Y., Sashida, T., & Aoki, Y. (2015). Hierarchical human action recognition around sleeping using obscured posture information. In F. Meriaudeau, & O. Aubreton (Eds.), Twelfth International Conference on Quality Control by Artificial Vision [953418] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 9534). SPIE. https://doi.org/10.1117/12.2182870