Model-based 3D human shape estimation from silhouettes for virtual fitting

Shunta Saito, Makiko Kouchi, Masaaki Mochimaru, Yoshimitsu Aoki

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    4 Citations (Scopus)

    Abstract

    We propose a model-based 3D human shape reconstruction system from two silhouettes. Firstly, we synthesize a deformable body model from 3D human shape database consists of a hundred whole body mesh models. Each mesh model is homologous, so that it has the same topology and same number of vertices among all models. We perform principal component analysis (PCA) on the database and synthesize an Active Shape Model (ASM). ASM allows changing the body type of the model with a few parameters. The pose changing of our model can be achieved by reconstructing the skeleton structures from implanted joints of the model. By applying pose changing after body type deformation, our model can represents various body types and any pose. We apply the model to the problem of 3D human shape reconstruction from front and side silhouette. Our approach is simply comparing the contours between the model's and input silhouettes', we then use only torso part contour of the model to reconstruct whole shape. We optimize the model parameters by minimizing the difference between corresponding silhouettes by using a stochastic, derivative-free non-linear optimization method, CMA-ES.

    Original languageEnglish
    Title of host publicationProceedings of SPIE-IS and T Electronic Imaging - Three-Dimensional Image Processing, Measurement (3DIPM), and Applications 2014
    PublisherSPIE
    ISBN (Print)9780819499301
    DOIs
    Publication statusPublished - 2014 Jan 1
    EventThree-Dimensional Image Processing, Measurement (3DIPM), and Applications 2014 - San Francisco, CA, United States
    Duration: 2014 Feb 52014 Feb 5

    Publication series

    NameProceedings of SPIE - The International Society for Optical Engineering
    Volume9013
    ISSN (Print)0277-786X
    ISSN (Electronic)1996-756X

    Other

    OtherThree-Dimensional Image Processing, Measurement (3DIPM), and Applications 2014
    CountryUnited States
    CitySan Francisco, CA
    Period14/2/514/2/5

      Fingerprint

    Keywords

    • 3D reconstruction
    • Active shape model
    • Anatomical landmarks
    • Digital Human Model
    • Non-linear optimization
    • Principal component analysis
    • Shape-from-silhouettes
    • Skinning

    ASJC Scopus subject areas

    • Electronic, Optical and Magnetic Materials
    • Condensed Matter Physics
    • Computer Science Applications
    • Applied Mathematics
    • Electrical and Electronic Engineering

    Cite this

    Saito, S., Kouchi, M., Mochimaru, M., & Aoki, Y. (2014). Model-based 3D human shape estimation from silhouettes for virtual fitting. In Proceedings of SPIE-IS and T Electronic Imaging - Three-Dimensional Image Processing, Measurement (3DIPM), and Applications 2014 [901307] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 9013). SPIE. https://doi.org/10.1117/12.2038457