Texture overlay for virtual clothing based on PCA of silhouettes

Jun Ehara, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

26 Citations (Scopus)

Abstract

In this paper, we propose a method for overlaying an arbitrary texture image onto a surface of a plain T-shirt worn by a user. For overlaying arbitrary textures onto the surface of the T-shirt, we need to know the deformation of the surface. For estimating the deformation of the surface from the input images, we use a two-phase process: learning and searching. In the learning phase, the system learns the relationship between the deformation of the surface and the silhouette of the T-shirt region in the image. A database of a number of training images in which a person wearing a T-shirt with markers moves through a variety of positions is used for this learning. Using the database, the system can learn the relationship between the shape of the silhouette and the surface deformation that is provided by the 2D positions of the markers on the surface of the T-shirt. In the searching phase, the silhouette of the user's T-shirt is extracted from the input image, and then, a search for a similar silhouette in the database is conducted in the subspace of the silhouette, which is computed using a PCA of the database. By using the proposed method for estimating the deformation of the surface of the T-shirt, we perform experiments for overlaying virtual clothing.

Original languageEnglish
Title of host publicationProceedings - ISMAR 2006
Subtitle of host publicationFifth IEEE and ACM International Symposium on Mixed and Augmented Reality
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages139-142
Number of pages4
ISBN (Print)1424406501, 9781424406500
DOIs
Publication statusPublished - 2006 Jan 1
EventISMAR 2006: 5th IEEE and ACM International Symposium on Mixed and Augmented Reality - Santa Barbara, CA, United States
Duration: 2006 Oct 222006 Oct 25

Publication series

NameProceedings - ISMAR 2006: Fifth IEEE and ACM International Symposium on Mixed and Augmented Reality

Other

OtherISMAR 2006: 5th IEEE and ACM International Symposium on Mixed and Augmented Reality
CountryUnited States
CitySanta Barbara, CA
Period06/10/2206/10/25

Keywords

  • Augmented reality
  • Deformable surface
  • Learning
  • PCA
  • Silhouette
  • Texture mapping
  • Virtual clothing

ASJC Scopus subject areas

  • Computer Science Applications
  • Computer Vision and Pattern Recognition
  • Software

Fingerprint Dive into the research topics of 'Texture overlay for virtual clothing based on PCA of silhouettes'. Together they form a unique fingerprint.

  • Cite this

    Ehara, J., & Saito, H. (2006). Texture overlay for virtual clothing based on PCA of silhouettes. In Proceedings - ISMAR 2006: Fifth IEEE and ACM International Symposium on Mixed and Augmented Reality (pp. 139-142). [4079267] (Proceedings - ISMAR 2006: Fifth IEEE and ACM International Symposium on Mixed and Augmented Reality). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISMAR.2006.297805