Non-rigid surface tracking for virtual fitting system

Naoki Shimizu, Takumi Yoshida, Tomoki Hayashi, Francois De Sorbier, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

In this paper, we describe a method for overlaying a texture onto a T-shirt, for improving current virtual fitting system. In such systems, users can try on clothes virtually. In order to realize such a system, a depth camera has been used. These depth cameras can capture 3D data in real time and have been used by some industrial virtual cloth fitting systems. However, these systems roughly, or just do not, consider the shape of the clothes that user is wearing. So the appearance of these virtual fitting systems looks unnaturally. For a better fitting, we need to estimate 3D shape of cloth surface, and overlay a texture of the cloth that the user wants to see onto the surface. There are some methods that register a 3D deformable mesh onto captured depth data of a target surface. Although those registration methods are very accurate, most of them require large amount of processing time or either manually-set markers or special rectangles. The main contribution of our method is to overlay a texture onto a texture of T-shirt in real-time without modifying the surface.

Original languageEnglish
Title of host publicationVISAPP 2013 - Proceedings of the International Conference on Computer Vision Theory and Applications
Pages12-18
Number of pages7
Volume2
Publication statusPublished - 2013
Event8th International Conference on Computer Vision Theory and Applications, VISAPP 2013 - Barcelona, Spain
Duration: 2013 Feb 212013 Feb 24

Other

Other8th International Conference on Computer Vision Theory and Applications, VISAPP 2013
CountrySpain
CityBarcelona
Period13/2/2113/2/24

Fingerprint

Textures
Cameras
Processing

Keywords

  • Augmented reality
  • Deformable 3D registration
  • Local feature point
  • Principal component analysis
  • RGB-D camera

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Cite this

Shimizu, N., Yoshida, T., Hayashi, T., De Sorbier, F., & Saito, H. (2013). Non-rigid surface tracking for virtual fitting system. In VISAPP 2013 - Proceedings of the International Conference on Computer Vision Theory and Applications (Vol. 2, pp. 12-18)

Non-rigid surface tracking for virtual fitting system. / Shimizu, Naoki; Yoshida, Takumi; Hayashi, Tomoki; De Sorbier, Francois; Saito, Hideo.

VISAPP 2013 - Proceedings of the International Conference on Computer Vision Theory and Applications. Vol. 2 2013. p. 12-18.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Shimizu, N, Yoshida, T, Hayashi, T, De Sorbier, F & Saito, H 2013, Non-rigid surface tracking for virtual fitting system. in VISAPP 2013 - Proceedings of the International Conference on Computer Vision Theory and Applications. vol. 2, pp. 12-18, 8th International Conference on Computer Vision Theory and Applications, VISAPP 2013, Barcelona, Spain, 13/2/21.
Shimizu N, Yoshida T, Hayashi T, De Sorbier F, Saito H. Non-rigid surface tracking for virtual fitting system. In VISAPP 2013 - Proceedings of the International Conference on Computer Vision Theory and Applications. Vol. 2. 2013. p. 12-18
Shimizu, Naoki ; Yoshida, Takumi ; Hayashi, Tomoki ; De Sorbier, Francois ; Saito, Hideo. / Non-rigid surface tracking for virtual fitting system. VISAPP 2013 - Proceedings of the International Conference on Computer Vision Theory and Applications. Vol. 2 2013. pp. 12-18
@inproceedings{61c795d0d8d643238ff3c896d62fadfc,
title = "Non-rigid surface tracking for virtual fitting system",
abstract = "In this paper, we describe a method for overlaying a texture onto a T-shirt, for improving current virtual fitting system. In such systems, users can try on clothes virtually. In order to realize such a system, a depth camera has been used. These depth cameras can capture 3D data in real time and have been used by some industrial virtual cloth fitting systems. However, these systems roughly, or just do not, consider the shape of the clothes that user is wearing. So the appearance of these virtual fitting systems looks unnaturally. For a better fitting, we need to estimate 3D shape of cloth surface, and overlay a texture of the cloth that the user wants to see onto the surface. There are some methods that register a 3D deformable mesh onto captured depth data of a target surface. Although those registration methods are very accurate, most of them require large amount of processing time or either manually-set markers or special rectangles. The main contribution of our method is to overlay a texture onto a texture of T-shirt in real-time without modifying the surface.",
keywords = "Augmented reality, Deformable 3D registration, Local feature point, Principal component analysis, RGB-D camera",
author = "Naoki Shimizu and Takumi Yoshida and Tomoki Hayashi and {De Sorbier}, Francois and Hideo Saito",
year = "2013",
language = "English",
isbn = "9789898565471",
volume = "2",
pages = "12--18",
booktitle = "VISAPP 2013 - Proceedings of the International Conference on Computer Vision Theory and Applications",

}

TY - GEN

T1 - Non-rigid surface tracking for virtual fitting system

AU - Shimizu, Naoki

AU - Yoshida, Takumi

AU - Hayashi, Tomoki

AU - De Sorbier, Francois

AU - Saito, Hideo

PY - 2013

Y1 - 2013

N2 - In this paper, we describe a method for overlaying a texture onto a T-shirt, for improving current virtual fitting system. In such systems, users can try on clothes virtually. In order to realize such a system, a depth camera has been used. These depth cameras can capture 3D data in real time and have been used by some industrial virtual cloth fitting systems. However, these systems roughly, or just do not, consider the shape of the clothes that user is wearing. So the appearance of these virtual fitting systems looks unnaturally. For a better fitting, we need to estimate 3D shape of cloth surface, and overlay a texture of the cloth that the user wants to see onto the surface. There are some methods that register a 3D deformable mesh onto captured depth data of a target surface. Although those registration methods are very accurate, most of them require large amount of processing time or either manually-set markers or special rectangles. The main contribution of our method is to overlay a texture onto a texture of T-shirt in real-time without modifying the surface.

AB - In this paper, we describe a method for overlaying a texture onto a T-shirt, for improving current virtual fitting system. In such systems, users can try on clothes virtually. In order to realize such a system, a depth camera has been used. These depth cameras can capture 3D data in real time and have been used by some industrial virtual cloth fitting systems. However, these systems roughly, or just do not, consider the shape of the clothes that user is wearing. So the appearance of these virtual fitting systems looks unnaturally. For a better fitting, we need to estimate 3D shape of cloth surface, and overlay a texture of the cloth that the user wants to see onto the surface. There are some methods that register a 3D deformable mesh onto captured depth data of a target surface. Although those registration methods are very accurate, most of them require large amount of processing time or either manually-set markers or special rectangles. The main contribution of our method is to overlay a texture onto a texture of T-shirt in real-time without modifying the surface.

KW - Augmented reality

KW - Deformable 3D registration

KW - Local feature point

KW - Principal component analysis

KW - RGB-D camera

UR - http://www.scopus.com/inward/record.url?scp=84878244263&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84878244263&partnerID=8YFLogxK

M3 - Conference contribution

SN - 9789898565471

VL - 2

SP - 12

EP - 18

BT - VISAPP 2013 - Proceedings of the International Conference on Computer Vision Theory and Applications

ER -