Automatic eyeglasses replacement for a 3d virtual try-on system

Takumi Kobayashi, Yuta Sugiura, Hideo Saito, Yuji Uema

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a 3D virtual eyeglasses try-on system for practical use. For fitting eyeglasses in a shop, consumers wish to look at themselves in a mirror while trying on various eyeglass styles. However, for people who need to wear eyeglasses for correcting problems with eyesight, it is impossible for them to clearly observe their face in the mirror without wearing eyeglasses. This makes fitting them for new eyeglasses difficult. This research proposes a virtual try-on system that can be used while wearing eyeglasses.We replace the user's eyeglasses in the input video with new eyeglasses virtually. Moreover, a fast and accurate face tracking tool enables our system to automatically display 3D virtual glasses following a user's head motion. Experimental results demonstrate that the proposed method can render virtual glasses naturally while the user is wearing real eyeglasses.

Original languageEnglish
Title of host publicationProceedings of the 10th Augmented Human International Conference, AH 2019
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450365475
DOIs
Publication statusPublished - 2019 Mar 11
Event10th Augmented Human International Conference, AH 2019 - Reims, France
Duration: 2019 Mar 112019 Mar 12

Publication series

NameACM International Conference Proceeding Series

Conference

Conference10th Augmented Human International Conference, AH 2019
CountryFrance
CityReims
Period19/3/1119/3/12

Fingerprint

Eyeglasses
Mirrors
Glass

Keywords

  • Augmented reality
  • Eyeglasses removal
  • Mixed reality
  • Virtual try-on

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Kobayashi, T., Sugiura, Y., Saito, H., & Uema, Y. (2019). Automatic eyeglasses replacement for a 3d virtual try-on system. In Proceedings of the 10th Augmented Human International Conference, AH 2019 [a30] (ACM International Conference Proceeding Series). Association for Computing Machinery. https://doi.org/10.1145/3311823.3311854

Automatic eyeglasses replacement for a 3d virtual try-on system. / Kobayashi, Takumi; Sugiura, Yuta; Saito, Hideo; Uema, Yuji.

Proceedings of the 10th Augmented Human International Conference, AH 2019. Association for Computing Machinery, 2019. a30 (ACM International Conference Proceeding Series).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kobayashi, T, Sugiura, Y, Saito, H & Uema, Y 2019, Automatic eyeglasses replacement for a 3d virtual try-on system. in Proceedings of the 10th Augmented Human International Conference, AH 2019., a30, ACM International Conference Proceeding Series, Association for Computing Machinery, 10th Augmented Human International Conference, AH 2019, Reims, France, 19/3/11. https://doi.org/10.1145/3311823.3311854
Kobayashi T, Sugiura Y, Saito H, Uema Y. Automatic eyeglasses replacement for a 3d virtual try-on system. In Proceedings of the 10th Augmented Human International Conference, AH 2019. Association for Computing Machinery. 2019. a30. (ACM International Conference Proceeding Series). https://doi.org/10.1145/3311823.3311854
Kobayashi, Takumi ; Sugiura, Yuta ; Saito, Hideo ; Uema, Yuji. / Automatic eyeglasses replacement for a 3d virtual try-on system. Proceedings of the 10th Augmented Human International Conference, AH 2019. Association for Computing Machinery, 2019. (ACM International Conference Proceeding Series).
@inproceedings{180efda308fd404fb88c6ac4e50664d9,
title = "Automatic eyeglasses replacement for a 3d virtual try-on system",
abstract = "This paper presents a 3D virtual eyeglasses try-on system for practical use. For fitting eyeglasses in a shop, consumers wish to look at themselves in a mirror while trying on various eyeglass styles. However, for people who need to wear eyeglasses for correcting problems with eyesight, it is impossible for them to clearly observe their face in the mirror without wearing eyeglasses. This makes fitting them for new eyeglasses difficult. This research proposes a virtual try-on system that can be used while wearing eyeglasses.We replace the user's eyeglasses in the input video with new eyeglasses virtually. Moreover, a fast and accurate face tracking tool enables our system to automatically display 3D virtual glasses following a user's head motion. Experimental results demonstrate that the proposed method can render virtual glasses naturally while the user is wearing real eyeglasses.",
keywords = "Augmented reality, Eyeglasses removal, Mixed reality, Virtual try-on",
author = "Takumi Kobayashi and Yuta Sugiura and Hideo Saito and Yuji Uema",
year = "2019",
month = "3",
day = "11",
doi = "10.1145/3311823.3311854",
language = "English",
series = "ACM International Conference Proceeding Series",
publisher = "Association for Computing Machinery",
booktitle = "Proceedings of the 10th Augmented Human International Conference, AH 2019",

}

TY - GEN

T1 - Automatic eyeglasses replacement for a 3d virtual try-on system

AU - Kobayashi, Takumi

AU - Sugiura, Yuta

AU - Saito, Hideo

AU - Uema, Yuji

PY - 2019/3/11

Y1 - 2019/3/11

N2 - This paper presents a 3D virtual eyeglasses try-on system for practical use. For fitting eyeglasses in a shop, consumers wish to look at themselves in a mirror while trying on various eyeglass styles. However, for people who need to wear eyeglasses for correcting problems with eyesight, it is impossible for them to clearly observe their face in the mirror without wearing eyeglasses. This makes fitting them for new eyeglasses difficult. This research proposes a virtual try-on system that can be used while wearing eyeglasses.We replace the user's eyeglasses in the input video with new eyeglasses virtually. Moreover, a fast and accurate face tracking tool enables our system to automatically display 3D virtual glasses following a user's head motion. Experimental results demonstrate that the proposed method can render virtual glasses naturally while the user is wearing real eyeglasses.

AB - This paper presents a 3D virtual eyeglasses try-on system for practical use. For fitting eyeglasses in a shop, consumers wish to look at themselves in a mirror while trying on various eyeglass styles. However, for people who need to wear eyeglasses for correcting problems with eyesight, it is impossible for them to clearly observe their face in the mirror without wearing eyeglasses. This makes fitting them for new eyeglasses difficult. This research proposes a virtual try-on system that can be used while wearing eyeglasses.We replace the user's eyeglasses in the input video with new eyeglasses virtually. Moreover, a fast and accurate face tracking tool enables our system to automatically display 3D virtual glasses following a user's head motion. Experimental results demonstrate that the proposed method can render virtual glasses naturally while the user is wearing real eyeglasses.

KW - Augmented reality

KW - Eyeglasses removal

KW - Mixed reality

KW - Virtual try-on

UR - http://www.scopus.com/inward/record.url?scp=85062975911&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85062975911&partnerID=8YFLogxK

U2 - 10.1145/3311823.3311854

DO - 10.1145/3311823.3311854

M3 - Conference contribution

T3 - ACM International Conference Proceeding Series

BT - Proceedings of the 10th Augmented Human International Conference, AH 2019

PB - Association for Computing Machinery

ER -