Automatic eyeglasses replacement for a 3d virtual try-on system

Takumi Kobayashi, Yuta Sugiura, Hideo Saito, Yuji Uema

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a 3D virtual eyeglasses try-on system for practical use. For fitting eyeglasses in a shop, consumers wish to look at themselves in a mirror while trying on various eyeglass styles. However, for people who need to wear eyeglasses for correcting problems with eyesight, it is impossible for them to clearly observe their face in the mirror without wearing eyeglasses. This makes fitting them for new eyeglasses difficult. This research proposes a virtual try-on system that can be used while wearing eyeglasses.We replace the user's eyeglasses in the input video with new eyeglasses virtually. Moreover, a fast and accurate face tracking tool enables our system to automatically display 3D virtual glasses following a user's head motion. Experimental results demonstrate that the proposed method can render virtual glasses naturally while the user is wearing real eyeglasses.

Original languageEnglish
Title of host publicationProceedings of the 10th Augmented Human International Conference, AH 2019
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450365475
DOIs
Publication statusPublished - 2019 Mar 11
Event10th Augmented Human International Conference, AH 2019 - Reims, France
Duration: 2019 Mar 112019 Mar 12

Publication series

NameACM International Conference Proceeding Series

Conference

Conference10th Augmented Human International Conference, AH 2019
CountryFrance
CityReims
Period19/3/1119/3/12

Keywords

  • Augmented reality
  • Eyeglasses removal
  • Mixed reality
  • Virtual try-on

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Fingerprint Dive into the research topics of 'Automatic eyeglasses replacement for a 3d virtual try-on system'. Together they form a unique fingerprint.

  • Cite this

    Kobayashi, T., Sugiura, Y., Saito, H., & Uema, Y. (2019). Automatic eyeglasses replacement for a 3d virtual try-on system. In Proceedings of the 10th Augmented Human International Conference, AH 2019 [a30] (ACM International Conference Proceeding Series). Association for Computing Machinery. https://doi.org/10.1145/3311823.3311854