TY - GEN
T1 - Automatic eyeglasses replacement for a 3d virtual try-on system
AU - Kobayashi, Takumi
AU - Sugiura, Yuta
AU - Saito, Hideo
AU - Uema, Yuji
N1 - Funding Information:
This work was supported by JST AIP-PRISM Grant Number JP-MJCR18Y2, JAPAN.
Publisher Copyright:
©2019 Association for Computing Machinery.
PY - 2019/3/11
Y1 - 2019/3/11
N2 - This paper presents a 3D virtual eyeglasses try-on system for practical use. For fitting eyeglasses in a shop, consumers wish to look at themselves in a mirror while trying on various eyeglass styles. However, for people who need to wear eyeglasses for correcting problems with eyesight, it is impossible for them to clearly observe their face in the mirror without wearing eyeglasses. This makes fitting them for new eyeglasses difficult. This research proposes a virtual try-on system that can be used while wearing eyeglasses.We replace the user's eyeglasses in the input video with new eyeglasses virtually. Moreover, a fast and accurate face tracking tool enables our system to automatically display 3D virtual glasses following a user's head motion. Experimental results demonstrate that the proposed method can render virtual glasses naturally while the user is wearing real eyeglasses.
AB - This paper presents a 3D virtual eyeglasses try-on system for practical use. For fitting eyeglasses in a shop, consumers wish to look at themselves in a mirror while trying on various eyeglass styles. However, for people who need to wear eyeglasses for correcting problems with eyesight, it is impossible for them to clearly observe their face in the mirror without wearing eyeglasses. This makes fitting them for new eyeglasses difficult. This research proposes a virtual try-on system that can be used while wearing eyeglasses.We replace the user's eyeglasses in the input video with new eyeglasses virtually. Moreover, a fast and accurate face tracking tool enables our system to automatically display 3D virtual glasses following a user's head motion. Experimental results demonstrate that the proposed method can render virtual glasses naturally while the user is wearing real eyeglasses.
KW - Augmented reality
KW - Eyeglasses removal
KW - Mixed reality
KW - Virtual try-on
UR - http://www.scopus.com/inward/record.url?scp=85062975911&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85062975911&partnerID=8YFLogxK
U2 - 10.1145/3311823.3311854
DO - 10.1145/3311823.3311854
M3 - Conference contribution
AN - SCOPUS:85062975911
T3 - ACM International Conference Proceeding Series
BT - Proceedings of the 10th Augmented Human International Conference, AH 2019
PB - Association for Computing Machinery
T2 - 10th Augmented Human International Conference, AH 2019
Y2 - 11 March 2019 through 12 March 2019
ER -