TY - JOUR
T1 - Visual attribute manipulation using natural language commands
AU - Kasai, Seito
AU - Akimoto, Naofumi
AU - Hayashi, Masaki
AU - Aoki, Yoshimitsu
N1 - Publisher Copyright:
© 2019 Japan Society for Precision Engineering. All rights reserved.
PY - 2019
Y1 - 2019
N2 - In this paper, a novel setting is tackled in which a neural network generates object images with transferred attributes, by conditioning on natural language commands. Conventional methods for object image transformation have used visual attributes, which are components that describe the object's color, posture, etc. This paper builds on this approach and finds an algorithm to precisely extract information from natural language commands, which transfers the attributes of an image and completes this image translation model. The effectiveness of our information extraction model is experimented, with additional tests to see if the change in visual attributes is correctly seen in the image.
AB - In this paper, a novel setting is tackled in which a neural network generates object images with transferred attributes, by conditioning on natural language commands. Conventional methods for object image transformation have used visual attributes, which are components that describe the object's color, posture, etc. This paper builds on this approach and finds an algorithm to precisely extract information from natural language commands, which transfers the attributes of an image and completes this image translation model. The effectiveness of our information extraction model is experimented, with additional tests to see if the change in visual attributes is correctly seen in the image.
KW - Computer vision
KW - Convolutional neural network
KW - Generative adversarial network
KW - Human computer interaction
KW - Image editing
KW - Image generation
KW - Natural language processing
KW - Word2vec
UR - http://www.scopus.com/inward/record.url?scp=85077632262&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85077632262&partnerID=8YFLogxK
U2 - 10.2493/jjspe.85.1102
DO - 10.2493/jjspe.85.1102
M3 - Article
AN - SCOPUS:85077632262
SN - 0912-0289
VL - 85
SP - 1102
EP - 1109
JO - Seimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering
JF - Seimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering
IS - 12
ER -