Eating and drinking recognition via integrated information of head directions and joint positions in a group

Naoto Ienaga, Yuko Ozasa, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Recent years have seen the introduction of service robots as waiters or waitresses in restaurants and cafes. In such venues, it is common for customers to visit in groups as well as for them to engage in conversation while eating and drinking. It is important for cyber serving staff to understand whether they are eating and drinking, or not, in order to wait on tables at appropriate times. In this paper, we present a method by which the robots can recognize eating and drinking actions performed by individuals in a group. Our approach uses the positions of joints in the human body as a feature and long short-term memory to achieve a recognition task on time-series data. We also used head directions in our method, as we assumed that it is effective for recognition in a group. The information garnered from head directions and joint positions is integrated via logistic regression and employed in recognition. The results show that this yielded the highest accuracy and effectiveness of the robots' tasks.

Original languageEnglish
Title of host publicationICPRAM 2017 - Proceedings of the 6th International Conference on Pattern Recognition Applications and Methods
EditorsMaria De De Marsico, Gabriella Sanniti di Baja, Ana Fred
PublisherSciTePress
Pages527-533
Number of pages7
ISBN (Electronic)9789897582226
DOIs
Publication statusPublished - 2017
Event6th International Conference on Pattern Recognition Applications and Methods, ICPRAM 2017 - Porto, Portugal
Duration: 2017 Feb 242017 Feb 26

Publication series

NameICPRAM 2017 - Proceedings of the 6th International Conference on Pattern Recognition Applications and Methods
Volume2017-January

Other

Other6th International Conference on Pattern Recognition Applications and Methods, ICPRAM 2017
CountryPortugal
CityPorto
Period17/2/2417/2/26

Keywords

  • Action recognition
  • Information fusion
  • Long short-term memory

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Eating and drinking recognition via integrated information of head directions and joint positions in a group'. Together they form a unique fingerprint.

  • Cite this

    Ienaga, N., Ozasa, Y., & Saito, H. (2017). Eating and drinking recognition via integrated information of head directions and joint positions in a group. In M. D. De Marsico, G. S. di Baja, & A. Fred (Eds.), ICPRAM 2017 - Proceedings of the 6th International Conference on Pattern Recognition Applications and Methods (pp. 527-533). (ICPRAM 2017 - Proceedings of the 6th International Conference on Pattern Recognition Applications and Methods; Vol. 2017-January). SciTePress. https://doi.org/10.5220/0006200305270533