AffectiveNemo: Promoting owner-fish interaction by displaying observed fish emotion with speech bubble

Naohiro Isokawa, Tadashi Okoshi, Jin Nakazawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Aquarium fish is one of the most common household companion animals for humans. Keeping and appreciating aquarium fish enriches us and provides comfort to our lives. However, difficulty in communicating and understanding their fish may negatively impact the person's motivation to continuously take care of their fish. In order to enhance human-fish interaction, we propose “AffectiveNemo”, an ACI system for aquarium fish, that estimates and displays “observed emotion” (defined as fish's emotional states that the system estimates based on observations by humans), via speech bubbles shown on an LCD display placed behind the aquarium. The system estimates the observed emotion by analyzing the movement of the fish in the aquarium, and combining this data along with the emotions that the humans perceive the fish to have. We evaluated the accuracy of each module as a preliminary experiment, conducted a user study on the influence of displaying observed emotion, and evaluated the utility of the system. Our findings concluded that the system can correctly detect the observed emotion, further enhance viewer sensitivity by displaying the observed emotion of aquarium fish that humans are perceptive, and promote the interest in aquarium fish.

Original languageEnglish
Title of host publicationACI 2019 - 6th International Conference on Animal-Computer Interaction
Subtitle of host publicationCommon Denominator, Proceedings
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450376938
DOIs
Publication statusPublished - 2019 Nov 12
Event6th International Conference on Animal-Computer Interaction: Common Denominator, ACI 2019 - Haifa, Israel
Duration: 2019 Nov 122019 Nov 14

Publication series

NameACM International Conference Proceeding Series

Conference

Conference6th International Conference on Animal-Computer Interaction: Common Denominator, ACI 2019
CountryIsrael
CityHaifa
Period19/11/1219/11/14

    Fingerprint

Keywords

  • Aquarium Fish
  • Companion Animal

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Isokawa, N., Okoshi, T., & Nakazawa, J. (2019). AffectiveNemo: Promoting owner-fish interaction by displaying observed fish emotion with speech bubble. In ACI 2019 - 6th International Conference on Animal-Computer Interaction: Common Denominator, Proceedings [3371067] (ACM International Conference Proceeding Series). Association for Computing Machinery. https://doi.org/10.1145/3371049.3371067