Tactile logging for understanding plausible tool use based on human demonstration

Shuichi Akizuki, Yoshimitsu Aoki

    Research output: Contribution to conferencePaper

    1 Citation (Scopus)

    Abstract

    In this paper, we propose a novel human-object interaction (HOI) representation for understanding plausible tool use; this is done by using an object-centric method. Everyday tools (such as kitchen or DIY utensils) have the ideal region and direction for being touched by hands and surrounding objects. By analyzing the human demonstrations, tactile histories that occurred on the tools are accumulated to the tool's surface as the "Tactile Log", which can help to achieve the plausible tool use by robot arms. We also proposed a dataset for the evaluation of generated tactile logs, which is called the Object-Centric Interaction (OCI) dataset consists of RGB-D videos of plausible tool use by human and 3D models of the tools used in the videos. We confirm that the precision of our tactile logging is 0.77.

    Original languageEnglish
    Publication statusPublished - 2019 Jan 1
    Event29th British Machine Vision Conference, BMVC 2018 - Newcastle, United Kingdom
    Duration: 2018 Sep 32018 Sep 6

    Conference

    Conference29th British Machine Vision Conference, BMVC 2018
    CountryUnited Kingdom
    CityNewcastle
    Period18/9/318/9/6

    ASJC Scopus subject areas

    • Computer Vision and Pattern Recognition

    Fingerprint Dive into the research topics of 'Tactile logging for understanding plausible tool use based on human demonstration'. Together they form a unique fingerprint.

  • Cite this

    Akizuki, S., & Aoki, Y. (2019). Tactile logging for understanding plausible tool use based on human demonstration. Paper presented at 29th British Machine Vision Conference, BMVC 2018, Newcastle, United Kingdom.