Grasping Point Estimation Based on Stored Motion and Depth Data in Motion Reproduction System

Xiaobai Sun, Takahiro Nozaki, Toshiyuki Murakami, Kouhei Ohnishi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Most countries are running shortage of working force due to the aging population and reduction in the birthrate. Robot manipulators are expected to replace human work. However, it it still difficult for manipulators to do simple tasks such as fruit harvesting, foods cooking or toy assembling. A problem for robotic automation arise in the difficulty in teaching how much force manipulators should use for a task execution. Motion reproduction system, which uses bilateral control to store motion data, is one of a method to teach manipulators motion including position and force. The problem concerning motion reproduction system is that the motion reproducing fails if environment is changed between motion saving phase and motion reproducing phase. Motion reproduction system which can understand and adapt to environment is required. Vision sensor can sense environment. Computer vision is mainly focus on how to classify objects. Vision information is seldom combined with motion control especially force motion. Therefore, I propose a motion reproduction system in which reproduced motion is decided based on several motions and collected depth data. Convolutional Neural Network(CNN) was used to estimate a motion command from a depth image. Saved force data was used to generate labels for training. The label decision is different from conventional Machine learning alzorithm.

Original languageEnglish
Title of host publicationProceedings - 2019 IEEE International Conference on Mechatronics, ICM 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages471-476
Number of pages6
ISBN (Electronic)9781538669594
DOIs
Publication statusPublished - 2019 May 24
Event2019 IEEE International Conference on Mechatronics, ICM 2019 - Ilmenau, Germany
Duration: 2019 Mar 182019 Mar 20

Publication series

NameProceedings - 2019 IEEE International Conference on Mechatronics, ICM 2019

Conference

Conference2019 IEEE International Conference on Mechatronics, ICM 2019
CountryGermany
CityIlmenau
Period19/3/1819/3/20

Keywords

  • bilateral control
  • image processing
  • motion control
  • motion reproduction

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction
  • Automotive Engineering
  • Mechanical Engineering
  • Control and Optimization
  • Industrial and Manufacturing Engineering

Fingerprint Dive into the research topics of 'Grasping Point Estimation Based on Stored Motion and Depth Data in Motion Reproduction System'. Together they form a unique fingerprint.

  • Cite this

    Sun, X., Nozaki, T., Murakami, T., & Ohnishi, K. (2019). Grasping Point Estimation Based on Stored Motion and Depth Data in Motion Reproduction System. In Proceedings - 2019 IEEE International Conference on Mechatronics, ICM 2019 (pp. 471-476). [8722836] (Proceedings - 2019 IEEE International Conference on Mechatronics, ICM 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICMECH.2019.8722836