Give me a hand - How users ask a robotic arm for help with gestures

Mahisorn Wongphati, Yusuke Kanai, Hirotaka Osawa, Michita Imai

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

A task that requires two hands to perform such as soldering usually needs additional tools for holding (e.g. a cable) or adding (e.g. solder) an object to a specific position. A robotic manipulator or robotic arm is one of the solution for this requirement. When gesture is selected as a method for controlling a robot, characteristics of gestures are needed for designing and developing a gesture recognition system. With this requirement, we conducted an experiment to obtain a set of userdefined gestures in the soldering task to find out properties and patterns of a gesture for future development of our research. 152 gestures were collected from 19 participants by presenting the "effect" of the gesture (robotic arm movement), and then asking the participants to perform its "cause" (a user-defined gesture). The analyzed data shows that hands are the most used body parts even they are occupied by the task, that one-hand and two-hands gestures were used interchangeably by the participants, that the majority of the participants performed reversible gestures for reversible movements, and that the participants were expecting for better recognition performance on an easier to plan gesture. Our finding can be useful as a guideline for creating gesture set and system for controlling robotic arms based on natural behavior of users.

Original languageEnglish
Title of host publicationProceedings - 2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems, CYBER 2012
PublisherIEEE Computer Society
Pages64-68
Number of pages5
ISBN (Print)9781467314213
DOIs
Publication statusPublished - 2012
Event2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems, CYBER 2012 - Bangkok, Thailand
Duration: 2012 May 272012 May 31

Other

Other2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems, CYBER 2012
CountryThailand
CityBangkok
Period12/5/2712/5/31

Fingerprint

Robotic arms
End effectors
Soldering
Gesture recognition
Soldering alloys
Manipulators
Cables
Robotics
Robots
Experiments

ASJC Scopus subject areas

  • Artificial Intelligence
  • Control and Systems Engineering

Cite this

Wongphati, M., Kanai, Y., Osawa, H., & Imai, M. (2012). Give me a hand - How users ask a robotic arm for help with gestures. In Proceedings - 2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems, CYBER 2012 (pp. 64-68). [6392528] IEEE Computer Society. https://doi.org/10.1109/CYBER.2012.6392528

Give me a hand - How users ask a robotic arm for help with gestures. / Wongphati, Mahisorn; Kanai, Yusuke; Osawa, Hirotaka; Imai, Michita.

Proceedings - 2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems, CYBER 2012. IEEE Computer Society, 2012. p. 64-68 6392528.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Wongphati, M, Kanai, Y, Osawa, H & Imai, M 2012, Give me a hand - How users ask a robotic arm for help with gestures. in Proceedings - 2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems, CYBER 2012., 6392528, IEEE Computer Society, pp. 64-68, 2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems, CYBER 2012, Bangkok, Thailand, 12/5/27. https://doi.org/10.1109/CYBER.2012.6392528
Wongphati M, Kanai Y, Osawa H, Imai M. Give me a hand - How users ask a robotic arm for help with gestures. In Proceedings - 2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems, CYBER 2012. IEEE Computer Society. 2012. p. 64-68. 6392528 https://doi.org/10.1109/CYBER.2012.6392528
Wongphati, Mahisorn ; Kanai, Yusuke ; Osawa, Hirotaka ; Imai, Michita. / Give me a hand - How users ask a robotic arm for help with gestures. Proceedings - 2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems, CYBER 2012. IEEE Computer Society, 2012. pp. 64-68
@inproceedings{569b8cec01de4d0ba3c1869f19373d19,
title = "Give me a hand - How users ask a robotic arm for help with gestures",
abstract = "A task that requires two hands to perform such as soldering usually needs additional tools for holding (e.g. a cable) or adding (e.g. solder) an object to a specific position. A robotic manipulator or robotic arm is one of the solution for this requirement. When gesture is selected as a method for controlling a robot, characteristics of gestures are needed for designing and developing a gesture recognition system. With this requirement, we conducted an experiment to obtain a set of userdefined gestures in the soldering task to find out properties and patterns of a gesture for future development of our research. 152 gestures were collected from 19 participants by presenting the {"}effect{"} of the gesture (robotic arm movement), and then asking the participants to perform its {"}cause{"} (a user-defined gesture). The analyzed data shows that hands are the most used body parts even they are occupied by the task, that one-hand and two-hands gestures were used interchangeably by the participants, that the majority of the participants performed reversible gestures for reversible movements, and that the participants were expecting for better recognition performance on an easier to plan gesture. Our finding can be useful as a guideline for creating gesture set and system for controlling robotic arms based on natural behavior of users.",
author = "Mahisorn Wongphati and Yusuke Kanai and Hirotaka Osawa and Michita Imai",
year = "2012",
doi = "10.1109/CYBER.2012.6392528",
language = "English",
isbn = "9781467314213",
pages = "64--68",
booktitle = "Proceedings - 2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems, CYBER 2012",
publisher = "IEEE Computer Society",

}

TY - GEN

T1 - Give me a hand - How users ask a robotic arm for help with gestures

AU - Wongphati, Mahisorn

AU - Kanai, Yusuke

AU - Osawa, Hirotaka

AU - Imai, Michita

PY - 2012

Y1 - 2012

N2 - A task that requires two hands to perform such as soldering usually needs additional tools for holding (e.g. a cable) or adding (e.g. solder) an object to a specific position. A robotic manipulator or robotic arm is one of the solution for this requirement. When gesture is selected as a method for controlling a robot, characteristics of gestures are needed for designing and developing a gesture recognition system. With this requirement, we conducted an experiment to obtain a set of userdefined gestures in the soldering task to find out properties and patterns of a gesture for future development of our research. 152 gestures were collected from 19 participants by presenting the "effect" of the gesture (robotic arm movement), and then asking the participants to perform its "cause" (a user-defined gesture). The analyzed data shows that hands are the most used body parts even they are occupied by the task, that one-hand and two-hands gestures were used interchangeably by the participants, that the majority of the participants performed reversible gestures for reversible movements, and that the participants were expecting for better recognition performance on an easier to plan gesture. Our finding can be useful as a guideline for creating gesture set and system for controlling robotic arms based on natural behavior of users.

AB - A task that requires two hands to perform such as soldering usually needs additional tools for holding (e.g. a cable) or adding (e.g. solder) an object to a specific position. A robotic manipulator or robotic arm is one of the solution for this requirement. When gesture is selected as a method for controlling a robot, characteristics of gestures are needed for designing and developing a gesture recognition system. With this requirement, we conducted an experiment to obtain a set of userdefined gestures in the soldering task to find out properties and patterns of a gesture for future development of our research. 152 gestures were collected from 19 participants by presenting the "effect" of the gesture (robotic arm movement), and then asking the participants to perform its "cause" (a user-defined gesture). The analyzed data shows that hands are the most used body parts even they are occupied by the task, that one-hand and two-hands gestures were used interchangeably by the participants, that the majority of the participants performed reversible gestures for reversible movements, and that the participants were expecting for better recognition performance on an easier to plan gesture. Our finding can be useful as a guideline for creating gesture set and system for controlling robotic arms based on natural behavior of users.

UR - http://www.scopus.com/inward/record.url?scp=84907300922&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84907300922&partnerID=8YFLogxK

U2 - 10.1109/CYBER.2012.6392528

DO - 10.1109/CYBER.2012.6392528

M3 - Conference contribution

SN - 9781467314213

SP - 64

EP - 68

BT - Proceedings - 2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems, CYBER 2012

PB - IEEE Computer Society

ER -