Eye-to-hand approach on eye-in-hand configuration within real-time visual servoing

Abdul Muis, Kouhei Ohnishi

Research output: Contribution to journalArticle

38 Citations (Scopus)

Abstract

This paper presents a framework of hand-eye relation for visual servoing with more precision, mobility, and global view. Mainly, there are two types of camera utilization for visual servoing: eye-in-hand and eye-to-hand configurations. Both have own merits and drawbacks regarding to precision and view limit that oppose each other. Based on both behaviors, this paper employs a mobile manipulator as the second robot to hold the camera. Here, the camera architecture is eye-to-hand configuration for the main robot, but mainly behaves as eye-in-hand configuration for the second robot. Having this framework, the drawback of each configuration is resolved by the benefit of the other. Here, the camera becomes mobile with more precision and global view. In addition, since there is no additional camera, the vision algorithm can be kept simple. In order to gain real-time visual servoing, this paper also addresses real-time constraints on vision system and data communication between robot and vision. Here, a hexagon pattern of artificial marker with a simplified image processing is developed. A grasp positioning problem is considered with position-based dynamic look and move visual control through object pose estimation. The system performance is validated by the experimental result.

Original languageEnglish
Pages (from-to)404-410
Number of pages7
JournalIEEE/ASME Transactions on Mechatronics
Volume10
Issue number4
DOIs
Publication statusPublished - 2005 Aug

Fingerprint

Visual servoing
Cameras
Robots
End effectors
Manipulators
Image processing
Communication

Keywords

  • Hand-eye configuration
  • Manipulator
  • Mobile robots
  • Robot vision systems

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Electrical and Electronic Engineering
  • Industrial and Manufacturing Engineering
  • Mechanical Engineering

Cite this

Eye-to-hand approach on eye-in-hand configuration within real-time visual servoing. / Muis, Abdul; Ohnishi, Kouhei.

In: IEEE/ASME Transactions on Mechatronics, Vol. 10, No. 4, 08.2005, p. 404-410.

Research output: Contribution to journalArticle

@article{dc05e5ae42a74e9d823374ec4b9923c2,
title = "Eye-to-hand approach on eye-in-hand configuration within real-time visual servoing",
abstract = "This paper presents a framework of hand-eye relation for visual servoing with more precision, mobility, and global view. Mainly, there are two types of camera utilization for visual servoing: eye-in-hand and eye-to-hand configurations. Both have own merits and drawbacks regarding to precision and view limit that oppose each other. Based on both behaviors, this paper employs a mobile manipulator as the second robot to hold the camera. Here, the camera architecture is eye-to-hand configuration for the main robot, but mainly behaves as eye-in-hand configuration for the second robot. Having this framework, the drawback of each configuration is resolved by the benefit of the other. Here, the camera becomes mobile with more precision and global view. In addition, since there is no additional camera, the vision algorithm can be kept simple. In order to gain real-time visual servoing, this paper also addresses real-time constraints on vision system and data communication between robot and vision. Here, a hexagon pattern of artificial marker with a simplified image processing is developed. A grasp positioning problem is considered with position-based dynamic look and move visual control through object pose estimation. The system performance is validated by the experimental result.",
keywords = "Hand-eye configuration, Manipulator, Mobile robots, Robot vision systems",
author = "Abdul Muis and Kouhei Ohnishi",
year = "2005",
month = "8",
doi = "10.1109/TMECH.2005.852397",
language = "English",
volume = "10",
pages = "404--410",
journal = "IEEE/ASME Transactions on Mechatronics",
issn = "1083-4435",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "4",

}

TY - JOUR

T1 - Eye-to-hand approach on eye-in-hand configuration within real-time visual servoing

AU - Muis, Abdul

AU - Ohnishi, Kouhei

PY - 2005/8

Y1 - 2005/8

N2 - This paper presents a framework of hand-eye relation for visual servoing with more precision, mobility, and global view. Mainly, there are two types of camera utilization for visual servoing: eye-in-hand and eye-to-hand configurations. Both have own merits and drawbacks regarding to precision and view limit that oppose each other. Based on both behaviors, this paper employs a mobile manipulator as the second robot to hold the camera. Here, the camera architecture is eye-to-hand configuration for the main robot, but mainly behaves as eye-in-hand configuration for the second robot. Having this framework, the drawback of each configuration is resolved by the benefit of the other. Here, the camera becomes mobile with more precision and global view. In addition, since there is no additional camera, the vision algorithm can be kept simple. In order to gain real-time visual servoing, this paper also addresses real-time constraints on vision system and data communication between robot and vision. Here, a hexagon pattern of artificial marker with a simplified image processing is developed. A grasp positioning problem is considered with position-based dynamic look and move visual control through object pose estimation. The system performance is validated by the experimental result.

AB - This paper presents a framework of hand-eye relation for visual servoing with more precision, mobility, and global view. Mainly, there are two types of camera utilization for visual servoing: eye-in-hand and eye-to-hand configurations. Both have own merits and drawbacks regarding to precision and view limit that oppose each other. Based on both behaviors, this paper employs a mobile manipulator as the second robot to hold the camera. Here, the camera architecture is eye-to-hand configuration for the main robot, but mainly behaves as eye-in-hand configuration for the second robot. Having this framework, the drawback of each configuration is resolved by the benefit of the other. Here, the camera becomes mobile with more precision and global view. In addition, since there is no additional camera, the vision algorithm can be kept simple. In order to gain real-time visual servoing, this paper also addresses real-time constraints on vision system and data communication between robot and vision. Here, a hexagon pattern of artificial marker with a simplified image processing is developed. A grasp positioning problem is considered with position-based dynamic look and move visual control through object pose estimation. The system performance is validated by the experimental result.

KW - Hand-eye configuration

KW - Manipulator

KW - Mobile robots

KW - Robot vision systems

UR - http://www.scopus.com/inward/record.url?scp=27144548503&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=27144548503&partnerID=8YFLogxK

U2 - 10.1109/TMECH.2005.852397

DO - 10.1109/TMECH.2005.852397

M3 - Article

AN - SCOPUS:27144548503

VL - 10

SP - 404

EP - 410

JO - IEEE/ASME Transactions on Mechatronics

JF - IEEE/ASME Transactions on Mechatronics

SN - 1083-4435

IS - 4

ER -