3-D drawing system via hand motion recognition from two cameras

In this paper, we propose a new human interface system, 3-D Drawing System, which allows a user to draw on virtual 3-D space in computer with user's hand motions and hand poses. This system has two cameras; one camera takes top-view of the desktop and another takes side-view. The input image of the top camera is transformed into the distance-transformed image, which is used for deciding Palm Square that gives the base size, position, and direction of hand. The Palm Square determines Finger Windows which are used for detecting each finger's expansion that is decided by the number of pixels in the Finger Window. The user's command is inputted to the system by the finger's expansion. At the same time, we extract the fingertip and estimate the 3-D position by comparing with the image obtained with side camera. Those procedures are very simple so that we can develop the real time 3D drawing system, which makes user draw figures in 3D space, and handle 3D virtual objects.