Human Computer Interaction Employing Hand Gestures in Lieu of Mouse Movements

Abstract

After the advent of computers, we have come to the stage where we can’t imagine a day without interacting with the computers. When the computer interaction is playing such an important role, it would not be wise if we don’t try to enhance the way we interact with the computer. So, the mechanism we propose helps to enhance the way we interact with the computer without any aid from any external device. The proposed system uses the webcam of the computer system to take the hand gestures as input and the cursor responds accordingly. Vision based approach is used for the skin detection. To reduce the effect of illumination on the image, HSV color space is used in the proposed design. The edge detection technique is used for the counter extraction process. Now a bounding rectangle is drawn so as to find the center of the hand. As the center of the hand moves, the cursor moves. To detect the gestures from the hand the fingers are to be recognized. This be done with the help of function like cvConvexityDefects() in openCV. Thus, with the help of two gestures right and left clicks can be preformed.