Vision-Based Remote Control System by Motion Detection and Open Finger Counting

Vision-Based Remote Control System by Motion Detection and Open Finger Counting


In this paper, we present a universal remote control system based on computer vision. The method is composed of two stages of detecting visual evidences. Motion and skin color information is utilized to detect waving hands requesting control commands. Upon the request, the camera is controlled to zoom in on local region of the hand. The number of open fingers is counted by the shape analysis on the segmented hand region image. Control command is issued when a predetermined sequence of gesture state transition is produced. Experimental results show that the shape of open fingers exhibits strong features for determining correct gesture states. The use of stable features on consecutive frames yields robust and accurate performance regardless of operating conditions.


Existing System:

An integrated and more convenient means has been devised to replace the existing remote control system (RCS). Voice or gesture recognition has been recently adopted to implement the universal RCS. Voice recognition, however, may fail to provide robust performance because of the speaker variation and surrounding noise. RCSs using gloves or markers are based on the gesture recognition. They may provide accurate control performance, but the use of the gloves or markers makes the users uncomfortable. More natural way to use human actions is required for commercially worthy RCS. Vision-based approaches to recognize the hand   gestures or postures, may be exemplified.

Proposed System:

The open fingers are detected using the boundary analysis on hand regions. The gesture state is determined when the number of open fingers is found to be stable at consecutive frames. Control commands can be defined by a set of state transitions. The processing speed is fast enough for real-time operation.