GestureWave: Hands-Free Human-Computer Interaction

Virtual Gesture Interface: Streamlined Human-Computer Interaction Through Hand Gestures and Voice Commands. This innovative system enables users to control their computers without physical contact, utilizing advanced Machine Learning and Computer Vision technologies to interpret both static and dynamic hand gestures alongside voice commands. Leveraging cutting-edge algorithms like CNN implemented through MediaPipe and pybind11, the platform seamlessly integrates two modules: one focusing on direct hand detection using MediaPipe Hand detection, and the other utilizing gloves of any consistent color. Currently compatible with Windows platforms, this project eliminates the need for additional hardware while providing intuitive control over input/output operations

Note: Use Python version: 3.8.5

Features

Gesture Recognition:

Neutral Gesture

Neutral Gesture. Used to halt/stop execution of current gesture.

Move Cursor

Cursor is assigned to the midpoint of index and middle fingertips. This gesture moves the cursor to the desired location. Speed of the cursor movement is proportional to the speed of hand.

Left Click

Gesture for single left click

Right Click

Gesture for single right click

Double Click

Gesture for double click

Scrolling

Dynamic Gestures for horizontal and vertical scroll. The speed of scroll is proportional to the distance moved by pinch gesture from start point. Vertical and Horizontal scrolls are controlled by vertical and horizontal pinch movements respectively.

Drag and Drop

Gesture for drag and drop functionality. Can be used to move/tranfer files from one directory to other.

Multiple Item Selection

Gesture to select multiple items

Volume Control

Dynamic Gestures for Volume control. The rate of increase/decrease of volume is proportional to the distance moved by pinch gesture from start point.

Brightness Control

Dynamic Gestures for Brightness control. The rate of increase/decrease of brightness is proportional to the distance moved by pinch gesture from start point.