Skip to content

zippynx/gesture-control-ai

Repository files navigation

๐Ÿค– Gesture Control AI

A futuristic AI-powered desktop controller that allows you to manage system volume, screen brightness, and act as a virtual mouse using real-time hand gestures. Built with Python, OpenCV, and MediaPipe.

โœจ Features

  • Multi-Mode System: Seamlessly switch between different control modes using keyboard triggers.
  • ๐Ÿ”Š Volume Control (Mode V): Adjust system volume by pinching your thumb and index finger.
  • โ˜€๏ธ Brightness Control (Mode B): Control screen brightness with the same intuitive pinch gesture.
  • ๐Ÿ–ฑ๏ธ Virtual Mouse (Mode M): Move your cursor using your index finger and click by pinching.
  • ๐Ÿ“ธ Quick Screenshot: Press S to take an instant screen capture of your workspace.
  • Interactive UI: Real-time visual feedback, FPS counter, and mode indicators drawn directly on the webcam feed.

๐Ÿ› ๏ธ Tech Stack

  • Python 3.x
  • OpenCV (cv2) - Computer vision and webcam frame processing
  • MediaPipe - Real-time advanced hand tracking and landmark detection
  • Pycaw & Comtypes - Windows system audio manipulation
  • Screen-Brightness-Control - Multi-monitor brightness adjustment
  • PyAutoGUI - Virtual mouse movement and automated clicks
  • NumPy & Math - Coordinate interpolation and distance calculation

๐Ÿ“ Project Structure

gesture-control-ai/
โ”‚
โ”œโ”€โ”€ main.py                 # Main application loop and mode logic
โ”œโ”€โ”€ hand_tracker.py         # MediaPipe hand tracking module
โ”œโ”€โ”€ volume_controller.py    # Pycaw volume integration
โ”œโ”€โ”€ brightness_control.py   # System brightness integration
โ”œโ”€โ”€ virtual_mouse.py        # PyAutoGUI mouse mapping
โ”œโ”€โ”€ gesture_actions.py      # Quick actions (screenshots, etc.)
โ”œโ”€โ”€ requirements.txt        # Dependencies
โ””โ”€โ”€ README.md

โš™๏ธ Installation

  1. Clone this repository:

    git clone https://github.com/YOUR_USERNAME/gesture-control-ai.git
    cd gesture-control-ai
  2. Create and activate a virtual environment (optional but recommended):

    python -m venv venv
    # On Windows:
    venv\Scripts\activate
    # On macOS/Linux:
    source venv/bin/activate
  3. Install the required dependencies:

    pip install -r requirements.txt

๐ŸŽฎ How to Use

  1. Run the main script:

    python main.py
  2. Make sure your hand is visible to the webcam.

  3. Press the following keys to change modes:

    • V - Switch to Volume Mode
    • B - Switch to Brightness Mode
    • M - Switch to Virtual Mouse Mode
    • S - Take a Screenshot
    • Q - Quit the application

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages