Abstract
This project, Virtual Mouse Using Hand Gestures, introduces a touchless
human-computer interaction system that replaces conventional mouse
devices with vision-based gesture control. Using a standard webcam, hand
movements are detected and tracked in real time through OpenCV,
MediaPipe, and PyAutoGUI, enabling cursor movement and mouse
functions such as clicking and scrolling. Developed in Python with open-
source tools, the system is cost-effective, hygienic, and accessible,
particularly beneficial in post-pandemic environments and for users with
physical challenges. The work highlights the potential of computer vision in
creating intuitive and user-friendly digital interaction systems.
Software & Hardware Requirements
Operating System: Windows, Linux Processor: Intel i5 or equivalent
Programming Languages: Python RAM: 8 GB
Libraries: OpenCV, MediaPipe, Storage: 256 GB SSD
AutoPy Display: HD webcam, Monitor
IDE/Tools: VS Code, PyCharm
Modules
Camera Input Module
The webcam captures live video frames of the user’s hand.
This acts as the primary input source for the system.
Hand Detection Module
Detects the presence of the hand in each frame.
Tracks key landmarks such as fingers and palm using OpenCV / Mediapipe.
Gesture Recognition Module
Interprets the detected hand shapes and finger positions.
Maps them to specific gestures like move, click, or scroll.
Cursor Control Module
Converts hand coordinates into screen coordinates.
Controls the mouse pointer and actions using libraries like PyAutoGUI.
Output Module
Executes the recognized mouse operations (move, left click, right click, scroll, drag).
Provides real-time feedback on the computer screen
Data Flow Diagram
System Flow Diagram
UI Design
VIRTUAL MOUSE