0% found this document useful (0 votes)
8 views13 pages

Gesture-Controlled Car Project Overview

Uploaded by

uttam3107sharma
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
8 views13 pages

Gesture-Controlled Car Project Overview

Uploaded by

uttam3107sharma
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

BMEE210L – Mechatronics and Measurement Systems

Course Project Review 2 Report


(Development & Midway Demonstration)

• Gesture-Controlled Car Project


• The rapid growth of automation and human–machine interaction has inspired
new ways to control machines beyond traditional switches and remotes. Gesture
control provides an intuitive and contactless method of interaction, making
systems more user-friendly and efficient. This project focuses on developing a
hand-gesture controlled car using an Arduino microcontroller, MPU6050 motion
sensor, and nRF24L01 wireless communication module.
• The MPU6050 sensor captures hand movements in terms of acceleration and
angular rotation, which are processed by the Arduino to interpret gestures.
These commands are transmitted wirelessly via the nRF24L01 module to the
receiver on the car, where another Arduino drives the motors accordingly.
• By combining motion sensing, embedded programming, and wireless
communication, this project aims to demonstrate a practical prototype of
gesture-based vehicle control. The system showcases potential applications in
assistive technologies, robotics, and smart automation, while addressing
challenges such as sensor calibration, wireless reliability, and real-time
responsiveness.

• · Team Name: THE ALCHEMIST

• · Member 1: UTTAM SHARMA , Reg. No.-23BME0057

• · Member 2: SUBRAMANYA HEGDE , Reg. No.-23BMA0004

• · Member 3: RACHIT TIKHE , Reg. No.-23BME0017

• Course & Code: BMEE210L – Mechatronics and Measurement Systems

• Faculty Mentor: Dr. Sathish G P

2. Abstract
Natural Interface

Intuitive control using natural hand movements eliminates the learning curve associated with
traditional remote controls. Users can immediately understand how to operate the system.

Accessibility

Gesture control provides alternative interaction methods for users with mobility limitations,
making technology more inclusive and accessible to diverse populations.

The advantages extend beyond convenience. Gesture control systems can operate in
environments where traditional interfaces fail, such as sterile medical settings, hazardous
industrial zones, or situations requiring hands-free operation. This technology bridges the gap
between human intention and machine response, creating more seamless interactions.

Our project will demonstrate these principles by building a responsive car that interprets hand
gestures in real-time, showcasing the potential for broader applications in autonomous
systems and smart technology integration.

The project addresses the need for more intuitive and contactless machine control, where
traditional joysticks or remotes may be less efficient. The solution is a hand-gesture
controlled car that interprets human gestures to drive vehicle movement.

The concept integrates an MPU6050 sensor to capture hand motions, an Arduino


microcontroller to process data, and an nRF24L01 wireless module to transmit commands
to the car. On the receiver side, the Arduino controls motors and chassis through a motor
driver circuit.

The methodology involves:

• Capturing real-time motion data from the MPU6050


• Filtering and mapping gestures into directional commands
• Sending these commands wirelessly to the car
• Driving actuators (DC motors) based on received instructions

So far, hardware components have been acquired, initial sensor calibration and motor testing
are in progress, and the wireless communication link has been established.

3. Introduction
Real-world Problem Addressed
Traditional remote control systems require physical interaction, making them less accessible
for individuals with physical limitations or in environments where contact should be
minimized (e.g., sterile medical zones, industrial automation settings). Furthermore, in fields
such as assistive robotics and personal mobility aids, intuitive control mechanisms are critical
for usability and adoption.

This prototype addresses the need for a more natural and accessible control system by
enabling a user to control a robotic car through simple hand movements without physical
contact.

Objectives of the Prototype

• To design and develop a robotic car that responds to real-time hand gestures for
directional movement.
• To integrate the MPU6050 motion sensor for capturing hand motion (acceleration and
orientation).
• To implement wireless communication using the nRF24L01 module to transmit
gesture data.
• To program an Arduino-based system that interprets gesture data and drives motors
accordingly.
• To validate system performance under basic test scenarios.

4. System Design and Development


4.1 Block Diagram / Concept Sketch

4.2 Hardware Components Acquired


Component Specification Function in System Status (Acquired/Testing)

MPU6050
Captures hand motion
Sensor(s) (Accelerometer Acquired & Calibrated
for gesture recognition
+ Gyroscope)

DC Geared
Drives the robotic car
Actuator(s) Motors (2/4- Acquired & Testing
based on control signals
wheel drive)

Arduino Uno / Processes sensor data


Microcontroller Acquired & Programmed
Arduino Nano and controls actuators

Sends gesture
nRF24L01
Communication commands wirelessly to Acquired & Configured
Wireless Module
the car

18650 Li-ion
Powers the car and
Power Supply Batteries (3.7V, Acquired
controller module
2500mAh)
4.3 Subsystem Assembly Progress

This image shows the partially assembled hardware setup of the hand-gesture
controlled car project. The wooden chassis holds four wheels and houses the main
electronic components. Mounted on the chassis are:

• An Arduino Uno microcontroller board connected with multiple jumper


wires.
• A motor driver module (likely an L298N or similar) positioned above the
Arduino to control the motors.
• Two 18650 lithium-ion batteries arranged in a holder to supply power to
the system.

The wiring connects the Arduino to the motor driver and batteries, preparing the
car for motor control. The setup appears neat and modular, suitable for further
integration with sensors like the MPU6050 and wireless modules for gesture
control.

Also visible around the car are tools and jumper wires, indicating ongoing
assembly and testing.

This image shows a compact electronics prototype board for the hand-gesture
controlled car system.

• It features an Arduino Nano microcontroller mounted on a perforated PCB


board.
• A wireless communication module (likely nRF24L01) is attached for
transmitting gesture data.
• An MPU6050 motion sensor breakout board is also mounted, used for
detecting hand movements via accelerometer and gyroscope data.
• The setup is powered by a single 18650 lithium-ion battery in a holder
connected by red and black wires.
• The red LEDs on the Arduino Nano and MPU6050 board indicate power
and operation status.
This setup represents the gesture capture and transmission unit, which senses
hand motion, processes data, and wirelessly sends control commands to the car.

Subsystem Assembly Progress

This image shows the partially assembled hardware setup of the hand-gesture controlled car
project. The wooden chassis holds four wheels and houses the main electronic components.
Mounted on the chassis are:

• An Arduino Uno microcontroller board connected with multiple jumper wires.


• A motor driver module (likely an L298N or similar) positioned above the Arduino to
control the motors.
• Two 18650 lithium-ion batteries arranged in a holder to supply power to the system.

The wiring connects the Arduino to the motor driver and batteries, preparing the car for motor
control. The setup appears neat and modular, suitable for further integration with sensors like
the MPU6050 and wireless modules for gesture control.

Also visible around the car are tools and jumper wires, indicating ongoing assembly and
testing.
This image shows a compact electronics prototype board for the hand-gesture controlled car
system.

• It features an Arduino Nano microcontroller mounted on a perforated PCB board.


• A wireless communication module (likely nRF24L01) is attached for transmitting
gesture data.
• An MPU6050 motion sensor breakout board is also mounted, used for detecting
hand movements via accelerometer and gyroscope data.
• The setup is powered by a single 18650 lithium-ion battery in a holder connected by
red and black wires.
• The red LEDs on the Arduino Nano and MPU6050 board indicate power and
operation status.

This setup represents the gesture capture and transmission unit, which senses hand motion,
processes data, and wirelessly sends control commands to the car.
5. Software Development
5.1 Initial Code Structure

CIRCUIT DIAGRAMS
Receiver Diagrams:-

Transmitter Diagram:-
RECEIVER-

TRANSMITTER-
In short: it shows the data flow from hand motion → sensing → wireless transmission
→ Arduino processing → motor control → car movement.

• Hand motion input is captured by the MPU6050 sensor (accelerometer +


gyroscope).
• The processed signals are sent via the transmitter to a receiver module.
• The receiver communicates with the Arduino Uno, which interprets the data.
• Based on the gestures, the Arduino sends commands to the motor driver.
• Finally, the motor driver controls the motors to achieve the expected movement
outcome of the car.

5.2 Demonstration Evidence

• Link to unlisted YouTube video: [Insert URL] self-explanatory


• Description of what the demo shows (e.g., sensor reads temperature, triggers fan
motor).

6. Troubleshooting and Iterative Development


• Sensor Noise & Drift
Challenge: MPU6050 readings are affected by noise and drift, leading to inaccurate
gesture detection.
Solution: Apply filtering techniques (e.g., Kalman/Complementary filter) and
periodic calibration to stabilize sensor data.
• Wireless Interference / Range Limitation
Challenge: nRF24L01 may face signal drops or limited range in certain
environments.
Solution: Use proper antenna placement, retries in communication, and consider
amplifiers or shielding for improved reliability.
• Latency in Response
Challenge: Delay between gesture input and car movement reduces responsiveness.
Solution: Optimize Arduino code for faster processing, minimize loop delays, and
streamline data packets.
• Power Management
Challenge: Motors and wireless modules drain power quickly, reducing runtime.
Solution: Use higher-capacity batteries, separate power supply for motors and logic,
and add voltage regulators for stability.
• Mechanical Stability
Challenge: Car may lose balance or traction at higher speeds.
Solution: Improve chassis design, ensure proper motor alignment, and balance weight
distribution.

7. Individual Contributions

Team Member Specific Role Progress Contribution`

UTTAM SHARMA Hardware Lead Sensor & Circuit Integration

SUBRAMANYA HEGDE System & Testing Lead Assembly & Validation

RACHIT TIKHE Software Lead Coding & Algorithm Development

8. Expected Outcomes (By Final Review)


• Optical Encoder Integration:
Add optical encoders to the wheels for real-time speed measurement and feedback
control, enabling smoother motion and precise navigation.
• Obstacle Detection Module:
Incorporate ultrasonic or infrared sensors for obstacle detection and collision
avoidance, improving safety and making the car more autonomous.
• Enhanced Gesture Recognition:
Implement advanced filtering or machine learning to reduce noise and improve
accuracy in interpreting hand gestures.
• Extended Wireless Range:
Upgrade communication setup to ensure stable operation over longer distances.

9. References
Mitra, S., & Acharya, T. (2007).
“Gesture Recognition: A Survey.”
IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews),
37(3), 311–324.
DOI: 10.1109/TSMCC.2007.893280
→ A comprehensive survey of gesture recognition technologies and methods..)

Common questions

Powered by AI

The architectural design of the gesture-controlled car is centered on modularity and performance efficiency. The car's wooden chassis is designed to hold and organize the main electronic components, including an Arduino microcontroller, motor driver module, and battery holder, achieving a neat and modular setup suitable for iterative development. The modular placement allows for easy integration and troubleshooting of components such as the MPU6050 sensor and nRF24L01 module. This design maximizes performance by ensuring balanced weight distribution and stable component connections, crucial for maintaining the car's mechanical stability and responsiveness during operation .

Gesture control technology enhances accessibility and usability by providing a contactless and intuitive control method that eliminates the need for physical interfaces, which can be challenging for individuals with mobility limitations. It allows for operation in environments where traditional controls may be impractical or unsafe, such as sterile medical settings or industrial zones where minimizing contact is essential. This alternative interaction method also broadens the potential for use in assistive technologies, improving the quality of life for disabled individuals by enabling natural and seamless machine control .

Arduino microcontrollers play a critical role in the gesture-controlled car project by acting as the central processing units that handle input from the MPU6050 sensor and interface with the wireless communication module. The first Arduino processes the raw sensor data, filtering and mapping them into gesture commands, which it then transmits wirelessly. Another Arduino, located on the car, receives these commands and converts them into motor control signals. This dual-Arduino architecture ensures prompt processing of data and effective control of the vehicle's movements based on user gestures .

The project highlights potential applications for gesture-controlled technology in assistive technologies, robotics, and smart automation. These applications are significant because they provide more intuitive and accessible interfaces for controlling machines, thereby enhancing usability for people with physical limitations. In robotics, gesture control can facilitate more natural human-robot interactions, while in smart automation, it can simplify tasks in environments where traditional controls are less effective, such as sterile medical settings or hands-free industrial operations. This broadens technological accessibility and fosters innovation in numerous fields .

The software system of the gesture-controlled car is designed to handle real-time data processing and efficient motor control. It involves initial code structures that manage the flow of data from the MPU6050 sensor to the processing and interpretation by the Arduino microcontroller. The code uses optimized algorithms to filter sensor noise and minimize latency, ensuring prompt and accurate gesture interpretation. It also incorporates streamlined communication protocols via the nRF24L01 module, facilitating uninterrupted data transmission to the car. This setup results in responsive motor control, as the Arduino efficiently translates processed gesture data into precise motor commands, enhancing the car's real-time responsiveness .

The MPU6050 sensor captures raw data including acceleration and angular rotation. This data is processed by an Arduino microcontroller using embedded programming techniques to filter and map movements into specific directional commands. These commands are then transmitted wirelessly through an nRF24L01 module to the car's receiver. Another Arduino microcontroller on the car interprets these commands and sends signals to a motor driver circuit, which controls the DC motors to execute the desired movements of the car .

The primary components of the gesture-controlled car system include the MPU6050 motion sensor, Arduino microcontrollers, nRF24L01 wireless module, and DC geared motors. The MPU6050 sensor captures hand movements by detecting acceleration and angular rotation, which the Arduino microcontroller processes to interpret gestures. These interpreted commands are then transmitted wirelessly via the nRF24L01 module to the receiver on the car. Another Arduino on the car processes the received commands and drives the motors accordingly through a motor driver module. This entire interaction chain allows for intuitive and responsive vehicle control using hand gestures .

To enhance gesture recognition, the project team plans to implement advanced filtering techniques or machine learning algorithms to better handle noise and improve accuracy in gesture interpretation. For extending the operational range, they have proposed upgrading the communication setup to ensure stable and reliable operation over longer distances. These enhancements aim to make the system more robust, accurate, and capable of operating in a wider range of environments .

The project identified sensor noise and drift as key challenges affecting the accuracy of gesture detection with the MPU6050 sensor. To address these, filtering techniques like Kalman or complementary filters and regular calibration were suggested. Wireless interference and range limitation issues with the nRF24L01 were met with solutions such as proper antenna placement, implementing retries in communication, and considering the inclusion of amplifiers or shielding for enhanced reliability. These solutions aim to stabilize sensor data and improve the efficacy of wireless communication in the system .

Individual team members had distinct roles that contributed critically to the project's development. Uttam Sharma led hardware integration, ensuring effective sensor and circuit connections; Subramanya Hegde focused on assembly and validation, overseeing system and testing; Rachit Tikhe was responsible for coding and algorithm development, developing software to process gestures. This division of labor facilitated efficient progress by allowing members to specialize and collaborate effectively. Their combined expertise ensured a well-rounded approach, integrating hardware, software, and system testing seamlessly to advance the project towards its objectives .

You might also like