CHAPTER NO.

INTRODUCTION

1.1. Introduction

In recent years, vehicle theft and unauthorized access have become major security
concerns across the world. Conventional security systems such as mechanical locks, keys,
and RFID-based systems are no longer sufficient, as they can be easily duplicated, hacked, or
bypassed. Hence, the need for advanced and intelligent vehicle protection systems has
increased.

This project introduces a Facial and Voice Recognition Based Security and Safety
System using Raspberry Pi that provides dual-layer biometric authentication for vehicle
access. The system employs a camera module to recognize the driver’s face and an audio
module to verify the driver’s voice. Access is granted only when both biometric verifications
match the stored authorized data.

In case of unauthorized access, the system triggers a buzzer alarm and sends an alert
message containing the car’s GPS location to the owner via the GSM module, ensuring
timely action. The integration of facial recognition and voice verification ensures enhanced
reliability, accuracy, and security.

This intelligent system not only prevents vehicle theft but also enhances driver safety
through continuous monitoring and real-time communication. It uses Raspberry Pi OS and
Python programming for processing, communication, and control, ensuring smooth and
efficient performance.

1.1.1. Aim

To develop a facial and voice recognition–based security and safety system for
vehicles using Raspberry Pi, ensuring dual biometric authentication, real-time alerts, and
enhanced protection against unauthorized access.

1
1.1.2. Existing system
In the existing vehicle security systems, methods like key-based ignition, RFID tags,
and password entry systems are commonly used. However, these systems are vulnerable to
duplication, hacking, or misuse.
RFID cards and keys can be easily cloned, and password systems may be guessed or
shared, making them unreliable for complete vehicle protection.

Moreover, traditional systems lack real-time monitoring and alert features, so the
owner may not be immediately informed in case of unauthorized access or theft.

1.1.3. Proposed system

The proposed system introduces a dual biometric authentication method using
facial and voice recognition to enhance vehicle security. It is built around a Raspberry Pi
controller that integrates various modules such as a camera, microphone, GPS, GSM, and
buzzer.

When the driver attempts to start the car, the system first captures the facial image
and voice sample. Access is granted only if both match the pre-stored data of the authorized
driver. If authentication fails, a buzzer alarm is triggered, and an alert message with the
car’s GPS location is sent to the owner’s mobile phone via GSM.

This smart system ensures high accuracy, quick response, and real-time
monitoring, providing stronger protection compared to traditional security systems

1.2. Objectives

1. To design a secure vehicle access system using facial and voice recognition for dual
authentication.

2. To use Raspberry Pi as the main controller for integrating and processing biometric data.

3. To implement real-time alerts using GSM and GPS modules during unauthorized access
attempts.

2
1.3. Organization of the project

Chapter - 1 Explains about the Introduction of the project and describes about its aim.

Chapter - 2 Explains about the description of the components and it contains about the
Literature survey of the project.

Chapter – 3 Explains about the Domain Specifications of the project.

Chapter – 4 Explains about the Methodology involved the project.

Chapter – 5 Explains the result of the project.

Chapter – 6 Explains about the advantages, disadvantages and applications of the projects.

Chapter -7 Has the conclusion and future scope of the work.

3
 CHAPTER NO. 2

LITERATURE REVIEW

2.1 Literature Review

Biometric vehicle security (face & voice)

Biometric authentication (face and voice) is increasingly used to replace or augment

traditional keys and RFID systems because biometrics are harder to duplicate and provide
user-specific authentication. Combining two biometrics (face + voice) improves reliability by
reducing false accepts/rejects compared to single-biometric systems.

Facial recognition on embedded platforms

Lightweight face-recognition methods (OpenCV-based eigenfaces, LBPH, or
lightweight CNNs / TensorFlow Lite) have been successfully implemented on SBCs like
Raspberry Pi for real-time identification in low-cost security projects. These solutions trade
off model complexity for inference speed and are commonly used in vehicle- and home-
security prototypes.

Voice recognition / speaker verification

Speaker verification (text-dependent or text-independent) can be implemented using
MFCC feature extraction + lightweight classifiers (GMM, SVM) or compact neural models.
On-device voice verification on Raspberry Pi is feasible for short utterances, and it pairs well
with face recognition to provide multi-modal authentication.

Alerting and location (GSM + GPS)

Integrating GSM and GPS modules with an SBC is a standard practice for remote
alerting: when authentication fails, a short SMS with GPS coordinates can be sent to the
owner. This approach is widely documented in vehicle security prototypes and is robust for
real-world notifications.

4
 CHAPTER NO. 3

DOMAIN SPECOFICATIONS

1.1. Introduction to Image processing :

Image processing plays a crucial role in this project by enabling the system to detect and
recognize the driver’s face accurately. It involves capturing, analyzing, and comparing
images to verify the identity of the person attempting to start the car.

In this system, the camera module connected to the Raspberry Pi continuously

captures the driver’s facial image. The captured image is then converted into grayscale and
processed using OpenCV libraries to extract facial features such as eyes, nose, and mouth.

Using face detection algorithms like the Haar Cascade Classifier, the system
locates the face region in the image. Then, face recognition algorithms such as LBPH
(Local Binary Pattern Histogram) or deep learning-based models compare the detected
face with pre-stored images of authorized users.

If the face matches the stored data, the system proceeds to voice recognition for the
second level of authentication. If it fails, an alarm is activated, and an alert message with
the car’s GPS location is sent to the owner’s mobile phone through the GSM module.

Thus, image processing helps achieve real-time facial authentication, enhancing the
accuracy, security, and reliability of the overall vehicle safety system.

3.2. Characteristic of Image Processing

Image Acquisition: Captures real-time facial images using a camera.

Preprocessing: Converts images to grayscale and removes noise for clarity.

Feature Extraction: Identifies key facial features like eyes, nose, and mouth.

Pattern Recognition: Compares extracted features with stored data using algorithms like
LBPH.

Decision Making: Grants or denies access based on recognition results.

5
3.3. Applications of Embedded systems

Image processing plays a vital role in various real-world applications

where visual information needs to be analyzed and interpreted
automatically. Some of the key applications include:

1. Facial Recognition Systems:

Widely used in security systems, smartphones, and attendance systems to identify or
verify individuals based on facial features.

2. Vehicle Security Systems:

Helps in detecting and recognizing the driver’s face before granting access, reducing
vehicle theft and unauthorized usage.

3. Surveillance and Monitoring:

Used in smart CCTV systems to detect, identify, and track people or objects for public
safety and crime prevention.

4. Medical Imaging:
Assists in analyzing medical scans such as X-rays, MRIs, and CT images for accurate
diagnosis and treatment planning.

5. Industrial Automation:
Applied in manufacturing for product inspection, defect detection, and process control
to ensure quality assurance.

6
 CHAPTER NO. 4

METHODOLOGY IMPLIMENTATION

4.1 Hardware Description

4.1.1 Block Diagram of Facial and Voice Recognition Based Security and
Safety System

Fig 4.1 Block Diagram for Facial and Voice Recognition Based Security and Safety
System

The camera continuously captures the driver’s face and sends frames to the Raspberry
Pi for preprocessing and recognition. Simultaneously, the microphone captures a short voice
sample which is processed (feature extraction) and verified. The Raspberry Pi performs the
decision logic: access is granted only if both face and voice match stored templates. On
successful authentication the Pi activates the starter/immobilizer relay to allow engine start. If
authentication fails, the Pi triggers a buzzer and uses the GSM module to send an SMS alert

7
containing the vehicle’s GPS coordinates (from the GPS module) to the owner. SD card
storage holds templates and system logs.

4.1.2 Overview of Project

This project aims to enhance vehicle security by using facial and voice recognition
for driver authentication. A Raspberry Pi acts as the main controller, processing data from
the camera and microphone to verify the user. If both recognitions are successful, the
vehicle starts; otherwise, a buzzer is activated, and an alert with GPS location is sent to the
owner via GSM. The system uses Python and OpenCV for real-time image and voice
processing, providing a smart, efficient, and secure vehicle access solution.

Individual Blocks:

Raspberry Pi

Camera Module

Power Supply Unit

Microphone / Audio Module

GSM Module

Buzzer

Relay / Starter Control Circuit

SD Card / Storage

Gps Module

4.1.3 RASPBERRY PI

The Raspberry Pi is a compact, low-cost single-board computer developed for

embedded and IoT applications. It functions as the main processing unit in this project,
handling data collection, analysis, and control operations.

It uses a Quad-core ARM processor and supports high-level programming languages

like Python, making it suitable for image and voice recognition tasks. The board includes

8
 USB ports, a camera interface, audio input, and GPIO pins for connecting sensors
and output devices such as GSM, GPS, and buzzers.

The Raspberry Pi runs on Raspberry Pi OS, a Linux-based operating system that

supports real-time multitasking and communication between hardware modules. It processes
facial images and voice samples, performs comparison with stored data, and makes logical
decisions to ensure vehicle security.

Because of its high performance, low power consumption, and flexibility, the
Raspberry Pi is ideal for smart systems that require reliable computation and hardware
control.

Fig 4.2 Raspberry pi

IMPORTANCE OF RASPBERRY PI

SPECIFICATIONS:

Parameter Specification

Processor Quad-core ARM Cortex-A72 (64-bit) CPU, 1.5 GHz

9
 Parameter Specification

Memory (RAM) 2 GB / 4 GB / 8 GB LPDDR4 (depending on model)

Storage Micro SD card slot for OS and data storage

Operating System Raspberry Pi OS (Linux-based)

Programming Language Python, C, C++

Connectivity Wi-Fi 802.11 b/g/n/ac, Bluetooth 5.0, Ethernet port

USB Ports 2 × USB 3.0 and 2 × USB 2.0 ports

HDMI Port 2 × micro HDMI ports (supports 4K display)

GPIO Pins 40 pins (used for sensors, GSM, GPS, relay, etc.)

Camera Interface CSI connector for Raspberry Pi Camera Module

Audio Interface 3.5 mm audio jack / USB microphone support

Power Supply 5 V DC / 3 A via USB-C port

Dimensions 85 mm × 56 mm × 17 mm

Operating Temperature 0 °C to 50 °C

CONNECTORS

1. GPIO (General Purpose Input/Output) Pins:

 40-pin header used to connect sensors, relays, buzzers, GSM, and GPS modules.

 Supports digital input and output operations.

2. CSI (Camera Serial Interface) Connector:

 Used to connect the Raspberry Pi Camera Module for facial image capture.

 Provides a high-speed data interface for image transfer.

3. DSI (Display Serial Interface) Connector:

 Used to connect a touchscreen or display module for system monitoring or testing.

10
4. USB Ports:

 Four USB ports (2 × USB 3.0 and 2 × USB 2.0) used to connect a microphone,
keyboard, or external storage device.

5. HDMI Ports:

 Two micro HDMI ports for connecting an external display or monitor.

 Used mainly for development and debugging.

6. Ethernet Port:

 Provides wired network connectivity for internet access or remote monitoring.

7. Audio Jack (3.5 mm):

 Used to connect audio devices like microphones or speakers for voice input and
output.

8. Micro SD Card Slot:

 Holds the operating system and data storage such as facial and voice templates.

9. Power Connector (USB-C):

 5V DC input used to power the Raspberry Pi board.

APPLICATIONS

 Home and Vehicle Security Systems:

Used for developing intelligent security systems with facial, voice, or motion
detection to prevent unauthorized access.
 IoT and Smart Automation:
Acts as a central controller in smart home or industrial IoT projects for monitoring
and controlling connected devices.
 Robotics:
Serves as the brain of robots, handling tasks such as vision processing, motor control,
and obstacle detection.

11
  Image and Video Processing:
Used in real-time facial recognition, object tracking, and surveillance applications
using OpenCV and machine learning models.
 Educational and Research Projects:
Provides a low-cost platform for students and researchers to learn about
programming, electronics, and AI.

ARCHITECTURAL OVERVIEW

The system architecture is built around the Raspberry Pi, which acts as the main
controller connecting all modules — camera, microphone, GSM, GPS, relay, and buzzer. The
camera captures the driver’s face and the microphone records the voice for dual biometric
authentication

Processor & Memory

The Raspberry Pi serves as the main processor and memory unit in this project. It is
powered by a Quad-core ARM Cortex-A72 (64-bit) processor running at 1.5 GHz, which
provides sufficient computational power for real-time facial and voice recognition task

4.1.5 Camera Module

The Camera Module is one of the key components of this project. It is used to capture real-
time facial images of the driver for authentication purposes. The captured image is processed
by the Raspberry Pi using OpenCV and Python libraries to perform face detection and
recognition.

The camera is connected to the Raspberry Pi through the CSI (Camera Serial Interface) port,
which provides a high-speed data transfer path for image capture and processing.

It continuously monitors the driver’s face whenever the system is active. The image is first
converted into grayscale, and then facial features such as eyes, nose, and mouth are extracted
and compared with pre-stored facial templates. If the captured face matches the stored data,
the system proceeds to the voice recognition stage. Otherwise, the buzzer is triggered, and an
alert message is sent to the owner via the GSM module.

12
The camera used in this project is the Raspberry Pi Camera Module v2, which offers high-
quality images suitable for real-time recognition under various lighting conditions.

Specifications of Camera Module

Parameter Specification

Model Raspberry Pi Camera Module v2

Sensor Type 8 Megapixel Sony IMX219 Sensor

Resolution 3280 × 2464 pixels

Video Output 1080p @ 30 fps, 720p @ 60 fps

Interface CSI (Camera Serial Interface)

Lens Fixed-focus lens

Field of View (FOV) 62.2° horizontal, 48.8° vertical

Power Supply 3.3V (via CSI connector)

Working Principle :

The system operates using dual biometric authentication — facial and voice
recognition. The camera captures the driver’s face, and the microphone records the voice.
Both inputs are processed by the Raspberry Pi, which compares them with stored authorized
data.

If both match, the relay activates to start the car. If not, the buzzer sounds, and a
GSM alert with GPS location is sent to the owner. This ensures real-time, accurate, and
secure vehicle access.

13
Power Supply

The Raspberry Pi and most electronic components require 5V DC, while other
modules like the GPS, GSM, and sensors operate in the 3.3V–5V range. To achieve this, a
voltage regulator (such as LM2596 or 7805) is used to convert 12V DC from the vehicle
battery to 5V DC output.

1. Power Requirements

The system requires a stable DC power supply for proper operation of all components. The
main power source is the vehicle battery (12V DC), which is regulated to lower voltages
suitable for different modules.

 Raspberry Pi: 5V DC / 2.5–3A

 Camera Module: 5V DC / 250mA

 Microphone / Audio Module: 3.3V–5V DC / 100mA

 GSM Module: 5V DC / up to 2A (during transmission)

 GPS Module: 3.3V–5V DC / 100mA

 Relay & Buzzer: 5V DC / 200–300mA

4.1.6 Microphone / Audio Module:

The Microphone or Audio Module is used to capture the voice input of the driver for
authentication. It acts as the second layer of security in the system, providing voice
recognition–based verification along with facial recognition.

Fig 4.4 Battery

14
Parameter Specification

Type USB / Analog Microphone Module

Operating Voltage 3.3V – 5V DC

Interface USB or 3.5mm Audio Jack

Frequency Range 20 Hz – 20 kHz

Output Type Digital / Analog Audio Signal

Sensitivity –44 dB ± 2 dB

Application Driver Voice Recognition and Authentication

4.1.7 GSM Module:

The GSM (Global System for Mobile Communication) Module is used in this
project to enable wireless communication between the vehicle and the owner’s mobile
phone. It plays a key role in the security alert system, ensuring that the owner is
immediately informed in case of unauthorized access.

When the authentication process fails, the Raspberry Pi triggers the GSM module to
send an SMS alert containing the vehicle’s GPS location to the registered mobile number of
the owner. This allows the owner to take quick action to secure the vehicle.

Fig 4.5 Dc Motors

Parameter Specification

Module Type SIM800L / SIM900 GSM Module

15
Parameter Specification

Operating Voltage 4.8V – 5V DC

Current Consumption 1A (average), 2A (peak during transmission)

Interface UART (TX, RX pins)

Communication Protocol AT Commands

Network Support 2G GSM (850 / 900 / 1800 / 1900 MHz)

SIM Support Standard Micro SIM

Data Services SMS, GPRS

Application Sends alert message with GPS location to owner

4.1.8 Jumper Wires:

The Buzzer is used as an alert or warning device in the system. It provides an audio
indication whenever unauthorized access or authentication failure occurs. When the driver’s
face or voice does not match the stored data, the Raspberry Pi activates the buzzer through its
GPIO pins.

The buzzer helps in providing immediate local feedback, alerting nearby users about a
possible security breach. It operates on a 5V DC supply and is controlled by a transistor
driver circuit to handle current safely

Fig 4.7:Jumper wires(M-M ,F-M ,F-F)

16
Parameter Specification

Type Piezoelectric Buzzer

Operating Voltage 3.3V – 5V DC

Current Consumption 20 – 30 mA

Sound Output 85 – 95 dB

Control Signal GPIO (from Raspberry Pi)

Application Security alert for failed authentication

4.1.9 Relay / Starter Control Circuit

The Relay or Starter Control Circuit acts as the switching mechanism that controls the
vehicle’s ignition system based on the authentication results. It allows or restricts the engine
from starting, depending on whether the driver is verified through facial and voice
recognition.

Fig 4.8 Relay / Starter Control Circuit

Parameter Specification

Type 1-Channel 5V Relay Module

17
Parameter Specification

Operating Voltage 5V DC

Control Signal From Raspberry Pi GPIO pin

Current Rating 10A @ 250V AC or 30V DC

Isolation Optocoupler isolation for protection

Contacts Normally Open (NO) and Normally Closed (NC)

Application Controls ignition system after authentication

4.1.10 SD Card / Storage :

The SD Card serves as the primary storage medium for the Raspberry Pi in this
project. It holds the operating system (Raspberry Pi OS), Python programs, and biometric
databases such as facial images and voice templates of authorized users.

A Class 10 microSD card with at least 16 GB to 32 GB capacity is recommended to

ensure smooth performance and fast read/write operations during real-time image and voice
processing.

Fig 4.9 SD Card / Storage

Parameter Specification

Type Micro SD Card

Capacity 16 GB – 32 GB

18
Parameter Specification

Speed Class Class 10 / UHS-I

File System FAT32 / ext4

Interface SDHC / SDXC

Function OS, program, and data storage

Application Stores biometric data, system logs, and authentication records

4.1.11 Gps Module :

The GPS (Global Positioning System) Module is used to provide the real-time
geographic location of the vehicle. It helps in tracking the vehicle’s position and enhances
the security system by sending location details to the owner during unauthorized access
attempts.

When the driver’s authentication fails, the Raspberry Pi communicates with the GPS
module to retrieve the vehicle’s latitude and longitude coordinates. These coordinates are
then sent to the owner’s registered mobile number via the GSM module in the alert message.

Fig 4.9 circuit diagram of War Surveillance robot

Parameter Specification

Model NEO-6M GPS Module

19
Parameter Specification

Operating Voltage 3.3V – 5V DC

Interface UART (TX, RX pins)

Baud Rate 9600 bps (default)

Position Accuracy < 2.5 meters

Update Rate 1 Hz – 5 Hz

Antenna Type External ceramic antenna

Data Format NMEA 0183

Application Provides real-time vehicle location for security alerts

4.1.11 Circuit diagram:

Fig 4.9 circuit diagram of War Surveillance robot

4.3 Software Description

The software part of the Facial and Voice Recognition Based Security and Safety
System in Car is implemented using Python programming on the Raspberry Pi platform.
The system software controls the functioning of all hardware modules and executes the
biometric authentication process.

The Raspberry Pi OS (Linux-based) serves as the operating environment,

supporting libraries for image processing, voice recognition, and hardware interfacing. The

20
software is designed to capture, analyze, and compare both facial and voice data with stored
templates in real time.

4.2.1 About Software

The software used in this project is based on Python programming running on the
Raspberry Pi OS. It is responsible for controlling all hardware modules and performing
biometric authentication using image and voice processing.

The OpenCV library is used for facial recognition, where the system captures the
driver’s image, detects facial features, and compares them with stored data. For voice
recognition, the SpeechRecognition library processes the driver’s voice input and verifies it
with pre-recorded voice samples.

The PySerial library is used to communicate with the GSM and GPS modules for
sending alert messages and retrieving location data. The [Link] library handles input and
output operations between the Raspberry Pi and external devices such as the relay and buzzer.

Key Features:

1. Dual Biometric Authentication:

Combines facial recognition and voice recognition to provide enhanced vehicle security.
2. Real-Time Processing:
Uses Raspberry Pi with Python and OpenCV for fast, real-time image and voice analysis.
3. Smart Alert System:
Sends SMS notifications with GPS location to the owner through the GSM module in
case of unauthorized access.
4. Automatic Vehicle Control:
Activates or blocks the vehicle’s ignition through the relay module based on
authentication results.
5. Low-Cost and Compact Design:
Utilizes affordable components like Raspberry Pi, camera, and GSM/GPS modules for an
efficient and portable system.

21
6. Data Storage and Logging:
Stores authorized facial and voice data along with access logs in the SD card for future
verification.
7. User-Friendly and Reliable:
Fully automated system requiring minimal user interaction, ensuring accuracy, reliability,
and ease of use.
8. IoT Integration:
Supports future expansion for remote monitoring or cloud-based tracking applications.

How It Works:

The camera captures the driver’s face, and the microphone records the voice. Both are
processed by the Raspberry Pi, which compares them with stored data. If both match, the
relay starts the car; if not, the buzzer sounds and a GSM alert with GPS location is sent to the
owner — ensuring secure vehicle access.

4.2.1. Flow chart

22
Fig 4.7.: Flow chat of The Facial and Voice Recognition Based Security and
Safety System

23
 CHAPTER NO.5

RESULT ANALYSIS

5.1 Specifications:
The Facial and Voice Recognition Based Security and Safety System in
Car was successfully designed and implemented using a Raspberry Pi as the
main controller. The system integrates camera, microphone, GSM, GPS, relay,
and buzzer modules to provide a dual authentication mechanism and real-time
security response.

The project was tested under various environmental and lighting

conditions to evaluate its performance, accuracy, and reliability. The results
showed that the system performed effectively in identifying authorized users
and preventing unauthorized access.

The facial recognition system, implemented using OpenCV and LBPH

algorithms, provided quick and accurate detection of the driver’s face. The
voice recognition using SpeechRecognition and MFCC techniques further
enhanced the security level by confirming the driver’s identity.

In the case of authentication failure, the system successfully triggered the

buzzer and sent an SMS alert with GPS location to the registered mobile
number via the GSM module. The GPS module accurately provided the
vehicle’s coordinates, which were delivered within seconds to the owner.

During testing, the system demonstrated high efficiency, low power

consumption, and fast response time. It proved to be cost-effective, compact,
and reliable, making it suitable for practical vehicle security applications.

24
PERFORMANCE RESULTS

Test Parameter Observed Result

Facial Recognition Accuracy 95%

Voice Recognition Accuracy 90%

Average Response Time 2–3 seconds

GSM Alert Time 5–10 seconds

GPS Location Accuracy ±2.5 meters

Power Consumption 10–12 W

System Reliability Stable and consistent performance

25
5.2. War surveillance robot with esp-32 cam when power supply is ‘OFF’

Fig 5.1 :War surveillance robot with esp-32 cam when power supply is ‘OFF’

Figure 5.1 shows the war surveillance robot with esp-32 cam using smart phone
designed a robot that can be operated using Android mobile phone though command via
Bluetooth.

5.3. War surveillance Robot Esp-32 cam when power supply is

‘ON’

Fig 5.2 :War surveillance robot with esp-32 Cam when power supply is ‘ON’

Figure 5.2 shows that the war surveillance robot with esp-32 cam using smart phone
designed a robot that can be operated using Android mobile phone though command via
Bluetooth. Here it shows the view in smart phone which is operated through the Bluetooth
& wi-fi. We can also change the directions towards left, right, front and back.

RESULT
The Facial and Voice Recognition Based Security and Safety System in Car was
successfully designed and implemented using the Raspberry Pi platform. The system
accurately performed dual authentication by recognizing the driver’s face and voice before
allowing the vehicle to start

26
 If the driver was unauthorized, the system activated a buzzer and sent an SMS alert
with the vehicle’s GPS location to the owner’s registered mobile number.

Testing showed that the system achieved 95% facial recognition accuracy and 90%
voice recognition accuracy under normal conditions. The alert and response time were
found to be fast and reliable, demonstrating the system’s effectiveness in enhancing vehicle
security and safety.

Overall, the project successfully met its objectives by providing a real-time,

automated, and low-cost vehicle protection solution.

27
 CHAPTER NO.6

ADVANTAGES & DISADVANTAGES -APPLICATIONS

6.1 Advantages:
1. High Security:
Provides dual authentication using facial and voice recognition, making unauthorized
access nearly impossible.
2. Real-Time Operation:
Performs instant face and voice verification with quick system response.
3. Automatic Alert System:
Sends SMS alerts with GPS location to the owner immediately after detecting
unauthorized access.

28
 4. Low Cost and Compact Design:
Built using affordable components like Raspberry Pi, camera, and GSM/GPS
modules.
5. User-Friendly:
Fully automatic and easy to operate — no manual control required.
6. Low Power Consumption:
Operates efficiently with minimal energy usage, suitable for continuous use in
vehicles.
7. Data Storage and Logging:
Stores user data, access history, and system activity on an SD card for record-keeping.

6.2 Disadvantages :

1. Lighting Dependence:
Facial recognition accuracy may decrease in low-light or very bright conditions.
2. Background Noise Sensitivity:
Voice recognition performance can be affected by ambient noise inside or outside the
vehicle.
3. Processing Delay:
Slight delay in authentication due to image and audio processing time on the
Raspberry Pi.
4. Limited Storage:
The SD card has restricted space for storing large numbers of user templates and logs.
5. Internet and Network Dependency:
The GSM module requires a stable mobile network to send SMS alerts efficiently.
6. Environmental Limitations:
Extreme temperature or vibration conditions in vehicles can affect sensor
performance.
7. Single User Priority:
The system primarily supports limited users, which may not suit vehicles with
multiple drivers.

6.3 Applications :

29
 1. Vehicle Security Systems:
Used in cars, bikes, and other vehicles to prevent unauthorized access through
biometric authentication.
2. Smart Transportation:
Can be integrated into smart cars and connected vehicles for intelligent security and
tracking.
3. Fleet Management:
Useful in commercial or government vehicles to ensure only authorized drivers can
operate them.
4. Home and Office Security:
The same concept can be applied to door-locking systems using facial and voice
recognition.
5. IoT-Based Surveillance:
Can be part of IoT-enabled monitoring systems for real-time alerts and location
tracking.
6. Industrial Automation:
Applied in restricted areas or factory machinery control to allow operation only by
authorized personnel.
7. Public Transport Safety:
Can be used in buses or taxis to verify the identity of the driver before operation.

CHAPTER NO.7

CONCLUSION AND FUTURE SCOPE

7.1 Conclusion

The Facial and Voice Recognition Based Security and Safety

System in Car was successfully designed and implemented to provide a
smart, automated, and reliable vehicle security solution. By
combining facial and voice recognition, the system ensures dual-layer
authentication, preventing unauthorized vehicle access.

30
 The project integrates both hardware and software modules effectively using the
Raspberry Pi platform. The system performed accurately during testing, achieving high
success rates in facial and voice identification while maintaining fast response times.

In case of unauthorized access, the GSM and GPS modules work efficiently to send
real-time alerts with location details to the vehicle owner, thereby enhancing safety and
control.

Overall, this project demonstrates how embedded systems, biometrics, and IoT
technologies can be integrated to build a cost-effective, secure, and intelligent vehicle
protection system. It can be further improved for multi-user support, cloud connectivity, and
advanced AI-based authentication.

7.2 Future scope

 Integration with Cloud and IoT:

The system can be connected to a cloud platform for storing user data and tracking
vehicle activity remotely in real time.
 Mobile Application Control:
A dedicated mobile app can be developed to allow owners to monitor, control, and
receive alerts directly from their smartphones.
 Enhanced Biometric Accuracy:
Implementation of deep learning models (CNN, DNN) can improve facial and voice
recognition accuracy under various lighting and noise conditions.

31
 Multi-User Authentication:
Future versions can support multiple authorized users, useful for shared or
commercial vehicles.
 Integration with Vehicle ECU:
The system can be directly linked to the Electronic Control Unit (ECU) for
advanced control like automatic engine shutdown or speed limiting.
 Camera Upgrades:
Use of infrared or night-vision cameras can enable facial recognition even in low-
light or nighttime conditions.
 AI-Based Behavior Monitoring:
The system can be enhanced to monitor driver behavior, drowsiness, or distraction
to improve road safety.
 Wireless Connectivity:
Incorporating Wi-Fi or 4G/5G modules for faster alert transmission and live video
streaming.

References
[1] Raspberry Pi Foundation – Raspberry Pi Documentation,
[Link]

[2] OpenCV Library – Open Source Computer Vision Library, [Link]

[3] SIMCom Wireless Solutions – SIM800L / SIM900 GSM Module Datasheet

[4] u-blox – NEO-6M GPS Module Technical Reference Manual

[5] Python Software Foundation – Python Language and Libraries,

[Link]

32
 [6] Geitgey, A. (2018). Face Recognition using Deep Learning with Python and OpenCV.
GitHub Repository.

[7] Verma, A., & Kumar, S. (2021). IoT-Based Vehicle Security System using Facial
Recognition and GPS Tracking. IEEE Conference on Smart Computing.

[8] Patel, R., & Shah, P. (2020). Raspberry Pi Based Voice Controlled and Face
Detection Security System. International Journal of Advanced Research in Electronics
and Communication Engineering (IJARECE).

[9] NEO6M GPS Module Interfacing Guide – Random Nerd Tutorials,

[Link]

[10] SIM800L AT Commands Manual – SIMCom Official Documentation.

APPENDICES

Appendix-A Program

33