VISVESVARAYA TECHNOLOGICAL UNIVERSITY
BELAGAVI - 590018
Project Report
on
SIGN LANGUAGE TO SPEECH CONVERSION –
ASSISTIVE SYSTEM FOR THE SPEECH IMPAIRED
[10ECP85]
Submitted in partial fulfillment for the award of degree
BACHELOR OF ENGINEERING
in
ELECTRONICS AND COMMUNICATION ENGINEERING
By
ADARSH PRABHAKARA 1JT14EC001
ARCHANA V MARATHE 1JT14EC009
MANOJ 1JT14EC028
SHYAM S BHARADWAJ 1JT14EC045
Under the Guidance of
MR. NAGESH KUMAR D N
Assistant Professor
Department of E & CE
Department of Electronics and Communication Engineering
Jyothy Institute of Technology
Tataguni, Off Kanakapura Road, Bangalore-560 082
Academic Year 2017-2018
Jyothy Institute of Technology
Tataguni, Off Kanakapura Road,
Bangalore-560 082
DEPARTMENT OF ELECTRONICS AND COMMUNICATION
ENGINEERING
Certificate
This is to certify that project work entitled “SIGN LANGUAGE TO SPEECH CONVERSION
- ASSISTIVE SYSTEM FOR THE SPEECH IMPAIRED” is a bonafide work carried out by
ADARSH PRABHAKARA (1JT14EC001), ARCHANA V MARATHE (1JT14EC009),
MANOJ (1JT14EC028), SHYAM S BHARADWAJ (1JT14EC045) in partial fulfillment
for award of the degree of Bachelor of Engineering in Electronics and Communication
Engineering of Visvesvaraya Technological University, Belagavi during the academic year
2017 – 2018. It is certified that all corrections / suggestions indicated for internal assessment
have been incorporated in the report and deposited in the department library. The project report
has been approved as it satisfies the academic requirement in respect of project work prescribed
for the above said degree.
Signature of Guide Signature of HOD Signature of Principal
Mr. NAGESH KUMAR D N Dr. K CHANDRASEKHAR Dr. K. GOPALAKRISHNA
Assistant Professor HOD Jyothy Institute of Technology
Dept. of E & CE [Link] E & CE
Jyothy Institute of Technology Jyothy Institute of Technology
External Viva:
Name of the Examiner Signature with Date
1. _______________________ _______________
2. _______________________ _______________
DECLARATION
We hereby declare that the dissertation entitled, “SIGN LANGUAGE TO SPEECH
CONVERSION - ASSISTIVE SYSTEM FOR THE SPEECH IMPAIRED” which is
submitted in partial fulfillment for the award of degree Bachelor of Engineering from
Visvesvaraya Technological University, Belagavi is an authentic record of bonafide work
carried out by us during the academic year 2017-2018 under the guidance of
Mr. NAGESH KUMAR D N, Assistant Professor in Department of Electronics and
Communication Engineering, Jyothy Institute of Technology, Bangalore.
We further undertake that the matter embodied in the dissertation has not been
submitted previously for the award of any degree or diploma by us to any institution.
Date: Signature of Students
Place: BENGALURU Adarsh Prabhakara
Archana V Marathe
Manoj
Shyam S Bharadwaj
ACKNOWLEDGEMENT
The satisfaction that accompanies the successful completion of any task would be
incomplete without the mention of the people who made it possible, whose constant guidance and
encouragement were reason for the successful completion.
We are grateful to the esteemed institution “Jyothy Institute of Technology” for
providing an opportunity to complete this Project.
We owe our success to and wish to express our heartfelt gratitude to our beloved Principal,
Dr. K Gopalakrishna, Jyothy Institute of Technology who has been a constant source of
inspiration and light.
We are very much indebted to Dr. T G S Moorthy, Advisor and Professor, Department of
Electronics and Communication Engineering, Jyothy Institute of Technology for his
encouragement and timely support and guidance till the completion of our project work.
We would like to thank Dr. K Chandrasekhar, Head of Department of Electronics and
Communication Engineering, Jyothy Institute of Technology for his encouragement and guidance.
We are very much grateful to project coordinator Mr. Guruprasad M Bhat, Assistant
Professor, Department of Electronics and Communication Engineering, for his inspiration and
timely support till the conclusion of our project work.
We sincerely thank our internal guide Mr. Nagesh Kumar D N, Assistant Professor,
Department of Electronics and Communication Engineering for the constant guidance,
encouragement, support and invaluable advice without which the project would not have become
a reality.
We would like to express gratitude and respect to the all teaching and non-teaching staff
who have rendered help, encouragement and intellectual influence during the course of the work.
We are very much indebted to our parents and friends for their moral support and encouragement
to achieve higher goals and for every support they gave us.
Adarsh Prabhakara
Archana V Marathe
Manoj
Shyam S Bharadwaj
i
ABSTRACT
Deaf-mute people need to communicate with normal people for their daily routine. The
deaf-mute people throughout the world use sign language to communicate with other people.
However, it is possible only for those who have undergone special training to understand the
language. Sign language uses hand gestures and other means of non-verbal behaviours to convey
their intended meaning. It involves combining hand shapes, orientation and hand movements, arms
or body movement, and facial expressions simultaneously, to fluidly express speaker's thoughts.
The speech impaired use sign language to communicate. This often is either misinterpreted
or falsely identified. This creates a communication gap between the physically disabled and the
normal person. Human beings interact with each other to convey their ideas, thoughts, and
experiences to the people around them. But this is not the case for deaf-mute people. Sign language
paves the way for deaf-mute people to communicate. Through sign language, communication is
possible for a deaf-mute person without the means of acoustic sounds.
Human beings interact with each other to convey their ideas, thoughts, and experiences to
the people around them. But this is not the case for deaf-mute people. Sign language paves the
way for deaf-mute people to communicate. Through sign language, communication is possible for
a deaf-mute person without the means of acoustic sounds. Thus, in order to bridge this gap, this
project intends to implement a real-time video processing-based speech assistant system for the
speech impaired.
ii
TABLE OF CONTENTS
ACKNOWLEDGEMENT i
ABSTRACT ii
TABLE OF CONTENTS iii
LIST OF FIGURES v
LIST OF TABLES vi
LIST OF SYMBOLS vii
LIST OF ABBREVIATIONS viii
CHAPTER 1: INTRODUCTION 1-5
1.1 INTRODUCTION 2
1.2 OBJECTIVE AND SCOPE OF THE PROJECT 3
1.3 PROBLEM FORMULATION 3
1.3.1 PROBLEM STATEMENT 4
1.3.2 PROBLEM SOLUTION 4
1.4 METHODOLOGY 4
CHAPTER 2: REVIEW OF LITERATURE 6-12
CHAPTER 3: HARDWARE IMPLEMENTATION 13-30
3.1 INTRODUCTION 14
3.2 DESIGN FLOW OF THE SYSTEM 15
3.3 BLOCK DIAGRAM 16
3.4 ANALYSIS OF DESIGN PHASE 19
3.4.1 COMPONENTS SELECTION 19
3.5 SYSTEM DESIGN AND ARCHITECTURE 27
3.5.1 INPUT/OUTPUT PORTS SPECIFICATION 28
3.5.2 MODULES INTERFACED WITH PIC16F877A 29
iii
CHAPTER 4: SOFTWARE DESIGN RESULTS 31-40
4.1 INTRODUCTION 32
4.2 MP LAB- IDE 32
4.2.1 WORKING WITH MPLAB IDE SOFTWARE 33
4.2.2 PROGRAMMING IN PICKIT2 PROGRAMMER 37
4.3 FLOWCHART OF THE PROCESS 40
CHAPTER 5: PROJECT OVERVIEW 41-45
5.1 PROCESS STAGES 42
5.2 ARCHITECTURAL DESIGN 43
5.3 ADVANTAGES AND LIMITATIONS 45
5.3.1 ADVANTAGES 45
5.3.2 LIMITATIONS AND MAPPED SOLUTIONS 45
CHAPTER 6: CONCLUSION & FUTURE WORK 46-49
6.1 CONCLUSION 47
6.2 FUTURE WORK AND DEVELOPMENT 48
BIBLIOGRAPHY 65
APPENDICES
APPENDIX A PAPER PUBLISHED / PRESENTED WITH CERTIFICATE
APPENDIX B ANY SOFTWARE TOOLS USAGE (OPTIONAL)
APPENDIX C SUPPORTING DATA SHEETS
iv
LIST OF FIGURES
Figure No. Description Page No.
v
LIST OF TABLES
Table No. Description Page No.
vi
LIST OF SYMBOLS
Symbol Description
vii
LIST OF ABBREVIATIONS
Abbreviations Description
viii
INTRODUCTION
DESIGN AND IMPLEMENTATION OF VISUAL CRYPTOGRAPHY SYSTEM FOR
TRANSMISSION OF SECURE DATA
1. INTRODUCTION
1.1 WHAT IS SECURITY?
Computer security, also known as cyber security or IT security, is the protection
of information systems from theft or damage to the hardware, the software, and to the
information on them, as well as from disruption or misdirection of the services they
provide. It includes controlling physical access to the hardware, as well as protecting
against harm that may come via network access, data and code injection, and due to
malpractice by operators, whether intentional, accidental, or due to them being tricked into
deviating from secure procedures. The field is of growing importance due to the increasing
reliance on computer systems in most societies. Computer systems now include a very wide
variety of "smart" devices, including smart phones, televisions and tiny devices as part of
the Internet of Things – and networks include not only the Internet and private data
networks, but also Bluetooth, Wi-Fi and other wireless networks.
1.2.1 METHODS OF NETWORK SECURITY
Data Encryption Standard (DES)
DES is the standard that was originated by the U.S. government which began promoting
for both business use and government. Originated practically unbreakable in the 1970s,
decrease in cost of computing and increase in power has made its 56-bit key for high
sensitive information. However, it is acceptable for lower security applications and hence
used in many commercial products. It is also used in products that have slower processors,
such as appliance devices that can't process a larger key size and smart cards.
Dept. of ECE, JIT Page 1
DESIGN AND IMPLEMENTATION OF VISUAL CRYPTOGRAPHY SYSTEM FOR
TRANSMISSION OF SECURE DATA
Fig. 1.1 Block diagram of a serial binary adder
Dept. of ECE, JIT Page 2