TEAM NO : 9
PANIMALAR ENGINEERING COLLEGE
Department of Information Technology
Paper Presentation – Abstract ;
TOPIC : A dual mode smart vision and audio guidance system with emotional
and contextual intelligence for visually and hearing impaired .
ABSTRACT :
This project presents a Dual Mode Smart Vision and Audio Guidance System
enhanced with emotional and contextual intelligence, specifically designed to
assist visually and hearing impaired individuals in navigating their
environments safely and independently. The system integrates computer
vision, natural language processing (NLP), and emotion recognition
technologies to provide real-time support through two-way interaction
modes—audio output for visually impaired users and visual/textual cues for
hearing impaired users.
The vision module uses object detection, facial recognition, and gesture
interpretation to recognize obstacles, signage, and people in the surroundings,
while the audio module uses speech-to-text and text-to-speech conversion to
enable effective interaction. The emotional intelligence layer detects the user's
mood and emotional state through facial analysis (for hearing impaired) or
voice tone analysis (for visually impaired) and adapts the system's response
accordingly, ensuring a more empathetic interaction. Additionally, contextual
intelligence allows the system to adjust its guidance based on environmental
factors such as lighting conditions, crowd density, or time of day.
This innovative solution aims to enhance independence, safety, and emotional
well-being for differently-abled individuals by offering personalized, adaptive,
and context-aware assistance—bridging communication gaps and empowering
them to lead more connected and confident lives.
TEAM MEMBERS :
[Link].R – 211423205218 (2023PECIT475) .
[Link].S – 211423205160 (2023PECIT443) .
[Link].S – 211423205202 (2023PECIT465) .