0% found this document useful (0 votes)
10 views9 pages

VocalLift: Assistive Speech-to-Text System

Uploaded by

krishrmodiya
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
10 views9 pages

VocalLift: Assistive Speech-to-Text System

Uploaded by

krishrmodiya
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

VocalLift: A Speech-to-Text Assistive System for Esophageal Speech Users

Group Number: 79

Group Members:

 Bhavsar Dev (202401031)

 Modiya Krishkumar Ravichandra (202401120)

 Krishna Solanki (202401209)

 Krisha Bhuva (202401099)

 Satvik Parihar (202401189)

Mentor: Prof. Hemant Patil

Course Number: PC122

1. Introduction

Communication is an essential human need. Individuals who undergo laryngectomy surgery,


often due to laryngeal cancer or severe throat trauma, lose their natural ability to speak. To
help them regain a form of speech, assistive technologies such as the Electrolarynx have
been developed.

An Electrolarynx is a handheld, battery-operated device that produces a vibrating sound.


When the user moves their mouth, lips, and tongue, this vibration is shaped into
understandable speech. However, traditional electrolarynx devices tend to be expensive,
mechanical-sounding, and lack natural pitch control, which reduces communication quality
and user comfort.

Our project, VocalLift, builds upon this idea but introduces an innovative, low-cost,
hardware-driven alternative. Instead of recreating full vocal tone artificially, VocalLift focuses
on capturing faint esophageal or throat vibration sounds through a Piezoelectric Sensor and
converting them into readable text using a Raspberry Pi based system.

By doing so, VocalLift not only provides an affordable assistive solution but also reduces
mechanical complexity, making it easier for first-time users and patients in developing
regions to communicate effectively.
2. Motivation

Globally, laryngeal cancer affects nearly 184,615 new patients annually (2020 data). Among
them, around 5.1% undergo total laryngectomy, permanently losing their natural voice.
These individuals often rely on external devices to regain their ability to communicate.

Commercial electrolarynx devices, while effective to some extent, come with major
drawbacks:

 High Cost: Often exceeding ₹10,000, limiting accessibility for many.

 Mechanical Voice: Produces robotic, monotone sounds lacking emotional


expressiveness.

 Complexity: Some devices require training and mechanical adjustments, adding to


the burden on patients.

VocalLift addresses these challenges by:

 Providing a low-cost, beginner-friendly prototype that can be easily built and


deployed.

 Using Piezo Sensors and Lav mic to detect real-time throat vibration signals naturally.

 Running open-source Speech Recognition software on Raspberry Pi to instantly


convert vibrations into text output.
 Allowing users to communicate naturally without heavy mechanical devices.

By creating a lightweight, portable system that focuses on speech-to-text translation,


VocalLift empowers laryngectomy patients with a simple, dignified way to reconnect with
society, express emotions, and maintain independence — thereby improving their overall
quality of life

3. Proposed Solution

Major Components:

 Microphone Setup: Piezoelectric Disc and Lav mic→ USB Sound Card → Raspberry Pi
Input

 Processor: Raspberry Pi 4 Model B (or Raspberry Pi 3B+ if available for lower cost)

 Software: Python scripts using Speech Recognition Libraries to convert captured


audio into text.

 Output: Text Display on Raspberry Pi’s connected monitor or GUI.


Block Diagram: [Insert block diagram here]

Diagram: [Insert circuit diagrams here]


Piezo mic circuit

Original circuit
Flowchart: [Insert flowchart here]

4. Timeline / Gantt Chart (PC223 Plan)


⎈ TIMELINE

August 2025 – Planning & Initial Setup

→ Finalize project design and block diagrams

→ Assign roles to each group member

→ Confirm the list of required components

→ Submit component list to lab team for approvals

→ Basic setup: Testing microphone input on Raspberry Pi

September 2025 – Core Development

→ Connect piezo disc to sound card, verify audio input

→ Write initial speech-to-text code on Raspberry Pi

→ Interface input and output together

→ Full-system testing with recorded samples

October 2025 – Hardware Integration & Optimization

→ Optimize audio filtering for better recognition

→ Improve text display output system

→ Debugging and stability testing

→ Documentation: Final diagrams, flow charts, working model summary

November 2025 – Final Testing & Exhibition

→ Real-world testing with actual esophageal speech samples

→ Mentor feedback and last corrections

→ Project presentation preparation (slides, poster)

→ Participate in project exhibition and submit final report/documentation


5. Budget and Justification

Approx.
Component Specification Quantity Purpose
Cost (₹)

Raspberry Pi 4 4GB RAM, 1.5GHz Main processing unit for


1 ₹4500
Model B Quad-Core speech-to-text conversion

Stereo input with Connect both Lavalier and


USB Sound Card 2 ₹300
Mic-in/Line-in Piezo mics via 3.5mm jacks

Piezoelectric Disc Diameter ~20mm, Capture throat/esophageal


1 ₹50
Sensor 2-wire output speech vibrations

Lavalier Electret Condenser


1 Clear voice capture alternative ₹350
Microphone (3.5mm TRRS)

1 Megaohm (1MΩ), Pull-down resistor for stable


1MΩ Resistor 1 ₹5
0.25W piezo signal

4-pole audio Connect Lavalier mic to sound


3.5mm TRRS Jack 1 ₹50
connector card

2-pole audio Connect piezo mic to sound


3.5mm TS Jack 1 ₹30
connector card

Male-to-Female
Connecting Wires 10 pcs Secure circuit connections ₹100
jumper wires

Store Raspberry Pi OS and


Micro SD Card 32GB Class 10 1 ₹400
program files

5V 3A USB-C Power Raspberry Pi (exclude if


Power Supply 1 ₹300
Adapter available)

Casing, tape,
Miscellaneous 1 Protection and organization ₹200
mounting hardware

Total ₹6,285

Extra : We might need a breadboard for the extra wiring of the circuit and we can make the
circuit with the breadboard too, we hope the both circuitary will be considered same as it
does not affect the final output.
6. References

 [1] "Raspberry Pi 4 Model B Product Specifications," Raspberry Pi Foundation, 2024.

 [2] "SpeechRecognition Library Documentation," Python Software Foundation, 2024.


[Online] Available: [Link]

 [3] "Understanding Piezoelectric Microphones," Technical Article, SparkFun


Electronics, 2024.

 [4] YouTube Tutorials and Practical Guides: "DIY Sound Detection using Piezo Discs,"
Various Creators, 2024.

 [5] Course Mentorship by Prof. Hemant Patil, PC122, DAU College, 2025.

 [6] Proposed Solution inspired through personal research combining simple sound
sensor interfacing with USB sound card input and open-source speech-to-text
software libraries for Raspberry Pi.

Common questions

Powered by AI

Challenges in linguistic adaptation include diverse phonetic systems and dialectal variations. VocalLift could face difficulties in accurately recognizing esophageal speech across languages with different morphologies and phonemes. Addressing these might involve training Speech Recognition models on diverse linguistic data and fostering community collaborations to fine-tune algorithms to support multiple languages. Through such strategies, VocalLift can become more universally applicable .

Using Raspberry Pi and open-source Speech Recognition libraries benefits assistive technology development by ensuring cost-effectiveness, ease of customization, and flexibility. Raspberry Pi is an affordable, compact computing solution, and open-source libraries allow for adaptable programming tailored to specific needs. This combination supports rapid prototyping, continuous improvement, and accessibility, making tools like VocalLift viable for widespread use .

VocalLift could significantly impact healthcare systems in developing regions by providing an affordable solution to restore communication for laryngectomy patients. With a total cost significantly lower than traditional devices and reliance on accessible technology like Raspberry Pi, VocalLift reduces the burden on healthcare systems while enabling a wider reach to patients who might otherwise lack resources, leading to improved patient outcomes and reduced socioeconomic barriers to care .

Mechanical voice limitations negatively impact users' quality of life by reducing their ability to express emotions and engage naturally in communication, which can lead to social isolation and lowered self-esteem. VocalLift addresses these limitations by capturing esophageal speech vibrations, which are then converted into text, bringing more natural expressiveness to communication and allowing users to reconnect with society and maintain a dignified presence, enhancing their quality of life .

Deploying VocalLift involves ethical considerations such as ensuring accessibility, maintaining affordability, and respecting patient privacy. Accessibility emphasizes providing equal opportunity for patients in various regions, and affordability ensures that cost doesn't hinder access. Patient privacy ties into ethical tech design, where the system must handle data responsibly and securely, especially when sensitive voice data is converted to text .

The proposed timeline ensures robust testing and delivery by structuring activities into focused phases: initial setup, core development, hardware integration, optimization, and final testing. Each phase builds upon the previous, allowing thorough evaluation of components and systems, ensuring stability before progressing. Concrete milestones, such as confirming component functionality and interfacing systems, allow for adjustments, ensuring a well-tested final product .

The integration enhances functionality by leveraging Piezoelectric Discs to capture faint throat vibrations that esophageal speech generates. These signals are then input into a USB Sound Card connected to a Raspberry Pi, which runs Python scripts with Speech Recognition Libraries to convert these vibrations into text. This setup allows VocalLift to provide a low-cost, lightweight, and expressive communication tool for laryngectomy patients .

Community feedback and iterative development are crucial in the final testing phases as they help identify real-world challenges and user needs not apparent during initial development. This feedback allows for refining features, improving usability, and ensuring the product meets patients' expectations. VocalLift incorporates such feedback during real-world testing with esophageal speech samples, enabling adjustments based on mentor feedback and preparing for an exhibition presentation .

VocalLift improves affordability and accessibility by significantly reducing costs associated with communication devices for laryngectomy patients. While traditional electrolarynx devices can exceed ₹10,000, VocalLift is priced at approximately ₹6,285, making it more accessible, particularly in developing regions. It also reduces complexity by relying on open-source software and simple hardware components, allowing easier deployment and use without extensive mechanical training .

Traditional electrolarynx devices present several challenges: they are expensive (exceeding ₹10,000), produce a mechanical-sounding voice lacking natural pitch and emotional expressiveness, and require mechanical training, increasing patient burden. VocalLift addresses these by providing a low-cost alternative (totaling around ₹6,285), capturing natural throat vibrations through piezoelectric sensors, and converting them into text using Raspberry Pi, thus simplifying use and improving accessibility and communication comfort .

You might also like