0% found this document useful (0 votes)
10 views6 pages

Speech Spectra & Spectrograms Guide

Uploaded by

Soo K
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
10 views6 pages

Speech Spectra & Spectrograms Guide

Uploaded by

Soo K
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

ACOUSTICS TOPICS | ACOUSTICS SOFTWARE | SPH301 | SLP801 | RESOURCE INDEX | HELP PAGES

Back to Main "Speech Spectra and Spectrograms" Page

Speech Spectra and Spectrograms


Robert Mannell

Click here for a print formatted pdf file

1. Speech Analysis Programs


There are many software packages that permit the display of speech
spectrograms and spectra. In this unit you will encounter displays generated
by the "Emu" package (created by Steve Cassidy and colleagues) and the "MU-
spec" program (created by Robert Mannell). In this topic we will mostly use
images generated by MU-spec, but in some of the practical work as well as in
some of the assessment you will also work with images generated by Emu.
a) Emu

In the following image you will see a spectrogram and waveform of the word
"heed" generated by Emu. The word was spoken by an adult male speaker of
general Australian English.

EMU display of "heed" displaying the label, spectrogram and waveform


windows.
You should note that this image is divided up into three "windows". The top
window is the label window. It displays phoneme boundary segment markers
and labels for the phonemes in "heed". Note that the labels use the ANDOSL
phoneme symbols for Australian English. Also note that there is a separate
label ("H") for the release phase of the phoneme /d/. The label window
displays existing labels, but it can also be used to generate new labels. Note
that the horizontal axis is time and when the time axis of the label window
aligns with the time axes of the spectrogram and waveform windows (see
below) then the label segment boundary markers (the red triangles) align with
the red lines on the spectrogram and waveform.

The middle window is the spectrogram window. It follows the normal


convention of having frequency (in Hertz) on the vertical axis and time on the
horizontal axis. Intensity is denoted by the darkness of the grey image. The
three buttons to the left of this window are (from top to bottom) the play
button, a button which displays a dialog box which permits the user to change
certain settings, and a button which when pressed displays an FFT spectrum of
the part of the speech sound selected by the user.

The bottom window displays the waveform of this speech file. Sound pressure
is on the vertical axis and time is on the horizontal axis. The buttons on the
left are a play button and three buttons which control zooming in and out on
the waveform.

The time axis of the waveform, label and spectrogram windows can be
synchronised with each other (as they are here) but this is not always the case
with displays generated by Emu so you must take care to determine whether
or not they are aligned.

The following image displays a sample FFT spectrum of the /i:/ vowel in "heed"
as generated by Emu.
EMU FFT window displaying spectrum of /i:/ in "heed"
b) MU-spec

In the following image you will see a spectrogram and waveform of the word
"heed" generated by MU-spec. This is exactly the same word that is displayed
in the Emu image.

In this image the display is divided into two windows. The top window is the
spectrogram window and has frequency (in kiloHertz, kHz) on the vertical axis
and time on the horizontal axis. The bottom window is the waveform window.
Additionally, the bottom of the waveform window displays segment labels.
Note that the segment boundary lines for the spectrogram and waveform are
always aligned for images generated with MU-spec. Note also that some
additional markers (dotted lines) indicate certain features within each
phoneme (in this case vowel transitions and the burst of /d/).

To display a combined FFT/LPC spectrum you click on the part of the waveform
or spectrogram that you want to display (this displays a marker line, which is
not shown here) and then a press of a certain button (also not displayed)
displays the spectrum as shown in the following image.
In this image the waveform and label window is unchanged whilst the
spectrogram window is replaced by an FFT/LPC spectrum window. If you look
closely at the waveform window you can see a pair of vertical light blue lines
which indicate the start and end of the analysis window that was used to
generate this spectrum. In the spectrum window the LPC is in red and the
more detailed FFT is in grey. The vertical axis is the intensity axis (displayed in
dB) and the horizontal axis is frequency (in kHz).

Common questions

Powered by AI

The integration of LPC (Linear Predictive Coding) alongside FFT (Fast Fourier Transform) in MU-spec enhances analysis by combining high-level formant detail with precise spectral information. While FFT provides a snapshot of frequency components, LPC predicts the spectral envelope, representing resonant frequencies (formants) essential for vowel and articulation analysis. This combination offers a more comprehensive view of speech characteristics than FFT alone, as seen in Emu, which may miss some subtleties of formant transitions not captured in just spectral data. MU-spec thus provides a richer, more accurate representation beneficial for detailed phonetic analysis.

The separate window display in Emu allows for detailed observations of individual components, such as waveform specifics, phonemic labeling, and spectrogram details, albeit requiring careful manual alignment for cohesive analysis. This design provides flexibility in isolating aspects but can be complex to navigate. MU-spec's unified display aligns all components consistently, enhancing interpretability and ease of use. The integrated FFT/LPC spectrum provides a more streamlined analysis with a clear visual output, making MU-spec's approach more effective for quick, comprehensive analysis compared to Emu's potentially more cumbersome, though detailed, method.

In Emu, the FFT spectrum of the /i:/ vowel is displayed separately in an additional window, showing the frequency content of the vowel sound specifically. MU-spec utilizes a combined FFT/LPC spectrum display where the FFT is shown in grey and LPC in red, fitting together in a single spectrum window that replaces the spectrogram temporarily. The alignment of spectrum boundaries with the waveform in MU-spec provides a clearer association with the specific sound segment.

Emu displays spectrograms and waveforms in three separate windows: the label window, spectrogram window, and waveform window. These windows can be synchronized in time, though not necessarily always aligned. Emu's labels use ANDOSL phoneme symbols specific to Australian English. In contrast, MU-spec has two windows: a spectrogram window and a waveform window that consistently remain aligned. MU-spec includes additional markers for features within phonemes, and allows a combined FFT/LPC spectrum display.

Alignment in software tools like Emu and MU-spec is crucial for accurately interpreting and analyzing speech signals. Emu's optional synchronization and manual alignment mean users have to verify the matching of time across waveform, labels, and spectrograms. In contrast, MU-spec ensures constant alignment, simplifying the analysis, especially when identifying specific features of phonemes like vowel transitions and burst sounds. The guaranteed alignment in MU-spec aids users in understanding speech signal interactions as it prevents misinterpretation that may arise from misaligned displays.

Both Emu and MU-spec provide play buttons allowing users to listen to the selected audio segments, aiding auditory verification of visual data. In Emu, additional buttons offer options such as displaying dialog boxes for changing settings and generating FFT spectra of selected speech sections. MU-spec similarly includes controls for analysis; users can generate combined FFT/LPC spectra by interacting with the waveform or spectrogram. These functionalities support detailed data interaction, but MU-spec's method provides a streamlined interface for simultaneous analysis, enhancing user efficiency.

Spectrogram representations assist understanding by clearly displaying frequency changes over time, which highlights dynamic features like vowel transitions through shifting formant frequencies. Burst sounds such as those associated with plosives are indicated by abrupt spectral changes. Waveforms complement spectrograms by providing visual cues of amplitude variation and temporal detail, making it easier to detect these brief, high-intensity bursts accurately. MU-spec's alignment of waveform and spectrogram ensures coherent interpretation of these acoustic features, allowing precise analysis of phonetic detail.

Using ANDOSL phoneme symbols in Emu impacts the analysis by aligning the tool with the specific phonetic characteristics of Australian English. These symbols offer precise labeling that corresponds to the unique phonetic inventory of the dialect, which facilitates accurate phoneme identification, boundary marking, and transition analysis within speech segments. This specificity aids in detailed linguistic studies and facilitates clearer understanding for users familiar with Australian English sounds.

You might also like