0% found this document useful (0 votes)
15 views7 pages

Video and Audio Compression Techniques

This document covers video and audio compression techniques in multimedia technology, including principles, applications, and psycho-acoustics. It discusses the necessity of compression due to large data sizes and outlines various methods used for both video and audio compression. Additionally, it highlights the importance of understanding human hearing in the context of audio compression and streaming media.

Uploaded by

silvazoldyck187
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
15 views7 pages

Video and Audio Compression Techniques

This document covers video and audio compression techniques in multimedia technology, including principles, applications, and psycho-acoustics. It discusses the necessity of compression due to large data sizes and outlines various methods used for both video and audio compression. Additionally, it highlights the importance of understanding human hearing in the context of audio compression and streaming media.

Uploaded by

silvazoldyck187
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

CIT 742 MODULE 4

UNIT 3 VIDEO AND AUDIO COMPRESSION


CONTENTS

1.0 Introduction
2.0 Intended Learning Outcomes (ILOs)
3.0 Main Content
3.1 Principle of Video Compression
3.2 Application of Video Compression
3.3 Audio Compression
3.3.1 Simple Audio Compression 3.3.2
Psycho-acoustics
3.4 Human Hearing andVoice
3.5 Streaming Audio (and video)
4.0 Self-Assessment Exercise(s)
5.0 Conclusion
6.0 Summary
7.0 Further Readings

1.0 Introduction
In this unit, you have a chance to learn another aspect of Multimedia
Technology. We will study about video compression. We will equally
learn about different audio compressions.

2.0 Intended Learning Outcomes (ILOs)


At the end of this unit, you should be able to:

 explain the principle of video compression


 describe the JPEG algorithm approach
 examine the application of video compression
 appreciate the sensitivity of human hearing
 discuss the notion of psycho-acoustics.

3.0 Main Content

3.1 Principle of Video Compression


The principle of still image compression is very similar to that of video
compression. Video is simply sequence of digitised picture. Video can
also be referred to as moving picture. The terms ―frame‖ and ―pictures‖
are used interchangeably in relation to video. However, we shall use the
term frame in relation to videos except where particular standard uses
the term picture.

155
CIT 742 MULTIMEDIA TECHNOLOGY

In principle, one way to compress video source is to apply any of the


common algorithms such as JPEG algorithm independently to each
frame that makes up a video. This approach is also known as moving
JPEG or MPEG. For now typical compression ratios of about 29:1
obtained with JPEG are not large enough to produce the compression
ratio needed for multimedia applications.

In practice, in addition to the spatial redundancy present in each frame


considerable redundancy is often present between a set of frame since,
in general, only a small portion of each frame is involved with any
motion that is generally, only a small portion of each frame is involved
with any motion that is taking place. For an example, consider the
movement of a person‘s lip or eye in a video telephony application.

3.2 Application of Video Compression


Haven studied the theory of encoding now let us see how this is applied
in practice.

Video (and audio) need to be compressed in practice for the following


reasons:

1. Uncompressed video (and audio ) data are huge . In HDTV , the bit
rate easily exceeds 1 Gbps . -- big problems for storage and
network communications . For example : One of the formats
defined for HDTV broadcasting within the United States is 1920
pixels horizontally by 1080 lines vertically , at 30 frames per
second . If these numbers are all multiplied together , along with 8
bits for each of the three primary colors , the total data rate
required would be approximately 1.5 Gb/sec. Because of the 6 MHz.
channel bandwidth allocated , each channel will only support a
data rate of 19.2 Mb/sec, which is further reduced to 18 Mb/sec by
the fact that the channel must also support audio , transport , and
ancillary data information . As can be seen , this restriction in data
rate means that the original signal must be compressed by a figure
of approximately 83:1. This number seems all the more impressive
when it is realised that the intent is to deliver very high quality video
to the end user, with as few visible artifacts as possible.

2. Lossy methods have to be employed since the compression ratio of


lossless methods (e.g., Huffman , Arithmetic , LZW ) is not high
enough for image and video compression , especially when
distribution of pixel values is relatively flat.

The following compression types are commonly used in video compression:

156
CIT 742 MODULE 4

 Spatial Redundancy Removal - Intraframe coding (JPEG)


Spatial and Temporal Redundancy Removal - Intraframe
and Interframe coding (H.261, MPEG)
3.3 Audio Compression
As with video a number of compression techniques have been applied to
audio. We shall consider the common ones in the subsequent units.

3.3.1 Simple Audio Compression


The following are some of the Lossy methods applied to audio
compression:

 Silence Compression - detect the "silence", similar to run-length


coding
 Adaptive Differential Pulse Code Modulation (ADPCM) e.g., in
CCITT G.721 - 16 or 32Kbits/sec
 Encodes the difference between two consecutive signals
 Adapts at quantisation so fewer bits are used when the value is
smaller.
o It is necessary to predict where the waveform is headed -
difficult
o Apple has proprietary scheme called ACE/MACE. Lossy
scheme that tries to predict where wave will go in next
sample. About 2:1 compression.
 Linear Predictive Coding (LPC) fits signal to speech model and
then transmits parameters of model. Sounds like a computer
talking, 2.4kbits/sec
 Code Excited Linear Predictor (CELP) does LPC, but also
transmits error term - audio conferencing quality at 4.8kbits/sec.

3.3.2 Psychoacoustics

These methods are related to how humans actually hear sounds

157
CIT 742 MULTIMEDIA TECHNOLOGY

3.4 Human Hearing andVoice

These methods are related to how humans actually hear sounds.

 Range is about 20 Hz to 20 kHz, most sensitive at 2 to 4KHz.


 Dynamic range (quietest to loudest) is about 96dB
 Normal voice range is about 500 Hz to 2kHz
o Low frequencies are vowels and bass
o High frequencies are consonants

Question: How sensitive is human hearing?

 Experiment: Put a person in a quiet room. Raise level of 1kHz


tone until just barely audible. Vary the frequency and plot

In sum,

 If we have a loud tone at, say, 1 kHz, then nearby quieter tones
are masked
 Best compared on critical band scale - range of masking is
 band
about 1 critical
 Two factors for masking - frequency masking and
temporal masking

3.5 Streaming Audio (and Video)

This is the popular delivery medium for the Web and other Multimedia
networks
Examples of streamed audio (and video)

 RealAudio
 Shockwave
 WAV files (not video obviously)

If you you could try the file was originally recorded at CD Quality (44
Khz, 16-bit Stereo) and is nearly minutes in length.

158
CIT 742 MODULE 4

 The original uncompressed file is about 80Mb.


 The compressed file (at 33.3) is only 1.7 Mb in total and is still of
very good quality.
 The file is downloaded to browser and not streamed above .
Whilst real audio players and encoders are freely available (see
{\em [Link] Real audio servers {\bf cost
money}.
 Buffered Data:
 Trick get data to destination before it isneeded
 Temporarily store in memory (buffer)
 Server keeps feeding the buffer
 Client application reads buffer
 Needs reliable connection, moderately fast too.
 Specialized client, Streaming Audio Protocol (PNM
for real audio).

4.0 Self-Assessment Exercise(s) To be submitted, Oct.16 2025


(Write your answer on a separate sheet of paper)
1. Which compression method is preferable in the image and video
compression context?
2. List the common compression techniques used in audio.
3. Give two common examples of streamed audio.
4. State the lossy method applied to audio compression

5.0 Conclusion

In conclusion, video is simply sequence of digitised picture, they can be


compressed. One way to compress video source is to apply any of the
common algorithms such as JPEG algorithm independently to each
frame that makes up a video. Normal voice range is about 500 Hz to 2
kHz. Low frequencies are vowels and bass, while high frequencies are
consonants.

6.0 Summary

In sum, we learnt about the principle of video compression. We equally


discovered the common types of audio compression as well as the
phenomenon of human hearing and voice. Some examples of streamed
audio (and video) are; real audio, shockwave, .WAV files. Hope you

159
CIT 742 MULTIMEDIA TECHNOLOGY

grasped these key points? You can now attempt the questions below.

7.0 FurtherReadings

Zeng, B., El-Saddik, A., Fan, X., Huang, Q., Jiang, S. and Li, H. (Eds.). (2017). Advances in
multimedia information processing --- PCM 2017. Springer international publishing

Shi, Y. and Sun, H. (2019). Image and Video Compression for Multimedia Engineering:
Fundamentals,Algorithms and Standards. Taylor & Francis Group

Stankovic, S., Sejdic, E., and Orovic, I. (2016). Multimedia Signals and Systems: Basic and
Advanced Algorithms for signal processing (2nd edition). Springer International Publishing.
Ohm, J. (2015). Multimedia signal coding and transmission. Spring street, NY. Springer
Karrenberg, U. (2013). Signals, processes and systems; an interactive multimedia introduction to
signal processing (3rd edition). Spring street, NY. Springer

Stankovic, S., Sejdic, E., and Orovic, I. (2012). Multimedia signals and systems. Spring street, NY.
Springer

Li Z., Drew M.S and Liu J (2014). Fundamentals of Multimedia (2nd edition). Sprinnger Cham
Heidelberg, New York London, Prentice-Hall

Lovely Professional University (2013). Multimedia Systems. Rajneesh Agrawal. Excel Books
Private Limited.

Tsihrintzis G.A.,Virvou and M.,Jain L.C (2013). Multimedia Services in Intelligient Environments:
Advances in recommender systems. Springer International Publishing

Pande A and Zambreno J (2013). Embedded Multimedia Security Systems: Algorithms and
Architectures. Springer-Verlag London

Veena M.N, Vasudev T., Swamy P.P. and Guru D.S (2013). Multimedia Processing,
Communication and Computing Applications: Proceedings of the First International
Conference, ICMCCA. Springer India

Fernandes J.P.S (2013). Moodle 2.5 Multimedia. Packet Publishing.

Rao K.R., Bojkovic Z.S and Bakmaz B.M (2014). Wireless Multimedia Communication Systems:
Design, Analysis, and Implementation. CRC Press.

Ho Y (2013). Advance Video Coding for Next-Generation Multimedia Services. Intech

Lisowska A, Park J.J., Ng J.K., Jeong H.Y and Waluyo B (2013). Multimedia and Ubiquitous
Engineering: MUE 2013. Springer Netherlands.

Karrenberg, U. (2013). Signals, processes and systems; an interactive multimedia


introduction to signal processing (3rd edition). Spring street, NY. Springer

160
CIT 742 MODULE 4

Ohm, J. (2015). Multimedia signal coding and transmission. Spring street, NY. Springer

Analog vs. Digital (n.d). [Link]

Multimedia Systems (n.d). [Link]

161

Common questions

Powered by AI

Intraframe coding processes each frame independently and relies on spatial redundancy within a single frame, much like JPEG compression . This method compresses individual frames by analyzing and reducing redundant data in each frame independently. Conversely, interframe coding examines temporal redundancy between consecutive frames. This approach, used in formats like MPEG, compresses video by identifying and only encoding changes from one frame to the next, significantly reducing the data required for video transmission . Combining these two methods provides a robust strategy for video compression, capitalizing on both spatial and temporal data redundancies.

Lossless compression methods, such as Huffman or LZW coding, are limited in video applications due to their inability to provide sufficiently high compression ratios needed for large video data. Unlike lossy compression, which selectively removes data, lossless compression retains all original data and can only compress through pattern redundancy, which is insufficient given the flat distribution of pixel values in video data . For this reason, lossy methods like intraframe and interframe coding (MPEG) are preferred due to their ability to achieve higher compression rates .

Streaming multimedia ensures continuous playback through buffering strategies. Data is temporarily stored in memory buffers at the client side which allows playback to continue smoothly, even if there are interruptions in the data stream. This requires a moderately fast and reliable network connection and a specialized client with protocols capable of managing streaming, such as the Streaming Audio Protocol (PNM) for audio . Pre-buffering allows the streaming server to send data ahead of time, ensuring that playback can proceed without delays . These technical requirements are critical to providing a seamless streaming experience.

Human auditory characteristics, particularly sensitivity to frequencies between 2 to 4 kHz, play a significant role in shaping audio compression strategies. Compression algorithms are tailored to preserve the fidelity of audio within these most perceptible ranges while being more aggressive with data removal at less conspicuous frequencies . Additionally, understanding frequency masking allows compression techniques to eliminate sounds that are masked by louder ones, optimizing audio quality without increasing the data size unnecessarily. These strategies take advantage of psychoacoustic principles to achieve efficient and perceptually-lossless compression .

Video compression utilizes both spatial and temporal redundancy to effectively reduce data. Spatial redundancy is comparable to techniques used in still image compression, like JPEG, where similar pixel values are identified within a single frame . Temporal redundancy, on the other hand, takes advantage of the similarities between consecutive frames, encoding only the parts of the frame that have changed . This dual approach allows for a much higher compression ratio by reducing repeated data across both single images and sequences of images.

For HDTV broadcasting, a typical compression ratio of around 83:1 is necessary due to the immense data volume involved . HDTV transmission involves a data rate of about 1.5 Gbps, which is well beyond the capacity of standard transmission channels. Lossy compression is crucial in this context because it allows for a reduction in data size, making it possible to transmit high-quality video efficiently within the limited bandwidth (about 19.2 Mbps, further reduced due to additional data needs) while maintaining as high visual quality as possible . Lossless methods cannot achieve such high compression ratios.

Critical bands in psychoacoustics refer to specific frequency ranges over which the human ear integrates sounds. Within these bands, loud sounds mask quieter sounds more easily, which is a phenomenon exploited in audio compression to reduce file size by removing data that cannot be perceived . By attending to these critical bands, audio compression techniques can discard sounds outside these bands when masked, thereby reducing the audio's data load without perceptually impacting quality . These insights allow for sophisticated compression techniques that maintain high audio fidelity while achieving efficient data reduction.

Adaptive Differential Pulse Code Modulation (ADPCM) benefits audio compression by encoding the difference between consecutive audio signals rather than the signals themselves. This approach takes advantage of the relatively small changes between consecutive audio samples to achieve compression . ADPCM adapts to quantization, using fewer bits when changes are minor, which further optimizes data efficiency. This results in effective compression, especially for voice signals, where it is commonly used, for instance, in telephony, providing an efficient balance between quality and compression ratio at data rates around 16 or 32 Kbits/sec .

Psychoacoustic models in audio compression exploit the human ear's varying sensitivity to different frequencies and its ability to mask inaudible sounds. For example, a loud tone can mask quieter tones at nearby frequencies, allowing these masked sounds to be suppressed without affecting perceived audio quality . Additionally, human hearing is most sensitive between 2 to 4 kHz, and compression techniques can prioritize this range while reducing detail in less sensitive frequency ranges . These methods enable higher compression ratios by removing perceptually irrelevant audio data.

Compression methods focus on redundancy because it represents repeat data that can be systematically reduced without losing content meaning. In video compression, redundancy is handled both spatially and temporally. Spatial redundancy within each frame is managed through techniques similar to JPEG compression, where unneeded pixel value repetition is minimized . Temporal redundancy, on the other hand, leverages the predictability of consecutive frames wherein only frame differences need encoding. This approach is evident in MPEG's interframe coding, efficiently compressing video by maintaining only changes across frames, thus substantially reducing overall data size .

You might also like