20EC923-DIGITAL IMAGE AND VIDEO PROCESSING
Course Instructor
[Link],
[Link]/ECE Department/SKCET
12/9/2025 Module 1 DIP 1
Vision and Mission of ECE department
• Vision:
• To equip future engineers with high academic knowledge,
ethical values, leadership skills and a passion to contribute to
the society.
• Mission:
• To provide quality and contemporary education in Electronics
and Communication Engineering through continuous up
gradation of Curriculum and laboratory facilities, industrial
collaboration and effective teaching learning process.
• To facilitate research activities and entrepreneurship skills to
cope up with the changes in industrial demand and meet the
global and societal needs.
• To inculcate professional attitude and ethical values.
12/9/2025 Module 1 DIP 2
At the end of this module student will be
able to :
• C923.1 Recall the basic definition of an image and
human visual system.
[R]
• C923.2 Understand the principles of image formation,
sampling, quantization and the human visual system
to investigate specific image processing Techniques.
[U]
12/9/2025 Module 1 DIP 3
Module 1 Fundamentals of Image
processing and image transform
15 hrs.
• Basic steps in Digital Image processing, Image
sampling and quantization, Basic relationship
between pixels, color images- RGB, HSI and other
models. Image Transforms: 2 –D Discrete Fourier
Transform, Discrete Cosine Transform (DCT),
Discrete Wavelet transforms
12/9/2025 Module 1 DIP 4
Text books /Web resources/NPTEL for + credits.
• 1 Rafael C. González ,Richard E Woods, “Digital image processing” Pearson Education,Third Edition,
2014
• 2 John W. Wood, Multidimensional Signal, Image, and Video Processing and Coding,Second Edition,
Academic Press, 2011
• 3 Yao Wang,JornOstermann, Ya-Qin Zhang, “Video Processing and Communications”,Prentice Hall,
First Edition, 2001
• Reference Books:
• 1 A. Murat Tekalp, “Digital Video Processing”, Prentice Hall, 2 Edition, 2015.
• 2 W. K. Pratt, ``Digital Image Processing,John Wiley and Sons,2Edition, 2008
• 3 Alan C. Bovik, “The Essential Guide to Video Processing”, Elsevier Science, Second,Edition, 2009
• Web References/Online :
• 1 [Link] ,
• 2 [Link]
• 1 [Link]/downloads/117104020/
• 2 [Link]
12/9/2025 Module 1 DIP 5
Topic for Discussion
12/9/2025 Module 1 DIP 6
ELEMENTS OF VISUAL PERCEPTION
12/9/2025 Module 1 DIP 7
12/9/2025 Module 1 DIP 8
Structure of Human Eye
12/9/2025 Module 1 DIP 9
Fig: Cross Sectional View of human Eye
The Human Eye
• Diameter: 20 mm
• 3 membranes enclose the eye
• Cornea & sclera
• Choroid
• Retina
The Choroid
• The choroid contains blood vessels for eye nutrition and is
heavily pigmented to reduce extraneous light entrance and
backscatter.
• It is divided into the ciliary body and the iris diaphragm, which
controls the amount of light that enters the pupil (2 mm ~ 8
mm).
The Lens
• The lens is made up of fibrous cells and is suspended by fibers
that attach it to the ciliary body.
• It is slightly yellow and absorbs approx. 8% of the visible light
spectrum.
• The lens contains 60-70% water, 6% of fat.
The Retina
• The retina lines the entire posterior portion.
• Discrete light receptors are distributed over the surface of the
retina:
• cones (6-7 million per eye) and
• rods (75-150 million per eye)
Cones
• Cones are located in the fovea and are sensitive to color.
• Each one is connected to its own nerve end.
• Cone vision is called photopic (or bright-light vision or day
vision).
• There are three types of cones: Red, Green, and Blue
Rods
Rods are giving a general, overall picture of the field of view
They see only brightness (not color) and are not involved in
color vision.
• Several rods are connected to a single nerve and are sensitive to
low levels of illumination (scotopic or dim-light vision or night
vision).
MESOPIC VISION
• Intermediate region of illumination – between dim and bright
light
• Both rods and cones are active
Receptor Distribution
• The distribution of receptors is radially symmetric about the
fovea.
• Cones are most dense in the center of the fovea while rods
increase in density from the center out to approximately 20% off
axis and then decrease.
Contd.,
• There are two types of photoreceptors in the human retina, rods
and cones.
• Rods are responsible for vision at low light levels (scotopic vision).
They do not mediate color vision, and have a low spatial acuity.
• Cones are active at higher light levels (photopic vision), are
capable of color vision and are responsible for high spatial acuity.
The central fovea is populated exclusively by cones. There are 3
types of cones which we will refer to as the short-wavelength
sensitive cones, the middle-wavelength sensitive cones and the
long-wavelength sensitive cones or S-cone, M-cones, and L-cones
for short.
• The light levels where both are operational are called mesopic.
12/9/2025 Module 1 DIP 19
Distribution of photoreceptors: Rods and
Cones
12/9/2025 Module 1 DIP 20
Properties of rods and Cones
The lens focuses light from objects onto the retina. The retina is covered
with light receptors called cones (6-7 million) and rods (75-150
million).Cones are concentrated around the fovea and are
very sensitive to colour. Rods are more spread out and are sensitive to
low levels of illumination.
The human visual system can perceive approximately 1010 different light
intensity levels. However, at any one time we can only discriminate
between a much smaller number – brightness adaptation.
Similarly, the perceived intensity of a region is related to the light
intensities of the regions surrounding it.
• Blind spot is the region of emergence of the optic nerve from the eye,
Place on the retina where optic nerve connects, and which consists of no
light sensors.
12/9/2025 Module 1 DIP 21
12/9/2025 Module 1 DIP 22
Image formed in eye is simple and
inverted.
12/9/2025 Module 1 DIP 23
Image Formation in the Eye
• Example:
• Calculation of retinal image of an object
15 x
100 17
x 2 . 55 mm
Human eye and spectrum for visibility
12/9/2025 Module 1 DIP 25
12/9/2025 Module 1 DIP 26
12/9/2025 Module 1 DIP 27
Mach band Effect: Mach bands is an Optical Illusion named after the
physicist Ernst Mach. It exaggerates the Contrast between edges of the
slightly differing shades of gray, as soon as they contact one another, by
triggering edge-detection in the human visual system.
12/9/2025 Module 1 DIP 28
12/9/2025 Module 1 DIP 29
12/9/2025 Module 1 DIP 30
What is a digital image?
• A representation of the original image by a discrete set of data
points
• Each of these data points is called a picture element,
commonly referred to as a “pixel”
12/9/2025 Module 1 DIP 31
12/9/2025 Module 1 DIP 32
12/9/2025 Module 1 DIP 33
12/9/2025 Module 1 DIP 34
Quality of image is lost with finer details.
12/9/2025 Module 1 DIP 35
Checker board Effect
12/9/2025 Module 1 DIP 36
False Contorting
12/9/2025 Module 1 DIP 37
12/9/2025 Module 1 DIP 38
12/9/2025 Module 1 DIP 39
12/9/2025 Module 1 DIP 40
12/9/2025 Module 1 DIP 41
12/9/2025 Module 1 DIP 42
12/9/2025 Module 1 DIP 43
12/9/2025 Module 1 DIP 44
Problem. Derive the 4 way and 8 Way
adjacency
12/9/2025 Module 1 DIP 45
Solution
12/9/2025 Module 1 DIP 46
12/9/2025 Module 1 DIP 47
key stages in digital image processing
• Sampling : related to coordinates values
(Nyquist frequency)
Quantization : related to intensity values
12/9/2025 Module 1 DIP 48
Digital Image Generation
Generating a digital image
• Place a regular 2D grid over an image and read the colour value
• at the intersections of the grid => set of data points for that image
12/9/2025 Module 1 DIP 49
Digital Image
Digital image = a multidimensional
array of numbers (such as intensity image)
or vectors (such as color image)
Each component in the image 10 10 16 28
9 656 7026 5637 43
called pixel associates with 32 9954 7096 56 67 78
15 2560 13 90 22 96
67
the pixel value (a single number 21 54 47 42
in 32 1585 87 85 39 43 92
54 65 65 39
the case of intensity images or a 32 65 87 99
12/9/2025 vector in the case of color Module 1 DIP 50
Digital Image Acquisition
12/9/2025 Module 1 DIP 51
A Simple Image Model
• Nature of f(x,y):
• The amount of source light incident on the scene being viewed
• The amount of light reflected by the objects in the scene
12/9/2025 Module 1 DIP 52
A Simple Image Model
• Illumination & reflectance components:
• Illumination: i(x,y)
• Reflectance: r(x,y)
• f(x,y) = i(x,y) r(x,y)
• 0 < i(x,y) <
and 0 < r(x,y) < 1
(from total absorption to total reflectance)
12/9/2025 Module 1 DIP 53
Sampling & Quantization
• The spatial and amplitude digitization of f(x,y) is called:
• image sampling when it refers to spatial coordinates (x,y) and
• gray-level quantization when it refers to the amplitude.
12/9/2025 Module 1 DIP 54
Digital Image
12/9/2025 Module 1 DIP 55
Sampling and Quantization
12/9/2025 Module 1 DIP 56
A Digital Image
12/9/2025 Module 1 DIP 57
Sampling & Quantization
f ( 0, 0) f ( 0 , 1) ... f ( 0, M 1)
f (1, 0 ) ... ... f (1, M 1)
f ( x, y )
... ... ... ...
f ( N 1, 0 ) f (N 1,1) ... f ( N 1, M 1)
Digital Image Image Elements
(Pixels)
12/9/2025 Module 1 DIP 58
Sampling & Quantization
• How many samples and gray levels are required for a good
approximation?
• Resolution (the degree of discernible detail) of an image depends on
sample number and gray level number.
• i.e. the more these parameters are increased, the closer the digitized
array approximates the original image.
Sampling & Quantization
• How many samples and gray levels are required for a good
approximation? (cont.)
• But: storage & processing requirements increase rapidly as a function
of N, M, and k
Sampling & Quantization
• Different versions (images) of the same object can be
generated through:
• Varying N, M numbers
• Varying k (number of bits)
• Varying both
Sampling & Quantization
• Conclusions:
• Quality of images increases as N & k increase
• Sometimes, for fixed N, the quality improved by
decreasing k (increased contrast)
• For images with large amounts of detail, few gray
levels are needed
Comparison
Sampling Quantization
Sampling establishes the number of pixels Quantization establishes the color of each
in a digital image. pixel.
Sampling digitalizes an analog signal's x- Quantization digitalizes its y-axis.
axis.
An analog signal's amplitude value is noted In quantization, the amplitude values are
at predetermined intervals during sampling. rounded off, and the values are given.
Sampling is carried out before quantization. Quantization is carried out following
sampling.
12/9/2025 Module 1 DIP 63
Fundamental steps in Image Processing
12/9/2025 Module 1 DIP 64
12/9/2025 Module 1 DIP 65
12/9/2025 Module 1 DIP 66
12/9/2025 Module 1 DIP 67
12/9/2025 Module 1 DIP 68
Image enhancement and restoration both involve techniques to make a better image
Image compression involves development of techniques to make smaller files, while still retaining high quality
images
12/9/2025 Module 1 DIP 69
Hardware and
Software tools
12/9/2025 Module 1 DIP 70
Basics of 2D Sampling
12/9/2025
Module 1 DIP 71
2D-Fundamentals of Image sampling and
Quantization
12/9/2025 Module 1 DIP 72
Contd.,
It can be shown that the FT of the sampling function with spacing.
12/9/2025 Module 1 DIP 73
12/9/2025 Module 1 DIP 74
12/9/2025 Module 1 DIP 75
exact reconstruction
12/9/2025 Module 1 DIP 76
12/9/2025 Module 1 DIP 77
12/9/2025 Module 1 DIP 78
12/9/2025 Module 1 DIP 79
Where
12/9/2025 Module 1 DIP 80
12/9/2025 Module 1 DIP 81
Comparison Between 1 D and 2D Signal
12/9/2025 Module 1 DIP 82
2D-sampling
12/9/2025 Module 1 DIP 83
Contd.,
12/9/2025 Module 1 DIP 84
12/9/2025 Module 1 DIP 85
12/9/2025 Module 1 DIP 86
12/9/2025 Module 1 DIP 87
12/9/2025 Module 1 DIP 88
Online Experiment-1
What do you observe and infer from the slide?
12/9/2025 Module 1 DIP 89
Perception of Color
[Link] the end, color is a perceptual phenomenon.
[Link] Adds value to image recognition.
12/9/2025 Module 1 DIP 90
Colour Fundamentals
• Color spectrum
• In 1666, Sir Isaac Newton
• When a beam of sunlight is passed through a glass prism
• The emerging beam of light consists of a continuous spectrum
of colors ranging from violet to red (not white)
• Divided into six broad regions • Violet, blue, green, yellow,
orange, and red • Each color blends smoothly into the next
Fig: White light splits into Vbgyor Fig: Wavelengths in visible range of
spectrum
12/9/2025 Module 1 DIP 91
Characteristics of colors
• Characteristics of colors
• Brightness: • The chromatic notion
of intensity
• Hue: • An attribute associated with
the dominant wavelength in a mixture
of l i g ht wav e s • Re p re se nti ng
dominant color as perceived by an
observer
• Saturation • Referring to relative
purity or the amount of white mixed
with a hue • Saturation is inversely
proportional to the amount of white Fig; Chromaticity Diagram-Horse
l i g ht H ue a nd sa t ura t i o n t a ke n shoe shaped figure.
together are called chromaticity
12/9/2025 Module 1 DIP 92
Contd.,
12/9/2025 Module 1 DIP 93
Additive and Subtractive mixing
12/9/2025 Module 1 DIP 94
Classification of Colour Models
Colour
Models
Hardware- Colour image Image processing
oriented manipulation
Color monitor/ Video
camera : RGB HSI, HSV RGB,HIS
Color printer : CMY
Color TV broadcast :
YIQ
12/9/2025 Module 1 DIP 95
RGB colour Model
• Images represented in the RGB color model consist of three
independent image planes, one for each primary color.
• The number of bits used to represent each pixel in RGB space
is called the pixel depth. The term full-color image is used often
to denote 24-bit RGB color image
• RGB model is based on a Cartesian coordinate system
• The color subspace of interest is the cube
• RGB values are at three corners
• Colors are defined by vectors extending from the origin
• For convenience, all color values have been normalized
• All values of R, G, and B are in the range [0, 1]
12/9/2025 Module 1 DIP 96
Contd..,
12/9/2025 Module 1 DIP 97
CMY Colour Model
• General purpose of CMY color model is to generate hardcopy
output • The primary colors of pigments • Cyan, Magenta, and
Yellow •
• C = W - R,
• M = W - G, and
• Y=W-B•
• Most devices that deposit colored pigments on paper require
CMY data input
• Converting RGB to CMY
• The inverse operation from CMY to RGB is generally of no
practical interest.
12/9/2025 Module 1 DIP 98
Contd.,
Fig CMY model
12/9/2025 Module 1 DIP 99
Comparison
12/9/2025 Module 1 DIP 100
HIS Colour Model H : Hue S : Saturation I :
Intensity
•The intensity is
decoupled from the color
information
• The hue and saturation
are intimately related to
the way in which human
beings perceive color
•An ideal tool for
developing image
processing algorithms
based on som e of the
color sensing properties
of the human visual
system.
12/9/2025 Module 1 DIP 101
YIQ model
12/9/2025 Module 1 DIP 102
Converting colors from RGB to HSI
12/9/2025 Module 1 DIP 103
Converting colors from HSI to RGB
12/9/2025 Module 1 DIP 104
Online experiment-2
12/9/2025 Module 1 DIP 105
Dithering
• Full-color photographs may contain an almost inf inite range of
color values
• Dithering is the attempt by a computer program to approximate
a color from a mixture of other colors when the required color is
not available
• Dithering is the most common means of reducing the color
range of images down to the 256 (or fewer) colors seen in 8-bit
GIF images
Online Experiment
3
Summary
• Colour Improves image recognition.
• RBG, CMY, HIS, YIQ are important colour models and conversion possible.
• In computer graphics, dithering is an image processing operation used to create the
illusion of color depth in images with a limited color palette. Colors not available in
the palette are approximated by a diffusion of colored pixels from within the
available palette.
12/9/2025 Module 1 DIP 108
Applications of Color Models
12/9/2025 Module 1 DIP 109
Image
Transforms
12/9/2025 Module 1 DIP 110
T(u,x)- Transformation function,f(x)- Input signal
12/9/2025 Module 1 DIP 111
12/9/2025 Module 1 DIP 112
12/9/2025 Module 1 DIP 113
12/9/2025 Module 1 DIP 114
12/9/2025 Module 1 DIP 115
12/9/2025 Module 1 DIP 116
Forward and reverse Transform Pair
12/9/2025 Module 1 DIP 117
12/9/2025 Module 1 DIP 118
12/9/2025 Module 1 DIP 119
12/9/2025 Module 1 DIP 120
12/9/2025 Module 1 DIP 121
12/9/2025 Module 1 DIP 122
12/9/2025 Module 1 DIP 123
12/9/2025 Module 1 DIP 124
12/9/2025 Module 1 DIP 125
12/9/2025 Module 1 DIP 126
12/9/2025 Module 1 DIP 127
Example
-1
12/9/2025 Module 1 DIP 128
Example
-2
12/9/2025 Module 1 DIP 129
Summary
12/9/2025 Module 1 DIP 130
2D-Discrete
Cosine
Transform
12/9/2025 Module 1 DIP 131
2D-DCT
properties
• The cosine transform is close to the KL transform of first order Markov
sequences.
• The DCT is a real transform. This property makes it attractive in comparison
to the Fourier transform.
• The DCT has excellent energy compaction properties. For that reason it is
widely used in image compression standards (as for example JPEG
12/9/2025 Module 1 DIP 132
standards).
12/9/2025 Module 1 DIP 133
CWT VS DWT
12/9/2025 Module 1 DIP 134
12/9/2025 Module 1 DIP 135
12/9/2025 Module 1 DIP 136
12/9/2025 Module 1 DIP 137
12/9/2025 Module 1 DIP 138
1D-DWT
12/9/2025 Module 1 DIP 139
2-D DWT
12/9/2025 Module 1 DIP 140
12/9/2025 Module 1 DIP 141
Example
12/9/2025 Module 1 DIP 142
12/9/2025 Module 1 DIP 143
Basic Commands in matlab
Reading an Image >> I=imread('[Link]');
Display an image >> I=imshow(f);
Write an image >> I= imwrite(f, '[Link]');
Property of An Image >> imfinfo [Link];
Size of an Image >> size(f);
I=rbg2gray;
F=gray2rbg;
F=plothist(r);
12/9/2025 Module 1 DIP 144
Summary –End of Module 1
• Human vision-Rods and cones
• Image Sampling and Quantization
• Colour Models RBG, HIS, YIQ, CMY
• Image transforms: DFT, DCT, DWT.
12/9/2025 Module 1 DIP 145
Thank you
12/9/2025 Module 1 DIP 146