Chapter 1: Introduction & Image
Acquisition
History
Human Vision
Image Acquisition
Image Formation
Image Representation
1
History
Photography appeared in 19th century
View from the Window at Le Gras,
The 1st image in the world The 2nd image in the world
By Joseph Nicphore Nipce, 1825. By Joseph Nicphore Nipce, 1826.
2
History
The 1st application of digital image
Ideas for developing fax machines and usage of telegraphic lines for digital image
submission was born during World War I. The transmission time is reduced
from more than one week to 3 hours
Newspaper industry used Bartlane cable picture transmission system to
send pictures by submarine cable between London and New York in 1920s
3
History
Early Improvement on Image Acquisition
The number of distinct gray levels coded by Bartlane system
was improved from 5 to 15 by the end of 1920s
4
History
Remote imaging
An important event for remote imaging was astronomical
exploration and space race
The first picture of moon sent by US Spacecraft Ranger 7
5
on July 31, 1964 at 9:09AM EDT
History
Biomedical Imaging
The Born of Computer Tomography (CT)
Sir Godfrey N. Housefield and Prof. Allan M. Cormack
6
shared 1979 Nobel Prize in Medicine for the invention of CT
History
The Boom of Digital Images in Last 20 Years
Acquisition
Digital cameras, scanners
MRI and Ultrasound imaging
Infrared and microwave imaging
Transmission
Internet, satellite and wireless communication
Storage
CD/DVD
Flash memory, Phase-change memory
Display
Printers, LCD monitor, digital TV
Portable DVD player, PDAs, cell-phone, iPAD
7
History
The Born of Digital Computers
The images in previous slides are digital; but they
are NOT considered as the results of Digital Image
Processing (DIP).
What do we mean by DIP?
Processing digital images by a digital computer
DIP is dependent on the development of digital
computers and other supporting technologies (e.g.,
data storage, display and transmission).
8
Human Vision
Human Eye is one of five human senses.
5/6 of all information we are getting is from the eyes.
Image capture sensors is similar to the work of eyes.
9
Human Vision
Steps in human vision
We are looking with eyes but we see with brain!
Brain
Visual Cell
Light passes from source -> iris -> lens -> retina -> yellow spot .
Photosensitive muscles adjust iris size to regulate amount of light allowed
in eye. Other muscles adjust lens to give appropriate focusing of image.
Light should come to the exact position on the retina called yellow spot
with size about 1mm.
Light is transformed in visual cells to electric impulses. The number of
visual cells decreases with moving away from the yellow spot. 10
Problems in Human Vision
Problems in focusing light in the eye leads to missing
yellow spot, e.g., short-sightedness and long-
sightedness.
Due to slower reaction of the muscles that manage the
size of eye lenses, long-sightedness common for older
people can develop.
Problem with development of one type of cone cells can
follow to daltonism ().
Different problems within eyes including physical
damage and dangerous deceases can cause problems
in vision.
11
Image Acquisition
Electromagnetic spectrum
12
Image Acquisition
Image sensors extend the capabilities of human vision
13
Image Acquisition
Fundamentals
14
Image Acquisition
f(x,y) can be considered as a power of the light (or
some other signal that is subject of visualization).
h(x,y) is impulse response of the optical system. Output
of the optical system is optical signal.
For linear space invariant systems, output is given as:
15
Image Acquisition
Optical system h(x,y) can deform image. Companies
producing systems can estimate distortion and develop
techniques to reduce effects of distortion.
The second important element in image acquisition is
sensor that transforms optical signal into electrical
equivalent.
We will not study sensors in this course. Some details
related to sensors are given in the reference.
16
Image Acquisition
Charge coupled device (CCD) Imaging
17
Image Acquisition
CCD image sensor
18
[Link]
Image Acquisition
19
Image Acquisition
Complementary Metal Oxide Semiconductor (CMOS)
Image Sensor
20
[Link]
Image Acquisition
A Physical Perspective of Image Acquisition
Extend the capabilities of human vision systems
From visible spectrum to non-visible
electromagnetic power spectrum
From close-distance sensing to remote sensing
21
Image Acquisition
Visible (I): Photography
Which camera is the most expensive,
Leica M8, Canon 40D or Nikon D700?
22
Image Acquisition
Visible (II): Motion Pictures
23
Image Acquisition
Visible (III): Biometrics and Forensics
You=ID
Real or PS?
24
Image Acquisition
Visible (IV): Remote Sensing
Earth at night (Only Asia/Europe shown)
25
Image Acquisition
Beyond Visible
Gamma-ray and X-ray: medical and
astronomical applications
Infrared (thermal imaging): near-infrared and
far-infrared
Microwave imaging:
Radio-frequency: MRI and astronomic
applications
26
Image Acquisition
Beyond Visible (I): Thermal Images
Operate in infrared frequency
Pseudo-color representation (Human Grayscale representation (bright pixels
body disperses with heat denoted by red) correlate with high-temperature regions)
27
Image Acquisition
Beyond Visible (II): Radar Images
Operate in microwave frequency
28
Image Acquisition
Beyond Visible (III): Astronomy
Infrared Satellite Image
29
Image Acquisition
Beyond Visible (IV): Fluorescence Microscopy
Operate in ultraviolet frequency
normal corn smut corn
30
Image Acquisition
Beyond Visible (V): Magnetic Resonance Imaging (MRI)
Operate in radio frequency
Knee Head
31
Image Acquisition
Beyond Visible (VI): Medical Diagnostics
Operate in X-ray frequency
chest head
32
Image Acquisition
Beyond Visible (VII): Positron Emission Tomography
(PET)
Operate in gamma-ray frequency
33
Image Acquisition
Other Non-Electro-Magnetic Imaging Modalities
Acoustic imaging
Translate sound waves into image signals
visible seismic
potential locations of oil/gas
34
Image Acquisition
Electron microscopy
Shine a beam of electrons through a specimen
2500 Scanning Electron Microscopy (SEM) image of
damaged integrated circuit
(white fibers are oxides resulting from thermal destruction)
35
Image Acquisition
Synthetic images in Computer Graphics
Computer generated (non-existent in the real world)
36
Synthetic Images in Gaming: Warcraft III by Blizzard
Image Acquisition
Virtual Reality (Photorealistic) 37
Summary: Importance of Visual Information
A picture is worth a thousand words!
Various imaging modalities help us to see invisible
objects due to
Opaqueness (e.g., see through human body)
Far distance (e.g., remote sensing)
Small size (e.g., light microscopy)
Other signals (e.g., seismic) can also be translated into
images to facilitate the analysis
Images are important to convey information and support
reasoning
38
Toward the Future: Nano-scale Imaging
New imaging technology that can reveal fine structures
at the nano scale is going to be useful in biology (e.g.,
protein sequencing and folding)
39
Toward the Future: 3D Imaging
3D Imaging (Stereoscopy ) is a technique for
creating or enhancing the illusion of depth in an
image by means of stereopsis for binocular vision.
Laser plasma volumetric display
40
Image Formation
Image Formation Model
f(x,y)=i(x,y)r(x,y)+n(x,y)
0<f(x,y)< Intensity proportional to energy
radiated by a physical source
0<i(x,y)< illumination
0<r(x,y)<1 reflectance (intrinsic images)
n(x,y) noise
41
Image Formation
Sampling and Quantization: 1D Case
42
Image Formation
2D Sampling and Quantization
43
Image Formation
3D Visualization
400
300
200
100
0
120
100 0
80 20
60 40
40 60
20 80
0 100
It is useful to take an analogy to rain gauge (image intensity values
Measure the amount of ``photon rain)
44
Image Representation
Image Represented by a Matrix
1. Spatial resolution
2. Bit-depth resolution
45
Image Representation
Spatial Resolution
46
Image Representation
Image Resampling
47
Image Representation
Bit-depth Resolution
256-level 128-level
64-level 32-level
48
Image Representation
Bit-depth Resolution (Cond)
16-level 8-level
4-level 2-level
49
Image Representation
Aliasing in Digital Images: corruption/distortion
50
Image Representation
Commonlyused Terminology
Neighbors of a pixel p=(i,j)
N8(p)={(i-1,j),(i+1,j),(i,j-1),(i,j+1),
N4(p)={(i-1,j),(i+1,j),(i,j-1),(i,j+1)}
(i-1,j-1),(i-1,j+1),(i+1,j-1),(i+1,j+1)}
Adjacency
4-adjacency: p,q are 4-adjacent if p is in the set N4(q)
8-adjacency: p,q are 8-adjacent if p is in the set N8(q)
Note that if p is in N4/8(q), then q must be also in N4/8(p)
51
Image Representation
Common Distance Definitions
For pixels p & q with coordinates (x,y), (s,t):
1
De ( p, q) [( x s) ( y t ) ]
2 2 2
D4 ( p, q) x s y t
D8 ( p, q) max(| x s |,| y t |)
Euclidean distance D4 distance D8 distance
(2-norm) (city-block distance) (checkboard distance)
2 2 5 2 52 2 4 3 2 3 4 2 2 2 2 2
5 2 1 2 5 3 2 1 2 3 2 1 1 1 2
2 1 0 1 2 2 1 0 1 2 2 1 0 1 2
5 2 1 2 5 3 2 1 2 3 2 1 1 1 2
2 2 5 2 52 2 4 3 2 3 4 2 2 2 2 2
52
Image Representation
Block-based Processing
53
Image Representation
54