Lectures 1-3 Final
Lectures 1-3 Final
Lectures 1-3 Final
MAN 325
Mathematical Imaging
Techniques
Instructor
► Dr. Sanjeev Kumar
Associate Professor
Department of Mathematics, IIT Roorkee
Can catch at : Room No. 302
mail at: [email protected]
gtalk: MALIKDMA@GMAIL
S. No.
Contents
1. Image fundamentals: A simple image formation model, sampling and quantization,
connectivity and adjacency relationships between pixels
2. Spatial domain filtering: Basic intensity transformations: negative, log, power-law and
piecewise linear transformations, bit-plane slicing, histogram equalization and matching,
smoothing and sharpening filtering in spatial domain, unsharp masking and high-boost
filtering
3. Frequency domain filtering: Fourier Series and Fourier transform, discrete and fast
Fourier transform, sampling theorem, aliasing, filtering in frequency domain, lowpass
and highpass filters, bandreject and bandpass filters, notch filters
4. Image restoration: Introduction to various noise models, restoration in presence of
noise only, periodic noise reduction, linear and position invariant degradation,
estimation of degradation function
5. Image reconstruction: Principles of computed tomography, projections and Radon
transform, the Fourier slice theorem, reconstruction using parallel-beam and fan-beam
by filtered backprojection methods
6. Mathematical morphology: Erosion and dilation, opening and closing, the Hit-or-Miss
transformation, various morphological algorithms for binary images
7. Wavelets and multiresolution processing: Image pyramids, subband coding,
multiresolution expansions, the Haar transform, wavelet transform in one and two
dimensions, discrete wavelet transform
Gonzalez, R. C. and Woods, R. E., "Digital Image
Processing", Prentice Hall, 3rd Ed.
Jain, A. K., "Fundamentals of Digital Image Processing",
PHI Learning, 1st Ed.
Bernd, J., "Digital Image Processing", Springer, 6th Ed.
Burger, W. and Burge, M. J., "Principles of Digital Image
Processing", Springer
Scherzer, O., " Handbook of Mathematical Methods in
Imaging", Springer
Image Acquisition Process
Weeks 1 & 2 8
Introduction
► What is Digital Image Processing?
Digital Image
— a two-dimensional function f ( x, y )
x and y are spatial coordinates
The amplitude of f is called intensity or gray level at the point (x, y)
Pixel
— the elements of a digital image
Weeks 1 & 2 9
A Simple Image Formation Model
f ( x, y ) i ( x, y ) r ( x, y )
Weeks 1 & 2 10
Some Typical Ranges of Reflectance
► Reflectance
Digitizing the
coordinate
values
Digitizing the
amplitude
values
Weeks 1 & 2 12
Image Sampling and Quantization
Weeks 1 & 2 13
Representing Digital Images
Weeks 1 & 2 14
Representing Digital Images
Weeks 1 & 2 15
Representing Digital Images
Weeks 1 & 2 16
Representing Digital Images
b=M×N×k
Weeks 1 & 2 17
Representing Digital Images
Weeks 1 & 2 18
What is a Digital Image? (cont…)
►Common image formats include:
1 sample per point (B&W or Grayscale)
3 samples per point (Red, Green, and Blue)
4 samples per point (Red, Green, Blue, and “Alpha”,
a.k.a. Opacity)
► Or the domain of f:
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
Key Stages in Digital Image Processing:
Image Aquisition
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
Key Stages in Digital Image Processing:
Image Enhancement
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
Key Stages in Digital Image Processing:
Image Restoration
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
Key Stages in Digital Image Processing:
Morphological Processing
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
Key Stages in Digital Image Processing:
Segmentation
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
Key Stages in Digital Image Processing:
Object Recognition
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
Key Stages in Digital Image Processing:
Representation & Description
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
Key Stages in Digital Image Processing:
Image Compression
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
Key Stages in Digital Image Processing:
Colour Image Processing
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
Applications
&
Research Topics
Document Handling
Signature Verification
Biometrics
Fingerprint Verification /
Identification
Fingerprint Identification Research at
UNR
Minutiae Matching
Delaunay Triangulation
Object Recognition
Object Recognition Research
reference view 1 reference view 2
► Neighborhood
► Adjacency
► Connectivity
► Paths
Weeks 1 & 2 62
Basic Relationships Between Pixels
Weeks 1 & 2 63
Basic Relationships Between Pixels
► Adjacency
Let V be the set of intensity values
Weeks 1 & 2 64
Basic Relationships Between Pixels
► Adjacency
Let V be the set of intensity values
(ii) q is in the set ND(p) and the set N4(p) ∩ N4(p) has no pixels whose
values are from V.
Weeks 1 & 2 65
Basic Relationships Between Pixels
► Path
A (digital) path (or curve) from pixel p with coordinates (x0, y0) to pixel
q with coordinates (xn, yn) is a sequence of distinct pixels with
coordinates
We can define 4-, 8-, and m-paths based on the type of adjacency
used.
Weeks 1 & 2 66
Examples: Adjacency and Path
V = {1, 2}
0 1 1 0 1 1 0 1 1
0 2 0 0 2 0 0 2 0
0 0 1 0 0 1 0 0 1
Weeks 1 & 2 67
Examples: Adjacency and Path
V = {1, 2}
0 1 1 0 1 1 0 1 1
0 2 0 0 2 0 0 2 0
0 0 1 0 0 1 0 0 1
8-adjacent
Weeks 1 & 2 68
Examples: Adjacency and Path
V = {1, 2}
0 1 1 0 1 1 0 1 1
0 2 0 0 2 0 0 2 0
0 0 1 0 0 1 0 0 1
8-adjacent m-adjacent
Weeks 1 & 2 69
Examples: Adjacency and Path
V = {1, 2}
0 1 1
1,1 1,2 1,3 0 1 1 0 1 1
0 2 0
2,1 2,2 2,3 0 2 0 0 2 0
0 0 1
3,1 3,2 3,3 0 0 1 0 0 1
8-adjacent m-adjacent
The 8-path from (1,3) to (3,3): The m-path from (1,3) to (3,3):
(i) (1,3), (1,2), (2,2), (3,3) (1,3), (1,2), (2,2), (3,3)
(ii) (1,3), (2,2), (3,3)
Weeks 1 & 2 70
Basic Relationships Between Pixels
► Connected in S
Let S represent a subset of pixels in an image. Two pixels
p with coordinates (x0, y0) and q with coordinates (xn, yn)
are said to be connected in S if there exists a path
Weeks 1 & 2 71
Basic Relationships Between Pixels
Weeks 1 & 2 72
Basic Relationships Between Pixels
Weeks 1 & 2 73
Basic Relationships Between Pixels
Weeks 1 & 2 74
Basic Relationships Between Pixels
Weeks 1 & 2 75
Basic Relationships Between Pixels
BW = imread('text.png');
imshow(BW);
CC = bwconncomp(BW);
numPixels =
cellfun(@numel,CC.PixelIdxList);
[biggest,idx] = max(numPixels);
BW(CC.PixelIdxList{idx}) = 0;
figure, imshow(BW);
Weeks 1 & 2 76
Basic Relationships Between Pixels
The boundary of the region R is the set of pixels in the region that
have one or more neighbors that are not in R.
If R happens to be an entire image, then its boundary is defined as the
set of pixels in the first and last rows and columns of the image.
Weeks 1 & 2 77
Question 1
1 1 1
Region 1
1 0 1
0 1 0
0 0 1 Region 2
1 1 1
1 1 1
Weeks 1 & 2 78
Question 2
1 1 1
Part 1
1 0 1
0 1 0
0 0 1 Part 2
1 1 1
1 1 1
Weeks 1 & 2 79
► In the following arrangement of pixels, the two
regions (of 1s) are disjoint (if 4-adjacency is used)
1 1 1
Region 1
1 0 1
0 1 0
0 0 1 Region 2
1 1 1
1 1 1
Weeks 1 & 2 80
► In the following arrangement of pixels, the two
regions (of 1s) are disjoint (if 4-adjacency is used)
1 1 1
foreground
1 0 1
0 1 0
0 0 1 background
1 1 1
1 1 1
Weeks 1 & 2 81
Question 3
0 0 0 0 0
0 1 1 0 0
0 1 1 0 0
0 1 1 1 0
0 1 1 1 0
0 0 0 0 0
Weeks 1 & 2 82
Question 4
0 0 0 0 0
0 1 1 0 0
0 1 1 0 0
0 1 1 1 0
0 1 1 1 0
0 0 0 0 0
Weeks 1 & 2 83
Distance Measures
b. D(p, q) = D(q, p)
Weeks 1 & 2 84
Distance Measures
a. Euclidean Distance :
De(p, q) = [(x-s)2 + (y-t)2]1/2
Weeks 1 & 2 85
Question 5
0 0 0 0 0
0 0 1 1 0
0 1 1 0 0
0 1 0 0 0
0 0 0 0 0
0 0 0 0 0
Weeks 1 & 2 86
Question 6
0 0 0 0 0
0 0 1 1 0
0 1 1 0 0
0 1 0 0 0
0 0 0 0 0
0 0 0 0 0
Weeks 1 & 2 87
Introduction to Mathematical Operations in
DIP
► Array vs. Matrix Operation
Weeks 1 & 2 88
Introduction to Mathematical Operations in
DIP
► Linear vs. Nonlinear Operation
H f ( x, y) g ( x, y)
H ai f i ( x, y ) a j f j ( x, y )
Additivity
H ai fi ( x, y ) H a j f j ( x, y )
ai H f i ( x, y ) a j H f j ( x, y ) Homogeneity
ai gi ( x, y ) a j g j ( x, y )
H is said to be a linear operator;
H is said to be a nonlinear operator if it does not meet the
above qualification.
Weeks 1 & 2 89
Arithmetic Operations
Weeks 1 & 2 90
Example: Addition of Noisy Images for Noise Reduction
Weeks 1 & 2 91
Example: Addition of Noisy Images for Noise Reduction
K
1
g ( x, y )
K
g ( x, y )
i 1
i
1 K
E g ( x, y ) E gi ( x, y )
2
2 K
K i 1 g ( x,y ) 1
gi ( x , y )
K i 1
1 K
E f ( x, y ) ni ( x, y )
K i 1 1 2
2
n( x, y )
1 K
1 K
K
ni ( x , y )
f ( x, y ) E ni ( x, y ) K i 1
K i 1
f ( x, y )
Weeks 1 & 2 92
Example: Addition of Noisy Images for Noise Reduction
Weeks 1 & 2 93
Weeks 1 & 2 94
An Example of Image Subtraction: Mask Mode Radiography
Weeks 1 & 2 95
Weeks 1 & 2 96
An Example of Image Multiplication
Weeks 1 & 2 97
Set and Logical Operations
Weeks 1 & 2 98
Set and Logical Operations
► Let A be the elements of a gray-scale image
The elements of A are triplets of the form (x, y, z), where
x and y are spatial coordinates and z denotes the intensity
at the point (x, y).
A {( x, y, z ) | z f ( x, y)}
► The complement of A is denoted Ac
Ac {( x, y, K z ) | ( x, y, z ) A}
K 2k 1; k is the number of intensity bits used to represent z
Weeks 1 & 2 99
Set and Logical Operations
► The union of two gray-scale images (sets) A and B is
defined as the set
A B {max(a, b) | a A, b B}
z
► Single-pixel operations
Alter the values of an image’s pixels based on the intensity.
s T ( z)
e.g.,
( x, y ) T {(v, w)}
— intensity interpolation that assigns intensity values to the spatially
transformed pixels.
► Affine transform
t11 t12 0
x y 1 v w 1 t21 t22 0
t31 t32 1
Weeks 1 & 2 106
Weeks 1 & 2 107
Image Registration
x c1v c2 w c3vw c4
y c5v c6 w c7 vw c8
M 1 N 1
f ( x, y ) T (u , v) s ( x, y, u , v)
u 0 v 0
M 1 N 1
T (u, v) f ( x, y )e j 2 ( ux / M vy / N )
x 0 y 0
M 1 N 1
1
f ( x, y )
MN
T (u, v)e
u 0 v 0
j 2 ( ux / M vy / N )
p( z ) 1
k 0
k