CPE412 Pattern Recognition (Week 1)
CPE412 Pattern Recognition (Week 1)
CPE412 Pattern Recognition (Week 1)
Introduction
Dr. Nehad Ramaha,
Computer Engineering Department
Karabük Universities 1
The class notes are a compilation and edition from many sources. The instructor does not claim intellectual property or ownership of the lecture notes.
https://t.me/+Xwx8UELos_BiMDI0
2
Humans have developed highly sophisticated skills
for sensing their environment and taking actions
according to what they observe, e.g.,
◦ recognizing a face,
◦ understanding spoken words,
◦ Reading, handwriting,
◦ distinguishing fresh food
from its smell.
We would like to give similar
capabilities to machines.
3
Pattern recognition is the study of how machines can:
◦ observe the environment,
◦ learn to distinguish patterns of interest,
◦ make right and reasonable decisions about the categories of the
patterns.
A pattern is an entity, that could be given a name, e.g.,:
◦ fingerprint image,
◦ handwritten word,
◦ human face,
◦ speech signal,
◦ DNA sequence,
◦ ...
4
"The assignment of a physical object or event to one
of several pre-specified categories" -- Duda & Hart
A pattern is an object, process or event.
A class (or category) is a set of patterns that share
common attribute (features) usually from the same
information source
During recognition (or classification) classes are
assigned to the objects.
A classifier is a machine that performs such task.
5
6
What is a Pattern Class (or category)?
◦ is a set of patterns sharing common attributes
◦ a collection of "similar", not necessarily identical,
objects
◦ During recognition, given objects are assigned to a
prescribed class
7
Figure 1: English handwriting recognition.
8
9
10
11
12
13
14
15
16
How can a machine learn the rule from data?
Supervised learning: a teacher provides a category
label or cost for each pattern in the training set.
◦ Classification
Unsupervised learning: the system forms clusters or
natural groupings of the input patterns (based on
some similarity criteria).
◦ Clustering
Reinforcement learning: no desired category is given
but the teacher provides feedback to the system such
as the decision is right or wrong.
17
Introduction to Pattern Recognition
Feature Formation and Feature Selection
BAYES THEOREM
KNN (K-Nearest Neighbor)
Regression and Linear Regression Analysis
Representation of Regression Analysis in Scatter
Plot
Decision Tree
What is Data Cleansing? How to Clean Data?
18
19