Lecture 4-Machine Learning Applications
Lecture 4-Machine Learning Applications
Lecture 4-Machine Learning Applications
MACHINE-LEARNING TECHNIQUES
LEARNING OBJECTIVES
5.1 Understand the basic concepts and definitions of artificial neural networks (AN N)
5.2 Learn the different types of AN N architectures
5.3 Understand the concept and structure of support vector machines (SV M)
5.4 Learn the advantages and disadvantages of SV M compared to AN N
5.5 Understand the concept and formulation of k-nearest neighbor (k N N) algorithm
LEARNING OBJECTIVES
1
Acronyms for model types: artificial neural networks (A N N), support vector machines (S V M), popular decision tree algorithm (C5), classification and regression trees
(CA R T).
2
Prediction results for the test data samples are shown in a confusion matrix where the rows represent the actuals and columns represent the predicted cases.
3
Accuracy, sensitivity, and specificity are the three performance measures that were used in comparing the four prediction models.
NEURAL NETWORK CONCEPTS
• Neural networks (N N): a human brain metaphor for information processing
• Neural computing
• Artificial neural network (AN N)
• Many uses for AN N for
• pattern recognition, forecasting, prediction, and classification
• Many application areas
• finance, marketing, manufacturing, operations, information systems, and so on
BIOLOGICAL NEURAL NETWORKS
ct ion
edi y
P curac
r
og Ac
ol
od
e th
M
y
b le c
a
ri rtan
a
V po
Im
e
BAYESIAN NETWORKS
• A tool for representing dependency structure in a graphical, explicit, and
intuitive way
• A directed acyclic graph whose nodes correspond to the variables and arcs
that signify conditional dependencies between variables and their possible
values
• Direction of the arc matter
• A partial causality link in student retention
BAYESIAN NETWORKS
1. Compute information
function
2. Build the undirected graph
3. Build a spanning tree
4. Convert the undirected
graph into
a directed one
Tree Augmented Naïve (TA N) Bayes
5. Construct a TA N model Network Structure
BAYESIAN NETWORKS
AN N: artificial neural networks; D T: decision trees; L R: logistic regression; R F: random forest; H E: heterogeneous ensemble; AU C: area under the curve; G: graduated; T:
terminated