Experiment 1 Aim:: Introduction To ML Lab With Tools (Hands On WEKA On Data Set (Iris - Arff) ) - (A) Start Weka

Date: _________
Experiment 1
Aim: Introduction to ML lab with tools (Hands on WEKA on data set (iris.arff)).
(a) Start Weka
Start Weka. This may involve finding it in program launcher or double clicking on the weka.jar file. This
will start the Weka GUI Chooser. The Weka GUI Chooser lets you choose one of the Explorer,
Experimenter, Knowledge Explorer and the Simple CLI (command line interface).
Weka GUI Chooser

Click the “Explorer” button to launch the Weka Explorer. This GUI lets you load datasets and run
classification algorithms. It also provides other features, like data filtering, clustering, association rule
extraction, and visualization, but we won’t be using these features right now.
(b). Open the data/ Dataset(sample iris.arff)
Dataset
A comma-separated list. A set of data items, the dataset, is a very basic concept of machine learning. A
dataset is roughly equivalent to a two-dimensional spreadsheet or database table. In WEKA,it is
implemented by the weka.core.Instances class. A dataset is a collection of examples, each one of class
weka.core.Instance. Each Instance consists of a number of attributes, any of which can be nominal (=
one of a predefined list of values), numeric (= a real or integer number) or a string (= an arbitrary long
list of characters, enclosed in ”double quotes”). Additional types are date and relational, which are not
covered here but in the ARFF chapter. The external representation of an Instances class is an ARFF file,
which consists of a header describing the attribute types and the data.
Click the “Open file…” button to open a data set and double click on the “data” directory.
Weka provides a number of small common machine learning datasets that you can use to practice on.
Select the “iris.arff” file to load the Iris dataset.
Weka Explorer Interface with the Iris dataset loaded .The Iris Flower dataset is a famous dataset from
statistics and is heavily borrowed by researchers in machine learning. It contains 150 instances (rows) and
4 attributes (columns) and a class attribute for the species of iris flower (one of setosa,
versicolor, and virginica).In our example, we have not mentioned the attribute type string, which
defines ”double quoted” string attributes for text mining. In recent WEKA versions, date/time attribute
types are also supported.By default, the last attribute is considered the class/target variable, i.e. the
attribute which should be predicted as a function of all other attributes. If this is not the case, specify the
target variable via -c. The attribute numbers are one-based indices, i.e. -c 1 specifies the first
attribute.Some basic statistics and validation of given ARFF files can be obtained via the main() routine
of weka.core.Instances:
Classifier
Any learning algorithm in WEKA is derived from the abstract weka.classifiers.Classifier class.
Surprisingly little is needed for a basic classifier: a routine Which generates a classifier model
from a training dataset (= buildClassifier) and another routine which evaluates the generated model on
an unseen test dataset (= classifyInstance), or generates a probability distribution for all classes (=
distributionForInstance).A classifier model is an arbitrary complex mapping from all-but-one dataset
attributes to the class attribute.
(c) Select and Run an Algorithm

Now that you have loaded a dataset, it’s time to choose a machine learning algorithm to model the
problem and make predictions. Click the “Classify” tab. This is the area for running algorithms against a
loaded dataset in Weka. You will note that the “ZeroR” algorithm is selected by default. Click the “Start”
button to run this algorithm.
Weka Results for the ZeroR algorithm on the Iris flower dataset. The ZeroR algorithm selects the
majority class in the dataset (all three species of iris are equally present in the data, so it picks the first
one: setosa) and uses that to make all predictions. This is the baseline for the dataset and the measure by
which all algorithms can be compared. The result is 33%, as expected (3 classes, each equally
represented, assigning one of the three to each prediction results in 33% classification accuracy).
You will also note that the test options selects Cross Validation by default with 10 folds. This means that
the dataset is split into 10 parts: the first 9 are used to train the algorithm, and the 10th is used to assess
the algorithm. This process is repeated, allowing each of the 10 parts of the split dataset a chance to be the
held-out test set. Click the “Choose” button in the “Classifier” section and click on “trees” and click on
the “J48” algorithm. This is an implementation of the C4.8 algorithm in Java (“J” for Java, 48 for C4.8,
hence the J48 name) and is a minor extension to the famous C4.5 algorithm. Click the “Start” button to
run the algorithm.
Weka J48 algorithm results on the Iris flower dataset
(d) Review Results

After running the J48 algorithm, you can note the results in the “Classifier output” section.
The algorithm was run with 10-fold cross-validation: this means it was given an opportunity to make a
prediction for each instance of the dataset (with different training folds) and the presented result is a
summary of those predictions.
Just the results of the J48 algorithm on the Iris flower dataset in Weka.
Firstly, note the Classification Accuracy. You can see that the model achieved a result of 144/150 correct
or 96%, which seems a lot better than the baseline of 33%.Secondly, look at the Confusion Matrix. You
can see a table of actual classes compared to predicted classes and you can see that there was 1 error
where an Iris-setosa was classified as an Iris-versicolor, 2 cases where Iris-virginica was classified as an
Iris-versicolor, and 3 cases where an Iris-versicolor was classified as an Iris-setosa (a total of 6 errors).
This table can help to explain the accuracy achieved by the algorithm.
Date: _________
Experiment 2
Aim:Understanding of Machine learning algorithms

The information data and algorithm, that will be used for different problems, can be done but before that
we need to understand some of algorithms (machine learning). Several machine learning algorithms from
top 10 data mining algorithms are described and evaluated here. Furthermore, several meta-algorithms are
presented to enhance the AUC results of selected machine learning algorithms. The machine learning
classifiers for Web Spam detection are:
● Support Vector Machine (SVM) - SVM discriminates a set of high-dimension features using a or
sets of hyper planes that gives the largest minimum distance to separates all data points among
classes.
● Multilayer Perceptron Neural Network (MLP) - MLP is a non-linear feed-forward network model
which maps a set of inputs x onto a set of outputs y using multi weights connections.
● Bayesian Network (BN) - A BN is a probabilistic graphical model for reasoning under uncertainty,
where the nodes represent discrete or continuous variables and the links represent the relationships
between them.
● C4.5 Decision Tree (DT) - DT decides the target class of a new sample based on selected features
from available data using the concept of information entropy. The nodes of the tree are the attributes,
each branch of the tree represents a possible decision and the end nodes or leaves are the classes.
● Random Forest (RF) - RF works by constructing multiple decision tree s on various sub-samples of
the datasets and output the class that appear most often or mean predictions of the decision trees.
● Naive Bayes (NB) - The NB classifier is a classification algorithm based on Bayes theorem with
strong independent assumptions between features.
● K-nearest Neighbour (KNN) - KNN is an instance-based learning algorithm that store all available
data points and classifies the new data points based on similarity measure such as distance. The
machine learning ensemble meta-algorithms on the other hand are:
● Boosting algorithms - Boosting works by combining a set of weak classifier to a single strong
classifier. The weak classifiers are weighted in some way from the training data points or hypotheses
into a final strong classifier, thus there are a varieties of boosting algorithms. Here, three boosting
algorithms are introduced in this paper:-
● Adaptive Boosting (AdaBoost) - The weights of incorrectly labelled data points are adjusted in
AdaBoost such that the following classifiers focus more on incorrectly labelled or diffi cult cases.
.
● LogitBoost - LogitBoost is actually an extension of AdaBoost where it applies the cost function
logistic regression to AdaBoost, thus it classifies by using a regression scheme as base learner.
● Real AdaBoost - Unlike most Boosting algorithms which returns binary valued classes (Discrete
AdaBoost), Real AdaBoost outputs a real valued probability of the class.
● Bagging – Bagging is a method by generating several training sets of the same size and use the same
machine learning algorithm to build model of them and combine the predictions by averaging. It is
often improve the accuracy and stability of the classifier.
● Dagging - Dagging generates a number of disjoint and stratified folds out of the data and feeds each
chunk of data to a copy of the machine learning classifier. Majority vote is done for predictions since
all the generated machine learning classifier are put into the voted Meta classifier. Dagging is useful
for base classifiers that are quadratic or worse in time behaviour on the number of instances in the
training data.
● Rotation Forest - The rotation forest is constructed using a number of the same machine learning
classifier typically decision tree independently and trained on a new set of trained features form by
sub-sampling of thedatasets with principal component analysis applied on each sub-sets.
Date: _________
Experiment 3
Aim: Understand clustering approaches and implement K means Algorithm using Weka Tool
=== Run information ===
Scheme: weka.clusterers.SimpleKMeans -init 0 -max-candidates 100 -periodic-pruning 10000 -min-

density 2.0 -t1 -1.25 -t2 -1.0 -N 2 -A "weka.core.EuclideanDistance -R first-last" -I 500 -num-slots 1 -S
10
Relation: iris
Instances: 150
Attributes: 5
sepallength
sepalwidth
petallength
petalwidth
class
Test mode: evaluate on training data
=== Clustering model (full training set) ===
kMeans
======
Number of iterations: 7
Within cluster sum of squared errors: 62.1436882815797
Initial starting points (random):
Cluster 0: 6.1,2.9,4.7,1.4,Iris-versicolor
Cluster 1: 6.2,2.9,4.3,1.3,Iris-versicolor
Missing values globally replaced with mean/mode
Final cluster centroids:

Cluster#
Attribute Full Data 0 1
(150.0) (100.0) (50.0)
==================================================================
sepallength 5.8433 6.262 5.006
sepalwidth 3.054 2.872 3.418
petallength 3.7587 4.906 1.464
petalwidth 1.1987 1.676 0.244
class Iris-setosa Iris-versicolor Iris-setosa
Time taken to build model (full training data) : 0.01 seconds
=== Model and evaluation on training set ===

Clustered Instances
0 100 ( 67%)
1 50 ( 33%)
The above information shows the result of k-means clustering Methods using WEKA tool. After that we
saved the result, the result will be saved in the ARFF file format. We also open this file in the ms excel.
Date: _________
Experiment 4
Aim:Study sample ARFF files in Database.
There are lot of data files that store attributes details of problem description and they store data in either
of formats
1. CSV- comma separated value

2. arff
3. excel -xls
There is list of following arff files shown below. These files are evaluated and analysed to get results on
basis of data provided in files.
1) Airline
2) Breast-cancer
3) Contact-lenses
4) Cpu
5) Credit-g
1. Airline:
Monthly totals of international airline passengers (in thousands) for 1949-1960.
@relation airline_passengers
@attribute passenger_numbers numeric
@attribute Date date 'yyyy-MM-dd'
@data
112,1949-01-01
118,1949-02-01
132,1949-03-01
129,1949-04-01
121,1949-05-01
135,1949-06-01
148,1949-07-01
148,1949-08-01
432,1960-12-01
2. Breast-cancer
This data set includes 201 instances of one class and 85 instances of another class. The instances are
described by 9 attributes, some of which are linear and some are nominal.
Number of Instances: 286

Number of Attributes: 9 + the class attribute
Attribute Information:
1. Class: no-recurrence-events, recurrence-events
2. age: 10-19, 20-29, 30-39, 40-49, 50-59, 60-69, 70-79, 80-89, 90-99.
3. menopause: lt40, ge40, premeno.
4. tumor-size: 0-4, 5-9, 10-14, 15-19, 20-24, 25-29, 30-34, 35-39, 40-44,
45-49, 50-54, 55-59.
5. inv-nodes: 0-2, 3-5, 6-8, 9-11, 12-14, 15-17, 18-20, 21-23, 24-26,
27-29, 30-32, 33-35, 36-39.
6. node-caps: yes, no.
7. deg-malig: 1, 2, 3.
8. breast: left, right.
9. breast-quad: left-up, left-low, right-up, right-low, central.
10. irradiat: yes, no.
Missing Attribute Values: (denoted by "?")

Attribute #: Number of instances with missing values 8
Class Distribution:
1. no-recurrence-events: 201 instances
2. recurrence-events: 85 instances
Num Instances: 286
Num Attributes: 10
Num Continuous: 0 (Int 0 / Real 0)
Num Discrete: 10
Missing values: 9 / 0.3
name type enum ints real missing distinct (1)
1 'age' Enum 100 0 0 0/ 0 6/ 2 0
2 'menopause' Enum 100 0 0 0/ 0 3/ 1 0
3 'tumor-size' Enum 100 0 0 0 / 0 11 / 4 0
4 'inv-nodes' Enum 100 0 0 0/ 0 7/ 2 0
5 'node-caps' Enum 97 0 0 8 / 3 2/ 1 0
6 'deg-malig' Enum 100 0 0 0/ 0 3/ 1 0
7 'breast' Enum 100 0 0 0/ 0 2/ 1 0
8 'breast-quad' Enum 100 0 0 1 / 0 5/ 2 0
9 'irradiat' Enum 100 0 0 0/ 0 2/ 1 0
10 'Class' Enum 100 0 0 0/ 0 2/ 1 0
@relation breast-cancer
@attribute age {'10-19','20-29','30-39','40-49','50-59','60-69','70-79','80-89','90-99'}
@attribute menopause {'lt40','ge40','premeno'}
@attribute tumor-size {'0-4','5-9','10-14','15-19','20-24','25-29','30-34','35-39','40-44','45-49','50-54','55-
59'}
@attribute inv-nodes {'0-2','3-5','6-8','9-11','12-14','15-17','18-20','21-23','24-26','27-29','30-32','33-35','36-
39'}
@attribute node-caps {'yes','no'}
@attribute deg-malig {'1','2','3'}
@attribute breast {'left','right'}
@attribute breast-quad {'left_up','left_low','right_up','right_low','central'}
@attribute 'irradiat' {'yes','no'}
@attribute 'Class' {'no-recurrence-events','recurrence-events'}
@data
'40-49','premeno','15-19','0-2','yes','3','right','left_up','no','recurrence-events'
'50-59','ge40','15-19','0-2','no','1','right','central','no','no-recurrence-events'
'50-59','ge40','35-39','0-2','no','2','left','left_low','no','recurrence-events'
'40-49','premeno','35-39','0-
3. Contact-lenses
1. Title: Database for fitting contact lenses
2. Sources:
(a) Cendrowska, J. "PRISM: An algorithm for inducing modular rules",
International Journal of Man-Machine Studies, 1987, 27, 349-370
(b) Donor: Benoit Julien ([email protected])
(c) Date: 1 August 1990
3. Past Usage:
1. See above.
2. Witten, I. H. & MacDonald, B. A. (1988). Using concept
learning for knowledge acquisition. International Journal of
Man-Machine Studies, 27, (pp. 349-370).
Notes: This database is complete (all possible combinations of attribute-value pairs are represented).
Each instance is complete and correct. 9 rules cover the training set.
4. Relevant Information Paragraph:

The examples are complete and noise free.
The examples highly simplified the problem. The attributes do not
fully describe all the factors affecting the decision as to which type,
if any, to fit.
5. Number of Instances: 24
6. Number of Attributes: 4 (all nominal)
7. Attribute Information:
-- 3 Classes
1 : the patient should be fitted with hard contact lenses,
2 : the patient should be fitted with soft contact lenses,
1 : the patient should not be fitted with contact lenses.
1. age of the patient: (1) young, (2) pre-presbyopic, (3) presbyopic

2. spectacle prescription: (1) myope, (2) hypermetrope
3. astigmatic: (1) no, (2) yes
4. tear production rate: (1) reduced, (2) normal
8. Number of Missing Attribute Values: 0
9. Class Distribution:
1. hard contact lenses: 4
2. soft contact lenses: 5
3. no contact lenses: 15
@relation contact-lenses
@attribute age {young, pre-presbyopic, presbyopic}

@attribute spectacle-prescrip {myope, hypermetrope}
@attribute astigmatism {no, yes}
@attribute tear-prod-rate {reduced, normal}
@attribute contact-lenses {soft, hard, none}
@data
24 instances
young,myope,no,reduced,none
young,myope,no,normal,soft
young,myope,yes,reduced,none
young,myope,yes,normal,hard
young,hypermetrope,no,reduced,none
young,hypermetrope,no,normal,soft
young,hypermetrope,yes,reduced,none
young,hypermetrope,yes,normal,hard
pre-presbyopic,myope,no,reduced,none
pre-presbyopic,myope,no,normal,soft
pre-presbyopic,myope,yes,reduced,none
pre-presbyopic,myope,yes,normal,hard
pre-presbyopic,hypermetrope,no,reduced,none
pre-presbyopic,hypermetrope,no,normal,soft
pre-presbyopic,hypermetrope,yes,reduced,none
pre-presbyopic,hypermetrope,yes,normal,none
presbyopic,myope,no,reduced,none
presbyopic,myope,no,normal,none
presbyopic,myope,yes,reduced,none
presbyopic,myope,yes,normal,hard
presbyopic,hypermetrope,no,reduced,none
presbyopic,hypermetrope,no,normal,soft
presbyopic,hypermetrope,yes,reduced,none
presbyopic,hypermetrope,yes,normal,none
4. CPU
Deleted "vendor" attribute to make data consistent with with what we
used in the data mining book.
@relation 'cpu'
@attribute MYCT numeric
@attribute MMIN numeric
@attribute MMAX numeric
@attribute CACH numeric
@attribute CHMIN numeric
@attribute CHMAX numeric
@attribute class numeric
@data
125,256,6000,256,16,128,198
29,8000,32000,32,8,32,269
29,8000,32000,32,8,32,220
29,8000,32000,32,8,32,172
29,8000,16000,32,8,16,132
26,8000,32000,64,8,32,318
23,16000,32000,64,16,32,367
23,16000,32000,64,16,32,489
23,16000,64000,64,16,32,636
23,32000,64000,128,32,64,1144
5. Credit-g
Description of the German credit dataset.
1. Title: German Credit data

2. Source Information
3. Number of Instances: 1000
Two datasets are provided. the original dataset, in the form provided
by Prof. Hofmann, contains categorical/symbolic attributes and
is in the file "german.data".
For algorithms that need numerical attributes, Strathclyde University produced the file "german.data-
numeric". This file has been edited and several indicator variables added to make it suitable for
algorithms which cannot cope with categorical variables. Several
attributes that are ordered categorical (such as attribute 17) have been coded as integer. This was the
form used by StatLog.
6. Number of Attributes german: 20 (7 numerical, 13 categorical) Number of Attributes
german.numer: 24 (24 numerical)
7. Attribute description for german
Attribute 1: (qualitative)
Status of existing checking account
A11 : ... < 0 DM
A12 : 0 <= ... < 200 DM
A13 : ... >= 200 DM /
salary assignments for at least 1 year
A14 : no checking account
Attribute 2: (numerical)
Duration in month
Credit history
A30 : no credits taken/
all credits paid back duly
A31 : all credits at this bank paid back duly
A32 : existing credits paid back duly till now
A33 : delay in paying off in the past
A34 : critical account/
other credits existing (not at this bank)
Attribute 4: (qualitative) Purpose
A40 : car (new)
A41 : car (used)
A42 : furniture/equipment
A43 : radio/television
Credit amount
Attibute 6: (qualitative)
Savings account/bonds
A61 : ... < 100 DM
A62 : 100 <= ... < 500 DM
A63 : 500 <= ... < 1000 DM
A64 : .. >= 1000 DM
A65 : unknown/ no savings account
Present employment since
A71 : unemployed
A72 : ... < 1 year
A73 : 1 <= ... < 4 years
A74 : 4 <= ... < 7 years
A75 : .. >= 7 years
Installment rate in percentage of disposable income
Personal status and sex
A91 : male : divorced/separated
A92 : female : divorced/separated/married
A93 : male : single
A94 : male : married/widowed
A95 : female : single
Other debtors / guarantors
A101 : none
A102 : co-applicant
A103 : guarantor
Present residence since
Property
A121 : real estate
A122 : if not A121 : building society savings agreement/
life insurance
Age in years

Other installment plans
A141 : bank
A142 : stores
A143 : none
Housing
A151 : rent
A152 : own
A153 : for free
Number of existing credits at this bank
Job
A171 : unemployed/ unskilled - non-resident
A172 : unskilled - resident
A173 : skilled employee / official
A174 : management/ self-employed/ highly qualified employee/ officer
Number of people being liable to provide maintenance for
Telephone
A191 : none
A192 : yes, registered under the customers name
foreign worker
A201 : yes
A202 : no
Cost Matrix This dataset requires use of a cost matrix (see below)
1 2
1 0 2
2 5 0
(1 = Good, 2 = Bad)
the rows represent the actual classification and the columns the predicted classification. It is worse to
class a customer as good when they are bad (5), than it is to class a customer as bad when they are good
(1).
Relabeled values in attribute checking_status

From: A11 To: '<0'
From: A12 To: '0<=X<200'
From: A13 To: '>=200'
From: A14 To: 'no checking'
@relation german_credit
@attribute checking_status { '<0', '0<=X<200', '>=200', 'no checking'}
@attribute duration numeric
@attribute credit_history { 'no credits/all paid', 'all paid', 'existing paid', 'delayed previously',
'critical/other existing credit'}
@attribute purpose { 'new car', 'used car', furniture/equipment, radio/tv, 'domestic appliance', repairs,
education, vacation, retraining, business, other}
@attribute credit_amount numeric
@attribute savings_status { '<100', '100<=X<500', '500<=X<1000', '>=1000', 'no known savings'}
@attribute employment { unemployed, '<1', '1<=X<4', '4<=X<7', '>=7'}
@attribute installment_commitment numeric
@attribute personal_status { 'male div/sep', 'female div/dep/mar', 'male single', 'male mar/wid', 'female
single'}
@attribute other_parties { none, 'co applicant', guarantor}
@attribute residence_since numeric
@attribute property_magnitude { 'real estate', 'life insurance', car, 'no known property'}
@attribute age numeric
@attribute other_payment_plans { bank, stores, none}
@attribute housing { rent, own, 'for free'}
@attribute existing_credits numeric
@attribute job { 'unemp/unskilled non res', 'unskilled resident', skilled, 'high qualif/self emp/mgmt'}
@attribute num_dependents numeric
@attribute own_telephone { none, yes}
@attribute foreign_worker { yes, no}
@attribute class { good, bad}
@data
'<0',6,'critical/other existing credit',radio/tv,1169,'no known savings','>=7',4,'male single',none,4,'real
estate',67,none,own,2,skilled,1,yes,yes,good
'0<=X<200',48,'existing paid',radio/tv,5951,'<100','1<=X<4',2,'female div/dep/mar',none,2,'real
estate',22,none,own,1,skilled,1,none,yes,bad
'no checking',12,'critical/other existing credit',education,2096,'<100','4<=X<7',2,'male single',none,3,'real
estate',49,none,own,1,'unskilled resident',2,none,yes,good
'<0',42,'existing paid',furniture/equipment,7882,'<100','4<=X<7',2,'male single',guarantor,4,'life
insurance',45,none,'for free',1,skilled,2,none,yes,good
'<0',24,'delayed previously','new car',4870,'<100','1<=X<4',3,'male single',none,4,'no known
property',53,none,'for free',2,skilled,2,none,yes,bad
'no checking',36,'existing paid',education,9055,'no known savings','1<=X<4',2,'male single',none,4,'no
known property',35,none,'for free',1,'unskilled resident',2,yes,yes,good
'no checking',24,'existing paid',furniture/equipment,2835,'500<=X<1000','>=7',3,'male single',none,4,'life
insurance',53,none,own,1,skilled,1,none,yes,good
'0<=X<200',36,'existing paid','used car',6948,'<100','1<=X<4',2,'male
single',none,2,car,35,none,rent,1,'high qualif/self emp/mgmt',1,yes,yes,good.
Date: _________
Experiment 5
Aim: Implement major classification algorithms.
(a) Naive Bayes algorithm
Scheme: weka.classifiers.bayes.NaiveBayes
Relation: labor-neg-data
Instances: 57
Attributes: 17
duration
wage-increase-first-year
wage-increase-second-year
wage-increase-third-year
cost-of-living-adjustment
working-hours
pension
standby-pay
shift-differential
education-allowance
statutory-holidays
vacation
longterm-disability-assistance
contribution-to-dental-plan
bereavement-assistance
contribution-to-health-plan
class
Test mode: 10-fold cross-validation
=== Classifier model (full training set) ===
Naive Bayes Classifier
Class
Attribute bad good
(0.36) (0.64)
=================================================
duration
mean 2 2.25
std. dev. 0.7071 0.6821
weight sum 20 36
precision 1 1
mean 2.6563 4.3837
std. dev. 0.8643 1.1773
weight sum 20 36
precision 0.3125 0.3125
mean 2.9524 4.447
std. dev. 0.8193 0.9805
weight sum 15 31
precision 0.3571 0.3571
mean 2.0344 4.5795
std. dev. 0.1678 0.7893
weight sum 4 11
precision 0.3875 0.3875
none 10.0 14.0
tcf 2.0 8.0
tc 6.0 3.0
[total] 18.0 25.0
working-hours
mean 39.4887 37.5491
std. dev. 1.8903 2.9266
weight sum 19 32
precision 1.8571 1.8571
pension
none 12.0 1.0
ret_allw 3.0 3.0
empl_contr 6.0 8.0
[total] 21.0 12.0
standby-pay
mean 2.5 11.2
std. dev. 0.866 2.0396
weight sum 4 5
precision 2 2
shift-differential
mean 2.4691 5.6818
std. dev. 1.5738 5.0584
weight sum 9 22
precision 2.7778 2.7778
education-allowance
yes 4.0 8.0
no 10.0 4.0
[total] 14.0 12.0
statutory-holidays
mean 10.2 11.4182
std. dev. 0.805 1.2224
weight sum 20 33
precision 1.2 1.2
vacation
below_average 12.0 8.0
average 8.0 11.0
generous 3.0 15.0
[total] 23.0 34.0
yes 6.0 16.0
no 9.0 1.0
[total] 15.0 17.0
none 8.0 3.0
half 8.0 9.0
full 1.0 14.0
[total] 17.0 26.0
yes 10.0 19.0
no 4.0 1.0
[total] 14.0 20.0
none 9.0 1.0
half 3.0 8.0
full 7.0 15.0
[total] 19.0 24.0
Time taken to build model: 0 seconds
=== Stratified cross-validation ===

=== Summary ===
Correctly Classified Instances 51 89.4737 %

Incorrectly Classified Instances 6 10.5263 %
Kappa statistic 0.7741
Mean absolute error 0.1042
Root mean squared error 0.2637
Relative absolute error 22.7763 %
Root relative squared error 55.2266 %
Total Number of Instances 57
=== Detailed Accuracy By Class ===
TP Rate FP Rate Precision Recall F-Measure MCC ROC Area PRC Area Class
0.900 0.108 0.818 0.900 0.857 0.776 0.965 0.926 bad
0.892 0.100 0.943 0.892 0.917 0.776 0.965 0.983 good
Weighted Avg. 0.895 0.103 0.899 0.895 0.896 0.776 0.965 0.963
=== Confusion Matrix ===

a b <-- classified as
18 2 | a = bad
4 33 | b = good
(b) Decision Trees in Machine Learning
Scheme: weka.classifiers.trees.DecisionStump
Instances: 57
Attributes: 17
duration
working-hours
pension
standby-pay
shift-differential
education-allowance
statutory-holidays
vacation
class
Decision Stump
Classifications
pension = none : bad

pension != none : good
pension is missing : good
Class distributions
pension = none
bad good
1.0 0.0
pension != none
bad good
0.4375 0.5625
pension is missing
bad good
0.06666666666666667 0.9333333333333333

=== Summary ===

0.550 0.054 0.846 0.550 0.667 0.564 0.835 0.815 bad
0.946 0.450 0.795 0.946 0.864 0.564 0.835 0.851 good
Weighted Avg. 0.807 0.311 0.813 0.807 0.795 0.564 0.835 0.838
11 9 | a = bad
2 35 | b = good.
(c) Classification and Regression Trees:
Scheme: weka.classifiers.meta.ClassificationViaRegression -W weka.classifiers.trees.M5P -- -M 4.0

Instances: 57
Attributes: 17
duration
working-hours
pension
standby-pay
shift-differential
education-allowance
statutory-holidays
vacation
class
Classification via Regression
Classifier for class with index 0:
M5 pruned model tree:

(using smoothed linear models)
wage-increase-first-year <= 4.55 :

| pension=none <= 0.5 :
| | working-hours <= 36.5 : LM1 (9/0%)
| | working-hours > 36.5 :
| | | shift-differential <= 3.5 : LM2 (5/0%)
| | | shift-differential > 3.5 :
| | | | wage-increase-first-year <= 2.75 : LM3 (5/83.814%)
| | | | wage-increase-first-year > 2.75 : LM4 (14/0%)
| pension=none > 0.5 : LM5 (11/0%)
wage-increase-first-year > 4.55 : LM6 (13/0%)
LM num: 1
class =
-0.0515 * duration
- 0.1851 * wage-increase-first-year
+ 0.0443 * working-hours
+ 0.236 * pension=none
- 0.0225 * shift-differential
- 0.5762
LM num: 2
class =
-0.1125 * duration
+ 0.1224
LM num: 3
class =
-0.1156 * duration
+ 0.1288
LM num: 4
class =
-0.1068 * duration
+ 0.0143
LM num: 5
class =
-0.0767 * duration
- 0.0512
LM num: 6
class =
-0.0461 * duration
- 0.2876
Number of Rules : 6
Classifier for class with index 1:
M5 pruned model tree:

(using smoothed linear models)
wage-increase-first-year <= 4.55 :

| pension=ret_allw,empl_contr <= 0.5 : LM1 (11/0%)
| pension=ret_allw,empl_contr > 0.5 :
| | working-hours <= 36.5 : LM2 (9/0%)
| | working-hours > 36.5 :
| | | shift-differential <= 3.5 : LM3 (5/0%)
| | | shift-differential > 3.5 :
| | | | wage-increase-first-year <= 2.75 : LM4 (5/83.814%)
| | | | wage-increase-first-year > 2.75 : LM5 (14/0%)
wage-increase-first-year > 4.55 : LM6 (13/0%)
LM num: 1
class =
0.0767 * duration
+ 0.1349 * wage-increase-first-year
- 0.0341 * working-hours
+ 0.3259 * pension=ret_allw,empl_contr
+ 0.0183 * shift-differential
+ 0.7253
LM num: 2
class =
0.0515 * duration
+ 1.3402
LM num: 3
class =
0.1125 * duration
+ 0.6416
LM num: 4
class =
0.1156 * duration
+ 0.6352
LM num: 5
class =
0.1068 * duration
+ 0.7497
LM num: 6
class =
0.0461 * duration
+ 1.0142
Number of Rules : 6
Time taken to build model: 0.19 seconds

=== Summary ===

0.750 0.135 0.750 0.750 0.750 0.615 0.918 0.880 bad
0.865 0.250 0.865 0.865 0.865 0.615 0.918 0.951 good
Weighted Avg. 0.825 0.210 0.825 0.825 0.825 0.615 0.918 0.926
15 5 | a = bad
5 32 | b = good
(D) Autoregressive Integrated Moving Average Model(ARIMA)
Scheme: weka.classifiers.functions.Logistic -R 1.0E-8 -M -1 -num-decimal-places 4

Instances: 57
Attributes: 17
duration
working-hours
pension
standby-pay
shift-differential
education-allowance
statutory-holidays
vacation
class
Logistic Regression with ridge parameter of 1.0E-8

Coefficients...
Class
Variable bad
===========================================================
duration -6.7163
wage-increase-first-year -12.8834
wage-increase-second-year -14.4955
wage-increase-third-year -16.7011
cost-of-living-adjustment=none -1.5224
cost-of-living-adjustment=tcf -18.0862
cost-of-living-adjustment=tc 22.9968
working-hours 3.8788
pension=none 44.9626
pension=ret_allw 8.6984
pension=empl_contr -39.0399
standby-pay -5.5156
shift-differential -2.0348
education-allowance=no 1.6458
statutory-holidays -8.8172
vacation=below_average 8.4791
vacation=average 2.2878
vacation=generous -12.6085
longterm-disability-assistance=no 42.2098
contribution-to-dental-plan=none 34.1177
contribution-to-dental-plan=half 0.211
contribution-to-dental-plan=full -26.0513
bereavement-assistance=no 38.3015
contribution-to-health-plan=none 42.2098
contribution-to-health-plan=half -11.5132
contribution-to-health-plan=full -17.0185
Intercept 205.7015
Odds Ratios...
Class
Variable bad
===========================================================
duration 0.0012
wage-increase-first-year 0
wage-increase-second-year 0
wage-increase-third-year 0
cost-of-living-adjustment=none 0.2182
cost-of-living-adjustment=tcf 0
pension=none 3.3653068354006045E19
pension=empl_contr 0
standby-pay 0.004
shift-differential 0.1307
statutory-holidays 0.0001
vacation=generous 0
longterm-disability-assistance=no 2.14532228968581478E18
contribution-to-dental-plan=none 6.563512730450786E14
contribution-to-dental-plan=full 0
bereavement-assistance=no 4.3065760813857376E16
contribution-to-health-plan=none 2.14532228874995942E18
contribution-to-health-plan=half 0
contribution-to-health-plan=full 0

=== Summary ===

0.950 0.081 0.864 0.950 0.905 0.852 0.970 0.927 bad
0.919 0.050 0.971 0.919 0.944 0.852 0.981 0.989 good
Weighted Avg. 0.930 0.061 0.934 0.930 0.931 0.852 0.977 0.967
19 1 | a = bad
3 34 | b = good
(e) Linear Regression and Logistics regression
Scheme: weka.classifiers.functions.Logistic -R 1.0E-8 -M -1 -num-decimal-places 4

Instances: 57
Attributes: 17
duration
working-hours
pension
standby-pay
shift-differential
education-allowance
statutory-holidays
vacation
class
Logistic Regression with ridge parameter of 1.0E-8

Coefficients...
Class
Variable bad
===========================================================
duration -6.7163
wage-increase-first-year -12.8834
wage-increase-second-year -14.4955
wage-increase-third-year -16.7011
cost-of-living-adjustment=none -1.5224
cost-of-living-adjustment=tcf -18.0862
pension=none 44.9626
pension=empl_contr -39.0399
standby-pay -5.5156
shift-differential -2.0348
statutory-holidays -8.8172
vacation=generous -12.6085
longterm-disability-assistance=no 42.2098
contribution-to-dental-plan=none 34.1177
contribution-to-dental-plan=full -26.0513
bereavement-assistance=no 38.3015
contribution-to-health-plan=none 42.2098
contribution-to-health-plan=half -11.5132
contribution-to-health-plan=full -17.0185
Intercept 205.7015
Odds Ratios...
Class
Variable bad
===========================================================
duration 0.0012
wage-increase-first-year 0
wage-increase-second-year 0
wage-increase-third-year 0
cost-of-living-adjustment=none 0.2182
cost-of-living-adjustment=tcf 0
pension=none 3.3653068354006045E19
pension=empl_contr 0
standby-pay 0.004
shift-differential 0.1307
statutory-holidays 0.0001
vacation=generous 0
longterm-disability-assistance=no 2.14532228968581478E18
contribution-to-dental-plan=none 6.563512730450786E14
contribution-to-dental-plan=full 0
bereavement-assistance=no 4.3065760813857376E16
contribution-to-health-plan=none 2.14532228874995942E18
contribution-to-health-plan=half 0
contribution-to-health-plan=full 0

=== Summary ===

0.950 0.081 0.864 0.950 0.905 0.852 0.970 0.927 bad
0.919 0.050 0.971 0.919 0.944 0.852 0.981 0.989 good
Weighted Avg. 0.930 0.061 0.934 0.930 0.931 0.852 0.977 0.967
19 1 | a = bad
3 34 | b = good
(F.) SVM (SUPPORT VECTOR MACHINES)
=== RUN INFORMATION ===
SCHEME: WEKA.CLASSIFIERS.FUNCTIONS.SMO -C 1.0 -L 0.001 -P 1.0E-12 -N 0 -V -1 -W 1 -K

"WEKA.CLASSIFIERS.FUNCTIONS.SUPPORTVECTOR.POLYKERNEL -E 1.0 -C 250007" -
CALIBRATOR "WEKA.CLASSIFIERS.FUNCTIONS.LOGISTIC -R 1.0E-8 -M -1 -NUM-DECIMAL-
PLACES 4"
RELATION: LABOR-NEG-DATA
INSTANCES: 57
ATTRIBUTES: 17
DURATION
WAGE-INCREASE-FIRST-YEAR
WAGE-INCREASE-SECOND-YEAR
WAGE-INCREASE-THIRD-YEAR
COST-OF-LIVING-ADJUSTMENT
WORKING-HOURS
PENSION
STANDBY-PAY
SHIFT-DIFFERENTIAL
EDUCATION-ALLOWANCE
STATUTORY-HOLIDAYS
VACATION
LONGTERM-DISABILITY-ASSISTANCE
CONTRIBUTION-TO-DENTAL-PLAN
BEREAVEMENT-ASSISTANCE
CONTRIBUTION-TO-HEALTH-PLAN
CLASS
TEST MODE: 10-FOLD CROSS-VALIDATION
=== CLASSIFIER MODEL (FULL TRAINING SET) ===
SMO
KERNEL USED:
LINEAR KERNEL: K(X,Y) = <X,Y>
CLASSIFIER FOR CLASSES: BAD, GOOD
BINARYSMO
MACHINE LINEAR: SHOWING ATTRIBUTE WEIGHTS, NOT SUPPORT VECTORS.
0.0754 * (NORMALIZED) DURATION

+ 0.7894 * (NORMALIZED) WAGE-INCREASE-FIRST-YEAR
+ 0.8109 * (NORMALIZED) WAGE-INCREASE-SECOND-YEAR
+ 0.339 * (NORMALIZED) WAGE-INCREASE-THIRD-YEAR
+ -0.0216 * (NORMALIZED) COST-OF-LIVING-ADJUSTMENT=NONE
+ 0.2843 * (NORMALIZED) COST-OF-LIVING-ADJUSTMENT=TCF
+ -0.2628 * (NORMALIZED) COST-OF-LIVING-ADJUSTMENT=TC
+ -0.5644 * (NORMALIZED) WORKING-HOURS
+ -0.8 * (NORMALIZED) PENSION=NONE
+ 0.2033 * (NORMALIZED) PENSION=RET_ALLW
+ 0.5968 * (NORMALIZED) PENSION=EMPL_CONTR
+ 0.3396 * (NORMALIZED) STANDBY-PAY
+ -0.0055 * (NORMALIZED) SHIFT-DIFFERENTIAL
+ -0.5502 * (NORMALIZED) EDUCATION-ALLOWANCE=NO
+ 0.6464 * (NORMALIZED) STATUTORY-HOLIDAYS
+ -0.2443 * (NORMALIZED) VACATION=BELOW_AVERAGE
+ -0.0503 * (NORMALIZED) VACATION=AVERAGE
+ 0.2946 * (NORMALIZED) VACATION=GENEROUS
+ -1.2183 * (NORMALIZED) LONGTERM-DISABILITY-ASSISTANCE=NO
+ -0.2628 * (NORMALIZED) CONTRIBUTION-TO-DENTAL-PLAN=NONE
+ -0.0485 * (NORMALIZED) CONTRIBUTION-TO-DENTAL-PLAN=HALF
+ 0.3113 * (NORMALIZED) CONTRIBUTION-TO-DENTAL-PLAN=FULL
+ -0.6222 * (NORMALIZED) CONTRIBUTION-TO-HEALTH-PLAN=NONE
+ 0.2688 * (NORMALIZED) CONTRIBUTION-TO-HEALTH-PLAN=HALF
+ 0.3534 * (NORMALIZED) CONTRIBUTION-TO-HEALTH-PLAN=FULL
- 0.2873
NUMBER OF KERNEL EVALUATIONS: 1055 (93.756% CACHED)
TIME TAKEN TO BUILD MODEL: 0.01 SECONDS
=== STRATIFIED CROSS-VALIDATION ===

=== SUMMARY ===
CORRECTLY CLASSIFIED INSTANCES 51 89.4737 %

INCORRECTLY CLASSIFIED INSTANCES 6 10.5263 %
KAPPA STATISTIC 0.7635
MEAN ABSOLUTE ERROR 0.1053
ROOT MEAN SQUARED ERROR 0.3244
RELATIVE ABSOLUTE ERROR 23.0111 %
ROOT RELATIVE SQUARED ERROR 67.9505 %
TOTAL NUMBER OF INSTANCES 57
=== DETAILED ACCURACY BY CLASS ===
TP RATE FP RATE PRECISION RECALL F-MEASURE MCC ROC AREA PRC AREA
CLASS
0.800 0.054 0.889 0.800 0.842 0.766 0.873 0.781 BAD
0.946 0.200 0.897 0.946 0.921 0.766 0.873 0.884 GOOD
WEIGHTED AVG. 0.895 0.149 0.894 0.895 0.893 0.766 0.873 0.848
=== CONFUSION MATRIX ===
A B <-- CLASSIFIED AS
16 4 | A = BAD
2 35 | B = GOOD
(G.) KNN (K- NEAREST NEIGHBORS)
Scheme: weka.classifiers.functions.SMO -C 1.0 -L 0.001 -P 1.0E-12 -N 0 -V -1 -W 1 -K

"weka.classifiers.functions.supportVector.PolyKernel -E 1.0 -C 250007" -calibrator
"weka.classifiers.functions.Logistic -R 1.0E-8 -M -1 -num-decimal-places 4"
Instances: 57
Attributes: 17
duration
working-hours
pension
standby-pay
shift-differential
education-allowance
statutory-holidays
vacation
class
SMO
Kernel used:
Linear Kernel: K(x,y) = <x,y>
Classifier for classes: bad, good
BinarySMO
Machine linear: showing attribute weights, not support vectors.
0.0754 * (normalized) duration

+ 0.7894 * (normalized) wage-increase-first-year
+ 0.8109 * (normalized) wage-increase-second-year
+ 0.339 * (normalized) wage-increase-third-year
+ -0.0216 * (normalized) cost-of-living-adjustment=none
+ 0.2843 * (normalized) cost-of-living-adjustment=tcf
+ -0.2628 * (normalized) cost-of-living-adjustment=tc
+ -0.5644 * (normalized) working-hours
+ -0.8 * (normalized) pension=none
+ 0.2033 * (normalized) pension=ret_allw
+ 0.5968 * (normalized) pension=empl_contr
+ 0.3396 * (normalized) standby-pay
+ -0.0055 * (normalized) shift-differential
+ -0.5502 * (normalized) education-allowance=no
+ 0.6464 * (normalized) statutory-holidays
+ -0.2443 * (normalized) vacation=below_average
+ -0.0503 * (normalized) vacation=average
+ 0.2946 * (normalized) vacation=generous
+ -1.2183 * (normalized) longterm-disability-assistance=no
+ -0.2628 * (normalized) contribution-to-dental-plan=none
+ -0.0485 * (normalized) contribution-to-dental-plan=half
+ 0.3113 * (normalized) contribution-to-dental-plan=full
+ -0.6222 * (normalized) contribution-to-health-plan=none
+ 0.2688 * (normalized) contribution-to-health-plan=half
+ 0.3534 * (normalized) contribution-to-health-plan=full
- 0.2873
Number of kernel evaluations: 1055 (93.756% cached)

=== Summary ===

0.800 0.054 0.889 0.800 0.842 0.766 0.873 0.781 bad
0.946 0.200 0.897 0.946 0.921 0.766 0.873 0.884 good
Weighted Avg. 0.895 0.149 0.894 0.895 0.893 0.766 0.873 0.848
16 4 | a = bad
2 35 | b = good
Date: _________
Experiment 6
Aim:Analysis of round trip Time of Flight measurement from a supermarket.
Algorithms:
1. Naïve Bayes
Scheme: weka.classifiers.bayes.NaiveBayes
Relation: supermarket
Instances: 4627
Attributes: 217
[list of attributes omitted]
Naive Bayes Classifier
=== Summary ===
Kappa statistic 0
Relative absolute error 100 %
Root relative squared error 100 %
1.000 1.000 0.637 1.000 0.778 0.000 0.499 0.637 low
0.000 0.000 0.000 0.000 0.000 0.000 0.499 0.363 high
Weighted Avg. 0.637 0.637 0.406 0.637 0.496 0.000 0.499 0.537
2948 0 | a = low
1679 0 | b = high
Mean absolute error is:
MAE = 1N∑i=1N|θ^i−θi|
2.Decision stump
Scheme: weka.classifiers.trees.DecisionStump
Instances: 4627
Attributes: 217
Decision Stump
Classifications
tissues-paper prd = t : high

tissues-paper prd != t : low
tissues-paper prd is missing : low
Class distributions
tissues-paper prd = t
low high
0.48553627058299953 0.5144637294170005
tissues-paper prd != t
low high
0.7802521008403361 0.21974789915966386
tissues-paper prd is missing
low high
0.7802521008403361 0.21974789915966386

=== Summary ===

0.627 0.325 0.772 0.627 0.692 0.290 0.642 0.732 low
0.675 0.373 0.507 0.675 0.579 0.290 0.642 0.466 high
Weighted Avg. 0.644 0.343 0.676 0.644 0.651 0.290 0.642 0.635
1847 1101 | a = low
546 1133 | b = high
3.Random forest
== Run information ===
Scheme: weka.classifiers.trees.RandomForest -P 100 -I 100 -num-slots 1 -K 0 -M 1.0 -V 0.001 -S 1

Instances: 4627
Attributes: 217
RandomForest
Bagging with 100 iterations and base learner
weka.classifiers.trees.RandomTree -K 0 -M 1.0 -V 0.001 -S 1 -do-not-check-capabilities

=== Summary ===

Kappa statistic 0
1.000 1.000 0.637 1.000 0.778 0.000 0.500 0.637 low
0.000 0.000 0.000 0.000 0.000 0.000 0.500 0.363 high
Weighted Avg. 0.637 0.637 0.406 0.637 0.496 0.000 0.500 0.538
2948 0 | a = low
1679 0 | b = high
4. MLP(multi layer preceptron)
Scheme: weka.classifiers.functions.MultilayerPerceptron -L 0.3 -M 0.2 -N 500 -V 0 -S 0 -E 20 -H a

Instances: 4627
Attributes: 217
Attrib department216 0.044512208908162154

Class low
Input
Node 0
Class high
Input
Node 1
5. K MEAN CLUSTERING
Scheme: weka.clusterers.SimpleKMeans -init 0 -max-candidates 100 -periodic-pruning 10000 -min-

density 2.0 -t1 -1.25 -t2 -1.0 -N 2 -A "weka.core.EuclideanDistance -R first-last" -I 500 -num-
slots 1 -S 10
Instances: 4627
Attributes: 217
=== Clustering model (full training set) ===
Number of iterations: 2
Within cluster sum of squared errors: 0.0
Initial starting points (random):

Cluster 0:
t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t
,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,
t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,high
Cluster 1:
t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t
,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,
t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,t,low
Missing values globally replaced with mean/mode
Final cluster centroids:

Cluster#
Attribute Full Data 0 1
(4627.0) (1679.0) (2948.0)
=====================================================
department1 t tt
department2 t tt
department3 t tt
department4 t tt
department5 t tt
department6 t tt
department7 t tt
department8 t tt
department9 t tt
grocery misc t tt
department11 t tt
baby needs t tt
bread and cake t tt
baking needs t tt
coupons t tt
Time taken to build model (full training data) : 0.22 seconds
=== Model and evaluation on training set ===
Clustered Instances
0 1679 ( 36%)
1 2948 ( 64%)
Result:
By perform the classification by using the above five algorithms, we observe that ‘Naïve bayes’ take the
least time to build model and naïve bayes is also most accurate with least Mean Absolute Error.
Therefore, we conclude that out of the above algorithms, Naïve Bayes performs best.
Date: _________
Experiment 7
Aim:Implement supervised learning (KNN classification)
Sample Input:
Step 1: Open WEKA GUI and Select Explorer

Step 2: Load the Breast Cancer data set (breast-cancer.arff) given in experiment 4 databases,
using“Open File”
Step 3: Choose the“Classify”Tab and Choose The Decision Tree Classifier labelled asJ48in
the trees folder and choose “Cross-Validation” and enter 5 in the Folds, then press Start
Output:
Scheme: weka.classifiers.trees.J48 -C 0.25 -M 2

Relation: breast-cancer
Instances: 286
Attributes: 10
age
menopause
tumor-size
inv-nodes
node-caps
deg-malig
breast
breast-quad
irradiat
Class
J48 pruned tree

------------------
node-caps = yes
| deg-malig = 1: recurrence-events (1.01/0.4)
| deg-malig = 2: no-recurrence-events (26.2/8.0)
| deg-malig = 3: recurrence-events (30.4/7.4)
node-caps = no: no-recurrence-events (228.39/53.4)
Number of Leaves : 4
Size of the tree : 6

=== Summary ===
TP Rate FP Rate Precision Recall F-Measure MCC ROC Area PRC Area
Class
0.960 0.776 0.745 0.960 0.839 0.287 0.582 0.728 no-recurrence-
events
0.224 0.040 0.704 0.224 0.339 0.287 0.582 0.444 recurrence-events
Weighted Avg. 0.741 0.558 0.733 0.741 0.691 0.287 0.582 0.643
193 8 | a = no-recurrence-events
66 19 | b = recurrence-events
Date: _________
Experiment 8
Aim:Understanding of R and its basics
R is a programming language and software environment for statistical analysis, graphics representation
and reporting. R was created by Ross Ihaka and Robert Gentleman at the University of Auckland, New
Zealand, and is currently developed by the R Development Core Team.
The core of R is an interpreted computer language which allows branching and looping as well as
modular programming using functions. R allows integration with the procedures written in the C, C++,
.Net, Python or FORTRAN languages for efficiency.
R is freely available under the GNU General Public License, and pre-compiled binary versions are
provided for various operating systems like Linux, Windows and Mac.
R is free software distributed under a GNU-style copy left, and an official part of the GNU project
called GNU S.
Evolution of R
R was initially written by Ross Ihaka and Robert Gentleman at the Department of Statistics of the
University of Auckland in Auckland, New Zealand. R made its first appearance in 1993.
● A large group of individuals has contributed to R by sending code and bug reports.
● Since mid-1997 there has been a core group (the "R Core Team") who can modify the R source
code archive.
Features of R
As stated earlier, R is a programming language and software environment for statistical analysis,
graphics representation and reporting. The following are the important features of R −
● R is a well-developed, simple and effective programming language which includes conditionals,
loops, user defined recursive functions and input and output facilities.
● R has an effective data handling and storage facility,
● R provides a suite of operators for calculations on arrays, lists, vectors and matrices.
● R provides a large, coherent and integrated collection of tools for data analysis.
● R provides graphical facilities for data analysis and display either directly at the computer or
printing at the papers.
As a conclusion, R is world’s most widely used statistics programming language. It's the # 1 choice of
data scientists and supported by a vibrant and talented community of contributors. R is taught in
universities and deployed in mission critical business applications.
Date: _________
BEYOND THE SYLLABUS
Experiment 1
Aim:Understanding of RMS Titanic Dataset to predict survival by training a model and predict the
required solution.
The sinking of the RMS Titanic is one of the most infamous shipwrecks in history. On April 15, 1912,
during her maiden voyage, the Titanic sank after colliding with an iceberg, killing 1502 out of 2224
passengers and crew. This sensational tragedy shocked the international community and led to better
safety regulations for ships.One of the reasons that the shipwreck led to such loss of life was that there
were not enough lifeboats for the passengers and crew. Although there was some element of luck
involved in surviving the sinking, some groups of people were more likely to survive than others, such as
women, children, and the upper-class.
• Survived (Target Variable) - Binary categorical variable where 0 represents not survived and 1
represents survived.
• Pclass - Categorical variable. It is passenger class.
• Sex - Binary Variable representing the gender the of passenger
• Age - Feature engineered variable. It is divided into 4 classes.
• Fare - Feature engineered variable. It is divided into 4 classes.
• Embarked - Categorical Variable. It tells the Port of embarkation.
• Title - New feature created from names. The title of names is classified into 4 different classes.
• isAlone - Binary Variable. It tells whether the passenger is travelling alone or not.
• Age*Class - Feature engineered variable.
Model, predict and solve

Now we are ready to train a model and predict the required solution. There are 60+ predictive modelling
algorithms to choose from. We must understand the type of problem and solution requirement to narrow
down to a select few models which we can evaluate. Our problem is a classification and regression
problem. We want to identify relationship between output (Survived or not) with other variables or
features (Gender, Age, Port...). We are also performing a category of machine learning which is called
supervised learning as we are training our model with a given dataset. With these two criteria -
Supervised Learning plus Classification and Regression, we can narrow down our choice of models to a
few. These include:
• Logistic Regression
• KNN or k-Nearest Neighbours
• Support Vector Machines
• Naive Bayes classifier
• Decision Tree
Size of the training and testing dataset
1. Logistic Regression is a useful model to run early in the workflow. Logistic regression measures the
relationship between the categorical dependent variable (feature) and one or more independent variables
(features) by estimating probabilities using a logistic function, which is the cumulative logistic
distribution.
Note the confidence score generated by the model based on our training dataset.
2. In pattern recognition, the k-Nearest Neighbours algorithm (or k-NN for short) is a non-parametric
method used for classification and regression. A sample is classified by a majority vote of its neighbours,
with the sample being assigned to the class most common among its k nearest neighbours (k is a positive
integer, typically small). If k = 1, then the object is simply assigned to the class of that single nearest
neighbour.
KNN confidence score is better than Logistics Regression but worse than SVM.
3. Next we model using Support Vector Machines which are supervised learning models with associated
learning algorithms that analyze data used for classification and regression analysis. Given a set of
training samples, each marked as belonging to one or the other of two categories, an SVM training
algorithm builds a model that assigns new test samples to one category or the other, making it a non-
probabilistic binary linear classifier.
Note that the model generates a confidence score which is higher than Logistics Regression model.
4. In machine learning, naive Bayes classifiers are a family of simple probabilistic classifiers based on
applying Bayes' theorem with strong (naive) independence assumptions between the features. Naive
Bayes classifiers are highly scalable, requiring a number of parameters linear in the number of variables
(features) in a learning problem.
The model generated confidence score is the lowest among the models evaluated so far.
5. This model uses a decision tree as a predictive model which maps features (tree branches) to
conclusions about the target value (tree leaves). Tree models where the target variable can take a finite set
of values are called classification trees; in these tree structures, leaves represent class labels and branches
represent conjunctions of features that lead to those class labels. Decision trees where the target variable
can take continuous values (typically real numbers) are called regression trees. The model confidence
score is the highest among models evaluated so far.
Date: _________
Experiment 2
Aim:Understanding of Indian education in Rural villages to predict whether girl child will be sent to
school or not?
The data is focused on rural India. It primarily looks into the fact whether the villagers are willing to send
the girl children to school or not and if they are not sending their daughters to school the reasons have
also been mentioned. The district is Gwalior. Various details of the villagers such as village, gender, age,
education, occupation, category, caste, religion, land etc have also been collected.
1. Naïve Bayes Classifier
The algorithm was run with 10-fold cross-validation: this means it was given an opportunity to make a
prediction for each instance of the dataset (with different training folds) and the presented result is a
summary of those predictions. Firstly, I noted the Classification Accuracy. The model achieved a result of
109/200 correct or 54.5%.
a b c d e f g h i j k l m <-- classified as
0 0 1 1 0 1 0 2 0 0 0 0 0 | a = Govt.
2 1 1 1 8 0 0 0 0 1 0 0 0 | b = Driver
2 0 17 2 9 0 0 2 0 0 0 0 0 | c = Farmer
0 0 4 3 2 0 1 0 0 1 0 0 0 | d = Shopkeeper
1 8 2 3 73 1 0 1 1 3 2 2 0 | e = labour
3 0 0 0 0 0 0 1 0 0 0 0 0 | f = Security Guard
0 1 0 1 0 0 0 2 0 0 0 0 0 | g = Raj Mistri
1 0 0 0 1 1 0 8 0 0 0 0 0 | h = Fishing
0 0 2 0 0 0 0 0 2 0 0 0 0 | i = Labour & Driver
0 0 2 0 1 0 0 0 0 2 0 0 0 | j = Homemaker
0 0 0 0 1 0 0 0 0 2 0 0 0 | k = Govt School Teacher
0 0 0 1 4 0 0 0 0 0 0 0 0 | l = Dhobi
1 0 0 0 3 0 0 0 0 0 0 0 1 | m = goats
The confusion matrix shows the precision of the algorithm showing that 1,1,1,2 Government officials
were misclassified as Farmer, Shopkeeper, Security Guard and Fishermen respectively, 2,1,1,8,1 Drivers
were misclassified as Government officials, Farmer, Shopkeeper, Labour, Homemaker, and so on. This
table can help to explain the accuracy achieved by the algorithm.
Now when we have model,
we need to load our test data we’ve created before. For this, select Supplied test set and click button Set.
Click More Options, where in new window, choose PlainText from Output predictions. Then click left
mouse button on recently created model on result list and select Re-evaluate model on current test set.
After re-evaluation
Now the Classification Accuracy is 151/200 correct or 75.5%.

TP = true positives: number of examples predicted positive that are actually positive
FP = false positives: number of examples predicted positive that are actually negative
TN = true negatives: number of examples predicted negative that are actually negative
FN = false negatives: number of examples predicted negative that are actually positive
Recall is the TP rate ( also referred to as sensitivity) what fraction of those that are actually positive were
predicted positive? : TP / actual positives Precision is TP / predicted Positive
what fraction of those predicted positive are actually positive? precision is also referred to as Positive
predictive value (PPV); Other related measures used in classification include True Negative Rate and
Accuracy: True Negative Rate is also called Specificity. (TN / actual negatives) 1-specificity is x-axis of
ROC curve: this is the same as the FP rate (FP / actual negatives) F-measure A measure that combines
precision and recall is the harmonic mean of precision and recall, the traditional F-measure or balanced F-
score:
Mean absolute error (MAE)
The MAE measures the average magnitude of the errors in a set of forecasts, without considering their
direction. It measures accuracy for continuous variables. The equation is given in the library references.
Expressed in words, the MAE is the average over the verification sample of the absolute values of the
differences between forecast and the corresponding observation. The MAE is a linear score which means
that all the individual differences are weighted equally in the average;
Root mean squared error (RMSE)

The RMSE is a quadratic scoring rule which measures the average magnitude of the error. The equation
for the RMSE is given in both of the references. Expressing the formula in words, the difference between
forecast and corresponding observed values are each squared and then averaged over the sample. Finally,
the square root of the average is taken. Since the errors are squared before they are averaged, the RMSE
gives a relatively high weight to large errors. This means the RMSE is most useful when large errors are
particularly undesirable.
2. Support Vector Machine
The model achieved a result of 181/200 correct or 92.3469%.

We have classified the dataset on the basis the reasons why the villagers are unwilling to send girl
children to schools in Gwalior village. The different classes are NA, Poverty, Marriage, Distance, X,
Unsafe Public Space, Transport Facilities, and Household Responsibilities.
The weighted average true positive rate is 0.923 that is nearly all the predicted positive values are actually
positive. The weighted average false positive rate is 0.205 that is few of them are predicted as positive
values but are actually negative. The precision in 0.902 that is the algorithm is nearly accurate.
a b c d e f g h <-- classified as
147 0 1 0 0 0 0 0 | a = NA
4 12 0 0 0 0 0 0 | b = Poverty
5 0 3 0 0 0 0 0 | c = Marriage
0 0 1 3 0 0 0 0 | d = Distance
0 0 0 0 8 0 0 0 |e=X
4 0 0 0 0 0 0 0 | f = Unsafe Public Space
0 0 0 0 0 0 4 0 | g = Transport Facilities
1 0 0 0 0 0 0 4 | h = Household Responsibilities
The confusion matrix shows that majority of the reasons were not available and out of the reasons which
were available people did not send their daughters to school because of poverty and very few of them
considered Distance as a major factor for not sending their girl children to school.
3. Random Forest
The accuracy of this algorithm is 100% that is 200/200 have been correctly classified
a b c d e f g h i j k l m <-- classified as
5 0 0 0 0 0 0 0 0 0 0 0 0 | a = Govt.
0 14 0 0 0 0 0 0 0 0 0 0 0 | b = Driver
0 0 32 0 0 0 0 0 0 0 0 0 0 | c = Farmer
0 0 0 11 0 0 0 0 0 0 0 0 0 | d = Shopkeeper
0 0 0 0 97 0 0 0 0 0 0 0 0 | e = labour
0 0 0 0 0 4 0 0 0 0 0 0 0 | f = Security Guard
0 0 0 0 0 0 4 0 0 0 0 0 0 | g = Raj Mistri
0 0 0 0 0 0 0 11 0 0 0 0 0 | h = Fishing
0 0 0 0 0 0 0 0 4 0 0 0 0 | i = Labour & Driver
0 0 0 0 0 0 0 0 0 5 0 0 0 | j = Homemaker
0 0 0 0 0 0 0 0 0 0 4 0 0 | k = Govt School Teacher
0 0 0 0 0 0 0 0 0 0 0 5 0 | l = Dhobi
1 0 0 0 0 0 0 0 0 0 0 0 4 | m = goats
There is no observation which has been misclassified. Maximum number of villagers are laborers.
4. Random Tree
The classification accuracy is 76.0204% that is 149/200 have been classified correctly.
The false positive rate is 0.352 that is highest of all the four algorithms applied above. Here 35.2% of the
values which should have been classified negatively have been assigned a positive value.
a b c d e f g h <-- classified as
126 7 3 1 0 8 3 0 | a = NA
7 8 1 0 0 0 0 0 | b = Poverty
4 1 3 0 0 0 0 0 | c = Marriage
1 0 0 3 0 0 0 0 | d = Distance
2 0 0 0 6 0 0 0 | e=X
4 0 0 0 0 0 0 0 | f = Unsafe Public Space
3 1 0 0 0 0 0 0 | g = Transport Facilities
1 0 0 0 0 0 0 3 | h = Household Responsibilities
22 NA , 8 Poverty , 5 Marriage, 1 Distance, 2 X, 4 Unsafe Public Space, 4 Transport Facilities and 1

Household Responsibilities class values have been misclassified.
The best algorithm out of the above algorithms is Random Forest with 100% accuracy rate and the worst
is Naïve Bayes algorithm with 75.5% accuracy rate.
Date: _________
Experiment 3
Aim:Understanding ofDataset of contact patterns among students collected in National University of

Singapore.
This is dataset collected from contact patterns among students collected during the spring semester 2006
in National University of Singapore
Using RemovePercentage filter, instances have been reduced to: 500

This data has been taken and saved as training data set and then used for further classification.
ALGORITHM-1 : GaussianProcesses
Scheme: weka.classifiers.functions.SimpleLinearRegression
Relation: MOCK_DATA (1)-weka.filters.unsupervised.instance.RemovePercentage-P50.0
Instances: 500
Attributes: 4
Start Time
Session Id
Student Id
Duration
Linear regression on Session Id
0.03 * Session Id + 10.38
=== Evaluation on training set ===
Time taken to test model on training data: 0 seconds
=== Summary ===

Correlation coefficient 0.0677
ALGORITHM 2: Linear Regression
Linear Regression Model
Start Time =
0.0274 * Session Id +
10.3846
=== Summary ===
Correlation coefficient 0.0677

Algorithm 3: Decision Table
Algorithm 3: DecisionTable
Merit of best subset found: 5.814

Evaluation (for feature selection): CV (leave one out)
Feature set: 1
=== Summary ===
Correlation coefficient 0
Relative absolute error 100 %
CONCLUSION:
Six algorithms have been used to measure the best classifier. Depending on various attributes,
performance of various algorithms can be measured via mean absolute error and correlation coefficient.
Depending on the results above, worst correlation has been found by DecisionTable and best correlation
has been found by Decision Stump
Scheme: weka.classifiers.rules.DecisionTable -X 1 -S "weka.attributeSelection.BestFirst -D 1 -N 5"

Relation: MOCK_DATA (1)-weka.filters.unsupervised.instance.RemovePercentage-P50.0
Instances: 500
Attributes: 4
Start Time
Session Id
Student Id
Duration
Decision Table:
Number of training instances: 500

Number of Rules : 1
Non matches covered by Majority class.
Best first.
Start set: no attributes
Search direction: forward
Stale search after 5 node expansions
Total number of subsets evaluated: 9

Experiment 1 Aim:: Introduction To ML Lab With Tools (Hands On WEKA On Data Set (Iris - Arff) ) - (A) Start Weka

Uploaded by

Copyright:

Available Formats

Experiment 1 Aim:: Introduction To ML Lab With Tools (Hands On WEKA On Data Set (Iris - Arff) ) - (A) Start Weka

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Experiment 1 Aim:: Introduction To ML Lab With Tools (Hands On WEKA On Data Set (Iris - Arff) ) - (A) Start Weka

Uploaded by

Copyright:

Available Formats

Date: _________

Weka GUI Chooser

(c) Select and Run an Algorithm

(d) Review Results

Aim:Understanding of Machine learning algorithms

Scheme: weka.clusterers.SimpleKMeans -init 0 -max-candidates 100 -periodic-pruning 10000 -min-

=== Clustering model (full training set) ===

Initial starting points (random):

Missing values globally replaced with mean/mode

Final cluster centroids:

Time taken to build model (full training data) : 0.01 seconds

=== Model and evaluation on training set ===

Aim:Study sample ARFF files in Database.

1. CSV- comma separated value

Number of Instances: 286

Missing Attribute Values: (denoted by "?")

4. Relevant Information Paragraph:

6. Number of Attributes: 4 (all nominal)

1. age of the patient: (1) young, (2) pre-presbyopic, (3) presbyopic

8. Number of Missing Attribute Values: 0

@attribute age {young, pre-presbyopic, presbyopic}

1. Title: German Credit data

Attribute 14: (qualitative)

Relabeled values in attribute checking_status

Aim: Implement major classification algorithms.

(a) Naive Bayes algorithm

=== Run information ===

=== Classifier model (full training set) ===

Naive Bayes Classifier

Time taken to build model: 0 seconds

=== Stratified cross-validation ===

Correctly Classified Instances 51 89.4737 %

=== Detailed Accuracy By Class ===

=== Confusion Matrix ===

=== Classifier model (full training set) ===

pension = none : bad

=== Stratified cross-validation ===

Correctly Classified Instances 46 80.7018 %

=== Detailed Accuracy By Class ===

=== Confusion Matrix ===

(c) Classification and Regression Trees:

=== Run information ===

Scheme: weka.classifiers.meta.ClassificationViaRegression -W weka.classifiers.trees.M5P -- -M 4.0

Classification via Regression

Classifier for class with index 0:

M5 pruned model tree:

wage-increase-first-year <= 4.55 :

Classifier for class with index 1:

M5 pruned model tree:

wage-increase-first-year <= 4.55 :

Time taken to build model: 0.19 seconds

=== Stratified cross-validation ===

Correctly Classified Instances 47 82.4561 %

=== Detailed Accuracy By Class ===

=== Confusion Matrix ===

(D) Autoregressive Integrated Moving Average Model(ARIMA)

=== Run information ===

Scheme: weka.classifiers.functions.Logistic -R 1.0E-8 -M -1 -num-decimal-places 4

=== Classifier model (full training set) ===