LU 6 Mean Comparison
LU 6 Mean Comparison
LU 6 Mean Comparison
Assuming that all other factors have been considered, it is rational to use t-
test for even large sample, because the population variance is unknown for
almost all cases in practice. When we use sample variance for population
variance, we deal with t distribution. This is right philosophically.
Numerically, when n> 30, statistic t and statistic z are closed, or t
distribution is closed to normal distribution, and more important, the
influence of the degrees of freedom on the shape of distribution gradually
becomes null.
Introduction
Research Question: Does the IQ scores of the sample differ from 100? (Is there a
significant difference between the IQ scores of the samples and 100?)
Step 1. With SPSS open, Click File, Open, Data, and search where the Excel file
is saved. Specify: Files of type (*.xls,*xlsx,*xlsm). Choose the excel file:
DATA SET (one sample t test). Click open, then OK.
Step 3. Select IQ and put it in the Test Variable(s) box. Set Test Value to 100 ,
the specified constant.
(Note: We are testing whether the mean IQ of the sample is equal to 100)
One-Sample T-Test
Step 4. Click continue, then OK. The result of the analysis is shown
below.
One-Sample T-Test
(一次样本T检验)
One-Sample T-Test
Problem 2. Test whether the average weight of the sample respondents is equal
to 110 lbs.
Research Question: Does the average weight of the samples differ from 110
lbs?
Null Hypothesis: There is no difference between the Mean weight of the
respondents and 110 lbs. (𝐻𝑜: 𝑀𝑒𝑎𝑛#$%&'( = 110)
Alternative Hypothesis: There is a difference between the Mean weight of the
respondents and 110 lbs. (𝐻𝑎: 𝑀𝑒𝑎𝑛#$%&'( ≠ 110)
Test Statistic: One sample t-test
One-Sample T-Test
Example 1. In a study on high blood pressure, all patients are measured at the
beginning of the study, given a treatment, and are measured again. Thus,
each subject has two measures, often called before and after measures.
Example 2. How would you know if there was a significant increase in the post
test of the students after they were exposed to a treatment (i.e. new
method of teaching)?
Paired Sample T-Test
Null Hypothesis: There is no difference between the pretest and post test
scores.
(𝐻𝑜: 𝑀𝑒𝑎𝑛)*$($+( = 𝑀𝑒𝑎𝑛),+(($+( )
Step 1. With SPSS open, Click File, Open, Data, and search where the Excel file
is saved. Specify: Files of type (*.xls,*xlsx,*xlsm). Choose the excel file:
DATA SET (paired sample t-test). Click open, then OK.
Step 3. Select pretest and posttest and put it in the Paired Variables as Pair 1.
Note that the default option for confidence interval percentage is .05%
(We can change it to .01 or .001)
Using the same data set, we perform the same procedure , using before
and after as paired variables.
Research Question: Is there a significant difference on the Math scores between those
who were taught the traditional and new method of teaching?
Null Hypothesis: There is no significant difference on the Math scores between students
who were taught the traditional and the new method of teaching
(𝐻𝑜: 𝑀𝑒𝑎𝑛!"#$%!%&'#( = 𝑀𝑒𝑎𝑛')* ,)!-&$ )
Step 1. With SPSS open, Click File, Open, Data, and search where the Excel file is saved.
Specify: Files of type (*.xls,*xlsx,*xlsm). Choose the excel file: DATA SET (independent
sample t test) .Click Open, then OK.
Step 3. Select Math score and put it as Test Variable(s), select group and put it in Grouping
Variable. The default option for confidence interval percentage is .05 (We can change it
to .01 or ,.001)
Step 4. Click Define groups. Since 1 is the code we used for Group 1 (new method) and 2 for
Group 2 (traditional), we will use the same numbers in defining the groups.
Results: The Mean score in Math of Group 1, n=51 (new method of teaching) is
78.96 and the Standard Deviation is 8.93, while the Mean score of Group
2, n=49 (traditional method) is 76.84 and Standard Deviation is 7.98. The
mean difference (Group 1 – Group 2) is 2.214. The computed t-statistics
𝑡 = 1.253 (when we assumed that variances of Group 1 and 2 are equal
as shown by the Levene’s test for Equality of Variances*), df (degrees of
freedom) is 98: that is 𝑛 − 2 = 100 − 2 = 98, and the alpha level or p-
value Sig. (2-tailed) is 0.213 which is p>0.05. Since p>0.05, we retain the
null hypothesis saying that the mean score of Group 1 is not different with
the mean scores of Group 2. The result of the independent sample T-test
shows that 78.96 is statistically equal to 76.84.
Independent Sample T-test
Step 1. With SPSS open, Click File, Open, Data, and search where the Excel file is saved.
Specify: Files of type (*.xls,*xlsx,*xlsm). Choose the excel file: DATA SET (one-way
anova). Click Open, then OK.
Step 3. Select Science score and put it on the Dependent List. Select review technique
and put it as the Factor. The default option for confidence interval percentage is
.05% (You can change it to .01 or .001)
Step 4. Select Options and Click Descriptive & Homogeneity of variance test, Then click
Continue
One-way ANOVA (Analysis of Variance)
Step 5. Click Post Hoc*, then Select 1 (Scheffe and Bonferroni are the most
commonly used). Click Continue
*Post hoc analysis is used to determine which pair of means are equal or
different. If the ANOVA result is significant, it indicates that at least 1 pair of
means is different (the highest value and the lowest value are significantly
different). It could be 2 pairs, or 3 pairs. If the ANOVA is not significant, no need
to analyze the post.
Results 1. Descriptive statistics show that the Mean of Group 1 (self-review, n=16) is
77.25, Group 2 (pair review, n=31) is 80.16, and Group 3 (group review, n=13) is
80.69. Levene’s test show that the data is homoscedastic, (F=0.577, p>0.05,
indicating that there are no significant differences on the variance of the three
groups.
Results 2. ANOVA Table shows that the F-value (Between Groups) is 0.668, and p=value
(Sig.) is 0.517, which is greater than 0.05. The df between groups is 2 (3 groups –
1) and within group is 57 (n–2–1 = 60–2–1). Since the p-value>0.05, we retain the
null hypothesis stating that the three means are equal. Statistically, 77.25, 80.16
and 80.69 are equal. Note: There is no need to examine post hoc analysis because
the overall ANOVA indicates no significant differences.
One-way ANOVA (Analysis of Variance)
One way analysis of variance was performed to determine the effect of type of review
to Science scores. Results show that type of review has no significant effect to Science sores,
𝐹(",$%) = 0.668, 𝑝 > 0.05. The average scores of those who self-reviewed (𝑀𝑒𝑎𝑛 = 77.25, 𝑆𝐷 =
11.03), pair reviewed (Mean=80.16, SD = 8.71) and group reviewed (𝑀𝑒𝑎𝑛 = 80.69, 𝑆𝐷 = 7.39)
are equal. The null hypothesis is retained. It implies that the type of review does not affect the
performance of the students in Science.
One-way ANOVA (Analysis of Variance)
Problem 2. Determine the effect of type of review to the students’ English scores.
Using the same data set, we run an ANOVA with English as the
dependent variable.
Results: The Mean of Group 1 (self review) is 78.56, Group 2 (pair review) is 79.10 and Group 3
(group review) is 90.15. The data is homoscedastic as shown in the Levene’s test, (F = 0.374,
p>0.05). The ANOVA model is significant, F-value = 6.599, p=0.003, which is less than 0.05.
Since p-value <0.05, we reject the null hypothesis stating that there is no difference between
the means. The result of the One Way ANOVA indicates that there is significant difference.
Since the ANOVA is significant, we examine the post hoc analysis to determine which pair/s
of means are different. The multiple comparison using Scheffe shows that the difference
between Group 1 (self) and 2 (pair) is not significant (p=0.985, which is p>0.05). However, the
difference between Group 1 (self) and Group 3 (group) is significant (p=0.011, which is
p<0.05). The difference between Group 2 (pair) and Group 3 (group) is also significant
(p=0.005, which is p<0.05). Of the three pairs of means, two are found to be significantly
different: Group 1 vs Group 3 and between Group 2 vs Group 3.
One-way ANOVA (Analysis of Variance)
One way analysis of variance was performed to determine the effect of type of review to
English scores. Results show that type of review has significant main effect to English scores, 𝐹(",$%) =
6.599, 𝑝 < 0.01. The average scores of those who group reviewed (𝑀𝑒𝑎𝑛 = 90.15, 𝑆𝐷 = 10.96) was the
highest. Post hoc analysis using Scheffe showed that those who group reviewed scored significantly higher
than those who pair reviewed (𝑀𝑒𝑎𝑛 = 79.10, 𝑆𝐷 = 9.53) and self- reviewed (𝑀𝑒𝑎𝑛 = 78.56, 𝑆𝐷 =
9.67). On the other hand, there is no significant difference between self and pair review. The null
hypothesis is rejected. It implies that the type of review affects the performance of the students in
English.
One-way ANCOVA (Analysis of Covariance)
Step 1. With SPSS open, Click File, Open, Data, and search where the Excel file
is saved. Specify: Files of type (*.xls,*xlsx,*xlsm). Choose the excel file:
DATA SET (ancova). Click Open, then OK.
Step 2. Click Analyze, General Linear Model, Univariate
Step 3. Select English score and put it on the Dependent Variable. Select review
technique and put it on the Fixed Factor(s), and put the Verbal IQ scores
as Covariate(s).
Step 4. Select Options. Display Means for (OVERALL) and review technique.
Click Descriptive statistics and Estimates of effect size. Then click
Continue.
Step 5. Click OK, and we have the result.
One-way ANCOVA (Analysis of Covariance)
Result 1: The Mean of Group 1 (self review) is 78.56, Group 2 (pair review) is 79.10 and
Group 3 (group review) is 90.15. This is the same result for the descriptive
statistics.
Results 2. ANOVA Table shows that there is a significant main effect of Verbal IQ scores
to English scores, 𝐹(6,89) = 1197.64, and p-value (Sig.) is 0.000. The independent
variable (review technique) does not affect English scores, 𝐹(;,89) = 0.020, and p–
value (Sig.) is 0.980.
The independent variable (review technique) affects English test scores, when the
model does not include the covariate (Verbal IQ scores). Using analysis of
covariance (ANCOVA), the effect of review technique is no longer significant. In
other words, English test scores are influenced by verbal IQ scores, and not the
type of review conducted.
One-way ANCOVA (Analysis of Covariance)