Classroom Assessment TQ Questionnaire
Classroom Assessment TQ Questionnaire
Classroom Assessment TQ Questionnaire
TESOL Quarterly invites readers to submit short reports and updates on their
work. These summaries may address any areas of interest to Quarterly readers.
doi: 10.1002/tesq.476
2 TESOL QUARTERLY
experience various forms of classroom assessment in their English
course? (2) What may characterize these EFL students’ motivational dis-
position related to their English course? and (3) What is the relationship
between various forms of classroom assessment practice and these EFL
students’ learning motivation? Building on previous studies (e.g., Broo-
khart, 1997; Cheng & Fox, 2017; You & D€ ornyei, 2016), we hypothesized
that (1) Chinese university EFL students experience student-centred
assessment such as self-assessment the least; (2) there is a higher level of
endorsement for effort investment compared with other motivational
dimensions among these Chinese university EFL students; and (3) class-
room assessment practices are closely associated with students’ learning
motivation, and different classroom assessment practices predict stu-
dents’ learning motivation to a different extent.
THIS STUDY
Motivational Variables as Operationalized in This Study
Participants
Instruments
4 TESOL QUARTERLY
investment (3 items; e.g., “I persist in reading English newspapers,
magazines, or novels to improve my English proficiency”); and linguis-
tic self-confidence (3 items; e.g., “I am sure that one day I will be able
to speak English fluently”).
Data Analyses
To explore the factor structure of the two instruments used in the
current study, we split the total sample randomly with one half being
used for exploratory factor analysis (EFA; n = 102) and the other half
for confirmatory factor analysis (CFA; n = 102). First, by using SPSS
22.0 (IBM Corporation, Armonk, NY), we conducted EFA with princi-
pal component analysis and Promax rotation; and to determine the
number of factors we used Kaiser’s eigenvalues-greater-than-one crite-
rion (Kaiser, 1960) and the scree plot (Raubenheimer, 2004); more-
over, we excluded items showing loadings less than 0.4 (DeVellis,
2003) and/or cross-loading on two or more factors with loadings of
0.4 or greater (Krishnan, 2011). After the factor structure was derived
from the EFA, we performed CFA by using Mplus 7.4 (Muthen and
Muth en, Los Angeles, CA) to confirm the factor structure with the
other half sample; and we used the weighted least squares means and
variance adjusted (WLSMV) estimator to estimate the model parame-
ters because it has been shown to be the best estimator for Likert-type
data (Wang & Cunningham, 2005). In addition, to evaluate the model
fitness the following fit indices with cut-off values (Hooper, Coughlan,
& Mullen, 2008) were reported: the root mean square error of approx-
imation (RMSEA; < 0.08 indicates good fit), the comparative fit index
(CFI; > 0.90 indicates good fit), the Tucker-Lewis index (TLI; > 0.90
indicates good fit), and the weighted root mean square residual
(WRMR; < 1.0 indicates good fit; Yu, 2002). It should be noted that
the RMSEA often falsely indicates a poor-fitting model with a small
sample (Kenny, Kaniskan, & McCoach, 2015). Thus, we mainly relied
on CFI, TLI, and WRMR for evaluating the model fitness.
Then, by using the whole sample (N = 204), the reliabilities of the
classroom assessment practices and EFL course learning motivation
were evaluated by internal consistency coefficient with the Cronbach’s
coefficient, for which a value greater than 0.6 suggests acceptable relia-
bility. To explore the effects of university type (keynote university vs.
non-keynote university) on classroom assessment practices and EFL
course learning motivation, multivariate analysis of variance (MAN-
OVA) was used. Pearson product-moment correlation (r) analysis was
carried out to examine the relationship between assessment practice
and learning motivation factors. Furthermore, a multiple regression
RESULTS
Initial Analysis of the Classroom Assessment Practices
Questionnaire
6 TESOL QUARTERLY
TABLE 1
Factor Loadings of EFA and CFA and Reliability for the Classroom Assessment Practices Questionnaire
Note. Item loadings of EFA greater than 0.40 are in bold type. EFA = exploratory factor analysis; CFA = confirmatory factor analysis.
7
8
TABLE 2
Factor Loadings of EFA and CFA and Reliability for the Students’ EFL Course Learning Motivation Questionnaire
Items of the students’ EFL course learning motivation questionnaire EFA CFA Reliability
Factor 1. L2 classroom anxiety 0.756
1. I get very worried if I make mistakes during English class. 0.803 0.026 0.028 0.231 0.772
2. I am afraid other students will laugh at me when I speak English. 0.749 0.030 0.208 0.174 0.877
3. I am worried about my ability to do well in English this semester. 0.660 0.060 0.200 0.285 0.681
4. Improving my English is a burden for me this semester. 0.637 0.154 0.143 0.256 0.582
5. I feel nervous in English listening and speaking classes. 0.487 0.033 0.336 0.087 0.699
Factor 2. Linguistic self-confidence 0.616
13. I volunteer to seek speaking opportunities outside class to enhance 0.102 0.878 0.093 0.044 0.991
my spoken English.
14. I often volunteer to do speaking presentations in English classes. 0.042 0.753 0.124 0.061 0.504
15. I am sure that one day I will be able to speak English fluently. 0.221 0.723 0.005 0.086 0.324
Factor 3. Attitude towards the English course 0.697
6. In English classes this semester, we are learning things that will be 0.031 0.310 0.775 0.153 0.721
useful in the future.
7. I enjoy my English lessons this semester because what we do is 0.013 0.095 0.664 0.077 0.650
neither too hard nor too easy.
8. I like English classes this semester. 0.146 0.347 0.581 0.056 0.861
9. I want to work hard in English to make my teacher happy. 0.213 0.226 0.508 0.028 0.714
Factor 4. Effort investment 0.698
10. I persist in listening to radio English programs or watch English 0.122 0.067 0.149 0.811 0.755
movies to enhance my English.
11. I persist in reading English newspapers, magazines, or novels to 0.053 0.074 0.095 0.790 0.709
improve my English proficiency.
12. I feel I am making progress in English this semester as a result of 0.061 0.135 0.368 0.443 0.740
persistent effort.
Percentage of variance explained based on EFA (%) 21.799 16.694 9.940 8.062 0.727
Note. Item loadings of EFA greater than 0.40 are in bold type. EFA = exploratory factor analysis; CFA = confirmatory factor analysis.
TESOL QUARTERLY
0.086 (90% CI: 0.062, 0.110), CFI = 0.921, TLI = 0.901, and WRMR =
0.891. A Cronbach’s coefficient of 0.727 was found for the total items
selected for assessing learning motivation. Furthermore, the Cron-
bach’s a coefficients for the four factors were 0.756 for L2-classroom
anxiety, 0.616 for linguistic self-confidence, 0.697 for attitude towards
the English course, and 0.698 for effort investment. Factor loadings
for EFA and CFA of the Students’ EFL Course Learning Motivation
Questionnaire and its reliability for each factor are presented in
Table 2.
TABLE 3
Results of MANOVAs: Classroom Assessment Practices and Student Learning Motivation by
University
Keynote Non-keynote
uni. uni. F Cohen’s d
Factors Mean(SD) Mean(SD)
Assessment Self-assessment 3.20(0.83) 3.06(0.80) 1.24 0.16
Wilks’ k = 0.860 Interactive-informal 3.87(0.77) 3.62(0.81) 4.40* 0.31
assessment
F(5,178) = 5.809** Teacher scaffolding 3.93(0.62) 3.79(0.64) 2.08 0.21
g2 =0.140 In-class diagnostic 4.07(0.57) 3.62(0.76) 19.92** 0.67
assessment
Subject performance 3.71(0.69) 3.78(0.68) 0.57 0.11
assessment
Motivation L2 classroom anxiety 3.05(0.83) 3.13(0.65) 0.46 0.10
Wilks’ k = 0.939 Attitude towards the 3.18(0.70) 3.18(0.59) 0.002 0.01
English course
F(4,176) = 2.87* Effort investment 3.41(0.74) 3.20(0.56) 4.35* 0.31
g2 =0.061 Linguistic 3.28(0.66) 2.98(0.64) 9.10** 0.45
self-confidence
TABLE 4
Correlation Between Classroom Assessment Practices and Student Learning Motivation
10 TESOL QUARTERLY
whereas teacher scaffolding (b = 0.138, p > 0.05) and subject perfor-
mance assessment (b = 0.065, p > 0.05) could not; and the R2 was
0.219, indicating that 21.9% of the variance in students’ learning motiva-
tion could be explained by these five assessment practices predictors.
Furthermore, by using only the three significant assessment practices
predictors as independent variables, regression results (Model 2)
showed that self-assessment (b = 0.254, p < 0.01), interactive-informal
assessment (b = 0.204, p < 0.01), and in-class diagnostic assessment (b =
0.146, p < 0.05) were still significant, with the regression model present-
ing a slightly decreased R2 (i.e., 0.205), indicating that self-assessment,
interactive-informal assessment, and in-class diagnostic assessment could
have significant influence on students’ learning motivation. Details of
the two regression models can be found in Table 5.
DISCUSSION
The findings revealed that the participants experienced four types
of assessment practice considerably frequently—in-class diagnostic
assessment, teacher scaffolding, interactive-informal assessment, and
subject performance assessment, whereas self-assessment emerged to
be used the least. Note that teacher-directed subject performance
assessment is the only type of assessment on which the non-key univer-
sity students obtained a higher mean score. These results suggest that
Chinese university EFL students generally experience student-centred
assessment the least. With regard to students’ motivational disposition
TABLE 5
Regression Models Reporting Unstandardized (B), Standardized Betas (b), Standard Errors
(SE), t and p Values for Predictors of Learning Motivation
12 TESOL QUARTERLY
develop a positive attitude towards English learning, and the more lin-
guistically confident they tend to judge themselves to be. In other
words, student–student or teacher–student dialogic interaction can be
considered a primary source of formative learning potential in the EFL
classroom. The result is particularly encouraging given the tendency in
the literature to prioritize formal and the procedural assessment activi-
ties and to underplay observation-driven approaches to assessment in
everyday classroom practices. Note that the result that self-assessment
was reported to be least experienced in this study suggests that teacher
implementation of student-led assessment practices appeared to be lim-
ited in Chinese EFL classrooms. Chinese EFL teachers thus need to
play an active part in the development and monitoring of student self-
assessments, most especially for students who have a low level of learn-
ing motivation, and create opportunities for them to develop skills in
self- and peer-assessment within collaborative working opportunities in
classrooms.
CONCLUSION
THE AUTHORS
His research interests include second language classroom assessment practices, the
psycholinguistics of second language acquisition, individual differences in lan-
guage learning, and second language teacher education.
Jinbo He earned his Ph.D. degree from the Faculty of Education, University of
Macau, and is currently an associate professor in the School of Education, Tianjin
University. His research mainly focuses on quantitative research methodology such
as structural equation modeling.
REFERENCES
Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in
Education: Principles, Policy and Practice, 5, 7–74. https://doi.org/10.1080/
0969595980050102
14 TESOL QUARTERLY
Brookhart, S. M. (1997). A theoretical framework for the role of classroom assess-
ment in motivating student effort and achievement. Applied Measurement in Edu-
cation, 10, 161–180. https://doi.org/10.1207/s15324818ame1002_4
Brookhart, S. M., Walsh, J. M., & Zientarski, W. A. (2006). The dynamics of moti-
vation and effort for classroom assessments in middle school science and social
studies. Applied Measurement in Education, 19, 151–184. https://doi.org/10.1207/
s15324818ame1902_5
Brown, G. T., Irving, S. E., Peterson, E. R., & Hirschfeld, G. H. (2009). Use of
interactive informal assessment practices: New Zealand secondary students’ con-
ceptions of assessment. Learning and Instruction, 19, 97–111. https://doi.org/10.
1016/j.learninstruc.2008.02.003
Cheng, L.-Y., & Fox, J. (2017). Assessment in the language classroom. London, Eng-
land: Palgrave.
DeVellis, R. F. (2003). Scale development: Theory and applications (2nd ed.). Thou-
sand Oaks, CA: Sage publications.
D€
ornyei, Z., & Ushioda, E. (2010). Teaching and researching motivation (2nd ed.).
Harlow, England: Longman.
Guilloteaux, M. J., & D€ ornyei, Z. (2008). Motivating language learners: A class-
room-oriented investigation of the effects of motivational strategies on student
motivation. TESOL Quarterly, 42, 55–77. https://doi.org/10.1002/j.1545-7249.
2008.tb00207.x
Hao, S., & Johnson, R. L. (2013). Teachers’ classroom assessment practices and
fourth-graders’ reading literacy achievements: An international study. Teaching
and Teacher Education, 29, 53–63. https://doi.org/10.1016/j.tate.2012.08.010
Harlen, W., & Deakin Crick, R. (2003). Testing and motivation for learning. Assess-
ment in Education, 10, 169–207. https://doi.org/10.1080/0969594032000121270
Hooper, D., Coughlan, J., & Mullen, M. R. (2008). Structural Equation Modelling:
Guidelines for Determining Model Fit. The Electronic Journal of Business Research
Methods, 6, 53–60. https://doi.org/10.21427/D7CF7R
Kaiser, H. F. (1960). The application of electronic computers to factor analysis.
Educational and Psychological Measurement, 20, 141–151. https://doi.org/10.1177/
001316446002000116
Kenny, D. A., Kaniskan, B., & McCoach, D. B. (2015). The performance of RMSEA
in models with small degrees of freedom. Sociological Methods & Research, 44,
486–507. https://doi.org/10.1177/0049124114543236
Krishnan, V. (2011). A comparison of principal components analysis and factor
analysis for uncovering the early development instrument (EDI) domains. In
Early Child Development Mapping (ECMap) Project (Unpublished manuscript),
University of Alberta, Edmonton, Canada.
Leung, C. (2009). Developing formative teacher assessment: Knowledge, practice,
and change. Language Assessment Quarterly, 1, 19–41. https://doi.org/10.1207/
s15434311laq0101_3
Leung, C., Davison, C., Hamp-Lyons, L., East, M., Evans, M., Liu., Y.-C., & Purpura,
J. E. (2018). Using assessment to promote learning: Clarifying constructs, theo-
ries, and practices. In J. M. Davis, J. M. Norris, M. E. Malone, T. H. McKay, &
Y.-A. Son (Eds.), Useful assessment and evaluation in language education. Washing-
ton, DC: Georgetown University Press.
Purpura, J. E. (2016). Second and foreign language assessment. Modern Language
Journal, 100, 190–208. https:/doi.org/10.1111/modl.12308
Raubenheimer, J. (2004). An item selection procedure to maximize scale reliability
and validity. SA Journal of Industrial Psychology, 30, 59–64. https://doi.org/10.
4102/sajip.v30i4.168
16 TESOL QUARTERLY