Persian Version of Nursing Students' Perceptions of An Online Course Scale: Translation and Psychometric Testing
Persian Version of Nursing Students' Perceptions of An Online Course Scale: Translation and Psychometric Testing
Persian Version of Nursing Students' Perceptions of An Online Course Scale: Translation and Psychometric Testing
net/publication/370519788
CITATIONS READS
0 86
5 authors, including:
All content following this page was uploaded by Hamid Sharif-Nia on 04 May 2023.
Research
A R T I C L E I N F O A B S T R A C T
Article History: The purpose of the present study is to evaluate the psychometric properties of the Persian version of the stu-
Accepted 1 April 2023 dent perceptions of an online course (P-SPOC) measure among Iranian nursing students. In this cross-sec-
tional study a total of 302 Iranian undergraduate nursing students filled the online questionnaire between
Keywords: October and December 2021. Validity (construct, convergent and divergent), and reliability of the P-SPOC
Nursing students were evaluated. For ensuring high quality the presence observational study the STROBE checklist was ful-
Online course
filled. Total variance explained of the P-SPOC for the two factors namely course components and course for-
Reliability
mat was estimated 51.84%. Using confirmatory factor modeling two factors have acceptable composite
Validity
reliability, convergent and divergent validity. These results confirmed that the Persian version of the SPOC is
a reliable and valid measure to assess nursing student perceptions of online courses in Iran.
© 2023 Organization for Associate Degree Nursing. Published by Elsevier Inc. All rights reserved.
https://doi.org/10.1016/j.teln.2023.04.001
1557-3087/© 2023 Organization for Associate Degree Nursing. Published by Elsevier Inc. All rights reserved.
Please cite this article as: Z. Tayebi ?Myaneh et al., Persian version of nursing students’ perceptions of an Online course scale: Translation and
psychometric testing, Teaching and Learning in Nursing (2023), https://doi.org/10.1016/j.teln.2023.04.001
JID: TELN
ARTICLE IN PRESS [m5GUS;May 1, 2023;15:18]
2 Z. Tayebi ?Myaneh et al. / Teaching and Learning in Nursing 00 (2023) 1 5
(e.g., nursing), where experiential learning is required alongside high via social networking apps such as Channel and a group in WhatsApp
standards of technology and infrastructure support (Khodaei et al., and Telegram. Students who were undergraduate of nursing, willing
2022). To minimize adverse effects from the lack of infrastructure to participate in the study and had experience in online classes were
and technology required for satisfactory online learning, it is impor- invited to the study. According to Kellar and Kelvin (2012), the sam-
tant for universities to prioritize quality course design, which has ple size for a factor analysis between 5 and 10 per item is acceptable.
been shown to a critical factor in students’ online learning experien- Therefore, for the exploratory factor analysis (EFA) that the original
ces (Laksana, 2021). Thus, understanding students' experiences about 31-item scale evaluated, 186 sample (31 £ 6 = 186); and to evaluate
online learning becomes imperative. However, to date, limited tools the extracted items (n = 19) by confirmatory factor analysis (CFA) 114
have been developed to access students’ experiences and perceptions students were collected (19 £ 6 = 114). In total, 302 students from
about online courses with less available that have been psychometri- three universities completed the form.
cally validated with Iranian populations.
There are few surveys measuring student’s experiences and Instruments
perceptions of online have been developed and readily available.
Some examples include the course experience questionnaire The survey questionnaire contained two parts: (1) demographic
(CEQ), the questionnaire satisfaction of university students and educational information of students and (2) the Persian version
towards online training, and a few researcher-designed question- of the SPOC (P-SPOC). The original SPOC had 31 items in 3 subscales,
naires (Ruiz-Grao et al., 2022). The existing tools need updating, namely student engagement, organization, and resources (Chung &
have a too many items, or do not correspond to the realities of Chen, 2020). Student engagement is described as active participation,
today's online learning. Gosak et al.(2021) recently developed and interaction, and collaboration in the online settings. Organization
evaluated the DREEM tool to measure nursing students’ percep- measures perception of effective course design and clear course
tion of the online learning environment. It consists of 50 items in objectives and learning outcomes. Resources refers to any materials,
five subscales, while the measure is valid, a shorter version has staff, and other assets available that can support students'
not been developed and evaluated. learning. The coefficient alpha for the factors was 0.97, 0.96, and 0.89
There is a need to assess students' perceptions on how to improve respectively.
the quality of e-learning that is reliable, up-to-date, and user friendly Item scaling was created as a 5-point Likert scale. Responses rang-
(i.e., short). The current study aims to evaluate the psychometrics of ing from 1 to 5 (strongly disagree to strongly agree respectively).
the Persian version of the student perceptions of an online course Thus the summed range of scores range from 31 to 155.
(SPOC) survey in Iranian nursing students. The SPOC consists 31
items with three factors, including student engagement, organiza- Data Analysis
tion, and resources (Chung & Chen, 2020). It is a valid and reliable
tool for assessing online courses in RN-to-BSN programs among nurs- Exploratory and confirmatory factor analysis was used to evaluate
ing students. It is considered one of the most comprehensive tools construct validity of P-SPOC by SPSS-AMOS27. Factor extraction in
available (Chung & Chen, 2020). EFA was done using maximum likelihood with Promax rotation. Also
Considering the importance of online learning and the compre- to determine how suited data is for EFA, Kaiser Meyer Olkin (KMO)
hensiveness of the SPOC tool, this research aims to first translate the and Bartlett’s test were used.
SPOCE into Persian and then evaluate psychometric properties of the Horn's parallel analysis was run to estimate the number of factors
Persian version pf SPOC among undergraduate nursing students in to keep in EFA (Dinno, 2009). Next a maximum likelihood estimation
Iran. To the best of the researchers’ knowledge, this is the first study in confirmatory factor analysis (CFA) was conducted and goodness
to translate this tool into another language and evaluate the psycho- of fit indices (x2 test, x2/df< 3, RMSEA<.08, CFI, IFI, and TLI> 0.9
metric properties of the translated version. (Sun, 2005).
We applied best practices for assessing reliability, convergence,
Methods and discriminant validity based on multiple criteria and an explana-
tion of sampling error (Cheung et al., 2023). The divergent and con-
Design vergent and validity of the P-SPOC assessed by Composite Reliability
(CR) and Average Variance Extracted (AVE). In order to establish con-
The current study used a cross-sectional design to evaluate the vergent validity, there must be a criterion of CR > .7, AVE> .5, and
psychometric properties of the Persian version of the SPOC instru- AVE< CR (She et al., 2021). To assess divergent validity assessment
ment among Iranian nursing students between October and Decem- was used Fornell & Larcker criterion (Ab Hamid et al., 2017), The AVE
ber 2021. In this study, the translation process started after obtaining must be greater than its correlation values with other constructs
written permission to use the SPOC from the scale developer. Accord- (Fornell & Larcker, 1981).
ing to the World Health Organization (2016) protocol, the for- Finally, for assessing reliability of the P-SPOC the internal consis-
ward backward translation technique was used. The SPOC was tency was asserted by Cronbach’s alpha, McDonald’s omega, CR, and
translated into Persian by two independent translators and any dif- maximum reliability (MaxR). The acceptable value for these indica-
ferences were resolved through comprehensive discussion. The scale tors is greater than .7 (Rahmatpour et al., 2021).
was then back-translated independently into English by another This study assessed both univariate and multivariate (Mardia's
team (i.e., bilingual experts fluent in English and Persian) who were coefficients of multivariate skewness and kurtosis) normality. The
unaware of the original English version. The final version of the scale multivariate outliers were identified using Mahalanobis d-squared
was sent to the developer for consideration. distance (p< 0.001) (Kline, 2015).
To be included in this study, participants were current students in The protocol of this study was approved by Ethic committee of
a bachelor-level nursing degree who had experienced online learning Alborz university of medicals sciences [Ethic code: IR.ABZUMS.
in university. The online questionnaire was created using Google REC.1400.111]. The study aim, information about items, voluntary
Forms, and the URL link for the questionnaire was sent to students participation, the possibility of withdrawing from the study at any
Please cite this article as: Z. Tayebi ?Myaneh et al., Persian version of nursing students’ perceptions of an Online course scale: Translation and
psychometric testing, Teaching and Learning in Nursing (2023), https://doi.org/10.1016/j.teln.2023.04.001
JID: TELN
ARTICLE IN PRESS [m5GUS;May 1, 2023;15:18]
Z. Tayebi ?Myaneh et al. / Teaching and Learning in Nursing 00 (2023) 1 5 3
Table 1 Results
Characteristics of Students (n=302)
In the current study, most student participants were single
Variables n(%)
women. Other demographic and educational information are pro-
Gender vided in Table 1.
Female 189(62.6)
Male 113(37.4)
The KMO (0.951) and Bartlett test (3858.387, p <0.001) showed
Marital status that strength of the partial correlation between the variables are
Single 259(85.8) suited to EFA. Based on the EFA results, a two-factor subscale was
Married 43(14.2) determined, that is course components and course format (Fig. 1 and
Academic year
Table 2). These two factors explained 51.84% of the total variance of
First year 87(28.8)
2nd year 108(35.8) the P-SPOC among the nursing students.
3rd year 93(30.8) The fit indices of the CFA model showed that x2= 333.071, DF=
4th year and above 14(4.6) 145, x2 /df= 2.297, CFI= .950, IFI= .951, and TLI= .941, and RMSEA=
Age(mean §SD) years 20.05§6.0 .066.
GPA(mean §SD) of 20 16.60§1.3
Based on the reported indices in Table 3 showed that the
P-SPOC has good convergent and divergent validity. Also, the factors
extracted from this scale had good internal consistency and reliability.
Please cite this article as: Z. Tayebi ?Myaneh et al., Persian version of nursing students’ perceptions of an Online course scale: Translation and
psychometric testing, Teaching and Learning in Nursing (2023), https://doi.org/10.1016/j.teln.2023.04.001
JID: TELN
ARTICLE IN PRESS [m5GUS;May 1, 2023;15:18]
4 Z. Tayebi ?Myaneh et al. / Teaching and Learning in Nursing 00 (2023) 1 5
Table 2
The Results of EFA of 19 Items of Persian Version of SPOC (N = 186)
Course 26) The course facilitates student achievement of the stated course objectives. 0.901 0.743 6.35 33.42
components 27) The course learning content provides students to achieve the four domains of learning outcomes 0.891 0.758
(Patient-centred Care, Inquiry and Reasoning, Roles and Collaboration, and Quality and Safety).
29) The course provides the quality of learning activities/assignments for each week. 0.773 0.605
21) The course fosters student-to-student interaction for supporting learning. 0.773 0.555
23) The course provides information as to where to get technical support. 0.747 0.546
24) The course provides additional course content and related materials (e.g., handouts and forms, 0.719 0.577
videos, other websites, etc.) for supporting students’ learning effectively.
22) The course provides various methods for communication (e.g., online, phone, and email). 0.703 0.511
20) The instructor encourages student participation and questions. 0.694 0.532
13) Learning activities in the course encourage students to explore diversity of interests. 0.667 0.533
25) The course provides information as to where to get library support. 0.648 0.382
28) Learning activities/assignments are realistic and appropriate for course workload. 0.601 0.528
18) The instructor is supportive when a student had difficulties or questions. 0.500 0.465
Course format 4) Each week’s materials have consistent design elements (e.g., font sizes, color, paragraphing, and spacing). 0.880 0.602 3.50 18.42
6) The course follows a format (structure/layout) that is recognizable and comfortable. (e.g., even though 0.801 0.637
content is different, future modules are easy to navigate because of experience with
beginning modules).
5) All links (internal and external) are valid and active. 0.726 0.460
3) The course navigation is easy to follow. 0.705 0.551
10) Learning content is logically sequenced 0.676 0.631
9) The course content appears to be current for the subject matter presented. 0.542 0.613
11) Instructions for assignments/learning activities are clear. 0.522 0.567
* h2, item communality,
** λ, eigenvalue,
Total variance: 51.84%
course components and course format explaining 51.84% of the total of teaching and learning processes, course structure, and student
variance of the P-SPOC among the nursing students sampled. support. The results showed that the course structure (i.e., course
To the best of our knowledge, this is the first study to assess the objectives, resources, assignments) was rated the highest (M = 3.508,
structure of the SPOC scale in another context, and, for this reason, SD = .656) among the three dimensions.
only comparisons with the main tool are made herein. Three differ- The second factor extracted in the present study, “course format”
ences were found between the structure of the original scale and the with 7 items, referred to design format such as font size, paragraph-
Persian version. First, the original scale was composed of 31 items, ing, sequence of content, course links and navigations.
but the Persian version was reduced to 19 items. Second, based on According to the CFA results and the values of model fit indices,
the EFA results of the original scale with Varimax rotation, many the P-SPOC demonstrated a good model of fit. The reliability results
cross loadings between factors were found. In other words, many of the P-SPOC demonstrated strong internal consistency. In this
items loaded highly onto multiple factors. Therefore, we used the study, in addition to Cronbach's alpha coefficient, the McDonald's
Promax rotation instead of the Varimax rotation and deleted items omega and CR were used to check the reliability of the P-SPOC.
with cross-loadings of more than 0.4 in multiple factors. Last, the McDonald’s omega has been used as a popular alternative to Cron-
goal of factor extraction is to maximize the explained variance and bach alpha in the literature (Zhang & Yuan, 2016). CR has never been
the total variance of the original scale was 75.25% while the two fac- under suspicion of sampling bias (Ten Berge & Socan, 2004). How-
tors in the present study only accounted for 51.85% of the variance. ever, the original scale’s reliability was assessed only by Cronbach's
This is due to the different rotation methods and extraction methods alpha coefficient (Chung & Chen, 2020).
used in the EFA for the present and past study. The items of the origi-
nal scale were extracted by principal component analysis (PCA) but Limitations of the Work
the maximum likelihood method was used in the present study. The
PCA explains the greatest share of variance, and even for the same Convenience sampling method and difference in the type of stu-
number of common factors or principal components, the average dents participate in this study are the limitations (The original scale
squared residual, across the entire covariance matrix, will be smaller was developed for RN-to-BSN students). Students’ perceptions may
for a EFA model than for a PCA. be different near the beginning or end of the course, so this study
The EFA used in the present study extracted two factors. The first was conducted in the middle of the autumn semester (Septem-
factor, “course components” consisted of 12 items that assessed stu- ber January in Iran). Also, social desirability bias, which can result
dents’ perceptions about course requirements, such as providing from the use of Likert scales in surveys, could cause respondents to
objectives, assignments, and interactions. Stewart and Lowenthal choose answers that do not accurately reflect their actual experiences
(2021) assessed Korean exchange students’ perceptions of the quality or opinions. Finally, although the P-SPOC scale was found to have
good psychometric properties in this study, its validity and reliability
Table 3 may differ in diverse populations and settings, highlighting the need
Results of the Construct Reliability and Convergent Validity (N = 302) for further research to confirm its robustness.
Course components .744 .748 .753 .763 .435 The results demonstrated that the P-SPOC has good construct,
Course format .770 .775 .776 .783 .412
convergent, and divergent validity and reliability, and good model of
Please cite this article as: Z. Tayebi ?Myaneh et al., Persian version of nursing students’ perceptions of an Online course scale: Translation and
psychometric testing, Teaching and Learning in Nursing (2023), https://doi.org/10.1016/j.teln.2023.04.001
JID: TELN
ARTICLE IN PRESS [m5GUS;May 1, 2023;15:18]
Z. Tayebi ?Myaneh et al. / Teaching and Learning in Nursing 00 (2023) 1 5 5
fit. Based on study results, it could be suggested that the P-SPOC is a Dinno, A. (2009). Exploring the sensitivity of Horn's parallel analysis to the distribu-
valid and reliable measure to assess nursing student perceptions tional form of random data. Multivariate Behavioral Research, 44(3), 362–388.
Dumford, A. D., & Miller, A. L. (2018). Online learning in higher education: Exploring
about online course in Iran, especially in terms of course components advantages and disadvantages for engagement. Journal of Computing in Higher Edu-
and course format of online learning courses. In addition, the results cation, 30(3), 452–465.
can be useful for nurse educators as well, so that factors such as the Efriana, L. (2021). Problems of online learning during COVID-19 pandemic in EFL class-
room and the solution. JELITA, 2(1), 38–47.
connection of content and assignments with nursing fields, establish- Fornell, C., & Larcker, D. F. (1981). Evaluating Structural Equation Models with Unob-
ing more interaction between students, paying attention to design servable Variables and Measurement Error. Journal of Marketing Research, 18(1),
elements can lead to a higher perception of online education by nurs- 39–50. doi:10.2307/3151312.
Gosak, L., Fijacko, N., Chabrera, C., Cabrera, E., & Stiglic, G. (2021). Perception of the
ing students. online learning environment of nursing students in Slovenia: Validation of the
DREEM questionnaire. Healthcare, 9(8), 998. doi:10.3390/healthcare9080998.
Hermawan, D. (2021). The rise of e-learning in covid-19 pandemic in private univer-
Ethical Approval
sity: Challenges and opportunities. IJORER: International Journal of Recent Educa-
tional Research, 2(1), 86–95.
The protocol of this study was approved by Ethic committee of Iravani, M., Nasab, M. B., Bahmaei, H., Ghanbari, S., Mohaghegh, Z., &
Alborz university of medicals sciences [Ethic code: IR.ABZUMS. Siahkal, S. F. (2022). The level of satisfaction and quality of E-learning in medical
universities of Iran during the epidemic of COVID-19. J Educ Health Promot, 11, 9.
REC.1400.111]. doi:10.4103/jehp.jehp_1555_20.
Keane, T., Linden, T., Hernandez-Martinez, P., & Molnar, A. (2022). University students’
experiences and reflections of technology in their transition to online learning dur-
Data Availability ing the global pandemic. Education Sciences, 12(7), 453.
Kellar, S. P., & Kelvin, E. A. (2012). Munro’s statistical methods for health care research.
The data that support the findings of this study are available on Wolters Kluwer Health/Lippincott Williams and Wilkins.
Khodaei, S., Hasanvand, S., Gholami, M., Mokhayeri, Y., & Amini, M. (2022). The effect of
request from the corresponding author. the online flipped classroom on self-directed learning readiness and metacognitive
awareness in nursing students during the COVID-19 pandemic. BMC Nursing, 21(1),
22. doi:10.1186/s12912-022-00804-6.
Authorship Contribution Kline, R. B. (2015). Principles and practice of structural equation modeling. Guilford publi-
cations.
Performance of data gathering: ZT; Planning and supervision the Laksana, D. N. L. (2021). Implementation of online learning in the pandemic COVID-19:
Student perception in areas with minimum internet access. Journal of Education
work: HSH and PR; Performance of the analysis: HSH, LSH, Manu-
Technology, 4(4), 502–509.
script draft: PR, KA, ZT and LSH; and comment on the final manu- Rahmatpour, P., Chehrzad, M., Ghanbari, A., & Sadat-Ebrahimi, S.-R. (2019). Academic
script: All authors. burnout as an educational complication and promotion barrier among undergrad-
uate students: A cross-sectional study. Journal of Education and Health Promotion,
8, 201.
Declaration of Competing Interest Rahmatpour, P., Peyrovi, H., & Sharif Nia, H. (2021). Development and psychometric
evaluation of postgraduate nursing student academic satisfaction scale. Nursing
Open, 8(3), 1145–1156.
No conflict of interest has been declared by the authors. Ruiz-Grao, M. C., Cebada-Sanchez, S., Ortega-Martínez, C., Alfaro-Espín, A.,
Candel-Parra, E., García-Alcaraz, F., et al. (2022). Nursing Student Satisfaction with
the Teaching Methodology Followed during the COVID-19 Pandemic. Healthcare,
Acknowledgment 10(4), 597. doi:10.3390/healthcare10040597.
Sharif Nia, H., Azad Moghddam, H., Maro ^ co, J., Rahmatpour, P., Allen, K.-A., Kaur, H., . . .
The authors thank all participants who participated in this work Pahlevan Sharif, S. (2022). A psychometric lens for e-learning: Examining the
validity and reliability of the persian version of university students’ engagement
for their cooperation. The researcher hereby thanks the Deputy of inventory (P-USEI). The Asia-Pacific Education Researcher, 1–10.
Research and Technology of Alborz University of Medical Sciences for She, L., Ma, L., Jan, A., Sharif Nia, H., & Rahmatpour, P. (2021). Online learning satisfac-
supporting the current research. tion during COVID-19 pandemic among Chinese university students: The serial
mediation model. Frontiers in Psychology, 12, 743936.
Stewart, W., & Lowenthal, P. (2021). Experiences and perceptions of exchange stu-
References dents learning online during the COVID-19 pandemic in the Republic of
Korea: An exploratory descriptive study. Asian Journal of Distance Education,
16(1), 119–140.
Ab Hamid M, Sami W, Sidek MM, editors. Discriminant validity assessment: Use of For-
Sun, J. (2005). Assessing goodness of fit in confirmatory factor analysis. Measurement
nell & Larcker criterion versus HTMT criterion. Journal of Physics: Conference
and evaluation in counseling and development, 37(4), 240–256.
Series; 2017 , 8 10 August 2017, Kuantan, Pahang, Malaysia: IOP Publishing.
Taghizadeh, S. K., Rahman, S. A., Nikbin, D., Alam, M. M. D., Alexa, L., Ling Suan, C.,
doi:10.1088/1742-6596/890/1/012163
& Taghizadeh, S. (2022). Factors influencing students’ continuance usage
Barclay, C., Donalds, C., & Osei-Bryson, K.-M. (2018). Investigating critical success fac-
intention with online learning during the pandemic: A cross-country analysis.
tors in online learning environments in higher education systems in the Caribbean.
Behaviour & Information Technology, 41(9), 1998–2017. doi:10.1080/
Information Technology for Development, 24(3), 582–611. doi:10.1080/02681102.
0144929X.2021.1912181.
2018.1476831.
Ten Berge, J. M., & Socan, G. (2004). The greatest lower bound to the reliability of a test
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2023). Reporting reliabil-
and the hypothesis of unidimensionality. Psychometrika, 69(4), 613–625.
ity, convergent and discriminant validity with structural equation modeling: A
WHO. Process of translation and adaptation of instruments. 2013. Available from:
review and best-practice recommendations. Asia Pacific Journal of Management, 1–
https://www.mhinnovation.net/sites/default/files/files/WHO%20Guidelines%20on
39.
%20Translation%20and%20Adaptation%20of%20Instruments.docx. Access date
Chung, J., & Chen, H.-C. (2020). Development and psychometric properties of student
[December 2021]
perceptions of an online course (SPOC) in an RN-to-BSN program. Nurse Education
Yuhanna, I., Alexander, A., & Kachik, A. (2020). Advantages and disadvantages of online
Today, 85, 104303.
learning. Journal Educational Verkenning, 1(2), 13–19.
Cole, A. W., Lennon, L., & Weber, N. L. (2021). Student perceptions of online active
Zhang, Z., & Yuan, K.-H. (2016). Robust coefficients alpha and omega and confidence
learning practices and online learning climate predict online course engagement.
intervals with outlying observations and missing data: Methods and software. Edu-
Interactive Learning Environments, 29(5), 866–880. doi:10.1080/10494820.2019.
cational and Psychological Measurement, 76(3), 387–411.
1619593.
Please cite this article as: Z. Tayebi ?Myaneh et al., Persian version of nursing students’ perceptions of an Online course scale: Translation and
psychometric testing, Teaching and Learning in Nursing (2023), https://doi.org/10.1016/j.teln.2023.04.001
View publication stats