Report Exit Survey DIS 2012 DET
Report Exit Survey DIS 2012 DET
Report Exit Survey DIS 2012 DET
Report
Diploma in Electrical Engineering DET
December 2012 Session
Politeknik Kota Kinabalu (PKK)
Sabah
RESEARCH COMMITTEE
NAME
Wan Mohamad Nasir bin Wan Abdul Rahman
Norehan bt Md Shariff
Wan Zain bin Wan Dollah
POSITION
Director
Deputy Director (Academic)
Head of Department
NAME
Dr Hasnim bin Harun (Chief, Bureau of Research and Innovation)
Dr Suzan binti Impak
Azman B Talib
Farah Asyikin Abd Rahman
Shalizan B. Kadir
Norzila Salim
Halina Binti Hamid
Alester G Jakuil
Grace Jennifer Philip
Cynthia Nicholas
Julkifli bin Awang Besar
Bahril bin Balli
NAME
Chin Ken Leong (Head of Program)
Shalizan Bin Kadir
Farah Asyikin Abd Rahman
ABSTRACT
2
The purpose of this Programme Exit Survey (PES) was to provide data to gauge perceptions
of various aspects of programmes and services offered and to identify areas where
improvements may be needed in the Department of Electrical Engineering (JKE), Politeknik
Kota Kinabalu (PKK). This PES was conducted on 83 final semester students, graduating
from Diploma in Electrical Engineering (DET). They were the first Cohort whose intake was
in June 2010. The survey questionnaire had five main sections: respondents profile;
assessment of overall quality; assessment of skills and knowledge; assessment of Lecturers
and Academic Advisor; and assessment of academic resources and facilities. All the data were
analysed using the Statistical Product and Service Solutions (SPSS) software version IBM
SPSS Statistics 19.0. For the assessment of the overall quality, attribute for teaching and
learning experience was rated 95% with very good and good. Skills and knowledge
section was evaluated by relating the statements with nine items as stated in the Programme
Learning Outcomes (PLO). All the PLOs were marked at least adequate by 98.8% of the
students. Assessment on lecturers and academic advisor were rated 38.2% as very good and
56.2% as good. In terms of academic resources and facilities, the access to Wi-Fi had the
highest unsatisfactory concerned from the respondent whereby 18.1% rated the item as
poor and 7.2% as marginal.
Keywords: overall quality, skills and knowledge, lecturer and academic advisor, academic
resources and facilities
1. INTRODUCTION
ii.
demonstrate practical skills which includes the ability to troubleshoot, repair and do
maintenance work for electrical and electronic equipment
iii.
communicate effectively with the engineering community and the society at large.
4
iv.
apply creative and critical thinking in solving problem related to assigned tasks
v.
demonstrate awareness and consideration for societal, health, safety, legal and cultural
issues and consequences responsibilities, taking into account the need for sustainable
development.
vi.
vii.
viii.
ix.
2. METHODOLOGY
This survey involved 83 DET students from December 2012 semester. Students were asked
to fill up the PES questionnaires which were posted online and 100% of them responded.
The respondents were required to evaluate and rate themselves based on 5-Likert Scale
indicated below [5]:
1 = Poor
2 = Marginal
3 = Adequate
4 = Good
5 = Very good
Students satisfaction and acceptance level were determined from the level of the likert scale.
Very good, Good and Adequate indication rate shows the students were satisfied with the
item. While Marginal and Poor indication rate shows the program needs some improvements
and correction.
This online survey was conducted between March until May 2013. The survey
questionnaires were divided into five sections as follows:
i.
ii.
iii.
iv.
v.
The data collected in this survey was processed through Statistical Product and Service
Solutions (SPSS) software version IBM SPSS Statistics 19.0.
The questionnaires were based on students perception on teaching and learning in
PKK, students response on skills and knowledge related to PLOs, students attainment on the
soft skills, students rating for lecturers and academic advisors contribution, students opinion
towards academic resources, overall services and facilities in PKK [6,7]. This assessment
strategy was aligned with the Curriculum Development Cycle - develop-implement-review
as required by the MQA in order to improve the quality of programme. A description of the
survey findings is discussed below.
3. RESULTS
The response from the students were analysed based on the following four criteria:
i.
ii.
iii.
iv.
In Section C: (Skills and Knowledge) the statements have been classified under a particular
PLO so that the data analysis can be done appropriately for accreditation purposes. The
results can be used an indicator to show how well the students have acquired their skills and
knowledge as required in the PLOs of the programme.
3.1 SECTION B: OVERALL QUALITY
Overall Quality was evaluated by relating the students experience with the teaching and
learning environment in PKK. Two survey statements were as follows:
a) What is your impression on the overall quality of curriculum; and teaching and learning
at PKK?
b) To what extent has the quality of teaching and learning in PKK improved since you
were here?
100%
90%
80%
27
27
52
51
70%
60%
50%
Responses
40%
30%
20%
10%
5
4
0%
What is your impression on the overall quality of curriculum and teaching and learning at Politeknik Kota Kinabalu?
Poor
Marginal
Adequate
Good
Very good
For statement (a) (Figure 1), 52 of the respondents (62.7%) agreed and categorized as
good for the impression on the overall quality of curriculum and teaching and learning at
PKK. The other 27 (32.5%) responded very good while 4 (4.8%) expressed as adequate.
No respondent rated for marginal and poor indication.
While for statement (b), 51 of the respondents (61.4%) agreed that item to what
extent has the quality of teaching and learning in Politeknik Kota Kinabalu improved since
you were here the scale given was good. The other 27 (32.5%) responded very good
while 5 (6.0%) expressed adequate. No respondent rated for marginal and poor
indication.
From the analysis on overall quality, 100% of DET students were satisfied with the
overall quality for this programme during their study in PKK based on the experience with
the teaching and learning environment.
3.2 SECTION C: SKILLS AND KNOWLEDGE
In assessing the skills and knowledge of the students, the statements had been classified into
nine PLOs as follows:
3.2.1 PLO 1 (Knowledge)
For PLO 1 (Knowledge), four statements were given as follows:
a) I am able to apply knowledge of core discipline courses in my programme.
b) I am able to apply knowledge of specialized courses in my programme.
c) I am able to apply knowledge of elective courses in my programme.
d) I am able to understand the technological applications relevant to my programme of
study.
For statement (a) (Figure 2), I am able to apply knowledge of core discipline courses in
my programme and (b) I am able to apply knowledge of specialized courses in my
programme, all 83 respondents had rated for the same score. A total of 22 (26.5%)
respondents rated very good. The other 53 (63.9%) respondent selected good while 8
(9.6%) responded adequate, respectively. This shows that 100% of respondents were
satisfied with statement (a) and (b).
100%
90%
22
22
23
53
48
17
80%
70%
60%
50%
Responses
40%
53
51
30%
20%
10%
14
11
1
1
0%
I am able to apply knowledge of core discipline courses in my program.
Poor
Marginal
Adequate
Good
Very good
achievement of PLO1.
3.2.2 PLO 2 (Technical & Practical Skills)
Figure 3 shows the scores of 83 respondents for PLO 2 (Technical & Practical Skills). The
percentage of respondents who were satisfied (Very Good, Good and Adequate) for the
three statements were given as follows:
9
100%
90%
21
20
22
50
53
50
80%
70%
60%
50%
Responses
40%
30%
20%
10%
11
11
10
0%
I am able to apply information technology in my program.
Poor
Marginal
Adequate
Good
Very good
(28.9%)
(33.7%)
(43.4%)
(60.2%)
(54.2%)
(43.4%)
(13.3%)
(10.8%)
(12.1%)
3.2.4
Figure 5 shows the scores of 83 respondents for PLO 4 (Critical Thinking & Problem Solving
Skills).
The percentage of respondents who were satisfied (Very Good, Good and
11
100%
90%
80%
27
34
31
41
46
70%
60%
50%
Responses
40%
45
30%
20%
10%
11
8
6
0%
I am able to solve problems using methods, tools and skills related to my program.
Poor
Marginal
Adequate
Good
Very good
39
39
31
60%
50%
Responses
40%
30%
33
45
41
20%
10%
11
7
3
0%
I am able to understand the role of my work in relation to social or cultural issues.
Poor
Marginal
Adequate
Good
Very good
As the conclusion for PLO5, 100% (83 respondents) of DET students were satisfied
and were aware of their responsibilities in social context and able to associate with
community effectively which they gain during their studies in PKK.
3.2.6
Figure 7 shows the scores of 83 respondents for PLO 6 (Continuous Learning & Information
Management Skills). The percentage of respondents who were satisfied (Very Good, Good
and Adequate) for the four statements were given as follows:
a) I am able to continuously learn new skills and knowledge. (100% satisfied)
b) I am able to engage in continuous learning beyond the classroom. (100% satisfied)
c) I am able to learn and apply new concepts. (100% satisfied)
d) I am able to use information resources (databases, libraries, internet etc.). (100%
satisfied)
(42.2%)
(28.9%)
(36.1%)
(65.1%)
(47.0%)
(61.4%)
(53.0%)
(36.1%)
(2.4%)
(4.8%)
(6.0%)
(16.9%)
13
3.2.7
Figure 8 shows the scores of 83 respondents for PLO7 (Management & Entrepreneurial
Skills). The percentage of respondents who were satisfied (Very Good, Good and
Adequate) for the two statements were given as follows:
a) I am able to build/develop my career upon completion of my studies. (100% satisfied)
b) I am able to develop time management skills. (100% satisfied)
100%
90%
80%
32
34
46
43
70%
60%
50%
Responses
40%
30%
20%
10%
6
5
0%
I am able to build/develop my career upon completion of my studies.
Poor
Marginal
Adequate
Good
Very good
Figure 9 shows the scores of 83 respondents for PLO 8 (Professionalism, Ethics & Moral).
The percentage of respondents who were satisfied (Very Good, Good and Adequate) for the
two statements were given as follows:
For PLO 8 (Professionalism, Ethics & Moral), two statements were provided as follows:
a) I am able to understand the professional and ethical responsibilities related to my work.
(100% satisfied)
b) I am aware of the importance of safety issues related to my work. (100% satisfied)
14
100%
90%
80%
31
43
70%
60%
50%
Responses
40%
30%
49
20%
38
10%
3
2
0%
I am able to understand the professional and ethical responsibilities related to my work.
Poor
Marginal
Adequate
Good
Very good
3.2.9
Figure 10 shows the scores of 83 respondents for PLO 9 (Leadership & Teamwork Skills).
The percentage of respondents who were satisfied (Very Good, Good and Adequate) for the
four statements were given as follows:
a) I am able to work with individuals from different backgrounds. (98.8% satisfied)
b) I am able to work successfully as a member of a team. (100% satisfied)
c) I am able to work successfully as a leader of a team. (98.8% satisfied)
d) I am able to function in multidisciplinary teams. (100% satisfied)
As the conclusion for PLO9, 98.8% (82 respondents) of DET students were satisfied
and were able to work in a team successfully and capable of being a leader after finishing
their studies in PKK.
15
100%
90%
80%
38
70%
31
44
37
60%
50%
Responses
40%
30%
43
43
20%
38
36
10%
8
8
1
3
1
1
0%
0
I am able to work with individuals from different backgrounds.
Poor
Marginal
Adequate
Good
Very good
of DET students were satisfied with the contributions of lecturers and academic advisors
during their studies in PKK.
Table 1: Contributions of Lecturers and Academic Advisors rating
Question
(a)
Question
(b)
Question
(c)
Question
(d)
Question
(e)
Question
(f)
Average>
Poor
0
0.0
0
0.0
0
0
0
0.0
0
0.0
0
0.0
0%
Qty
%
Qty
%
Qty
%
Qty
%
Qty
%
Qty
%
Marginal
0
0.0
0
0.0
0
0
0
0.0
0
0.0
0
0.0
0%
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%
Responses
Adequate
Good
6
39
7.2
47.0
5
49
6.0
59.0
3
43
3.6
51.8
4
56
4.8
67.5
7
49
8.4
59.0
3
44
3.6
53.0
5.6%
56.2%
38
29
37
39
49
43
Very good
38
45.8
29
34.9
37
44.6
23
27.7
27
32.5
36
43.4
38.2%
23
27
56
49
36
44
3
Responses
Poor
Marginal
Adequate
Good
Very good
satisfied but expected more frequently and promptly feedback from the lecturers.
The same situations happened to the statement (b)Be an actively involved learner?
and (e) Effectively communicate critical concepts and ideas? which means many
17
respondents were satisfied but expect further improvement from the lecturers to be more
student-centred learning.
Question
(a)
Question
(b)
Question
(c)
Question
(d)
Question
(e)
Question
(f)
Question
(g)
Question
(h)
Question
(i)
Question
(j)
Question
(k)
Average>
Qty
%
Qty
%
Qty
%
Qty
%
Qty
%
Qty
%
Qty
%
Qty
%
Qty
%
Qty
%
Qty
%
(i)
Poor
1
1.2
0
0.0
2
2.4
1
1.2
0
0.0
0
0.0
15
18.1
1
1.2
0
0.0
0
0.0
2
2.4
2.4%
(ii)
Marginal
2
2.4
1
1.2
3
3.6
4
4.8
6
7.2
4
4.8
6
7.2
5
6.0
4
4.8
4
4.8
3
3.6
4.6%
Responses
(iii)
Adequate
13
15.7
20
24.1
17
20.5
17
20.5
17
20.5
18
21.7
35
42.2
16
19.3
17
20.5
23
27.7
19
22.9
23.2%
(iv)
Good
33
39.8
43
51.8
40
48.2
47
56.6
35
42.2
39
47.0
18
21.7
40
48.2
46
55.4
43
51.8
37
44.6
46.1%
(v)
Very good
34
41.0
19
22.9
21
25.3
14
16.9
25
30.1
22
26.5
9
10.8
21
25.3
16
19.3
13
15.7
22
26.5
23.7%
(iii)+(iv)+(v)
Satisfied
96.5%
98.8%
94.0%
94.0%
92.8%
95.2%
74.7%
92.8%
95.2%
95.2%
94.0%
93.0%
19
4. CONCLUSION
The results of the survey indicated high considerable for Overall Quality of teaching and
learning since 100% students rated as very good, good and adequate measures of
achievement for all the statements. Thus students were satisfied with the overall quality of
teaching and learning in PKK.
Over 98.8% of graduates agreed that they had achieved the PLOs of the programme.
The data showed majority of students responded between very good to good scale in this
Skills and Knowledge assessment. The rest of the graduates perceived and rated at least
adequate scale for all PLOs (soft-skills and knowledge-skills) acquired by the graduates.
Evaluation of the graduates opinions towards contributions of lecturers and academic
advisors system implemented also showed that graduates were satisfied with the lecturers.
Result showed that 100% of graduates rated very good, good and adequate scale. This
also supports the implementation of OBE in PKK which emphasized for student-centred
learning.
Finally 93.0% graduates were satisfied with the academic resources and facilities
provided. The most significant item that graduates were not satisfied with was the Wi-Fi
internet access in PKK where 25.3% of them rated for marginal and poor. Insufficient
Wi-Fi coverage around PKK was due to lack of Access Point (AP) installed.
This exit survey was found to be an essential tool to help identify the areas needs to
be improved in the quality of education as a whole in PKK especially for Diploma in
Electrical Engineering (DET).
REFERENCES
[1] Sani, M.S.M. (2009) Exit Surveys Assessment of Bachelor Mechanical Engineering
Programs at Universiti Malaysia Pahang. Proceedings of MUCEET 2009.
[2] Mohamed, A. (2012) Graduate Students Perspectives on Study Environment Based on
Exit Survey. Asian Social Science Vol. 8(16), 200-208.
[3] Zainulabidin, M.H. (2012) Indirect Program Learning Outcomes (PLO) Attainment for
the Bachelor of Mechanical Engineering with Honours (BDD) Degree Program.
FKMP OBE Committee Report 2012.
20
[4] COPPA. (2008) Code of Practice for Programme Accreditation. Malaysian Qualification
Agency.
[5] Adler, K. (2012) School Exit Surveys What you should know before you start. Michigan
State University.
[6] UNLV. (2011) Graduating Senior Exit Survey Report. University of Nevada Las Vegas
Office of Academic Assessment.
[7] Quality Support Unit. (2011) Exit Survey 2010. University of Limerick.
21