Web Based Teaching Evaluation Systems
Web Based Teaching Evaluation Systems
Web Based Teaching Evaluation Systems
International JOURNAL
Journal of Information Technology OF INFORMATION
& Management TECHNOLOGY
Information System &–
(IJITMIS), ISSN 0976
6405(Print), ISSN 0976 – 6413(Online), Volume 5, Issue 2, May - August (2014), pp. 15-27 © IAEME
MANAGEMENT INFORMATION SYSTEM (IJITMIS)
Adnan M. Al-Khatib
CIS Dept., College of IT and Computer Science,
Jerash University, Jerash, Jordan
ABSTRACT
1. INTRODUCTION
15
International Journal of Information Technology & Management Information System (IJITMIS), ISSN 0976 –
6405(Print), ISSN 0976 – 6413(Online), Volume 5, Issue 2, May - August (2014), pp. 15-27 © IAEME
useful report format. In most cases students do not have access to the evaluation results to
help them make decisions about which courses to take.
While many other administrative tasks, such as course registration and the posting of
grades, are usually worked as online processes, student course evaluation is still primarily a
paper process. Some studies show that few educational institutions used a wide online course
evaluation system to collect student ratings. The studies concluded, however, that the number
of institutions using online evaluation systems is growing
The World Wide Web (Web) opens up the possibility of collecting data from students
on-line. This report presents some useful recommendations for designing and implementing
an online teaching evaluation system. It describes an attempt to develop and implement a
simple Web-based (on-line) system for student Evaluation of Teaching, to support end-of-
semester teaching evaluation. Our simple system can be upgraded to include several features
needed in these types of systems. In this report we will discuss the planning, designing and
implementation of a good online evaluation system using new software programs such as
PHP and MYSQL Database management System (DBMS)
This report will talk about: reasons for going on-line in section 2, methodology in
section 3, literature review from previous studies of similar systems in section 4, design of
the project in section 5, implementation of the system in section 6, discussion and analysis in
section 7, conclusion and future work in section 8.
In the paper faculty evaluation process, evaluations are conducted during the last two
teaching weeks of each semester and are done in class. This process needs a lot of heavy
work to be done by the responsible persons of the process, such as: update the database of
classes taught in each semester; find out which departments will use additional questions;
package and distribute questionnaires to departments at appropriate times; receive answer
sheets and carry out optical scanning procedures; perform data analysis; generate a number of
different reports and distribute these to individual instructors, department heads, school deans
and university administration; ensure security of evaluation data during data processing and
report generation; ensure an appropriate turnaround time so that instructors can use results to
upgrade courses in the following semester or for academic review purposes; Issue guidelines
for conducting evaluations to all instructors, departmental office managers and people who
administer the questionnaire; and Issue instructors with guidelines for interpreting evaluation
reports.
Such delays in performing these tasks will seriously affect the usefulness of the
results with respect to either informing the revision and improvement process or providing up
to date information on individual performance.
In the online faculty evaluation process there are a lot of advantages over the paper
process, such as
• Increase in efficiency in the data collection process: data collection involves only the
inputting of student and instructor data into the system, and this data may be already in
electronic format. Students can access the questionnaire using any computer at any time
they choose within a specified period. Their responses will be transmitted back via the
Internet and stored in a server.
16
International Journal of Information Technology & Management Information System (IJITMIS), ISSN 0976 –
6405(Print), ISSN 0976 – 6413(Online), Volume 5, Issue 2, May - August (2014), pp. 15-27 © IAEME
• Increase in flexibility: on-line system with the processing power of its host computer
allows greater flexibility in performing different tasks in the system, such as supporting
complex questionnaire designs and other tasks.
• No need to schedule time for teaching evaluation students can do the evaluation
anywhere and at any time and not in class time.
• Flexibility in questionnaire design on-line system allows great flexibility in questionnaire
design. In an on-line system, questionnaires can always and easily be modified to contain
additional sections to evaluate any number of instructors in the course
• On-line system can support complex branching in presenting the following questions
according to the student answering in the previous questions, and this is difficult to be
done in paper evaluation.
• In an on-line system questionnaires can also be customized in accordance with the needs
of the individual course or instructor.
3. METHODOLOGY
Existing Systems: this need to interview persons, who are responsible about the current
evaluation system. Interview other departments at university, who used the existing system. It
needs to investigate how these systems work, the challenges to implementation, the costs of
transition, etc.
Best Practices: identify peer educational institutions currently using online evaluation
systems for their departments. Conduct interviews with those involved with the
development, planning and implementation of successful systems and programs at some local
institutions in Jordan
Students: this can be done through web-based or paper surveys. The most effective method
for reaching a large number of students would be to conduct an online survey. In addition, a
paper version of the survey can be distributed to students.
Faculty: This need to identify a list of deans, department chairs, and chairs of key Academic
Senate committees to be interviewed. It can be done by interviews with them, or receive
written responses to a questionnaire
Staff: conduct interviews with administrative staff who have responsibility for the
management of the evaluation process for their department, as well as those staff who would
need to be involved in the development and implementation of an evaluation system.
After collecting the above data, data need to be compiled for review and analysis
17
International Journal of Information Technology & Management Information System (IJITMIS), ISSN 0976 –
6405(Print), ISSN 0976 – 6413(Online), Volume 5, Issue 2, May - August (2014), pp. 15-27 © IAEME
4. LITERATURE REVIEW
Some previous studies for five universities in USA that implement successful online-
evaluation systems gave us some recommendations about the features that need to be
considered in this type of systems.
Existing Systems: From previous studies, several key features for an Online Course
Evaluation system were identified and need to be considered. For application requirements,
some requested features include Flexibility to customize questions, reporting capability for
current and historical data, development of questions database, using of the system for
evaluation and other university purposes, and ability to follow up with students to determine
importance of class. For administration requirements, some requested features include:
Provide adequate training for those who will administer the system, provide central funding
to departments, develop university policy to publish limited results, and guarantee ease of use
for the system.
Best Practices: From previous studies, five universities in USA that have successfully moved
from a paper to an online evaluation process mentioned some recommendations for
characteristics of features need to be considered in online evaluation teaching system. These
features include: Guaranteed anonymity of respondents, Customization of questions, Data
security and availability, Inclusion of incentives to achieve higher response rates, Ease of
maintenance and modification, and Reporting capability.
Student Survey: In the five universities Student opinions were solicited via a survey
conducted over a period of several days in both online and paper format. Selected anonymity
and confidentiality is the issue of greatest concern to students about completing evaluations
online.
Faculty Interviews: In the five universities Faculty opinions were collected through
Interviews. There desired features are summarized by: ability to customize evaluations at the
departmental and course levels in order to obtain more relevant data, availability of a menu of
reports with the ability to receive raw data that could be further analyzed, and security of data
and student anonymity must be provided by the new system.
Staff Interviews: From previous studies desired features for the staff can be summarized by:
the need for stringent security measures to guarantee anonymity and protect the sensitive data
that being collected, the need for the system to provide robust reporting and access to
collected data, the need for training program to use the system, Integration of the system with
other relevant databases and systems, and the development of an official department policy
that would clearly state the rules and regulations governing the use of the evaluation data
being collected by the new system.
18
International Journal of Information Technology & Management Information System (IJITMIS), ISSN 0976 –
6405(Print), ISSN 0976 – 6413(Online), Volume 5, Issue 2, May - August (2014), pp. 15-27 © IAEME
For the purpose of system maintenance, a front-end tool will be created using suitable
software. This system is a user-friendly menu-driven system which enables the system
administrator to do regular maintenance without the need for programming.
19
International Journal of Information Technology & Management Information System (IJITMIS), ISSN 0976 –
6405(Print), ISSN 0976 – 6413(Online), Volume 5, Issue 2, May - August (2014), pp. 15-27 © IAEME
stripped from the system after initial identification had been made and in no way could they
be matched to the response data.
It is important to emphasize that, although students have to log on using information
relating to their identities, their anonymity is maintained. The system has to be designed in
such a way that is impossible to trace the identity of any student making a particular
response.
For the first factor, Paper evaluations are usually conducted during the last two
teaching weeks of each semester and done in class. This process needs a heavy load of work
from the responsible persons as mentioned in section 2 above.
For the second factor: to ensure maximum efficiency of the online evaluation system,
it's necessary to link the system with other electronic systems in the university, such as: the
course registration system, the central computer system, the evaluation data processing
system, the instructor information system (if available), and the semester timetables that
determine the timing of evaluations. Figure 2 indicates the types of links desired.
Furthermore, the results of the evaluation must be immediately available and in a form
suitable for data processing and reporting. Hence, the need for close integration with each
university’s computer system has a major impact on the design of the system.
20
International Journal of Information Technology & Management Information System (IJITMIS), ISSN 0976 –
6405(Print), ISSN 0976 – 6413(Online), Volume 5, Issue 2, May - August (2014), pp. 15-27 © IAEME
For the third factor, the evaluation system can be designed to consist a set of modules,
such as: Questionnaire Input Module, Data Capturing Module, and Data Reporting Module.
The questionnaire input module allows users to design and input questionnaires. In
this module users specify the number of questions, the question types (multiple-choice,
true/false, short answer, etc.), and other relevant features. The reporting module processes
and analyzes evaluation data. The reports are usually printed and sent back to the interested
parties. Reports can be made available on-line, but data security needs to be considered.
These three modules need suitable Interfaces design.
21
International Journal of Information Technology & Management Information System (IJITMIS), ISSN 0976 –
6405(Print), ISSN 0976 – 6413(Online), Volume 5, Issue 2, May - August (2014), pp. 15-27 © IAEME
Fig 3: state diagram for different role players in the proposed system.
- Users Table: consists information of the users who can logon to the system, and
privileges allowed to each user.
22
International Journal of Information Technology & Management Information System (IJITMIS), ISSN 0976 –
6405(Print), ISSN 0976 – 6413(Online), Volume 5, Issue 2, May - August (2014), pp. 15-27 © IAEME
- Courses Table: consists information about the courses available for the students.
- Students Table: consists information about the students registered in the courses.
- Teachers Table: consists information about the teachers of the courses.
- Questions Table: consists the questions that will be included in the evaluation form.
- St_answer Table: consists the answers information that collected from the student form
after the student filled and submit the form.
- Course_eval Table: consists the evaluation marks for the courses after the evaluation
process.
You can see the tables' fields in the EER diagram above.
23
International Journal of Information Technology & Management Information System (IJITMIS), ISSN 0976 –
6405(Print), ISSN 0976 – 6413(Online), Volume 5, Issue 2, May - August (2014), pp. 15-27 © IAEME
Query1
te ache r_id course_ id cours e_sec teacher_name c ourse_name c ourse_mark teacher_college
1212 1
CIS101 2 Salma In trodu ction to Info rmation Technology 81.32 IT
CIS102 2 Salma Data Structu re 77.45 IT
Summa ry for 'teacher_id' = 12121 (4 deta il records)
Av g 79 .3849 9
1234 5
CIS101 1 Ahmad In trodu ction to Info rmation Technology 83.25 IT
CIS102 1 Ahmad Data Structu re 76.24 IT
Summa ry for 'teacher_id' = 12345 (8 deta il records)
Av g 79 .7449 9
6. IMPLEMENTATION
The system can take advantage of the latest development technologies in its
implementation. MYSQL can be used as a server database and the PHP scripting language
with HTML can be used to develop the web application. Windows 7 for example can be used
as a platform to develop the system.
Using these software programs in Implementation can help to: Allow users to simply
call up and login to the site using any standard web browser, fill in the appropriate
questionnaire forms and submit the forms, Results automatically saved in remote database
server, and Create dynamic web pages that can be displayed for user with suitable forms and
format.
By dynamic web pages, elements of the evaluation questionnaire can be saved in the
database and reconstructed dynamically on the Web when accessed. By using this approach,
when a student logs on to the system, his or her identification is first checked. If verified, the
courses within which that student is registered for the selected semester will be retrieved.
24
International Journal of Information Technology & Management Information System (IJITMIS), ISSN 0976 –
6405(Print), ISSN 0976 – 6413(Online), Volume 5, Issue 2, May - August (2014), pp. 15-27 © IAEME
After the student chooses a course to evaluate, the questionnaire of the course is retrieved and
displayed. Upon completion of the questionnaire the student would submit it and the system
would register it as complete. The entire process is a data driven process and is shown in
Figure 9.
Some points need to be considered during implementation such as: System needs to
be easy to access and use, System needs to be tied to the student registration database so as to
be able to access enrolment information dynamically, and System needs to guarantee data
security as required.
In system testing process, some issues need to be considered such as: Run the system
with a large number of students to test system stability; Allow students to use the system and
test response rates within a specified period of time; and Focusing on testing the validity,
reliability, stability, and consistency of the online system.
In this paper we presented some points that have to be considered in developing and
using online web-based teaching evaluation systems.
While students may find it somewhat inconvenient to evaluate faculty online, they
should have little difficulty understanding the online procedures, since students today, are
quite comfortable with the Internet and web sites.
This study and previous studies demonstrated that gathering teaching evaluations data
online is a viable alternative to the traditional, in-class method. In addition, several studies
have demonstrated that online surveys may produce a higher quality and greater quantity of
response to questions.
The only serious problem posed by the online method is a potentially low response
rate. Professors can use reminder messages to enhance the response to an online faculty
evaluation, they can easily make reminder announcements in class and/or they can have the
web site programmed to automatically Email reminder notices to non-respondents on a
regular basis. In addition, system can be programmed to prevent students from retrieving
their grades in the course before they do the evaluation for that course.
25
International Journal of Information Technology & Management Information System (IJITMIS), ISSN 0976 –
6405(Print), ISSN 0976 – 6413(Online), Volume 5, Issue 2, May - August (2014), pp. 15-27 © IAEME
When students log on to a web site to conduct an online evaluation, they should be
required to use an access code. The access code ensures that the response is coming from a
student in the class and it prevents students from evaluating the class more than once. In
many cases, a student’s access code is the student’s ID number.
When students use their ID number to log on to the survey web site, professors and
survey administrators must assure students that their identity will never be tied to their online
evaluation. It may be necessary to develop strategies that increase the student’s perceptions
that response to the survey is truly anonymous. One strategy that might work is to develop a
set of access codes for the web site survey.
Should students be required to verify that they have completed the evaluation, the
online system can be programmed to generate a ‘proof of completion’ certificate for the
evaluator.
Gathering evaluations of faculty through a web site survey is a relatively new
technique and many aspects of this survey method still need to be researched and fine tuned.
For example, when should the online faculty evaluation begin and how much time should
students be given to complete the evaluation? Most of the online evaluations in the literature
started a few weeks before the final exam.
When students respond online, should they be allowed only one attempt at the
evaluation or should they be allowed multiple visits to the same questionnaire so that they
can either complete the survey or change their previous answers?
Clearly, answers are needed to the above questions so that survey administrators will
know the optimal strategy to use when conducting an online evaluation of faculty.
26
International Journal of Information Technology & Management Information System (IJITMIS), ISSN 0976 –
6405(Print), ISSN 0976 – 6413(Online), Volume 5, Issue 2, May - August (2014), pp. 15-27 © IAEME
can compile questionnaires using questions from the bank. They will also be able to choose to
write their own questions or modify existing ones.
When instructors finish designing their questionnaires, the questionnaire will be put
on the Web to collect students’ responses. To do that, all they will have to do is to specify a
period during which the students will be given access to the questionnaire. When the data
collection period finishes, a report will be generated automatically which the instructor can
view on the Web.
REFERENCES
[1] Kelly, M. & Marsh, J.; "Going On-line with Student Evaluation of Teaching";
Evaluation of the Student Experience Project, Vol. 6; City University of Hong Kong,
Centre for the enhancement of Learning and Teaching; 1999.
[2] Tak S. Ha, Jonathon Marsh, John Jones; "A Web-based System for Teaching
Evaluation"; New Challenges and Innovations in Teaching and Training into the 21st
Century" (NCITT'98) conference; May, 1998; Hong Kong.
[3] Tak S. Ha, Jonathon Marsh; "Using the Web for Student Evaluation of Teaching
(COSSET & OSTEI)"; 1999.
[4] Thomas Price, Jeromie Walters; "A ROLE-BASED ONLINE EVALUATION
SYSTEM"; University of Akron, Ohio, USA; 2006.
[5] Improving the Process of Course Evaluation: The Online Alternative for Berkeley
University; Leadership Development Program; 2004-2005.
[6] MYSQL Reference Manuals from the web site www.mysql.com.
[7] PHP Reference manuals.
[8] Rutu Joshi and Priyank Thakkar, “Experimental Evaluation of Different Classification
Techniques for Web Page Classification”, International Journal of Advanced
Research in Engineering & Technology (IJARET), Volume 5, Issue 5, 2014,
pp. 91 - 101, ISSN Print: 0976-6480, ISSN Online: 0976-6499.
[9] Nathan D’lima, Anirudh Prabhu, Jaison Joseph and Shamsuddin S. Khan, “Novel
Approach in E-Learning to Imbibe Environmental Awareness”, International Journal
of Computer Engineering & Technology (IJCET), Volume 4, Issue 2, 2013,
pp. 166 - 171, ISSN Print: 0976 – 6367, ISSN Online: 0976 – 6375.
[10] Yahya Al-Ashmoery, Rochdi Messoussi, Youness Chaabi and Raja Touahni,
“Monitoring and Visualizing Students Tracking Data Online Learning Activities
(Tracking in E-Learning Platforms) MVSA”, International Journal of Information
Technology and Management Information Systems (IJITMIS), Volume 4, Issue 3,
2013, pp. 121 - 135, ISSN Print: 0976 – 6405, ISSN Online: 0976 – 6413.
27