IDELA Training Manual - Baseline II
IDELA Training Manual - Baseline II
IDELA Training Manual - Baseline II
BASELINE II SURVEY:
TRAINING MANUAL FOR KINDERGARTEN CHILD ASSESSORS
SEPTEMBER 2015
TABLE OF CONTENTS
Content Page
CHAPTER ONE: GENERAL INTRODUCTION
1.1 Welcome 1
1.2 Introduction to IPA 1
1.3 Training Objectives 1
1.4 Ground Rules for Training 2
1.5 Assessing Learning and Performance 2
1.6 Administrative Issues 3
ii
5.3 Routing checks on the tablets 15
iii
LIST OF TABLES
Table Page
Table 1. Per Diems and Wages for Field Staff 4
Table 2. Overall Work Plan for the Survey 6
Table 3. Composition and number of sample 11
Table 5. Responsibilities of Survey Team Members 17
Table 6. Field Supplies and Materials 25
LIST OF FIGURES
Figure Page
iv
CHAPTER ONE
GENERAL INTRODUCTION
1.1 Welcome
This manual contains information on data collection protocols that IPA use in
training its field personnel to ensure high quality data, especially for the improving
preschool quality study. The manual specifically focuses on the instructions for the school
surveys as part of the Baseline II. By the end of this training, trainees should be positive
about their involvement in the improving preschool quality baseline survey process;
confident that they are well-prepared for the field survey operations (teamwork,
interviewing, etc.); and confident that they are fully supported by the survey management
team. If you have any questions at any point, please ask.
Dedicated and professional surveyors are critical to producing high quality data.
Since you will be in the field collecting this data for IPA, you play a major role in the
success of our project. Your attention to details and adherence to the protocols you are
trained in will help ensure that communities, organizations, governments, and researchers
world-wide have access to good data to help them make decisions that will affect people’s
lives. We hope you will take as much pride in your work as we take in our hard-working
employees. Welcome to the training for the baseline survey of the Quality Preschool for
Ghana (QP4G) Study! Welcome to IPA!
1
a. Understand the QP4G Study.
b. State roles, responsibilities and expectations for their involvement in the survey.
c. Understand the IDELA child assessment tool.
d. Explain the field operations, survey process and protocols.
e. Carry out an effective interview, using the tablet to collect data.
f. Carry out the survey in the field, following the correct protocols prescribed during
the training.
2
c. Field practice: A field practice visit will be organized during the training on 2nd
September 2015 for all assessors. This gives the opportunity to apply what the
trainee have learnt during the training, and for the trainers to provide specific and
constructive feedback to the trainees. The practice session and the feedback help to
ensure the transfer of learning to the field survey.
d. Observations: The behavior of trainees will also be evaluated during the training.
3
Health insurance: You are required to have valid National Health
Insurance card. Present a photocopy of your NHIS card for evidence.
GCB accounts: If you are hired, IPA will pay you by bank transfer into
your account, preferably a GCB account. If you do not have a GCB
account, you will be required to open one or with other banks. You are
therefore required to provide your bank account details to project
management before your first day of fieldwork.
d. Finance:
4
CHAPTER TWO
BASICS OF THE QUALITY PRESCHOOL FOR GHANA STUDY
In order to address the above policy concerns, IPA, in partnership with researchers
from New York University in the United States, seek to improve the quality of kindergarten
education through teachers and parents. Specifically, the Project involves
a. An 8-day in-service teacher training delivered by the National Nursery Teacher
Training Center with monitoring and feedback visits;
b. A 3-part video and discussion intervention delivered to parents through school
Parent-Teacher Association meetings focused on early childhood development and
learning;
c. Evaluating the effectiveness of (a) improving the supply of teacher training; (b)
improving the supply and changing the demand of parental intervention.
5
2.3 Objectives of the QP4G Study
The primary objectives of the evaluation part of the QP4G Study are to:
a. test the efficacy of a low cost in-service kindergarten teacher training intervention on
the quality of kindergarten teachers’ classroom practices and interactions; children’s
development, school readiness and learning in preschools in Greater Accra Region.
b. test the efficacy of a low cost parental awareness intervention on changing the
parental perceptions and expectations of high quality kindergarten educatoin.
c. test the added value of combining a scalable (low-cost) parental awareness
intervention with teacher in-service training.
Key Dates
Key Activities Responsibilities From To
Training of Baseline II survey PI/FM/RA/FM 25th August 2015 3rd August 2015
Baseline II Survey Team 09th Sept. 2015 8th October 2015
Mop up Survey Team 9th October 2015 14th October 2015
6
CHAPTER THREE
PROTOCOLS FOR CONDUCTING FIELDWORK
7
h. Observe how the child is doing and offer breaks as needed throughout.
a. There is no “time limit” to complete the assessment although some questions
are timed to help move through the items at a regular pace.
b. Make sure that you understand visual and verbal cues if the child is feeling
discomfort or appears to want to end the assessment.
c. When the child shows any sign of distress, stop the assessment immediately
and send the child to the classroom, drawing the attention of the KG teacher
to the incidence. Notify your team leader to follow up on the child the
following day. The Team Leader should record all case of child distress and
notify the Research Associate.
i. Take care of yourself: Child assessment could be stressful and you need to take care
of yourself. To manage your stress:
a. Take care of your emotional self. Get support by talking with someone –
your colleague or team leader - after a particularly troublesome interview.
b. Take care of your physical self. Get enough rest and exercise, and eat
properly.
c. Take care of your intellectual self. Think about the goals of the survey. Keep
this balanced with your emotional self so one is not overpowering the other.
d. Take care of your spiritual self. Seek spiritual help according to your beliefs.
j. Be honest and professional: Treat all children with kindness and respect. Remember
that they are young and vulnerable group and are doing us a favor.
a. Don’t ever make up answers to assessment items. It will be discovered during
the auditing process. This will always result in immediate dismissal.
b. If you notice something that might be important to data quality, bring it to
our attention. We appreciate feedback, and it shows initiative.
k. Recording responses: When recording the child’s responses,
a. Listen carefully to the child’s response.
b. Record the answer correctly.
c. Strictly follow the specific instructions for each section/question.
8
participate in this survey. Informed consent is intended to inform a potential respondent
about the purpose, risks, potential benefits, confidentiality, compensation, contact
information for questions, and conditions of participation in the study. Because children
cannot provide informed consent, children provide assent to participate in research, to the
extent that they are able, and caregivers give permission for a child to participate in
research.
Parental consent is a prerequisite to the recruitment of KG children to participate in
the study. However, parental consent constitutes only half of the consent process.
Caregivers should give permission for their child(ren) to participate in the study. The Field
Mobiliser will provide each sampled child a note to the caregiver, and that if they do not
wish for their child to participate, they can indicate so on the paper and send it back to the
school the following day. However, if the caregiver does not send the note back, it means
s/he has given consent (passive consent). Notwithstanding, before assessing each child,
obtain the child’s assent [i.e., the agreement of the child to participate in the study]. Below
are the informed consents.
Consent Form Statement – KG Children
Hello, my name is [NAME OF ASSESSORS]. What is your name? How are you doing
today? I am here to learn about how children like you learn things and if they know how
to play some games and do different activities. Is it okay if we do some activities together
for the next 40 minutes or so?
You can stop and take a break if you need to - just let me know. If you decide at any point
that you’d like to stop, or that you don’t want to do a particular activity, that’s okay too.
Don’t worry about the answers you give me – this is not a test! Also, I am not going to tell
your head teacher, teacher or parents about the things we discuss or the activities we do.
We are just going to talk for some time and you can tell me if you want to leave at any
point in time.
Do you have any questions? Are you ready to start?
A18. Permission given by child to begin?
1. Yes
2. No (Skip to A19)
9
3.3 Selection of KG child-parent pair
The eligible respondents for the child assessment and caregiver survey are KG
children and their primary caregiver, respectively. KG children and parents will be selected
using the sample sampling approach. The selection will be done in the field. The Child-
Parent Listing Form will be used on the SurveyCTO platform for the listing and
randomization of kindergarten children and parents. Information for the listing of children
and parents will be obtained from the school’s KG roster/admission form and Parents
Teacher Association files. The details of the selected KG children will be given to the Team
Leaders of each group to be assigned to the Child Assessors. Fifteen (15) KG child-parent
pair will be randomly selected; 8 from KG1 and 7 from KG2. Each school will have ten
reserve/replacement child-parent pairs.
10
CHAPTER FOUR
THE BASELINE II SURVEY INSTRUMENTS
4.1 Overview
The Baseline II has four main questionnaires/tools – Direct Child Assessment (IDELA),
KG Teacher Survey, Caregiver Survey, and Classroom videotaping form. These tools will be
administered to eligible respondents of private and public schools in six selected
Municipalities in the Greater Accra Region of Ghana.
Table 3. Composition and Number of Sample
Method of Respondent Respondent’s Total
Survey Tool Administering Type Per School Respondent
KG Teacher Survey In-person interview KG teachers 2 480
Classroom Observation Video survey KG teacher 2 480
and children
Direct Child Assessment In-person assessment KG children 15 3600
Caregiver Survey Telephone survey Caregivers 15 3600
11
proceed to the next child. Remember that some children will refuse initially due to
fear or discomfort with the assessor. Hence, be professional in approaching the child!
c. Item labels: The IDELA tool has 29 items with labels. The labels are a kind of a
heading/section, and are not meant to be asked or spoken aloud during the
assessment. However, introduce the section to the child.
d. Questions/instructions for child: Each item (except Items 1 and 29) instruct the child
to perform a particular task or game. Item 1 asks the child pertinent questions about
his/her personal awareness. Item 29 relates to the Child Assessor’s personal
evaluation of the child BASED on the child’s performance on each item (except Item
29) and persistence/engagement during the whole assessment. Please pay attention
and critically observe the child right from the beginning of the assessment to the end!
e. Question should be read clearly to the respondent. The responses are either text,
requires specific values (such as numbers), or are completed by checking one of the
possible response options.
f. Instructions for Assessor: Assessors must pay careful attention to the instructions and
read all questions to children exactly as they appear. Instruction for assessors are in
two forms of type: bold type and italic type. Bold type in boxes indicates things
you, the assessor, must say to the child out loud. Please read this type aloud to the
child completely and exactly as it appears. This is important to ensure that the data
will be collected in a standardized manner across all children. Italic type indicates
instructions for you. Do not read these instructions aloud to the child.
g. Refer to the child assessment tool for more details on the specific instructions for
each item.
12
CHAPTER FIVE
USING THE SAMSUNG TABLET FOR DATA COLLECTION
13
2. Go back to the main Collect menu, then choose Get Blank Form. Press OK when
prompted to confirm the login information, select the checkbox next to Sample –
Basics, and press Get Selected. The forms you will see for our surveys are the Teacher
Survey, IDELA, Parent-Child Listing Form, and Videotaping Form.
3. Go back to the main Collect menu, choose Fill Blank Form. Fill out the sample forms
i.e., the Teacher Survey, IDELA, Parent-Child Listing Form, and Videotaping Form.
To navigate through the forms, swipe the screen to go backward to previous and
forward to next. Provide the record for each information or question following the
interviewer instructions provided in the previous sections. Take note of error
warnings (e.g., required fields, answers must be within a particular range, etc.).
Before saving the finalized form for editing, uncheck Mark form as finalized. After
editing, check Mark form as finalized before saving.
14
4. Back on the main Collect menu, choose Send Finalized Form. Check the listed form
and click Send Selected.
15
CHAPTER SIX
CONDUCTING THE FIELDWORK
16
Figure 1. Organizational Chart for the Survey
Research Associate
Field Manager
17
Position Responsibilities/Tasks Report To
Ensure sufficient surveys, supplies, and forms of all surveyors;
Solve and communicate all problems with team members to
field supervisors and field manager;
Edit all administered surveys for the surveyors;
Prior experience in working with IPA evaluation projects in
education.
Maintain team motivation and morale and foster team spirit.
Perform other duties related to the project that may be assigned
to him/her.
Child Assessors are responsible for administering the Direct Child
Assessment (IDELA) according to IPA data collection protocols.
Child Specifically, the Child Assessor administers learning assessments to TL
Assessor selected KG children in selected schools and ensures that learning
assessments are administered in an ethical, honest, and rigorous
manner based on IPA survey protocols.
18
b. Each school survey team will be tasked to complete 1 school/day; 5 schools/week
and 17 schools within the survey period. Therefore, each Child Assessor will
complete 5 child assessments per day, 25 per week and 85 within the survey period;
c. Surveys will be conducted on district basis. The number of teams working in a
district at a particular time depends on the number of schools within the district [left
to be covered]. Once a district is entirely covered, the team will visit the next
district. This will be continued until all selected schools/districts are covered.
19
o The assignment of child assessors should be consistent throughout the survey
period. One assessor for each team should assess children with IDs 01 to 05.
The second assessor should assess only children with IDs 06 to 10 while the
last assessor should assess only children with IDs 11 to 15. The team leader
should keep record of this for tracking purposes.
o Every child assessor should verify the identity of the child before beginning
the assessment.
20
e. Monitor the performance of the interviewers by observing interviews. Observing
interviews are important aspects of data quality.
a. Observing interviews must be aggressively pursued during the first two days
of fieldwork to ensure that interviewers understand the mechanics of high-
quality interviewing.
b. Each team leader must observe at least one full child assessment for each child
assessor and a KG teacher survey per day;
c. Provide constructive feedback to interviewers based on observations.
f. Confirm and ensure that the interviewers attempt to conduct the required number
of surveys/assessment/video recording in each school. Use the Respondent Tracking
Sheet to recording the team’s progress each day. If a particular respondent was not
assessed or interviewed, arrange for a second attempt to get the respondent
interviewed. Confirm with the interviewer that he/she entered the necessary
information on the outcome of the questionnaire.
g. Ensure that each interviewer follow the communication protocol agreed upon
during training. The channel of communication in the field should follow the
organogram for the study. On no account, should there be a break in the prescribed
chain of communication.
h. Follow data management procedures. Use the form Data Quality Issues for each
school to note data quality issues and the possible resolution of those issues.
a. Ensure that you review the records from each interviewer and edit the record
if an error has been found. For each questionnaire viewed and edited, ensure
that the correct information on the school and unique survey IDs are
accurately entered and not repeated.
b. If there are no errors observed by the team leader, write “no data issues” on
the form and return it to the field supervisor. Team leaders who report “no
data issues” on the form but such issues has been discovered later will be
considered as not having done their work well. Appropriate sanctions will be
used.
c. Ensure that data from every member is sent to the server every day.
d. Upload the recorded videos on the laptop and ensure that the correct
labeling system has been applied to the naming of the video for each school.
21
i. Maintain daily contact with your assigned field supervisor to provide an update
about the work completed, challenges encountered, data quality issues, security, etc.
Compile and submit the required documentation every day: Respondent Tracking
Sheet; Data Quality Issues Form; Signed informed consent forms; and a daily log of
fieldwork. The team leader is also required to produce weekly field reports.
22
c. Check to see if the correct survey IDs and other relevant personal information
have been accurately captured in the completed surveys. Check that NO
duplicate entries of survey IDs have been made.
d. If an error was identified, ask if the team leader edited the data and entered
the correct records before the data were sent to the server. Check all entries
on the Respondent’s Tracking Form and Data Quality Issues to confirm the
information provided for this school.
f. Confirm that all completed surveys for that school have been sent to the server.
g. Confirm that the team leader knows the assigned school for the next day. Inform the
team leader about any advance communications that have taken place with school
proprietor or head.
h. Find out whether the team leader requires any additional field materials or supplies
and provide, if needed.
i. Ensure that data entry errors have been reported to the Research Associate so that
they will be taken into account when the data are being cleaned and edited.
j. Retain the field materials that have been submitted from each team.
23
data collection. Second, the RA/FM/FS/TL pay(s) unannounced visits to the surveyors on
the field. This serves to provide information on where a surveyor should be and whether
or not s/he is following established procedures.
24
6.3 Logistics for Field Work
Transport allowance is provided for as part of the per diem for your field activities.
Where there is a strong evidence that the transport allowance of GH¢ 15 will be exceeded
in an attempt to track a school, inform your Team Leader, who will also inform the FM
before making such expenses. No allowance for accommodation will be provided for field
staff. The security of the field survey teams should be ensured and not taken for granted.
Your security is paramount to the success of this survey. Be safe! Adequate protection
should be made to protect yourself and the data collection tools/equipment against the
weather. Before leaving for the field, every survey team should be resourced with survey
supplies and materials (Table 6). You are responsible for all items that IPA provides you for
the fieldwork. You should treat such supplies/equipment as if they are your own! When
you receive/return your supplies/equipment, you will sign an equipment/material sign-out
sheet. Between the sing-in and sign-out times, you are fully responsible for any loss,
damage, or theft that occurs to the items. This means you must pay for a replacement or
provide a replacement if IPA determines that loss/damage has occurred.
Table 5. Field Supplies and Materials
Item Number Required
Team Members
Tablet, charger and case 1 per team member
Letter to school authorities 1 per school
Identification card 1 per team member
Informed consent script 2 per respondent (1 each signed script for the respondent
and surveyor)
Field manual 1 per team member
Respondent’s gifts (flip chart) 1 per school
Bag for field supplies/materials One per team member
Paper version of questionnaires 3 per survey team
(in case of tablet malfunction)
First Aid box I per survey team
Child assessment kit I per child assessor
Team Leaders Only
Survey movement plan/schedule 1 per survey team
List of districts/schools 1 per survey team
Field activity report template 1 per survey team
25
6.7 Frequently Asked Questions and Suggested Responses
The following presents frequently occurring questions and responses.
Question 1: What if it is raining? IPA works every work day, regardless of weather.
Rainy days can be great for surveying because people are less busy. Find a sheltered
spot during storms, and when the rain is lighter, continue. We advise you to carry a
rain coat, and wear clothing that can get a little wet, when in the field.
Question 2: What is IPA? Innovations for Poverty Action (IPA) is a non-profit
organization that specializes in evaluating economic and social development
programs. IPA has been working in Ghana for over 5 years and is registered as an
NGO in the country.
Question 3: What are you using these data for? We are collecting these data as
background for possible future research. It will also help us and the government to
understand issues surrounding preschool [kindergartern] classroom instructoin
quality and how to support kindergarten teachers with effective training and support
so they can best teach young children to learn.
Question 4: Will we get anything from you? Our organization is a research
organization, and we are just collecting data. This study will not directly benefit you.
However, the information you share with us will help us answer very important
questions about teachers’ and children’s experiences in school and is expected to
contribute to the improvement of education in Ghana.
Question 5: Can I interview any teacher or child if the primary respondent is not
around? No. The respondent should ideally be a person who is knowledgeable
about the information being collected in the survey. Only the primary respondent
can complete the survey.
26