Baseline

Download as docx, pdf, or txt
Download as docx, pdf, or txt
You are on page 1of 33

Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..

Project in Yabello Woreda


2023

COSULTANCY SERVICE TO CONDUCT BASELINE, MIDTERM


AND ENDLINE SURVEY FOR THE PROVISION OF CRITICAL EMERGENCY
GAP-FILLING INTERVENTIONS AND LIVELIHOOD SUPPORT FOR
VULNERABLE HOUSEHOLDS IMPACTED BY THE RE CURRENT DROUGHT
IN BORENA ZONE YABELLO WOREDA

(Technical Proposal)

Consultant:

Beles Engineering PLC


(Best Service, Right Time, Right People)

Client:

SOS Children’s Village

December 2023
Addis Ababa

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 1


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

TABLE OF CONTENTS

1. INTRODUCTION.......................................................................................................................................................................... 1

1.1. BACKGROUND OF THE PROJECT AND THE CLIENT.....................................................................................................................................1


1.2. OVERVIEW OF THE CONSULTANT.......................................................................................................................................................... 2

2. OBJECTIVE, SCOPE AND EXPECTED OUTCOMES........................................................................................................................... 1

2.1. OBJECTIVES OF ASSIGNMENT............................................................................................................................................................... 1


2.2. SCOPE OF WORK............................................................................................................................................................................... 1
2.3. EXPECTED IMPACT AND OUTCOMES......................................................................................................................................................2

3. APPROACH AND METHODOLOGY............................................................................................................................................... 4

3.1. APPROACH....................................................................................................................................................................................... 4
3.2. PLANNING AND SURVEY DESIGN...........................................................................................................................................................6
3.2.1. Defining Target Assessment Areas.........................................................................................................................................6
3.2.2. Sample Size............................................................................................................................................................................ 6
3.2.3. Data collection Methods........................................................................................................................................................7
3.2.4. Survey Questionnaire Design and Pre-test.............................................................................................................................9
3.2. INTERVIEWERS SELECTION, RECRUITMENT, TRAINING AND SUPERVISION....................................................................................................10
3.3. DATA PREPARATION AND MANAGEMENT.............................................................................................................................................11
3.4. DATA ANALYSIS AND REPORTING........................................................................................................................................................12
3.5. ETHICAL CONSIDERATIONS.................................................................................................................................................................12

4. STAFFI NG................................................................................................................................................................................ 16

5. WORK AND STAFFING SCHEDULE.............................................................................................................................................. 17

5.1. WORK SCHEDULE............................................................................................................................................................................ 17


5.2. STAFFING SCHEDULE........................................................................................................................................................................ 17

ANNEXES..................................................................................................................................................................................... 19

ANNEX 1: CURRICULUM VITAE..................................................................................................................................................... 20

ANNEX 2: TESTIMONIAL LETTERS................................................................................................................................................. 21

ANNEX 3: COMPANY PROFILE...................................................................................................................................................... 22

ANNEX 4: LEGAL DOCUMENTS..................................................................................................................................................... 23

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 2


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

1. INTRODUCTION
1.1. Background of the Project
SOS Children's Villages Ethiopia is a non-governmental non-political, non-denominational
charitable child welfare organization. For the last 49 years, it has been working on
addressing the needs of children who have lost parental care and those who have not
getting sufficient parental care and also strengthening the capacities of caregivers for better
care and support of children. It has the vision that, every child belongs to a family and
grows with love, respect, and security. This will be made possible through building families
for children in need, helping them shape their own futures, and sharing in the development
of their community.

SOS Children Villages Ethiopia operates in seven locations namely; Addis Ababa city
administration, Gode (Somali regional state), Bahir Dar (Amhara Regional state), Hawassa,
(SNNP), Jima (Oromia Regional state), Harar (Harari Regional State), and Mekele (Tigray
Regional State) by supporting children who are at risk of losing parental care and those who
lost.

SOS Children's Villages Ethiopia partner with donors, communities, governments and like-
minded organizations to reach children who need support, when emergencies strike, it
focuses on providing humanitarian assistance, care and protection for children and families
in collaboration with the government organizations.

Under nutrition is estimated to be the cause of more than 3 million child deaths per year
and is an underlying cause of 45% of child mortality. Without immediately addressing this
underlying factor through health treatment, health education, improved food security to
prevent re-admission, the child remains vulnerable. Due to the multi-sectoral needs of the
Borena community and lack of adequate resources, SOS CVE will concentrate its efforts in
supporting the poorest of the poor or nutritionally vulnerable groups such as PLW, the
elders, children under-fives. SOS CVE will scale up the implementation of therapeutic
nutrition treatment at the health posts and centers using Integrated Management of Acute
Malnutrition (IMAM) approach, put in place Maternal Infant and Young Child Nutrition
(MIYCN) intervention to provide preventive services, provide technical and logistical
assistance to Yabello Woreda health bureau to also cover hard-to-reach areas (HTR) of the
Woreda with mobile health and nutrition services. The two interventions will help restore
the health seeking behavior & basic primary health care service to contribute to the
reduction of malnutrition rates as well as lower morbidity and mortality rates because of the
current cholera outbreak in Yabello Woreda. This is further achieved by working with a
local partner, Gayo Pastoral Development Initiative (GPDI), which is both sub-grantee &

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 1


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

last mile community outreach arm. GPDI is going to raise awareness within the Borena
communities on where, how and when to access essential life-saving health, nutrition and
livelihood or recovery assistance to selected project direct beneficiaries.

The proposed program intervention was designed based on the outcome of the multi-
sectoral needs assessment conducted in the Borena zone, project insights and discussion
noted during the project formulation as well as in line with the recently unveiled 3-month
action plan or road map[1] that identified seven sectors (health, nutrition, education, food
(+cash), Essential Non-Food Items, WASH, agriculture & livestock and protection) requiring
additional fund amounting to $208,401,203.54. Any planned emergency response or support
to the zone will have to be a gap-filling in nature and must complement the gaps identified
in this road map or activities that would also support the gaps noted both during the multi-
sectoral needs assessment as well as project formulation exercise. It is, therefore, with this
background in mind that the proposed project title was named after “Provision of Critical
Emergency Gap-Filling Interventions and Livelihood Support for vulnerable households
impacted by the recurrent drought in Borena zone of Oromiya Region.”

As described above, the proposed intervention will quickly provide capacity building
(technical, logistical and financial) to Yabello Woreda health bureau so as to enable the
health office to manage the current public health emergency with confidence and ease while
minimizing unnecessary loss of lives. The priority set of tasks as explained above will be to
contain the cholera and measles spread that is very contagious and could spread like an
unattended wildfire in the context of the poor primary and secondary care service.

SOS CVE has thus floated a tender notice inviting competent consultants to undertake
baseline, midterm and endline survey for the intended intervention. Accordingly, Beles
Engineering PLC which is a multi-disciplinary service provider is happy to submit this
technical and financial proposal to bid for the work. Beles has very wide experience in
project evaluation (baseline, mid-term, endline) and rural development studies across the
country and in the sub-region in a wide variety of environments and assignments across the
country

1.2. Overview of the Consultant


Beles Engineering PLC is a multi-disciplinary consultancy firm, engaged in the provision of
professional services in a wide range of fields including project evaluation (baseline,
midterm and endline survey), water supply, sanitation, health, education and drainage
studies and design, water resources studies, environment, rural development studies and
WaSH.

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 2


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

The company has different licenses from the Ministry of Water and Energy; Ministry of
Mines, Ministry of Housing and Construction and the Commission for Environment, Forest
and Climate Change to conduct different project including project evaluation (baseline,
midterm and end line survey). The company has proven experience in baseline survey (see
annexed license and testimonials).

Beles is established and managed by highly-qualified professionals with many years of


practical experience in their respective fields of specialization. Beles wisely selected
important areas of professional involvement to expand its contribution in the development
endeavors that will have national and international significance. Beles has created conducive
working environment for multi-disciplinary and integrated professional services for on time
delivery of quality results to its clients.

1.3. Comments on the Terms of Reference


The consultant has thoroughly reviewed the Terms of Reference for the project. These terms provide
valuable information regarding the project's scope, key deliverables, and target groups to be focused
on. However, it is advisable to bring the following issues to the client's attention.

Firstly, according to the bidding document, the assignment is expected to be completed within four
and a half months (135 days). Considering the extent of the work and the locations of the target
areas, it appears that the given timeframe is somewhat short to produce a high-quality and
comprehensive evaluation report. Beles Engineering P.L.C. will make every effort to complete the
assignment within the given time by allocating additional support staff as necessary.

Secondly, the terms clearly state that the work will involve conducting baseline, midterm, and
endline surveys. We assume that the project has not been fully implemented yet, as we will be
carrying out the baseline survey. For the midterm and endline surveys, the same team will be
mobilized two additional times. Therefore, we have proposed a three-time travel plan and
corresponding financial proposal accordingly.

Lastly, the duration of the project is not clearly specified. If the project timeline is extensive, it may
be necessary to address potential inflation issues. This matter requires further discussion with the
client.

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 3


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

2. OBJECTIVE, SCOPE AND EXPECTED OUTCOMES

2.1. Objectives of Assignment

The purpose of the baseline data is to provide a benchmark from which to measure progress
of the “Provision of Critical Emergency Gap-Filling Interventions and Livelihood Support
for vulnerable households impacted by the recurrent drought in Borena zone of Oromia
Region” project at baseline, midline and endline of the project cycle.

Objectives of SOS CVE integrated emergency and recovery response project for Borena
community is also in line with Ethiopia HRP 2023 Strategic Objectives:
Strategic Objective 1: Reduce morbidity, mortality, and suffering due to multiple shocks for
22.6 million of the most vulnerable people by the end of 2023.
Strategic Objective 2: Provide protection and safe access to critical, integrated, and
inclusive basic services to enable 8.8 million most vulnerable people to meet their basic
needs by the end of 2023.
Strategic Objective 3: Support 9.4 million vulnerable people to start recovering from crisis
and natural hazards, through targeted programming to support rebuilding coping
capacities and livelihoods and strengthen linkages with development actors by the end of
2023.

2.2. Scope of Work


SOS CVE is interested to get the service of a competent firm to conduct a systematic
evaluation of its project in Borena at baseline, midline and endline using consistent study
methodologies and sampling procedure. The baseline study is the first step in the Project’s
M&E system and covers 15 Kebeles of Yabello Woreda. The baseline study gathers the
information to be used in subsequent assessments of how efficiently the Project is being
implemented and the eventual results of the Project. This also forms a basis for setting
performance targets and ensuring accountability to partners and other stakeholders. The
baseline study will also provide a starting point for monitoring and evaluating the impact of

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 4


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

the Project interventions and acts as a reference point against which progress can be
measured and evaluated throughout the Project cycle.
The Midline and Endline study however will provide data to be used to measure the impact
of the intervention and help to identify the changes that occur because of the intervention.
Findings from these surveys will help to measure the changes at outcome- level indicators,
as well as inform future Health and Nutrition Project implementation Modality.

2.3. Expected Impact and Outcomes


The project has the following expected impact and outcome:
Impact: To contribute to a reduction in morbidity and mortality prevalence in Yabello
Woreda caused by malnutrition & communicable diseases amongst PLW, the elders and
children less than 5 years of age
Outcome 1: Quality Public Health Emergency & IMAM programing supported by optimal
Maternal and Young Child Feeding (MICYN) Intervention improves the health and
nutrition outcomes of the project beneficiaries (direct & indirect)
Outcome 2: Direct Project beneficiary’s household food security and economic wellbeing is
restored, and beneficiaries continue to live with some dignity.
2.4. Questions to be answered by the Survey
1) The survey should also answer the following additional questions for the three Ethiopia HRP
2023 Strategic Objectives (this particular project is also in alignment with) this particular
project is referring above about the current health, nutrition, livelihood or recovery options
in the target areas;
2) What is the current level of knowledge, attitude, and practice as well as behaviors of care
givers or mothers under five years of when it comes to positive health seeking behavior and
adhering to recommended or healthy diet eating practice?
3) What is the current prevalence of wasting, underweight and stunting in Yabello Woreda?
4) What is current minimum dietary diversity score for women and under-fives?
5) What is current household food insecurity for Yabello Woreda (food insecurity Experience
Scale, Household Food Insecurity Access Scale, copying strategy index, etc.?
6) What is the current prevalence of morbidity, mortality, EPI coverage for Yabello Woreda?
7) What is the gender, cultural, socio-economic factors and policy/socio-economic that influence
the adoption of healthy dietary practices and positive health seeking behavior?
Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 5
Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

What is the status or change in knowledge and skills of Woreda Health workers & project staff
before and after the provision of the different capacity building, technical and logistical support
provided by the project?
2.2. Evaluation Criteria
For the endline and as appropriate mid-term evaluation follows the following specific evaluation
criteria. Project evaluation criteria refer to the specific standards or measures used to assess the
success, effectiveness, or performance of a project. These criteria help determine whether a project
has achieved its objectives, delivered the desired outcomes, and met the established standards.
While the specific evaluation criteria may vary depending on the nature of the project and its goals,
slight difference may exist in setting the evaluation criteria based on contexts or logical framework
of the project and the level of details of the outcome/output required.

As a customary practice, the endline survey will be assessed based on the OECD-DAC Network on
Development Evaluation (EvalNet) criteria which has six evaluation criteria – relevance, coherence,
effectiveness, efficiency, impact and sustainability – and two principles for their use. These criteria
provide a normative framework used to determine the merit or worth of an intervention (policy,
strategy, program, project or activity). They serve as the basis upon which evaluative judgments are
made. The OECD criteria are schematically presented below.

The key issues to be considered in the evaluation include:

1. Relevance: checking whether the goal of the aid activity met the needs of
beneficiaries; if the activities and outputs of the project were consistent with the
overall goal and the attainment of its objectives;
2. Effectiveness: Examining the degree to which the project attained its objectives.
3. Efficiency: Measuring the outputs in relation to the inputs to determine whether the
aid used the least costly resources possible to achieve the desired results.

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 6


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

4. Impact: Examining positive and negative changes in long-term, extensive effects and
attainment of overall goal as a result of the development intervention.
5. Sustainability: Measure whether the activities and effects of the project likely to be
maintained after the termination of the project. Generally, it is to assess how the
program/project effectively and efficiently achieved its goal and objectives.
6. Coherence and Coordination - The compatibility of the intervention with other
interventions in a country, sector or institution. The extent to which other
interventions (particularly policies) support or undermine the intervention, and vice
versa. Includes internal coherence and external coherence: Internal coherence
addresses the synergies and interlinkages between the intervention and other
interventions carried out by the same institution/government, as well as the
consistency of the intervention with the relevant international norms and standards
to which that institution/government adheres. External coherence considers the
consistency of the intervention with other actors’ interventions in the same context.
This includes complementarity, harmonization and co-ordination with others, and
the extent to which the intervention is adding value while avoiding duplication of
effort.
7. Connectedness - in the context of project evaluation, refers to the degree to which a
project or initiative fosters collaboration, networking, and integration among various
stakeholders, sectors, or regions. It assesses the level of interconnectivity and synergy
created through the project's activities and outcomes.
8. Cross cutting Issues – As appropriate these include Accountability, Environment,
Protection, Participation, Gender and Inclusion. In the context of livelihood project
implementation and results, the issues are described briefly as:
a) Accountability: Accountability refers to the responsibility and answerability of
project implementers, stakeholders, and decision-makers for their actions,
decisions, and use of resources. It involves transparently documenting and
reporting project activities, outcomes, and financial transactions to ensure that
the project is implemented efficiently, effectively, and in compliance with
established standards and guidelines.
b) Environment: In the context of livelihood projects, the environment refers to the
natural surroundings, including ecosystems, natural resources, and the
physical environment in which the project operates. Considerations related to
the environment involve assessing and minimizing the project's potential
negative impacts on ecosystems, biodiversity, water resources, air quality, and
other environmental factors. It may also involve promoting sustainable
practices, such as resource conservation, waste management, and ecological
restoration, to ensure the long-term viability of the project and its positive
contribution to environmental sustainability.
c) Protection: Protection refers to safeguarding the rights, well-being, and dignity
of individuals, communities, or vulnerable groups involved in the livelihood
project. It involves measures to prevent and address any potential harm,
exploitation, discrimination, or violation of human rights that may arise during
project implementation. Protection considerations encompass ensuring the

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 7


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

safety, security, and social inclusion of project participants, as well as


respecting cultural norms, gender equality, and the rights of marginalized or
disadvantaged populations. It may also involve establishing grievance
mechanisms and providing access to justice or support services for those
affected by project activities.
d) Gender: Gender refers to the socially constructed roles, behaviors, activities, and
expectations that societies assign to individuals based on their sex. Gender
considerations in livelihood projects involve recognizing and addressing the
different experiences, needs, and priorities of women, men, girls, and boys. It
aims to promote gender equality and empower all genders to actively
participate in and benefit from project activities. This includes ensuring equal
access to resources, opportunities, decision-making processes, and economic
benefits, as well as challenging gender-based stereotypes, discrimination, and
inequalities.
e) Inclusion: Inclusion refers to the active and meaningful participation and
representation of all individuals, regardless of their background, identity,
abilities, or circumstances. In the context of livelihood projects, inclusion entails
creating an enabling environment that embraces diversity and ensures that
marginalized or disadvantaged groups have equal opportunities to engage in
project activities and benefit from its outcomes. This includes considering the
needs of ethnic minorities, persons with disabilities, indigenous communities,
refugees, and other vulnerable or excluded populations. Inclusion also involves
addressing barriers, biases, or systemic inequalities that hinder full
participation and promoting equitable access to resources, services, and
decision-making processes.

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 8


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

3. APPROACH AND METHODOLOGY

In this project, the evaluation will encompass the entire process from start to finish. The
specific duration of the project is unknown. However, conducting a comprehensive
evaluation throughout the entire process will provide valuable insights into the project's
trends and ultimately determine the extent to which the project has achieved its objectives.
The approaches to be followed may vary depending on the project's stage, but the
methodology used will remain largely consistent. The target groups for evaluation will also
remain the same. The only difference lies in the endline survey, which will be based on the
OECD evaluation criteria encompassing relevance, impact, effectiveness, and sustainability.
These same evaluation criteria will be appropriately applied for the mid-term evaluation as
well. A brief description of the general methodology to be employed is provided below.

3.1. Approach

The baseline survey will use both qualitative and quantitative data collection techniques to
source for appropriate information from the respondents through longitudinal study.
Hence, the baseline survey is a longitudinal study that will allow the estimation of the
change difference of the project outcome indicators amongst the direct beneficiaries of the
project between baseline, midline and endline of the project cycle. This will also fulfill a
major part of evaluation compliance of the cooperative agreement for the project. Data will
be collected using a mixed method in the target areas, including desk review, qualitative
and quantitative and a combination of methods desirable to maximize the reliability of the
data. Key data collection methods expected to use in this survey are: (1) KAP survey among
mothers or care givers and their infants (children under-fives), 2) Household nutrition and
mortality survey that uses SMART methodology -depth interviews, (3) Focus group
discussions, (4) Health Facility Assessment (HFA) and (5) Observation and (6) Desk review.
Poorest households with children under 5 years of age that who are either identified as
having complicated or uncomplicated SAM will be considered as universe sample size for
the KAP and Household survey (nutrition and mortality survey).

The baseline study will be conduct focusing on the gaps and challenges of health care and
protection of children and economic empowerment of families in the 15 Kebeles of Yabello

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 9


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

Woreda. Focus group discussions (FGDs), Key Informant Interview (KII) and Household
Survey (HHs) will be done after thorough evaluation of all stakeholders. The assessment
methodology will employ both qualitative and quantitative approaches.

The study will adopt socio-economic sensitive approaches that are suitable for the local
context. Particular emphasis will be given to children and young people.

Quantitative data: It will be used to measure indicators of the project expressed in terms of
numbers/percentages (quantitative indicators).

Information will be collected using questionnaire survey which will be administered to a


sample of households. Beles is expected to determine the sampling technique and size which
would be representative and adequate to detect the changes observed and do basic
descriptive statistics.

Qualitative data: Qualitative information will be collected through Focus Group


Discussions (FGDs), Key Informant Interviews (KIIs) and Household Survey (HHS) with
key stakeholders including beneficiaries, religion leaders, community members, particularly
young and children, school teachers and pupils; the health sector; and local government
staff and district level coordination structures, project staff and others to complement the
information collected through quantitative approaches.

Secondary documentation: Review of related documents will also be important to establish


key insights relevant to the effective implementation of the project.

In order to get reliable results from the survey research, one must plan the survey processes
and activities to details. A successful survey work needs to be clearly defined, smoothly
processed, thoroughly analyzed and timely conducted. To this end, the survey work can be
split into the following major tasks and in order to be successful, the baseline assessment
will be properly implemented at each step: Planning and survey design; Data collection;
Data access; Data management and preparation; Data analysis and Reporting.

Details of the activities that will be included in these major work packages are discussed in
the sections below.

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 10


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

3.2. Planning and Survey Design

3.2.1. Defining Target Assessment Areas

Selection of the areas where the survey will be carried out is a three-stage process. The first
is identification of the target communities. The second step is identification of representative
villages/localities or kebeles, there are different localities to consider.

There may be marked variations in biophysical and socioeconomic circumstances of the


population within the target kebeles and hence representative samples should have to be
drawn from the large population based on those major variables that could affect the project
outputs and impacts. The definition of survey areas and households is best done by initial
rough stratification of the target areas which are relatively homogeneous with respect to
household circumstances (particularly in terms of economic or resource endowments).

Target Kebele Selection - theoretically, selecting a single survey area or kebele bearing all
the different target groups could be advantageous in terms of the logistics requirements and
the ease to manage the field activities.

However, it is difficult to find a single kebele or village where all the major target groups (in
terms of economic or demographic characteristics) exist. Therefore, two or three villages
will be randomly selected among each kebeles within the target project area. In fact, for this
project, three kebeles have been identified by the client. But, specific localities shall be
selected based on the objective reality of the areas based on purposive random sampling
with statistically acceptable sample number.

3.2.2. Sample Size

Participants are to be selected using purposive sampling based on its ability to provide rich
information and ability to represent the range of variation among subjects. Among
purposive sampling approaches, homogeneous sampling that is useful strategy in
identifying the most common phenomenon and maximum variation sampling
(heterogeneous sampling) that is helpful in identifying patterns that exist among different
groups are to be used.

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 11


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

The representative sample size that adequately answers the research question will be
estimated in a way to gather sufficient information with optimal data and information
saturation or redundancy and depending on available time and resources.

Representative sample must not only be random, but it has to be also large enough to reflect
all the population in the project area or beneficiaries. Well established statistical procedures
for determining sample sizes on the basis of the variability within the sample cannot be
formally applied for this type of survey. Nonetheless, consideration of the variability within
the target groups is important in determining sample size.

Generally, statistically acceptable sample number shall be chosen based on acceptable


statistical procedures.

Number of persons for the survey will be considered based on the Cochran's sample size
formula. Sample size estimation will consider 10% acceptable error (precession), 50%
reasonable estimate for the key proportion to be studied (P) 0.5) and 95% confidence
interval.

Cochran's formula can be expressed by:

Where, N) number of samples (in this case number of households/respondents)


Z) Standard value for 95% confidence interval (1.96)
P) Proportion
D) Precision
Depending up on the total population of the target kebeles the sample size shall be defined
in consultation with the client.

3.2.3. Data collection Methods

Various data collection methods will be employed and these include qualitative and
quantitative methods. To collect qualitative information at the selected communities and
target kebele, an inventory or status of community-level appropriate technology facilities

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 12


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

will be developed through focus group discussions, key informant interviews, household
survey, historical profiles and direct observations.

The process also captures photographs (preferably using digital camera) of all events and
other observations during the survey that helps to realize the impact of the project and the
findings will be inserted in the main baseline report, while the quantitative data will be
collected both by the survey team members and enumerators that will be recruited in the
target areas.

Households Survey: Prior to conducting detailed household surveys, registered members of


selected kebeles will be classified into three resource groups (rich, medium and poor) using
wealth ranking exercise. The rationale for grouping households into socio-economic classes
is that situation analysis and identifying appropriate technologies for household survey is
dependent on a range of socio-economic factors such as ownership of land, livestock, resource
availability, etc. and access to property ownership control over these productive assets and
public services is likely to vary among households.

The list of households will be obtained from kebele records and the ranking will be done by
a group of key informants chosen from community members and/or kebele leaders. Using
the list obtained, the informants divide the households in the village into three or four
classes and then describe the criteria they have applied for categorization. These criteria and
number of households within each group will be recorded and labeled (identified). The
households that will be interviewed will then be randomly drawn from different groups
(people targeted mother to mother group members, Teachers, PTA (parent teacher
associations), School Administrations and students) in the proportion to the distribution or
size of households in each group.

Focus Group Discussion (FGD): A cross checking/validation and elaboration responses for
the HH survey questionnaires will be collected using FGD with developed checklist. The
FGDs also helps to enrich the data/information requirements of the survey, which is
difficult or impossible to generate with a household survey.

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 13


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

Key Informant Interviews (KII): Key Informant Interviews are qualitative in-depth
interviews with people who know what is going on in the community. The purpose of key
informant interviews is to collect information from a wide range of people including
community leaders, professionals, or residents who have first-hand knowledge about the
community. To enrich data/information requirements of the survey, key informant
interview and direct observation will be used. It has the following main advantages:
1. Because information comes directly from knowledgeable people, key informant
interviews often provide data and insight that cannot be obtained with other methods.
2. Key informant interviews provide flexibility to explore new ideas and issues that had
not been anticipated in planning the study but that are relevant to its purpose.

3.2.4. Survey Questionnaire Design and Pre-test


The design of survey questionnaire begins by reviewing what is known from secondary
sources and then developing a list of additional data needs. The team will then decides on
the type of question and then each question will be carefully and clearly worded so as to
communicate the intended meaning of the inquiry. This will be helped when appropriate
local terminology and measurement units are used. The questions will then be arranged in a
logical progression from the household’s perspective, starting with simple, more general
questions and proceeding to the nonspecific, difficult and sensitive areas. Finally, the team
will decide on the appropriate layout and length of the questionnaire and to take time to
train interviewers who will then assist in pretesting the questionnaire.

Pretesting is a trial run during which the questionnaire is administered to a limited number
of households who will then be asked if they had problems understanding the question. The
pre-test will also provide an opportunity to check the data analysis techniques proposed.
Finally, the questionnaire will be revised and updated together with the Data Collectors.
The design of a questionnaire should not only take into account the best way in which to ask
questions, but should also consider ways to increase the efficiency of data collection and
processing.

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 14


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

3.2. Interviewers Selection, Recruitment, Training and Supervision

The survey team needs to select interviewers carefully to help assure that their survey
produce useful data. While the characteristics of good interviewers may vary from survey to
survey, they should generally have friendly, yet professional approaches to their work.
Various criteria will be used in choosing good interviewers and the qualities that will be
looked at in this survey to select interviewers include personality, language, education and
local area knowledge, sex and motivation and honesty and residence in the area.
 Personality – interviewers need to have a friendly, outgoing personality and sincere
interest in the target communities.
 Language – the interviewers must speak the language and dialect of the target
communities in survey districts.
 Education – the interviewers should have enough education to complete the
questionnaires without difficulties. Several researchers have found that a diploma
education is adequate for most interviews.
 Local Knowledge – interviewers need to know the target communities circumstances
and otherwise interviewers may obtain erroneous information.
 Sex – considering the role of household members in technology uses, it will be the
both adult male and female household members that will primarily be chosen for
interview and hence it is preferable if the interviewers are female.
 Motivation and honesty – researchers have found that the best interviewers are
highly motivated and honest. Potential interviewers who are only moderately
motivated may become discouraged and quit partway through the survey and some
may even falsify the data.
 Residence in the area – interviewers should come from the study area. Because
neither the survey team nor the client need not worry about their lodging and
transportation.
The survey team will share these criteria with proponent’s staff and its partners who will be
facilitating the processes to screen and hire the interviewers from within the target areas
and sample kebeles that will be identified. Considering the number of households that can

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 15


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

be interviewed, the number of days allocated for the assignment/survey, travel time
between interviews and time that the interviewers require to travel from their home or place
of living to the area where they will be interviewing.

Training interviewers - Interviewers should complete a training session if they are to


adequately conduct the interviews. Overall, the training session is intended to provide
interviewers with background on the surveys, purpose and to ensure the interviewers know
how to administer the questionnaire. Ideally, all interviewers should ask questions in the
same way so the responses would be the same as if all interviews were conducted by the
same individual. Thus the approach to a training session is to produce a team of
interviewers who administer the questionnaire uniformly without biasing the results.
Preparation for the training begins while the questionnaire is still being developed. At this
time the survey team needs to begin writing an instruction manual for the interviewers.

Supervising the interviewers - Once the interviewers have been trained, the field team
leader or coordinator normally supervise the interviewers throughout the field survey
period, providing the necessary logistical support, keep up the interviewers moral and spot
check for falsified interviews. The field coordinator supervisory role includes collecting and
editing questionnaire, checking questionnaire for legibility, completeness, consistency and
accuracy. Discussing problems with the interviewers and when necessary, shifting the
interviewers' assignment. Thus, the coordinator will visit interviewers regularly,
supervising their work closely and respond to their personal problems and needs.

3.3. Data Preparation and Management

The goal of the data preparation and management stage is to get the data ready for analysis.
When examining a new data set, performing data verification and cleaning, will help to
ensure that the analytical results are accurate. Two Data Clerks will be employed to assist
the survey team in verifying and cleaning the data collected from the field and this will thus
enable to prevent the risk of analyzing bad data, and consequently, getting bad results.

During the data preparation and management step, a “codebook” information, which is
variable definition information, will be set up and this includes variable names, variable

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 16


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

formats and descriptive variable labels (data such as gender or income level) and value
labels (numbers assigned to data, such as “1” for male, “2” for female). This information is
stored in the data “dictionary" of the SPSS software that will be used to store and analyze
the baseline data that will be collected.

3.4. Data Analysis and Reporting

The data collected will be analyzed to report the results or indicators requested by the
proponent. The goal of reporting is to create easy-to-understand results from the data
analysis that the client can quickly understand and act upon. The parameters for the
descriptive statistics are mainly mean, mode, standard errors and percentages and these are
used to characterize household’s appropriate economic status. The next step is to analyze
those actors and factor relationships determining household’s access to effort experiences,
conduct technical feasibility of marketing systems, define modality of sustainable
development, define technical specification for basic infrastructures and resource
endowments. This entails analysis involving multiple variables that affect households use
and practices relating to livelihood, health, education and related issues and integration
challenges and prospects.

Finally, the data collected will be put in SPSS software for analysis and presentation. The
basic statistics should provide detailed information on all deliverables stated in the project
document.

3.5. Ethical Considerations


The Consultancy Firm holder needs to apply standard ethical principles during the course
of the assignment. Some of these must deal with confidentiality of interviewee statements
when necessary, refraining from making judgmental remarks about stakeholders.

The evaluation team will comply with policies from the country agency on Child Protection,
Code of Conduct, and Safeguarding Protection Policies (Child Protection Policy, Disability,
Gender Inclusion, and Age Policy, Protection of Beneficiaries from Sexual Exploitation,

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 17


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

Abuse, and Harassment Policy, Anti-Fraud, and Bribery and Corruption Policy).
In addition, the following ethical issues will be adhered to:
1. Consent: It is important to always get the consent of the interviewees or children's
parents or guardians when doing an evaluation interview with them or when using their
story as part of the evaluation case study. Informed consent can be verbal or written;
whichever the evaluation team thinks is recommended for the person who is part of the
evaluation.
2. Confidentiality: It is important to respect confidentiality during this evaluation. For
example, it can be useful to use pseudonyms for children when using their names in a case
study in a report or to codify the names of communities for the identification of the children.
A good practice is that an interviewee is asked first whether a researcher can share
information before they tell their information to anyone else. But a researcher should not
promise to keep secrets from other team members, as this could create problems in the
future. It is good to let people know from the outset that the information they share with the
evaluator may be shared with other members of the team. There are some occasions when it
may be necessary to break confidentiality; this is when the child is threatened or in danger.
3. Privacy: It is important to respect the privacy of a child and not ask invasive questions.
While an adult may be able to say, "No, I don’t want to answer that," a child may not be able
to say that they feel uncomfortable. It is always good to give the child the right not to
answer any questions and to let them know that is OK.
4. Expectations: It is important that the interviewee's expectations be not unrealistically
raised in the survey. Therefore, an evaluator should not make promises that they cannot
keep.
5. Response Plan: In order to ensure that children and other project stakeholders who
disclose experiences of violence and abuse during data collection can be provided with the
necessary forms of care and support, it is essential that a response plan be in place. An
integral part of a response plan is to have a clearly mapped and documented referral
pathway that safely links survivors to supportive and competent services, such as medical
care, mental health and psychosocial support, police assistance, and legal and justice
support. The evaluator must work closely with the contracting agency to ensure a response
Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 18
Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

plan is in place before the initiation of data collection for this evaluation. Further guidance is
available.
6. Data protection and Data sharing: Embedding data protection features and data privacy-
enhancing technologies directly into the evaluation design and including risk mitigation
measures will avoid the risk of compliance failure. Enforce data protection mechanisms to
prevent irresponsible or unauthorized access to and use of data. All staff with access to data
should use password-protected laptops and tablets. Data must be secured in line with
organizational regulations. Data is to be maintained in a password-protected, encrypted
database maintained on secure servers in accordance with the organization's record
retention policies. The consultant understands and agrees not to use or disclose any data
collected or reports received to any third parties, including any foreign or domestic
researchers or companies. The copyright passes to the entity contracting the study. The
client will be responsible for the dissemination of the assessment findings.
7. Integrity: the consultant or consulting firm will have the responsibility to express issues
that are not mentioned in the Terms of Reference if it would be necessary, in order to
have a comprehensive analysis of the project
8. Independence: the consultant or consulting firm has to guarantee independence from the
study.
9. Incident: in case there are incidents during the fieldwork, the consultant or consulting
firm should immediately inform the focal person of WISE, and if deemed essential, WISE
will inform and discuss with responsible government officials. If the problems are not
communicated on time as mentioned before, the case cannot be used to justify the
unsuccessful results of the study.
10. Safeguarding: Adherence to client’s Code of Conduct, Child Safeguarding Practices, and
Confidentiality when interviewing or photographing children Gender mainstreaming is key
to the Project and the donor; therefore, the lead consultant will have to ensure that the
research team is gender balanced, ensuring that female enumerators are available to interact
with female beneficiaries and vice versa. The external consultant shall report any
safeguarding or child protection concerns as soon as possible and within 24 hours to Plan
Ethiopia’s Safeguarding Focal Points and perform child protection and safeguarding
Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 19
Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

background the clients on all their staff involved in evaluation activities, including
contractors.
11. Training: All enumerators will be trained on data collection tools, targeted people and
locations, inclusion and exclusion criteria, obtaining informed consent forms, data handling,
data quality assurance, data protection and ethics, and confidentiality. Finally, yet
importantly, the enumerators will sign a confidentiality MoU or a Non-Disclosure
Agreement.

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 20


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

4. STAFFI NG

The consultant has organized highly qualified and well experienced professionals for the project.
The team members were working in similar assignments in Ethiopia and at international stage.

The table below summarizes the core team members that will be assigned for the project. Aside
from the core team members, support staffs will be involved in the project. The curriculum vitae
of the key professionals are included. (Remark: the CV of each professional is attached in the
annex).

Expertise and
No Name Qualification Experience
Assignment in the
Project He has over 30 years’ experience in
project coordination and report
Tenalem Professor, writing of project having similar
1 Team Coordinator,
Ayenew PhD nature and commendable track record
in data analysis and presentation using
different software and platforms.

M.Sc. in
Aschalew He has over 20 years’ experience in
2 Public Health Project Manager
Tolla public health and the WASH sector.

M.Sc.
Yabibal He has worked for 14 years as data
3 In Statistics Field Manager
Ayalew manager, lecturer, evaluator and tutor

MA in Gender He has over 30 years’ experience in


Adanech Studies and project evaluation, feasibility study and
4 Data Manager
Shume B.A in economic analysis of a wide variety of
Sociology projects

B.Sc.
Chemistry
Assistant to Project
5 Almaz Shite M.Sc. In
Manager
Environmenta
l Science
6 Temesgen B.A In Assistant to Field He has over 40 years’ experience in
Mengistu Management Manager different positions as secondary
education program expert, Education
program Supervisor IV, Program
coordinator and graduate assistant in

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 21


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

Expertise and
No Name Qualification Experience
Assignment in the
Project Rift Valley University College, project
Officer of the AGSP (Ambassador’s
Girls Scholarship Program)-USAID in
Afar, Harar, Dire Dawa, Hirna, Jijiga,
Kebribeyah,Gode, Debremarkos,
Gondar, Rama, Fatsi, Woldiya,
empowerment of girls and women in
Commercial College of A.A.U and
Hawassa University; Education in
Emergency project coordinator for Plan
International Ethiopia in East Hararge

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 22


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

5. WORK AND STAFFING SCHEDULE

5.1. Work Schedule

The proposed time frame to conduct the b a s e l i n e , m i d t e r m a n d e n d l i n e s u r v e y will


depend on the specific scope and accessibility and sample size. The time line set in the Terms of
Reference for this study is 135 days (4.5 months). Based on our past experience it seems
sufficient to complete the baseline, midterm and endline survey in the given time.

The chart below summarizes the activity schedule for the assessment as a whole. The schedule is
lumped for all the baseline, mid-term and endline evaluation. The activity will be reframed for
the staffing schedule indicated for baseline, mid-term and endline survey. Shorter time is
allocated for the mid-term evaluation.

5.2. Staffing Schedule

The project involves a multi-disciplinary engagement. Different team members may be


engaged at different times. The following shows the simplified staffing schedule for the different
phases of the project.

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 23


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 24


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 25


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

ANNEXES

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 26


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

Annex 1: Curriculum Vitae

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 27


Baseline, Mid Term and Endline Survey for the Critical Gap Filling…..Project in Yabello Woreda
2023

Annex 2: Testimonial Letters

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 28


Technical proposal 2022

Annex 3: Company Profile

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 29


Technical proposal 2022

Annex 4: Legal Documents

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 30


Technical proposal 2022

Consultant: Beles Engineering PLC Client: SOS Children’s Village Ethiopia 31

You might also like