Monitoring and Evaluation:

Frameworks

For Malaria Programs

 Learning Objectives
At the end of the session, participants will be able to:
1. Identify and differentiate between conceptual
frameworks, results and logical frameworks, and logic
models
2. Define goals and objectives for specific intervention
programs
3. Design frameworks for specific intervention programs
4. Discuss how frameworks are used for M&E planning
 Module Outline

Introduction to frameworks
o Conceptual Frameworks
o Goals and objectives
o Results Frameworks
o Logical Frameworks
o Logic models
Exercises developing frameworks
Interface between frameworks and M&E
planning
Work on country group project
 Types of Frameworks
Conceptual Frameworks
Results Frameworks
Logical Frameworks
Logic Models

Why is it important to know about each of these

frameworks?
 Why are frameworks useful?
Designing frameworks assists to develop:
Clearly understood program/project goals and
measurable, long-term, short-term, and intermediate
objectives
Clearly defined relationships between
program/project: inputs, processes, outputs, and
outcomes, and between program/project
activities and the external context
(environmental factors)
Sound implementation and M&E plans
Conceptual Frameworks
 Conceptual Frameworks
(aka. research or theoretical frameworks)

What is a conceptual framework?

Diagram that identifies and illustrates the relationships between all relevant systemic,
organizational, individual, or other salient factors that may influence program/project
operation and the successful achievement of program or project goals

M&E Purpose:
To show where program fits into wider context
To clarify assumptions about causal relationships
To show how program components will operate to influence outcomes
To guide identification of indicators
To guide impact analysis (causal pathways)

Similar frameworks:
Proximate Determinants
 Conceptual Frameworks
Individual
characteristics
Healthy Health
Service practices status
utilization

Institutional Program
Program supply
capacity sustainability

Technical
inputs
 Conceptual Framework: Malaria Burden
External factors:
• Environmental (ecological, climate)
• Socio-economic (economic status, Malaria
movement, occupation, housing condition, infection
war, population displacement, etc)
• Demographic ( age, immunity, gender)
Prevention:
• LLINs, IRS, IPT
Health care system: • Environmental
 Accessibility Malaria
management
 Affordability morbidity
 Quality of care Treatment:
 Efficiency Early diagnosis
 Demand/utilization & treatment Malaria
mortality
Malaria knowledge:
Program factors: • Cause
• Health policy
• Prevention methods
• Antimalarial drug policy
• Early treatment
• Support/partnership
• Cultural beliefs
• National MCP
• Information
 Conceptual Framework:
Malaria Control and Elimination
 Activity

Get into country groups for 30 minutes

Review your Problem Statement
Develop a conceptual framework for
your malaria control program
Identify factors that influence malaria control and
elimination
Arrange factors into a conceptual framework
 Outputs from Activity

Reviewed Problem Statement

A list of factors influencing malaria
control and elimination
 A conceptual framework for your
malaria control/elimination program
Goals and Objectives
 Goals and Objectives

What is the difference between goals

and objectives?
Goal: a broad statement of a desired, long-
term outcome of the program

Objectives: statements of desired, specific,

realistic and measurable program results
 Goals

1. To reduce malaria incidence and to significantly

reduce deaths due to malaria by the end of
20115

2. Through the attainment of a 75% reduction,

malaria control will ultimately contribute to the
reduction of all-cause mortality by 20% in
children under five by 2020
 SMART Objectives

SMART
 Specific: identifies concrete events or actions that will
take place
 Measurable: quantifies the amount of resources,
activity, or change to be expended and achieved
 Appropriate: logically relates to the overall problem
statement and desired effects of the program
 Realistic: Provides a realistic dimension that can be
achieved with the available resources and plans for
implementation
 Time-based: specifies a time within which the
objective will be achieved
 Class Activity:
Are these objectives SMART?
1. To ensure that at least 80% of people sleep under LLINs in every
district
2. At least 80% of pregnant women have access to the package of
interventions to reduce the burden of malaria in pregnancy by
December 2008
3. At least 85% of people sleep in sprayed structures in eligible areas
of the 36 selected districts by December 2008, an upward revision
from the 15 initially planned districts in the 2006-2010 National
Malaria Strategic Plan
4. 100% of malaria patients in all districts are receiving prompt and
effective treatment according to the current drug policy within 24
hours of onset of symptoms by next month
 Small group work

Get into your groups for 30 minutes

and begin to develop goals and
objectives for your program
(First review your problem statement
and Conceptual Framework)
Results Frameworks
 Results Frameworks

What is a results framework?

Diagram that identifies steps or levels of results and illustrate the causal

relationships linking all levels of a program’s objectives.

Purposes:
Provides a clarified focus on the causal relationships that connect incremental
achievement of results to the comprehensive program impact
Clarifies project/program mechanics and factors’ relationships that suggest ways
and means of objectively measuring the achievement of desired ends

Other terms used:

Strategic frameworks
Results Frameworks
 Results Framework: Malaria Control Program
SO1:
SO1:Reduced
Reduced
Malaria
MalariaBurden
Burden

IR1:
IR1:Improved
Improved IR2:
IR2:Improved
Improvedmalaria
malaria IR3:
IR3:Increased
Increasedaccess
access
malaria
malariaprevention
prevention epidemic
epidemicprevention
prevention to
toearly
earlydiagnosis
diagnosis&&
&&management
management prompt
prompttreatment
treatmentofof
IR1.1 malaria
malaria
IR1.1Access
Accessto
to&& IR2.1
IR2.1Early
Earlydetection
detection
coverage
coveragebybyITNs
ITNs &&appropriate
appropriateresponse
response IR3.1
IR3.1Quality
Qualityof
of
increased
increased improved
improved care
careimproved
improved
IR1.2
IR1.2Improved
Improved IR2.2
IR2.2Epidemic
Epidemic IR3.2
IR3.2Efficiency
Efficiencyinin
access
accessto
toIPT
IPT preparedness
preparednessimproved
improved service
servicedelivery
delivery
IR1.3 improved
improved
IR1.3IRS
IRScoverage
coverage
increased
increasedinin IR2.3
IR2.3Surveillance
Surveillance
epidemic system
systemimproved
improved IR3.3
IR3.3Utilization
Utilizationof
of
epidemicprone
proneareas
areas
care
careimproved
improved
IR1.4
IR1.4Use
Useof
ofsource
source
reduction/ IR2.4
IR2.4Early
Earlywarning
warning IR3.4
IR3.4Access
Accessto
to
reduction/larviciding
larviciding
increased system
systemstrengthened
strengthened services
servicesimproved
improved
increased
 Results Frameworks

Assist you in

• Identifying/selecting appropriate interventions

to achieve strategic objectives

• Defining results/intermediate/operational/
outcome objectives

• Revisit the intervention you have selected,

update them and discuss with your Supervisors
Logic Models
 Logic Models
What is a Logic Model?
Diagram that identifies and illustrates the linear relationships flowing from
program inputs, processes, outputs, and outcomes. Inputs or resources affect
Processes or activities which produce immediate results or Outputs, ultimately
leading to longer term or broader results, or Outcomes.

Purposes:
Provides a streamlined interpretation of planned use of resources and desired
ends
Clarifies project/program assumptions about linear relationships between key
factors relevant to desired ends

Other terms used:

M&E Frameworks, Logical Frameworks
 Components of Logic Model
• The logic model has 5 essential components
Logic Model Description
Component
Inputs The resources we invest in an intervention
Processes The activities carried out in order to achieve the intervention’s
objectives
Outputs The immediate RESULTS achieved by the intervention at the
intervention level through the execution of activities

Outcomes The set of results at the (target) population level induced by the
interventions. People level effect
Impacts The long term effects or end results of the intervention eg.
changes in health status
 Logic Models: ITN Distribution

INPUT PROCESS OUTPUT OUTCOME IMPACT

Human and • Establish ITNs ITN use Malaria
financial distribution distributed prevalence
resources points for ITNs malaria
BCC
ITNs • BCC staff conducted
trained
BCC materials
 Logic Model: Malaria Control Programs

Inputs Process Outputs Outcomes Impact

•Strategies •Training •Services •IITN/IRS •Malaria
•Policies •Services delivered ownership Incidence/
•Guidelines •Education •Knowledge, •ITN use Prevalence
•Funding •Treatments skills, practice •Treatment •Mortality
•Materials •Interventions • ITNs distributed based on •Socio-
•Facilities • HH sprayed parasitological economic
•Commodities •IPTs delivered confirmation wellbeing
•Supplies •Antimalarials •Economic
•Staff delivered Impact
•RDTs/slides
delivered and reads
taken

Adapted from: RBM. 2008 Global Malaria Action Plan. Available at:
http://www.rollbackmalaria.org/gmap/gmap.pdf
Logical Frameworks
 Logical Frameworks

What is a logical framework?

A table which presents a standardized summary of the
project and its logic.
Purposes:
Summarizes what the project intends to do and
how
Summarizes key assumptions
Summarizes outputs and outcomes that will be
monitored and evaluated

Other terms used:

Logframe matrix
 Logical Frameworks
Project Description Performance Indicators Means of Assumptions
Verification
Goal: The broader Measures of the extent to which a Sources of information
development impact to which sustainable contribution to the goal has and methods used to
the project contributes - at a been made. Used during evaluation. collect and report it.
national and sectoral level.
Purpose: The development Conditions at the end of the project Sources of information Assumptions
outcome expected at the end indicating that the Purpose has been and methods used to concerning the
of the project. All components achieved and that benefits are collect and report it. purpose/goal
will contribute to this sustainable. Used for project linkage.
completion and evaluation.

Component Objectives: The Measures of the extent to which Sources of information Assumptions
expected outcome of component objectives have been and methods used to concerning the
producing each component's achieved and lead to sustainable collect and report it. component
outputs. benefits. Used during review and objective/purpose
evaluation. linkage.
Outputs: The direct Measures of the quantity and quality of Sources of information Assumptions
measurable results (goods and outputs and the timing of their delivery. and methods used to concerning the
services) of the project which Used during monitoring and review. collect and report it. output/component
are largely under project objective linkage.
management's control
Activities: The tasks carried Implementation/work program targets. Sources of information Assumptions
out to implement the project Used during monitoring. and methods used to concerning the
and deliver the identified collect and report it. activity/output
outputs. linkage.
 Logical Frameworks: Malaria Control Program
Project Description Performance Means of Assumptions
indicators verification

Goal: To reduce malaria • Malaria prevalence • Annual • Political stability

morbidity and mortality by • All-cause under –five reports • Environmental
50% by 2015 mortality rate • Surveys stability (no natural
• DSS disasters)
(INDEPTH)
• DHS
Overall Objective: To % of individuals with • Annual •Availability of
achieve universal coverage access to an LLIN in their reports effective and
of malaria control HH • Surveys affordable drugs
interventions • Record
reviews
Component Objective: % of individuals with •Population- • Strong political
•To achieve universal access to an LLIN in their based survey support
coverage and increase use HH •Health facility •Availability of LLINs
of LLINs % of individuals who slept surveys
under an LLIN the previous • Community
night
surveys
 Logical Frameworks: Malaria Control Program

Project Description Performance Means of Assumptions

Indicators Verification

Outputs: Number of LLINs Activity Funds available

LLINs Distributed to distributed to target reports/program for distribution
target population population records and
communication
Number of individuals campaign
LLIN hang up
demonstrated to who observed LLIN
individuals in target hang up demonstration Community
population support

Activities: Number of LLIN Activity •Funds

LLIN Distribution distribution campaigns reports/program available for
Campaigns records distribution and
Number of LLIN hang communication
up demonstrations campaign
LLIN hang up
demonstrations
 Discussion

1. Does your program use any of these

frameworks for planning? How?
2. What are other ways that these
frameworks can be used for planning?
 Frameworks for M&E Planning
Purposes:
• Clarifying assumptions, goals, and interrelationships
between factors relevant to the project or program
• Defining objectives
• Selecting activities
• Defining levels of performance and desired results in
terms of planned activities and realistic, objective impacts
Monitoring and evaluation plans incorporate:
• Program managers’ assumptions and objectives, in a given
context
• A schematic design displaying the directional linkages
between key program elements and/or planned results,
and other relevant factors
 Summary of Frameworks
Type of Brief Description Program Management Basis for Monitoring
Framework and Evaluation

Conceptual Interaction of various Determine which No. Can help to explain

factors factors the program results
will influence

Results Logically linked Shows the causal Yes – at the objective

program objectives relationship between level
program objectives

Logical Logically linked Shows the causal Yes – at the output and
program objectives, relationship between objective level
outputs, and activities activities and
objectives

Logic model Logically links inputs, Shows the causal Yes – at all stages of the
processes, outputs, relationship between program from inputs to
and outcomes, inputs and the process to outputs to
objectives outcomes/ objectives
 References
 AusGuide. The Logical Framework Approach.
http://www.ausaid.gov.au/ausguide/ausguidelines/1-1-1.cfm
 Bertrand, Jane T., Magnani, Robert J, and Rutenberg, Naomi, 1996. Evaluating
Family Planning Programs, with Adaptations for Reproductive Health, Chapel
Hill, N.C.: The EVALUATION Project.
 Global AIDS Program. (2003) Monitoring and Evaluation Capacity Building for
Program Improvement Field Guide, Version 1. U.S. Centers for Disease Control
and Prevention, Atlanta, GA.
 Ministry of Health, Zambia. 2008. 2008 National Malaria Control Action Plan:
Actions for Scale-up for Impact on Malaria in Zambia.
http://www.nmcc.org.zm/files/2008ZambiaNMCPActionPlan-5-20.pdf
 Marsh, David. 1999. Results Frameworks & Performance Monitoring. A
Refresher by David Marsh (ppt)
http://www.childsurvival.com/tools/Marsh/sld001.htm
 Measurement, learning and evaluation project for the urban reproductive
health initiative. Measuring success toolkit.
 Tsui, Amy. 1998. Frameworks (ppt). Presented at the Summer Institute,
University of North Carolina, Chapel Hill.
 Tsui, Amy. 1999. Frameworks (ppt). Presented at the Summer Institute,
University of North Carolina, Chapel Hill.
 UNICEF. 1998. State of the World’s Children.
 Group Projects

1. Get into your groups

2. For your malaria control program final project, complete the
following for your final presentation:
– Problem Statement
– Conceptual framework
– Goals and objectives with targets
– The Logic model, results framework, or Logical Framework
MEASURE Evaluation is a MEASURE program project funded by
the U.S. Agency for International Development (USAID) Through
Cooperative Agreement GHA-A-00-08-00003-00 and is
implemented by the Carolina Population Center at the University
of North Carolina at Chapel Hill, in partnership with Futures Group
International, John Snow, INC., ICF International, Management
Sciences for Health, and Tulane University.

VISIT US ONLINE AT HTTP://WWW.CPC.UNC.EDU/MEASURE.