Data Sources For Malaria Surveillance, Monitoring, and Evaluation
Data Sources For Malaria Surveillance, Monitoring, and Evaluation
Data Sources For Malaria Surveillance, Monitoring, and Evaluation
T
his module introduces the common data sources and systems for malaria programs and
specifically discusses the different types and sources of data, the strengths and weaknesses of
these data sources, and different issues affecting data quality for malaria programs.
Module Objectives
Figure 18. An example of data flow
By the end of this module, you will be able to:
A number of different malaria-related data sources are available for use, as shown in the graphic on the
next page. A few of the most common data sources for malaria programs include health information
systems, health facility and population-based surveys, and surveillance systems. It is important to
remember that for data sources to be useful, they must be complete, accurate, relevant or representative,
and timely.
Health management and information system: A system that collects and aggregates all health-related
information and data at the multiple administrative levels in a country
Operational/special research: The systematic and objective assessment of the availability, accessibility,
quality, or sustainability of services designed to improve service delivery
National household survey: A large-scale, nationally representative survey carried out at the household
level
Surveillance system: A systematic ongoing process of assessing the health status of a population by
using these four main activities:
Sentinel surveillance: Conducted in a small number of health facilities called sentinel sites, which are
selected on the basis of well-defined criteria for the collection of routine data and malaria-specific data
with varying frequency
Health and demographic surveillance system (HDSS): A set of field and computing operations to
handle the longitudinal follow-up of well-defined entities or primary subjects (individuals, households,
etc.) and all related demographic and health outcomes within a clearly circumscribed geographic area
Routine collection at community level: In the case of malaria routine data collection, community
surveillance consists of malaria detection, reporting, providing adequate response, and ensuring SME at
the community level.
Activity monitoring system: A system that collects data related to the progression or implementation of
a program’s activities
National census: A procedure for systematically acquiring and recording information about the
members of a population at a national level
Rapid assessment: A smaller-scale survey that uses a small, reliable sample and is carried out over a
short duration and typically examines only a small select set of variables
Meteorological data: Data related to weather conditions; for example, information on air temperature,
winds, humidity, and precipitation
Focus group discussion or key informant interviews: A qualitative data collection method for
obtaining in-depth information on concepts and perceptions about a certain topic through group
discussion that is guided by a facilitator
Health facility survey: Survey of a representative sample of facilities. The aim of a facility survey is
usually to assess the provision and quality of services provided within the health facility.
Vital registration system: A national system for registering all births and deaths of citizens and residents
of a country, including the cause of death
Nonroutine data are only collected periodically. For example, these data are collected quarterly, annually,
or every few years. A good example of a nonroutine data source is a population-based survey that is
conducted every three to five years. Because these types of surveys are large scale, they require a lot of
resources and time, and therefore it is only possible to conduct them every few years.
• In-depth interviews
• Key informant interviews
• Focus group discussions
• Direct observations
• HIS
• Surveillance
• Facility surveys
• Household surveys
• Censuses
• Routine service reporting
• Vital registration systems
• GIS
• Remote sensing
a. Surveillance
b. Facility surveys
c. Administrative systems
d. Focus groups
2. Select all of the following data sources that are classified as nonroutine.
a. Censuses
b. Routine services reporting
c. Direct observations
d. Vital registration systems
3. The following is an example of which two data types?
“Interviews conducted with household head members to understand why ITNs are not used in
Community Y”
a. Quantitative
b. Routine
c. Nonroutine
d. Qualitative
4. The following is an example of which two data types?
“Carrying out a nationally representative household survey to gather information on the country’s
population, health, and nutrition”
a. Qualitative
b. Quantitative
c. Routine
d. Nonroutine
5. The following is an example of which data type?
“Monthly reports from health facilities on the total number of deaths from malaria are sent to the
district health office where they are compiled and aggregated before being sent to the national level.”
a. Qualitative
b. Quantitative
“Monthly reports from health facilities on the total number of deaths from malaria are sent to the
district health office where they are compiled and aggregated before being sent to the national level.”
a. Routine
b. Nonroutine
7. True or False: The following statement is an example of a quantitative data source.
“Focus group discussions with caregivers about their perceptions of the quality of care at the local
health facility are conducted to understand why use of health services in the community is so low.”
a. True
b. False
8. True or False: The following statement is an example of a nonroutine data source:
“Focus group discussions with caregivers about their perceptions of the quality of care at the local
health facility are conducted to understand why use of health services in the community is so low.”
a. True
b. False
Strengths Weaknesses
• Ideally reflective of and integrated • Data not representative of population
within health systems activities • Difficult to determine population at risk
• Collected continuously and suitable for or denominators for coverage estimates
frequent reporting • Indicators determined centrally by
• System already exists: Ministry of Health and may not be easily
• Need fewer resources for new altered to answer new questions
infrastructure or systems • Quality and completeness of reporting
• Helps build local capacity and is frequently varies
sustainable • May only cover government facilities
• Typically available at lowest • Potential for double counting, both
administrative levels within and between facilities
Strengths Weaknesses
• Can be nationally or regionally • Overall less sustainable and not carried
representative out routinely:
• Can be tailored to specific program • Data collection is periodic and less
needs connected to ongoing program
• Quality control may be easier than in decision making
routine systems • Information can become rapidly
• Provide more detailed data than is outdated
typically available in routine systems • Requires devoted personnel,
• Timing can coincide with program resources, and time
implementation • Survey sampling design and analysis can
• Can cover both public and private be complex
health facilities • Coverage and sample size constraints
• Can combine with a population survey exist:
for outcome monitoring and impact • National vs. subnational coverage
evaluation • May not have enough of a specific
type of facility to be completely
representative
• May have small client sample sizes for
some services
Strengths Weaknesses
• Representative of the general • Very expensive and time-consuming to
population, which helps eliminate conduct; thus, are typically carried out
selection bias if the sample is truly only every three to five years
random • Not suitable for some types of data; for
• Can collect a wide range of example, if collecting retrospective
outcome-level indicators, such as data, the data will be subject to recall
program coverage bias
• Questionnaires can be adapted to • Do not provide input/process-level data
cover specific issues and topics • May not be adequately powered for
• Involve well-tested instruments with subnational or district-level estimates
good quality control • Cannot detect small changes or
changes over short periods of time
without large sample sizes
Strengths Weaknesses
• Very flexible and can be adapted to • Expensive and resource-intensive
cover specific topics to collect data because the following are necessary:
that are otherwise hard to obtain • Identifying sites and providing
• Can collect a wide range of data, from adequate resources for them
input data to impact data • Training staff at sites
• Especially useful and necessary when • Creating a system to monitor and
the events being monitored are rare transfer data to central authorities
and when a rapid response is required • Active surveillance even more resource-
intensive
Strengths Weaknesses
• Can monitor vital events in the • High maintenance cost
demographic surveillance area: births, • Community fatigue
deaths, migrations, morbidity, • Covers only a small area; thus, is
socioeconomic development (poverty) unrepresentative of the national
• Can assess progress and impact of population
intervention • Has either a weak link or no link at all to
• Can define population denominator the health management information
• Could be linked with the health system
management information system • Potential bias from over-study of the
• Could serve as sentinel sites population
• Could serve as operational research • Data not easily accessible
sites • Set up to address specific research
• Most field sites include malaria in their questions, not necessarily set up for
research agenda malaria SME
• Multidisciplinary team
• Provides an ideal environment for
training
A donor would like to determine whether its program has been able to improve coverage of prompt and
effective treatment for children under five with malaria. Thus, the donor wants to know how many
children under five in the program’s intervention areas received antimalarial treatment within 24 hours of
the onset of malaria. What would be the most appropriate data source to use to provide the answer?
Correct answer is provided on the next page.
1. HIS
2. Health facility surveys
3. Population-based surveys
4. National census
1. HIS: The HIS is the most appropriate data source because the donor wants to know how
many children received antimalarial treatment only (rather than a percentage, which would
require data on all children who had malaria). The HIS also has information on confirmed
cases, and these data are accessible for the specific intervened areas in the HIS. Lastly, HIS
will not require extra resources to obtain the data.
2. Health facility surveys: A health facility survey could answer the donor’s question; however, it is very
resource-intensive to carry out. In this scenario, the HIS is the most appropriate data source because
the donor wants to know how many children received antimalarial treatment only (rather than a
percentage, which would require data on all children who had malaria). Further, it would be specific
to the intervened areas.
3. Population-based surveys: A population-based survey would not be an appropriate data source in this
scenario for many reasons. First, these types of surveys are conducted every three to five years; it
would be difficult in terms of timing. Second, these surveys provide nationally representative data and
percentages, not the absolute number of children who had received antimalarial treatment. Further, it
would be specific to the intervened areas. In this scenario, the HIS is the most appropriate data
source because the donor wants to know how many children received antimalarial treatment only.
4. National census: A national census would not provide information on the number of children who
had received prompt and effective treatment with antimalarial drugs. In this scenario, the HIS is the
most appropriate data source because the donor wants to know how many children received
antimalarial treatment only (rather than a percentage, which would require data on all children who
had malaria). Further, it would be specific to the intervened areas.
The National Malaria Control Programme wants information on the percentage of homes that own at
least one ITN. What would be the most appropriate data source to use to provide the answer? Correct
answer is provided on the next page.
1. HIS
3. Population-based surveys
4. National census
1. HIS: An HIS generally includes information about the delivery, cost, and use of health services and
patient demographics and health status. It would not provide information regarding household
ownership of ITNs. In this scenario, population-based surveys, like the DHS and MIS, would be the
most appropriate source for providing the answer. In most cases, these surveys will provide a national
and regional estimate of the percentage of household ITN ownership.
2. Health facility surveys: A health facility survey would not be an appropriate data source, because it
does not capture information on household ITN ownership. In addition, it would not provide an
accurate reflection of all households, because it collects data only on those who attend health
facilities. In this scenario, population-based surveys, like the DHS and MIS, would be the most
appropriate source for providing the answer. In most cases, these surveys will provide a national and
regional estimate of the percentage of household ITN ownership.
3. Population-based surveys: In this scenario, population-based surveys, like the DHS and MIS,
would be the most appropriate source for providing the answer. In most cases, these surveys
will provide a national and regional estimate of the percentage of household ITN ownership.
4. National census: A national census gathers data on the members of a population, and thus would not
provide information regarding household ownership of ITNs. In this scenario, population-based
surveys, like the DHS and MIS, would be the most appropriate source for providing the answer. In
most cases, these surveys will provide a national and regional estimate of the percentage of household
ITN ownership.
• Validity: Data clearly, directly, and adequately represent what was intended to be measured.
• Reliability: Data are collected regularly using the same methodology, and if we repeat the same
procedure over and over, we end up with the same results or findings.
• Integrity: Data are truthful. In other words, they are free from willful or unconscious error due
to manipulation or through the use of technology.
• Precision: Data can be used to reproduce measurements consistently and to minimize random
error.
• Timeliness: Data are regularly collected, and up-to-date data are available when needed.
• Completeness: Data collected and reported are complete.
Here are some steps your program can follow to improve the quality of the data that you collect:
• Provide written instructions for how to use data collection instruments and tools. Include these
instructions on each of the instruments and tools. This will help ensure that no matter who is
collecting the data, they will be collected in the same way.
• Document processes for data entry, cleaning, and management.
• Provide continuous monitoring of data collection activities and perform routine checks to ensure
that instructions are being followed properly.
• Randomly sample data and verify that they are accurate.
• Take proactive steps to report, document, correct, and communicate problems that compromise
the quality of the data.
• Be transparent in the data analysis techniques used and the assumptions upon which the data are
based.
Data can be linked from different sources, across different levels, over time, across geography, and across
different sectors. Examples include the following:
• Sources: Linking health facility survey or HIS data with household survey data to establish
change in impact or outcome
• Levels: Linking HIS data from district, regional, and national levels to check data quality
• Time: Linking data on service provision for antenatal care with birth outcomes
• Geography: Linking malaria cases with GIS data to assess foci of transmission
• Sectors: Linking malaria cases from HIS with agricultural data on rainfall levels
1. Data and information serve which main purpose for programs? (Select all that apply.)
2. The ongoing, systematic collection, analysis, and interpretation of health data carried out in a limited
number of health facilities refers to which common malaria-related data source?
3. A routine data source refers to data that are continuously or regularly collected. Which of the
following data sources is NOT an example of a routine data source?
4. Linking different data sources serves all of the following purposes, except:
1. Data and information serve which main purpose for programs? (Select all that apply.)
2. The ongoing, systematic collection, analysis, and interpretation of health data carried out in a limited
number of health facilities refers to which common malaria-related data source?
c. Sentinel surveillance
Sentinel surveillance refers to the ongoing, systematic collection, analysis, and interpretation of health
data within a limited number of health facilities.
3. A routine data source refers to data that are continuously or regularly collected. Which of the
following data sources is not an example of a routine data source?
b. Facility surveys
Facility surveys are not carried out continuously or on a regular basis; therefore, they are considered a
nonroutine data source.
4. Linking different data sources serves all of the following purposes, except:
Linking data sources does not help you necessarily to determine whether your data are of poor
quality. Data quality checks and audits can help you to determine whether your data are of poor
quality. Linking different data sources serves the following purposes: provides context by increasing
understanding and informing analyses; helps attribute causality; and helps corroborate data quality,
trends, and associations observed within your data.