Evaluation Terms

Download as pdf or txt
Download as pdf or txt
You are on page 1of 2

EVALUATION

Library Assessment:
Vast amounts of resources have been allocated in the last quarter of the From Accountability
20th century to address issues with far-reaching implications—illegal drug use, ur-
ban crime, poverty, teen pregnancy, high school drop-outs, and declining test to Improvement
scores. By the 1990’s, it was apparent that despite vast amounts of money spent
on these problems, the severity of these issues remained unabated—there had
been little improvement in the conditions.
The practice of evaluation developed over the past 25 years in response to
evidence of apparent program ineffectiveness. The movement started in govern-
ment, progressed to the non-profit organizations, and then to education. First,
primary and elementary education, then high school education, and in the past 10
years, higher education.
What’s so important about evaluation? At its core, program evaluation is con-
cerned with accountability, and ultimately with improvement. However, business-
related constructs are also pursued—return on investment (ROI), societal value,
and cost-utility (i.e., ratio of costs to societal benefits).
Some terms used in program evaluation include:
 Inputs—resources required for operation (e.g., money,
people, equipment)
 Outputs—the “countable” results of the program activity
(e.g., no. of clients)
 Outcomes—the intended results/desired effects; can be short-term, What is a performance
intermediate, or long-term; are linked to program objectives indicator?
A logic model is provided on page 2 to illustrate the placement of each
component in an evaluation plan.

“Indicators are the


measures you select as
markers of your success.”2

PERFORMANCE INDICATORS
A performance indicator (PI) is a measure of progress, a way of demonstrating efficiency, impact, or effective-
ness. It replaces simple input measures (e.g., number of hours) with result-oriented estimates. The PI is usually devised
around specific outcomes. The measure may include a percentage, an ordinal number (e.g., 1, 2, 3), or an indication of
rank, scale, or degree (e.g., more than, above, equal to). A PI may simply be a statement of intent and a target date for
completion.
Examples of performance indicators:
 The Library’s facilities reflect usage patterns and provide space conducive for individual, small-group and classroom
learning.

The Library organizes the collections and provides multiple access mediums and points to information.3
Devising performance measures—individual or personal—that relate to unit or organizational goals can be diffi-
cult, but not impossible. Focus on what needs to be accomplished and what measurement or indicator will show that
it has been completed.
Page 2

LOGIC MODELS
A logic model is a
graphical representa-
tion that illustrates
the progress from
program inputs to Evaluating a pro-
program impact.
Inputs become activi- gram or constructing
ties which result in a set of performance
outputs and intended measures entails
results—outcomes— understanding how
illustrative of changes
for which the entire
the program operates
series of activities and what it is in-
were undertaken. tended to accom-
Fig. 1 depicts the plish.2
components of a
logic model.2
Performance Indicators can be placed at
several places to indicate short-term(1), in-
EXAMPLE: AN OUTCOME APPROACH MODEL 2
termediate(2), or long-term(3) objectives.
FROM THE CALHOUN COUNTY HEALTH IMPROVEMENT PROGRAM, FUNDED UNDER THE COMPREHENSIVE COMMUNITY HEALTH MODELS
OF MICHIGAN INITIATIVE
1 2 3

What differ- A WORD FROM YOUR ASSESSMENT LIBRARIAN


ence does the Accountability, quality and effectiveness are important to all of us. The Sources:
field of program evaluation provides tried and true tools that we can use to dem- 1 McDavid, James C. and Laura
library make? onstrate how the Library makes a difference. Hawthorn. Program Evaluation
& Performance Measurement.
How has the Library assessment requires us to move beyond accountability to im- Sage Publications: London. 2006
library im- provement—how do library users change as a direct result of interacting with
2 Kellogg Foundation. Logic
pacted student library programs, resources and services. Model Development Guide at
<http://www.wkkf.org/Pubs/
learning, fac- Developing the skills that will enable us to share our story is important. Tools/Evaluation/Pub3669.pdf>
If I can assist you, please call me at 8-2085 or send me an
ulty teaching, email ([email protected]). 3. Educational Outcomes As-
and research? sessment: Standards and Guide-
lines for AHSL’s, Tamera Lee

You might also like