Scoring Rubrics: Bulacan State University Hagonoy Campus Iba-Carillo, Hagonoy, Bulacan
Scoring Rubrics: Bulacan State University Hagonoy Campus Iba-Carillo, Hagonoy, Bulacan
Scoring Rubrics: Bulacan State University Hagonoy Campus Iba-Carillo, Hagonoy, Bulacan
Hagonoy Campus
Iba-Carillo, Hagonoy, Bulacan
CHAPTER VI:
SCORING RUBRICS
Types of Rubrics
1. Analytic rubrics are scoring system where the response is broken down
into relevant parts, and each part is assessed separately and assigned a
separate score.
2. Holistic rubrics are used where the response is judged more or less as a
whole by the scorer, resulting in an overall rating of its quality. It is also
called as “global scoring” because of its focus on the whole response
rather than its parts.
3. Combination of Analytic and Holistic rubrics is usually used with the types
of performance assessment that require the observation of skills or
processes and at the same time the judgment of the resulting product.
These three types of rubrics have each certain strengths and limitations.
However, we can choose a scoring system that is best suited for the type of
accomplishment we want to measure. And then, decisions would be more
useful as prompted by the assessment purposes and the task we have
developed.
A. Rating Scale
A set of ordered categories denoting different degrees of quality is called
a “rating scale”. It is used in noting finer distinction than just the presence or
absence of behavior. It will serve several important assessment functions such
as:
1. It will direct observation toward specific aspect of behavior.
2. it will provide a common frame of reference for rating the performance of all
students on the same set of characteristics.
3. It will provide a convenient method for recording the observer’s judgment.
1 2 3 4
2. To what extent are the comments related to the topic under discussion?
1 2 3 4
2. To what extent are the comments related to the topic under discussion?
Comment:
_______________________________________________________________________
______________________________________________________________________.
Principles of Effective Rating
1. Characteristics should be educationally significant.
2. Identify the learning outcomes that the task is intended to assess.
3. Characteristic should be directly observable.
4. Characteristics and points on the scale should be clearly defined.
5. Select the rating procedure that is most appropriate foe the task and the
purpose of assessment.
6. Between three and seven rating positions should be provides and rater
should be permitted to mark at intermediate points.
7. Rate performances of all students on one task before going on to the next
one.
8. When possible, rate performance without knowledge of the student’s
name.
9. When results from a performance assessment are likely to have long term
consequences for students, ratings from several observers should be
combined.
B. Checklists
A checklist is similar in appearance and use to the rating scale. The basic
difference between them is in the type of judgment needed. On a rating scale,
one can indicate the degree in which a characteristic is present or the
frequency with which a behavior occurs. It calls for a simple “yes-no judgment”.
The following steps summarize the development of a checklist for
assessing a procedure consisting of a series of sequential steps.
1. Identify each of the specific actions desired in the performance.
2. Add to the list those actions that represent common errors.
3. Arrange the desired actions.
4. Provide a simple procedure for checking each action as it occurs.
Directions: On the space in front for each item place a plus(+) sign if the
performance was satisfactory, place a minus (-) sign if it was unsatisfactory.
Directions: On the space in front for each item place a plus(+) sign if the
performance was satisfactory, place a minus (-) sign if it was unsatisfactory.
RUBRICS
It is the detailed descriptions of characteristic of performance
corresponding to each point on the scale known as scoring rubrics. A scoring
rubric makes explicit the criteria use to rate performance.
Steps in Constructing a Rubric
In the specifications:
1. Identify and justify the best assessment methods by which we gather
evidence of proficiency on outcomes/behavior in the domain.
2. Specify whether an analytic or holistic scoring rubric will be used or some
combination of the two.
3. Specify the scoring scheme or point-allocation scale to be used.
4. Identify weights in terms of point values to be allocated o different
components. This step is particularly relevant for analytic rubrics.
Then:
5. Design an exercise to capture the specified outcomes and behaviors in
the domain. Write the instruction and prompts to elicit responses; set the
context/conditions; provide instructions for assessors.
6. Develop a draft of a scoring rubric to score the responses. Use observable
descriptors to define the quality of a response at different levels of
acceptability. Try to operationally define each scale point.
7. Try out the task on a sample of typical respondents. Observe or gather
data on the possible range of responses to the task.
8. List common errors, omissions and in accuracies that you find in typical
responses. Based on an error analysis, revise the descriptors of scale points
on your rubric. Use the actual responses to tighten and clarify observable
indicators at different levels of quality.
9. Attempt scoring actual responses using the revised rubric. Evaluate the
extent to which the rubrics facilitate consistent scoring by different, but
knowledgeable raters.
10. Check back to make sure that rubric matches with outcomes/objectives
originally specified in the domain, as this will ensure content-based validity
of the results.
11. Hold on to some sample answers at each score point to use as “anchor
papers during scoring. This will enhance reliability by controlling scorer
errors.
The following are examples of scoring rubric for different kinds of
assessment tools.
EXAMPLES:
1. A rubric or scoring guide for a simple performance task in science.
Problem: It was a rainy season and people noticed that the stone buildings and
statues made of limestone were corroding. Furthermore, farmers were
wondering why their plants do not grow well and many were suddenly withered.
Explain the reasons and causes of these dilemma based on the descriptions of
the problem.
Rubric:
Incorrect
Fully Correct Partially Correct
Answer/Criteria Answer/No
Answer (5pts) Answer (3pts)
Answer (0pts)
Mentions that
Mention only that
those where Mention that
it was rainy season
caused by acid those were
as the cause of
rain. Also must caused by acid
Accuracy of the problem.
mention CO2, rain and its results
Answer Blank or crossed
firewood, etc as (without
out, with erased,
the reasons. mentioning the
illegible or study
(May also mention reasons)
marks.
the result)
Level 1
Levels Level 3 Level 2
Needs
Exemplary Satisfactory
Improvement
Criteria (30pts) (20pts)
10pts)
At least 25% of the
Alignment of All articles are At least 50 % of
articles are
articles with the related to the the articles relate
related to the
themes theme to theme
theme
Data are Has gross
Has some
accurate and inaccuracies,
inaccurate, has
Content updated, some info
questionable
nonbiased plagiarized, shows
statements.
information bias.
Parts of newsletter
Parts of newsletter
complete; in Heavy text, no
complete; in
columns; proper white space
columns; font size
Template/lay-out use of white available;
and style are
and designs space and graphics and font
appropriate; text
graphics; size and style
graphics balance
appropriate font inappropriate
not attained
size and style
Cited all Cited some
References No Citation
references references
Only some
Cooperation Output is a result member Output created
Learning of group effort contributed to the by one member
output
Holistic Rubric/Scoring
It is used when the rater is more interested in estimating the overall
quality of the performance and assigning a numerical value to that quality than
assigning points for the addition or omission of a specific aspect of performance.
Holistic scoring is typically used in evaluating extended essays, term papers,
academic proficiency or some artistic performance such as dance or musical
creations.
EXAMPLE:
A Holistic Rubric for Mathematical Knowledge
EXAMPLE:
A Sample of Holistic or Combined Scoring Rubric
Persuasiveness
1 2 3
Lacks enthusiasm Somewhat unanimated Highly convincing
Delivery
1 2 3
Unclear, mumbled Often failed to look at Clear, forceful
lot audience, somewhat unclear delivery
Sensitivity
1 2 3
Rarely look at or Answered some questions Encourages questions
noticed audience not always aware when stopped and clarified
audience didn’t understand when saw that
audience didn’t
understand