Talk About Item Analysis
Talk About Item Analysis
Talk About Item Analysis
How
Howcando we
we
How can we improve
determine
determine correct
test
the quality of the
effectiveness
and faulty testand
test?
fairness?
items?
ITEM
ANALYSIS
LORIE I. BRACIA
TEACHER I
“If our students learned what we taught,
we would never need to assess. It is
only through assessment that we can
discover whether the instructional
activities in which we engaged our
students resulted in the intended
learning. Assessment really is the
bridge between teaching and learning.”
- Dylan Williams
Welsh Educationalist and a Professor of
Educational Assessment at the
UCL Institute of Education.
Answers to Questions…
1. Which topics are students struggling with?
2. Is a particular question as difficult, complex or
rigorous as you intend it to be?
3. Do students really know the answer or just
applying test-taking strategies to eliminate to the
wrong answers?
4. Which item should be eliminated or revised before
use in subsequent test administrations?
5. Does the item do an excellent job of separating
students who know the answer from those who
may guess the correct answer?
ITEM ANALYSIS
A process which examines
student responses to individual
test items (questions) in order to
assess the quality of those items
and of the test as a whole.
Item Analysis reveals
Items
that are
too easy
or too
difficult.
Item Analysis reveals
Items that
failed to show
difference
between
skilled and
unskilled
examinees.
Item Analysis reveals
Items that are
scored
incorrectly.
Uses of Item Analysis
1. Determining whether an item functions as intended.
Uses of Item Analysis
2. Providing feedback to the teacher about student
difficulties.
Uses of Item Analysis
3. Suggesting areas for teaching improvement.
Uses of Item Analysis
4. Revising the
assessment task.
Uses of Item Analysis
5. Improving the item writing skills.
Steps in Item Analysis
1. Score the Test.
Steps in Item Analysis
2. Arrange the Test from
Highest to Lowest score.
Steps in Item Analysis
3. Separate both 27% of high and low score.
Steps in Item Analysis
4. Prepare a tally sheet.
Steps in Item Analysis
5. Convert the frequencies into proportions.
Steps in Item Analysis
6. Compute for the difficulty index.
Example:
0.86
0.90
0.75
Steps in Item Analysis
Let’s Interpret
For teacher-made tests, form a mix
of difficulties – a very few difficult,
some difficult, some average,
some easy and a few very easy.