Key Words
What is a Judgmental item improvement
the chief means of sharpening your tests is human judgement-your own and that of others
3 sources of test improvement judgments
The teacher
Colleagues
Students
Draw out the equation for Difficulty Indices
R
Difficulty p = --
T
What percentage would be considered very good items in the discrimination index?
.40 and above
Fill in the blank for Item Analysis for Criterion-Referenced Measurement
D= P_- P_
1. post
2. pre
Empirical item-improvement
procedures based on students responses to your assessment procedures
5 general writing commandments for modifications
1. item specific guidelines and general item writing commandments
2. Contribution to score based inference
3. Accuracy of content
4. Fairness
What does the answer of a Difficulty P represent?
The total of how many students answered correctly.
What does non-discriminating tell a teacher?
item for which there's no appreciable difference in the correct response proportions of those who score well or poorly on the total test.
P post =
proportion of students answering the item correctly on post-test
Negative discriminator
an item is answered correctly more often by those who score poorly on the total test than by those who score well on the total test.
What is a strategy recommended for student's to judge item improvement?
Hand out questionnaire after assessment
If 50 students answered an item, and only 37 of them answered it correctly then the p-value representing the items difficulty would be??
37
Difficulty p = --- = .74
50
What is an item discrimination indices?
How frequently an item is answered correctly by those who perform well on the total test.
What is the chapter name and one important fact from the chapter that you learned?
Improving Teacher- Developed Assessment
Any response!!
Extra: After creating an assessment what should a teacher do??
Let it " cool off " and come back to it later.