Lecture 9
Which of the following choices identifies a multiple-choice item that is relatively easy, but with a high degree of discrimination among higher and lower achievers?
A. Difficulty 0.75 Discrimination 0.13
B. Difficulty 0.75 Discrimination 0.38
C. Difficulty 0.25 Discrimination 0.13
D. Difficulty 0.25 Discrimination 0.38
What is B: Difficulty 0.75 Discrimination 0.38
Using the same standards may not be appropriate if the difficulty of assessments varies significantly from one year to another. This is a limitation of which type of grading?
What is absolute (criterion-referenced) grading?
The form of testing where the item administered changes depending on the students' performance as they progress through the test.
What is computerized adaptive testing?
A* B C D
Upper (50 students) 40 5 5 0
Lower (50 students) 20 10 10 10
Determine the difficulty (p value) of the item above.
What is 0.60?
Source: A college professor wants to design a mathematics test to evaluate each student's performance relative to others. Her test questions have similar levels of difficulty and each question focuses on a very specific skill. After the test, she evaluates students' performance based on a pre-determined scoring criterion (e.g., A+: 90-100; A-: 85-89; B+: 80-84; etc.).
Did the instructor use the right assessment for her purpose?
No, she should use a norm-referenced grading method and a variety of levels of difficulty to differentiate among students' performance.
These are three pillars of test standardization.
What are test questions, test administration, and scoring?
A* B C D
Upper (50 students) 40 5 5 0
Lower (50 students) 20 10 10 10
Determine the discrimination (D) index for the above item.
What is 0.40?
Which of the following assessments is MOST likely to be used consistently by teachers as part of the grade calculation process?
a. Performance assessments.
b. Portfolio assessments.
c. Formative tasks.
d. Unit exams.
What is d. Unit exams?
The three methods that are typically used to report standardized scores in Canada.
What are percent correct, scaled scores, and percentile ranks?
A* B C D
Upper (50 students) 20 10 10 10
Lower (50 students) 30 5 5 10
Compute the discrimination (D) index.
What is -0.2?
A teacher gives her students a grading rubric for her tests, which identifies the specific content that students must master. This helps the teacher measure her students' mastery of specific objectives.
Which type of test is the teacher using?
a. criterion-referenced
b. norm-referenced
c. standardized
d. diagnostic
What is a. criterion-referenced?
Which of these would be LEAST helpful when using information from a nationally-standardized norm-referenced test for planning instruction?
a. Use score reports along with other evidence to identify patterns of achievement or for initial student grouping.
b. Examine students' score reports to identify relative strengths and weaknesses.
c. Read the test manual to find out what objectives are measured by the test and what item formats are used.
d. Review the test manual to learn about the characteristics of the norming group and test reliability.
What is d. Review the test manual to learn about the characteristics of the norming group and test reliability?
A* B C D
Upper (50 students) 30 5 10 5
Lower (50 students) 20 10 10 10
Compute the difficulty (p value).
What is 0.5?
When constructing a computerized adaptive test, which of these is probably given the LEAST consideration?
a. The item bank should select the most suitable items for each student.
b. The item bank should have items with a very high discrimination level.
c. The item bank should have items with a wide range of difficulties.
d. The item bank should generate the same items every time the test is administered.
What is d. The item bank should generate the same items every time the test is administered?