Lecture 5
What is wrong with the multiple-choice item below?
Which of the following cities is a provincial capital?
a. Regina
b. Houston
c. Manitoba
d. British Columbia
A. Stem points to answer
B. There is no single answer
C. Distractors are not plausible
D. Stem does not contain sufficient information
What is C: Distractors are not plausible?
This is more likely to occur in selected-response items compared to constructed-response items.
What is guessing?
This is the main source of bias in classroom performance assessments.
What is a teacher's scoring?
When evaluating performance assessments, checklists can be better than anecdotal notes if
A. The assessment requires a set of sequential tasks
B. The assessment focuses on observable, simple tasks
C. The classroom size is big
D. The teacher intends to quantify student performance
E. All of the above
What is E: All of the above?
"Daniel Gabriel Fahrenheit is noted for_____________.
a. discovering radioactivity
b. inventing the steam engine
c. discovering the planet Saturn
d. inventing the Fahrenheit scale"
What is wrong with the following MC item?
A. Stem contains a clue
B. There is no single answer
C. Grammatical errors hinder understanding
D. Stem does not contain sufficient information
What is A: Stem contains a clue?
This effect happens when extraneous factors (i.e., student behaviours) influence the teacher's scoring of constructed-response items.
What is the halo effect?
Which of the following would NOT reduce the validity and reliability of performance assessments?
A. Broadly stated performance criteria
B. Teachers' prior perceptions of students
C. A large number of performance criteria to observe
D. Performance criteria matched to students' performance level
What is D: Performance criteria matched to students' performance level?
An advantage of this performance assessment method over checklists is that it allows the teacher to evaluate the degree of the performance rather than its completion.
What is a rating scale?
Which item is MOST suitable for measuring knowledge that includes associations?
a. Matching
b. Multiple choice with a source
c. Binary choice
d. Multiple choice without a source
What is matching?
This property of a high-quality restricted constructed-response item is used to clarify expectations.
What is the use of guiding words?
Which performance assessment method is not well suited for large classes?
What is an anecdotal note?
Both these performance assessment methods are practical to use in a class with many students.
What are rating scales and checklists?
Which of the following shows the BEST alignment between the learner outcome (LO) on the left and the assessment on the right?
a. Students will classify animals as mammals, reptiles, or birds -- Essay
b. Students will explain why an agouti is a mammal -- Restricted constructed-response item
c. Students will list the differences between mammals and reptiles -- Multiple-choice item
d. Students will design the ideal habitat for an agouti rodent. -- Informal questioning
What is b. Students will explain why an agouti is a mammal -- Restricted constructed-response item?
The components of an extended constructed-response item include all EXCEPT
a. scoring information
b. guiding words to clarify expectations
c. plausible distractors
d. meaningful context
What is c. plausible distractors?
These are some examples of student work that may be included in a portfolio.
What are videos, artwork, rough and final drafts, and posters?
Name two common elements of holistic and analytic rubrics.
What are scoring categories and descriptors?
Which of these is NOT a requirement for a portfolio assessment?
a. Purposeful
b. Student self-evaluation
c. Clear criteria
d. Best work
What is d. Best work?
Similar to rating scales, this performance assessment method could be used for self-assessment and peer assessment in large classrooms.
What is a checklist?