Rubrics
What is a rubric?
a scoring guide used to evaluate the quality of students' constructed responses. It is made of criteria, levels of performance, and descriptors.
What is face validity?
The extent to which a test looks like it assesses what is supposed to (use of logos, instructions, headings, etc.)
Which of the following three affects the reliability of a test?
a) a test that follows no clear format
b) outside noise and bad speakers
c) a text in a reading com beyond the level of the students
b) Outside noise and bad speakers
Van Dijk & Kintsch (1983) famously refer to 3 levels/dimensions of reading
-Surface code - Textbase - Situation model
What is the situation model?
The combination of prior knowledge and information from a text = LEARNING
Assessment OF learning relates to _________ assessment
summative
How is a holistic rubric different from an analytic rubric?
Holistic rubrics combine criteria into levels of performance (in analytic rubrics they are separated into different units)
Content validity includes 2 key concepts: R___________ & C_____
Relevance & Coverage
What is reliability?
The quality of being trustworthy or of performing consistently well.
What is the difference between a top-down and a bottom-up view of processing of reading comprehension?
Bottom-up processing refers toprocessing sensory information as it is coming in. ...Top-down processing, on the other hand, refers to perception that is driven by cognition.
"An ongoing process of activities which generate feedback and develop capacities as self-regulating and autonomous learners"
relates to assessment ______ learning
AS
assessment AS learning
Mention 2 limitations rubrics have
- They may limit creativity
- They may restrict teachers' reflections
- Teachers may rely only on the rubric as feedback for students instead of writing comments
Mention 3 ways to make sure an evaluation is valid
1.Write explicit specifications for the test
2.Use direct testing (test reading if you say reading, writing a composition if you say writing, etc.)
3.Make sure the scoring relates to what is being tested
4.Make sure you are testing what you have taught and how you have taught it.
5.The objective(s) of the test are coherent with the test tasks/items
6.Do everything possible to make the test reliable. If a test is not reliable, it cannot be valid
Mention 3 ways to make sure your evaluation is reliable
1) Write clear, unambigous instructions/ítems
2) Ensure that tests are well laid-out and perfectly legible
3) Make candidates familiar with format and testing techniques
4) Provide non-distracting conditions of administration
5) Provide a detailed scoring key
6) Make sure the test is readable
7) Make sure pictures are clear
Offer a standard definition of 'inference' in reading comprehension
What is the backwash effect?
the effect of each test item on teacher's teaching and learner's learning in terms of negative and positive aspects.
Mention 3 advantages rubrics offer
- Take the mystery out of assignments
- Provide feedback to students
- Contribute to sound assessment
- Improve consistency among different evaluators