Fairness
fairness
______ can occur during scoring
interpretation of scores or results
The comparison group in standardized testing
norming group
Name the generations of technology
Fairness as a property of test scores; Fairness as a set of practices; Fairness as a social goal
Mr. Smith has a positive impression of Martin and lets this influence his grading of Martin's final paper. This is an example of the ___________.
halo effect
__________ is the strength of the relationship between what you intend to measure and what you have actually measured. ___________ is the consistency of assessment results or scores.
types of standardized tests
The GRE is an example of the ________ generation of technology
second
-considering whether students have access to resources outside of the classroom for a group project
-ensuring that students have at least 1 weeks' notice prior to a formal assessment
-making students aware of plans for assessment
classroom techniques that support fairness in classroom assessment
Stephanie always talks in class and interrupts her teachers. As a result, Stephanie's teachers remember her poor behaviors when grading her for participation. This is an example of the _____________.
"demon effect"
Ideally, the quality for classroom assessment is _______ reliability and _______ validity.
high, high
z-scores, T-scores, College Entrance Examination Board scores (e.g., SAT), Army General Classification Test scores
The generation of technology that education is approaching
third
When students perceive an assessment to be unfair, they might react in these possible ways. Name one
-hostile
-truancy
-cheating
A test could be biased due to ___________________ (state 1 reason why)
-designed for one cultural group/region/gender/etc.
-disadvantages other cultural groups/regions/gender/etc.
-content matter
-lack of clarity in instructions
-scoring systems that don't credit appropriate or correct responses that are more typical for one group or another
Validation approaches include ______________
-gather test-taker cognitions via think-clouds or cognitive labs in the test development phase
-training raters extensively
-offering multiple opportunities to take high-stakes tests
-use regression to predict future performance
Name a norm-referenced and a criterion-referenced test
NRT: SAT, ACT, Stanford Achievement Test (SAT9), Iowa Tests of Basic Skills (ITBS), Certified Treasury Professional (CTP), GRE, IQ
CRT: Regents, NYS Testing Program (BOCES), National Assessment of Educational Progress (NAEP), Classroom Assessment, Competency Based Assessment, SAT Subject Tests, AP Exams
The NAEP uses __________________ items
technology-enhanced
conduct differential item functioning to remove biased items
One way to eliminate bias in testing
-students know what is expected of them
-instructions are clear and each student understands them
Technique to ensure validity of classroom assessments
Including but not limited to:
-making sure that teaching and assessment both relate to the same learning goals (instructional validity)
-aligning feedback with instruction and objectives (instructional validity)
-pilot assessments to check for grade-appropriate language
-use rubrics and compare against benchmarks
-use multiple iterations and multiple methods of assessment
-providing opportunities for reassessment
Name an inappropriate use of standardized norm-referenced test scores
-sole basis for placing students in special programs
-sole basis for retention decisions
-sole basis for judging the quality of an entire school
-assigning credit/blame for poor performance on a particular teacher
Name 2 types of technology that are used in either classroom or large-scale assessments
computer adaptive testing; technology-enhanced items; interactive tests; automated scoring; technology delivered testing; intelligent tutor; online quizzes (survey monkey, Google Forms, etc.); practice sites with feedback (Quizlet, Socrative); auto-feedback; using videos; technology-based portfolios (Chalk & Wire); Kahoot; EdPuzzle; Mentimeter, Goolgle Classroom; Google Suite; Office 365; Blackboard; and more