"Valid Tests" Don't Exist!
Essentials of the Validation Process
The Validation Voyage
A Trio of Reliability Indicators
Reliability Takeaways
100

Grant correctly solves ten out of ten 2-digit subtraction with regrouping problems on the Unit 3 Assessment. His teacher concludes that Grant has mastered this skill by scoring 100%.

What is an inference or interpretation?

100

High-stakes test designers mentally engage in designing a test that has score-based accuracy, is suitable for the test's purpose, and with a reasoned validity argument.

What is following the required steps in the building of an educational test's validity argument?

100

The School District of Manatee County is concerned about the validity and reliability of their District Benchmark Assessments.  They hire this person to evaluate if there is an evidence-based validity argument in support of the use of the Benchmark Assessments.

Who is a measurement specialist?

100

Name the reliability indicator used when Ms. Brown gives a Unit Test on Fractions on Thursday and gives the same Unit Test on Friday.  Her students earn consistent results.  

What is test-retest evidence?

100

This is mandatory for all high-stakes standardized tests, but not for Mrs. Jones' teacher-made assessments.

What is purpose-compatible reliability evidence?

200

In making this statement, Mrs. Hanley suggests that her grammar test has score-based accuracy and also contributes to the purpose of the test.

What is a validity argument?

200

Mrs. West gives this to her students before an essay assignment.  It is a scoring guide designed to help guide the students, as well as help Mrs. West evaluate the quality of the students' work.

What is a rubric?

200

Name the reliability indicator used when Mr. Cole gives Test Form A to his students for the weekly math assessment on Fridays.  If a student is absent, they make up the test on Monday using Test Form B (same content, equally challenging).

What is alternate-form reliability evidence?