Validity Basics
Types of Validity
Reliability
Standardization
Sources of Error
100

The teacher wonders if a test score reflects the student’s ability, the teacher’s instruction, or school decisions.

What is validity?

100

A student scores high on MAP and also scores high on the Milestone test at the same time.

What is concurrent validity?

100

The same test given on two different days produces nearly identical results.

What is test-retest reliability?

100

All students take a test under the same conditions, at the same time, with the same instructions.

What is standardization?

100

Students seem tired and distracted on test day.

What is student variability?

200

A kindergarten test includes paragraph writing, which is developmentally inappropriate.

What is a lack of construct validity?

200

Strong sentence-writing skills suggest a student will also do well in paragraph writing.

What is predictive validity?

200

A student’s test results remain consistent across multiple types of assessments.

What is reliability?

200

A test with consistent scoring, timing, and environment.

What is a standardized test?

200

One test item was confusing and poorly worded. The student seemed to feel that if they were given more questions or examples, they could've done better.

What is test-related error?

300

A test about “compare and contrast” is given, but students were only taught “sequential order.

What is a lack of content validity?

300

A student scores high on MAP and also scores high on the Milestone test at the same time.

What is concurrent validity?

300

Teachers across the district give the same test and see similar performance patterns.

What is reliability at the district level?

300

A principal reviews whether testing procedures were followed exactly at all schools. 

What is monitoring standardization?