Types of Validity
Reliability in Action
Real-World Assessment Examples
Consequences of Poor Validity/Reliability
Improving Assessments
100

A school district creates a new writing assessment and checks to see if it measures skills outlined in the state standards for writing.

 What is content validity?

100

 A teacher gives the same spelling test to a group of students on two different occasions, and their scores show a strong correlation.

 What is test-retest reliability?

100

 A school implements a district-wide math assessment that aligns with state standards and is regularly reviewed for its effectiveness.

 What is an example of formative assessment?

100

A high-stakes test inaccurately reflects student abilities, resulting in students being placed in inappropriate educational tracks.

What is misclassification of students?

100

 A school district engages teachers in developing common assessments to ensure alignment with curriculum and consistency across classrooms.

What is collaborative assessment design?

200

 A college uses SAT scores to predict students’ success in their first year. They analyze the correlation between SAT scores and GPA.

Answer: What is predictive validity?

200

 A school administers two different versions of a math test covering the same material on the same day, and the scores are nearly identical.

What is alternate-form reliability?

200

 This widely recognized test evaluates student performance in math and reading every year, allowing for progress tracking across grades.

What is the PARCC (Partnership for Assessment of Readiness for College and Careers)?

200

Teachers rely on a poorly designed assessment, leading to an emphasis on teaching test-taking strategies instead of real understanding.

What is curricular narrowing?

200

 Regular training sessions help educators better understand assessment practices, leading to more effective test creation and implementation.

What is professional development?

300

 A teacher uses a new math assessment that is supposed to measure problem-solving skills, then correlates it with scores from a well-established math test.

 What is criterion-related validity?

300

A researcher evaluates a set of quiz questions to ensure that they all measure the same concept, finding consistent scores across different items.

What is internal consistency evidence?

300

 A school uses a reading fluency tool that measures how many words a student can read accurately in one minute, used to track progress.

What is a Curriculum-Based Measurement (CBM)?

300

Students who perform poorly on an unreliable assessment may not receive needed interventions, affecting their long-term success.

What is misguided support?

300

A district implements feedback systems where students can share their assessment experiences to improve future test designs.

What is student feedback mechanisms?

400

An art portfolio is evaluated for creativity, technique, and expression to ensure it accurately reflects a student's artistic abilities.

What is construct validity?

400

Students take a reading comprehension assessment that uses various questions to measure the same skills, leading to similar scores across different question types.

What is internal consistency?

400

 Schools use an assessment program that combines project-based tasks and traditional tests to evaluate critical thinking and problem-solving skills.

What is the Next Generation Science Standards (NGSS) assessment?

400

An assessment that fails to account for diverse student backgrounds may unfairly penalize certain groups, leading to inequitable outcomes.
Answer: What is cultural bias?

 What is cultural bias?

400

A review committee assesses standardized tests annually to ensure they remain relevant and equitable for all student populations.

What is assessment validation?

500

 A reading assessment designed for English Language Learners is reviewed to ensure it accurately measures reading comprehension without cultural bias.

 What is concurrent validity?

500

After administering a science test twice to the same group of students, the scores reflect a high degree of consistency, confirming the assessment's reliability over time.

 What is test-retest reliability?

500

An adaptive learning platform assesses students in real-time and adjusts the difficulty of questions based on their performance.

What is personalized learning technology?

500

 A significant drop in assessment scores among students may lead to unjust assumptions about teacher effectiveness based on unreliable data.

 What is misinterpretation of educator performance?

500

 Schools create a committee to audit existing assessments for bias and relevance, ensuring they meet current educational standards.

What is assessment auditing?

M
e
n
u