Validity
Reliability
Testing Application
100

A teacher thinks a test can be valid.  This is true or false.

What is false?
100

A parent wants to know what reliability on a standardized test means.  A teacher can offer this synonym.

What is consistency?

100

For the last few years, a district has said that students who score 500 on a standardized assessment have to re-test.  This is an example of what.

What is decision consistency?

200

A teacher wants to make sure a test is measuring what it is designed to measure.  This is what he is attending to.

What is validity?

200

If a test is producing similar results over similar administrations with similar students, a teacher can predict that the test is possibly demonstrating this.

What is reliability?

200

A parent interprets a student's score on a norm-referenced test.  Grade level is 70% and the student scored a 67% with a SEM of plus or minus three points. The parent says the student could reach grade level if he re-tests. True or False -- the parent's interpretation is mostly accurate.

True 

300
A teacher begins planning a test.  The first step needed is to collect evidence about the accuracy of the test is this.

What is the student's score?

300

A teacher plans to give a test on Tuesday, but decides to give it on Monday instead.  She does not think the day should affect the scores.  This is the reliability aspect she is basing this decision on.

What is the test-retest reliability evidence?

300

A high stakes test has been scoring similarly over a number of years.  True or false -- it is not necessary to calculate other forms of evidence as the score history is sufficient.

What is false?

400

A teacher sees her class achieve certain scores on a test.  She concludes her class has mastered the material and is ready to move on. These are the aspects of validity on which she is basing this decision.

What are accuracy and accomplishment of a test's purpose?

400

An item analysis over the last three years shows that students struggle with the same concept in a given test.  This shows this test has this aspect of reliability.

What is the stability?

400

A teacher focus group is called together to analyze questions on a test that will be used for instructional evaluation.  This is the aspect of instructional sensitivity in question.

What is judgmental evaluation?

500

A standardized test score from a class is being used to measure a teacher's effectiveness.  This is the aspect that should be considered when evaluating instructional quality.

What is instructional sensitivity?

500

When planning on a differentiated assessment, a teacher knows questions will need to be presented in different forms, but will need to ask the same thing. This is the aspect of reliability evidence the teacher is addressing.

What is the alternate-form reliability evidence?

500
Instructional sensitivity is being regarded when test takers review evidence of scores of students' performance in several districts and SES groups in a state.

What is empirical evidence?

M
e
n
u