Validity
Two interchangeable terms to describe the nature of assessment validity
What are Inference and Interpretation
The most fundamental consideration in developing and evaluating tests
What is Validity?
This word is a synonym used for Reliability when referring to educational testing
What is "consistency"?
This is a reasonable level of a rest-retest reliability coefficient.
What is between .70 and .80?
The kinds of reliability coefficients usually reported for educational tests provide us with estimates of consistency for this, not this.
What are "groups of students, not individuals?"
A score based inference contribution to a test's primary purpose.
What is a validity argument?
A person that can be hired to create a validity argument
Who is an Assessment Expert?
Validity refers to the results of the test and their purpose, while Reliability discusses what?
What is "the test itself"?
Reliability evidence dealing with the degree to which different forms of a test yield consistent results.
What is "alternate form reliability evidence"?
This indicator of consistency can be uses when focusing on an individual student's performance
What is "the standard error of measurement"?
Focused on identifying and assembling evidence of accuracy of a score based inference's accuracy.
What is Step 1 of the Validity process?
Popham refers to this as the most invalid use of educational testing in America
What is evaluating instruction quality?
There are this many types of reliability evidence are described in AERA standards.
What is "three"?
Alternate form reliability coefficients should be in this range.
What is between .70 and .85?
When considering a tests reliability, Popham suggests relying mostly on this.
What is "common sense"?
Evidence of a test-taker's score appropriate contributing to accomplishing the tests primary purpose
What is Step 2 of the Validation Process?
Validity arguments must be based on this.
A teacher administers the same test on Monday, and again on Tuesday, and computes a correlation coefficient. The results of this is described as
What is a "test-retest reliability coefficient?
This type of reliability evidence focuses on the consistency among the test's items and what they are measuring.
What is "internal consistency reliability evidence"?
These two testing terms go together like "Peanut butter and jelly"
What are "reliability and validity"?
Generation of a reasoned Validity Argument based on "inference accuracy" and "purpose accomplishment".
What is step 3 of the validity process?
The most significant process in all of educational testing
What is assessment validation?
Test-retest reliability-coefficients represent the _____ with which a test is measuring what it is supposed to measure.
Stability.
This type of reliability evidence focuses not on the test score, but rather on the decisions made from the test score.
What is "decision-consistency estimates"?
It is important to match the type of reliability evidence supplied with this.
What is "the specific purpose of the test"?