Validity
Criterion-Related Evidence
Reliability
Reliability...Continued
100
the degree to which an instrument logically appears to measure an intended variable; it is determined by expert judgment.
What is Content-related evidence of validity
100
The degree to which scores on an instrument predict characteristics of individuals in a future situation.
What is predictive validity
100
Inconsistency of individual scores on the same instrument.
What is Errors of Measurment
100
A method of estimating the internal consistency reliability of an instrument; it is obtained by giving an instrument once but scoring it twice—for each of two equivalent "half tests." These scores are then correlated.
What is split-half procedure
200
A second measurement used to evaluate instrument validity
What is criterion
200
The degree to which the scores on an instrument are related to the scores on another instrument administered at the same time, or to some other criterion available at the same time.
What is concurrent validity
200
An index of the consistency of scores on the same instrument. There are several methods of computing a reliability coefficient, depending on the type of consistency and characteristics of the instrument.
What is reliability coefficient
200
Procedures for determining an estimate of the internal consistency reliability of a test or other instrument from a single administration of the test without splitting the test into halves.
What is Kuder-Richardson approach
300
The degree to which performance on an instrument is related to performance on other instruments intended to measure the same variable, or to other variables logically related to the variable being measured.
What is criterion-related evidence of validity
300
A decimal number between .00 and ±1.00 that indicates the degree to which two quantitative variables are related.
What is correlation coefficient
300
A procedure for determining the extent to which scores from an instrument are reliable over time by correlating the scores from two administrations of the same instrument to the same individuals.
What is test-retest method
300
An internal consistency or reliability coefficient for an instrument requiring only one test administration.
What is Alpha Coefficient
400
The degree to which an instrument measures an intended hypothetical psychological construct, or nonobservable trait.
What is construct-related evidence of validity
400
An index of the validity of scores; a special application of the correlation coefficient.
What is validity coefficient
400
Two tests identical in every way except for the actual items included.
What is equivalent-forms method
400
An estimate of the size of the error that one can expect in an individual's score.
What is Standard Error of Measurement
500
The degree to which correct inferences can be made based on results from an instrument; depends not only on the instrument itself but also on the instrumentation process and the characteristics of the group studied.
What is validity
500
A chart comparing predictor categories with criterion categories in order to evaluate instrument validity
What is expectancy table
500
Procedures for estimating reliability of scores using only one administration of the instrument.
What is internal-consistency methods
500
The percentage agreement among different scorers or observers.
What is Scoring Agreement