Show:
Reliability
Validity
Item Analysis and Test Theory
Miscellaneous
Standard Scores
100
Define Reliability in one word.
Consistency
100
True or False Tests need to demonstrate reliability before they can have evidence of validity
True
100
What does CTT stand for?
Classical Test Theory
100
Bias in the meaning of test question is what kind of bias?
Construct bias
100
What inferences can you make from raw scores?
You should not make any inferences from raw scores alone.
200
Name a common method for checking reliability
Cronbach's alphas
200
True or False? Tests can be proven through statistical methods to be valid.
False
200
What does IRT stand for?
Item Response theory
200
What is one way to statistically tell if an item has bias?
Conduct a DIF analysis
200
What is the method of assigning numerical value to a psychological attribute?
Scaling
300
True or False The standard error of measure can be negative?
False.
300
Define Content Validity
The extent to which the test assesses what it is truly meant to assess.
300
If an item has a difficulty of .9 what inferences can you make about the item?
90% of the students got it correct therefore it was a relatively easy item.
300
Who developed the logic for Multitrait Multimethod Model
Campbell and Fiske
300
Define the standard error of measures
It is the average of the error/deviation scores
400
In order to increase the reliability of a set of test scores what should you increase?
The number of items
400
List 3 different types of validity
Content Validity Face Validity Criterion Validity Predictive Validity Convergent and Discriminant Validity Construct Validity
400
What does an item discrimination index tell us?
How well the item distinguishes between those who did well on the entire exam and those who did not do well on the exam.
400
According to Classical Test Theory an observed score contains which two components?
True score and Measurement error
400
If a variable has no variability what is it then?
Constant
500
What is a KR20?
Estimate of reliability used with dichotomous data.
500
Name a statistical test used to provide evidence of validity
Exploratory Factor Analysis Confirmatory Factor Analysis
500
What would you do with an item that has a difficulty of .6 and a discrimination of -.25 with over 500 test takers from a normal population.
I would consider throwing out the item because it is fairly difficulty but did not discriminate well at all.
500
A researcher found a strong correlation between two assessments designed to measure test anxiety, this would be considered evidence of
Convergent Validity.
500
Nominal, Ordinal, Interval or Ratio- Which scale of measure is the following? Temperature in Celcius
Interval