Measurement Overview
T/F: SAT verbal scores are a psychological construct.
FALSE!!!!!!!!!
What is the definition of Reliability in the context of measurement?
Consistency in measurement
What is the definition of Validity in the context of measurement?
Accuracy of inferences
What is the definition of Correlation?
Statistical technique used to measure and describe a relationship between two variables
What is a hypothesis?
A testable statement describing the relationship between two or more variables.
What are implicit measures based on?
Based on associations and reaction times
What is Classical test theory?
A way of conceptualizing reliability (or consistency) in scores
What is content validity?
Showing that the test measures the theoretical construct it claims to measure.
Which indexes of reliability are correlation coefficients?
ALL: Test-retest; Parallel forms; Split-half; Internal Consistency; and Interrater
What is test-retest and split-half reliability?
Test-retest: Same measure at 2 points in time, correlation between scores
Split-half: 1 measure split into 2 halves, correlation between scores on one half and the other half
What are the scales of measurement?
–Nominal
–Ordinal
–Interval
–Ratio
In the context of measurement, what is reliability?
The extent to which test scores are consistent.
What is Convergent validity?
Different measures of the same construct yield similar results (high correlation)
What are direction and degree?
Direction
– The sign of the correlation coefficient specifies the direction of the relationship
– Positive (direct) or negative (inverse)
• Degree
– Magnitude of the relationship
– Magnitudes close to +1 or -1 indicate a strong relationship
– Magnitudes close to 0 indicate a weak relationship
What are the three steps of the construct validation?
(1)Identify behaviors that are related to the construct to be measured
(2)Identify other constructs and decide whether they are related or unrelated to the construct
(3)Identify behaviors that are related to each of these additional constructs and determine whether each behavior is related to construct being measured
What are the major modes of measurement? (Hint:5)
–Direct questioning
–Third-party reports
–Observation
–Implicit measures
–Physiological measures
What are the sources of errors for Test-retest; Parallel forms; Split-half; Internal Consistency; and Interrater?
Time: Test-retest
Content: Parallel forms; Spilt-half; Internal Consistency
Raters/Observers: Interrater
What is Multitrait-Multimethod Matrices?
Multiple measures of the same construct (e.g., self-report, peer report, physiological measures)
Timmy was too anxious to perform at the comedy club's "open mike" night. Joanie was the opposite; she was not anxious at all, too relaxed to perform her comedy routine. Susie was at the right level of anxiety - not too low and not too high - so she went out and made 'em laugh. This story suggests what relationship between anxiety and performance?
Curvilinear
MATH!!!!!!
Calculate the SP
X 5 7 4 6 3
Y 3 4 2 5 1
SP= 84- ((25*15)/5)=9