What part of the country is Matt from (city, state)
Pittsburgh, PA
100
What is generosity error?
Tendency for raters to overestimate the positive qualities of people they like
100
What type of reliability entails assessing the extent to which test scores are stable over time?
Test-retest reliability
100
Name one reason why direct questioning isn't ideal (hence, why we might use a different mode of measurement)
(1) Many subjects impacted by social desirability effects
(2) Many constructs not easy to reflect upon or verbalize
(3) Researcher unable to phrase questions so that others can understand
100
For what level of measurement do differences between scores reflect both relative and absolute meaning?
Ratio scales
200
What is one of the four problems associated with the use of observation (as a source of support for casual observation)?
(1) Observing behaviors that don’t represent the construct
(2) Difficult to infer causality from observation; can be mislead
(3) Biased sampling of people
(4) Choosing what is relevant and irrelevant is subjective
200
SAT scores are an example of what level of measurement?
Interval scales
200
What type of validity does random assignment help to ensure?
Internal Validity
200
What type of scaling method (scales) entails scoring individuals' responses according to judges' sortings of the items in regards to favorability toward the attitude object?
Differential scales
200
What is one advantage of using third-party reports?
(1) Helps identify or avoid biased self-responses
(2) Identifies areas of disagreement
(3) Helps provide a more complete picture of the individual
300
What type of validity entails the extent to which conclusions can be drawn about the causal effects of one variable on another?
Internal validity
300
What are the names of the two validity coefficients examined in discriminant validity analysis?
What is the name of a relationship depicted as below:
X --> Y AND X <-- Y
Reciprocal relationship
300
Convergent validity includes (a) the overlap/association between alternate measures intended to tap the same construct, and (b) ?
Overlap or association between theoretically-related constructs
300
What is the general term referring to the fact that respondents may use a given rating scale differently due to differences in their perspective?
Frame of reference
400
Because operational definitions specify the steps entailed in measuring a variable, or how numbers or categories are obtained, what do they allow?
Replication - Others can repeat the same steps we followed an obtain the same measurements
400
Scores on a personality test are converted to z-scores. Anne obtains a z-score of -.65, based on the scores in her class. How many standard deviations above/below the mean for the class is Anne in regards to the personality test?
.65 below the mean
400
What is the rule of thumb in regards to the minimum reliability of a measure when the measure is being used for applied decision making (what is the value)?
.90
400
In regards to item difficulty, do you want the items you've created on your test to be easy, medium, or difficult?
Ideally, you would have a nice mixture of relatively easy items, medium items, and relatively hard items
400
Scores on an achievement test are converted to T-scores. Thomas obtains a T-score of 60, based on the scores in his class. How many standard deviations above/below the mean for the class is Thomas in regards to the achievement test?
1 standard deviation above the mean
500
What is the term belonging to the following definition: The concept that for each construct of interest, there must be observable features representing the construct in order to study it.
Operationism
500
What are the two factors that we discussed that can negatively affect validity coefficients (make them appear smaller than they should be)?
(1) Unreliability in measures (predictor and criterion)
(2) Range restriction
500
Reliability coefficients reflect the ratio of what type of variance to what type of variance?
True-score variance to observed-score variance
500
What direct questioning mode of measurement contains the following two (2) disadvantages (among others): (1) Hawthorne Effect; (2) Difficult to test causal hypotheses.
What is Observation
500
What are two characteristics of items that we should keep in mind when creating multiple-item scales?
(1) Should be empirically related to construct
(2) Should differentiate among people who are at different points along the dimension
(3) Should not be double-barreled or ambiguous
(4) Should include some that are worded in positive direction and some that are worded in negative direction