Category 1
Reliability tells us whether a test: a) measures what we think it measures, b) measures something consistently, c) will predict to a future outcome well, d) has test bias
b) measures something consistently
A quasi-experimental design uses ___ variables, which is another form of independent variables.
Subject
When Neisser (an experimental psychologist) said “[We] must make a greater effort to understand cognition as it occurs in the ordinary environment and in the context of natural purposeful activity…” what type of validity is he talking about?
Ecological validity
Most people are average. This is a statement about _____
Normality/Norm/Gaussian
Suppose you have a score from a patient that is far removed from the mean. If you then choose again, you’re likely to pick a score less extreme than the first one. Why?
Regression towards the mean
The appearance that a measure has validity is: a) content validity, b) face validity, c) appearance validity, d) criterion validity
b) face validity
If scores shouldn’t change over time, and yet they do, we have a problem with measurement error due to timing. We should address this with what type of reliability?
Test-retest reliability
Pearson’s r is best used with what type of measurement scales?
Ratio/Interval
Eve and Ivan collect data on the same student using the same assessment and find their data is almost exactly the same. They have ____ reliability.
Inter-rater reliability
Suppose you created a new measure of reading comprehension and you wanted to test its validity. Therefore, you compare results to existing validated measures. This is dealing with ____ validity
Criterion/concurrent
An experimenter is trying to make sure his test relates to an existing gold standard measure. What type of validity is the experimenter trying to achieve? A) construct validity, b) criterion validity, c) face validity, d) both criterion and construct validity
b) criterion validity
If a test has face validity, we can assume the measure is appropriate to use – true or false?
False!
A test is said to accurately assess specific psychological and personality traits and psychological attributes. This assessment is likely to have good: a) predictive validity, b) concurrent validity, c) content validity, d) construct validity?
d) construct validity
During orientation, students were given questionnaires which serve as a pretest for test anxiety. Students who scored high in test anxiety were put into a program. After the completion of the program, all students received a posttest to determine change in test anxiety levels. Was the change due to the program, or something else? à this question deals with ____ validity.
Internal validity
The results of our study shows that all subjects in all conditions received a 95% average. It looks like we have a _____ effect with our dependent variables! Oh no!
Ceiling
Which are subtypes of criterion validity? A) convergent and discriminant, b) predictive and concurrent, c) A and B, d) None of the above
b) predictive and concurrent
All of the following are ways to improve reliability EXCEPT: a) administer the test to multiple people until you achieve reliability, b) remove inconsistent items, c) determine if subscales exist, d) add consistent items
a) Administer the test to multiple people until you achieve reliability
A study wants to compare the impact of ASMR on patients with insomnia. All subjects were told to record their sleep patterns with a sleep monitoring device, however 50% of subjects were not listening to ASMR. The later subjects had the ____ condition.
Control
Subjects were given a memory task, however 1/3 were told to form visual images of works, 1/3 were told to form associations between adjacent pairs of words, and 1/3 were told to repeat each word three times when presented. This is an example of _______ variables, which are types of manipulated independent variables.
Instructional variables
To establish construct validity, we need: a) convergent evidence, b) divergent evidence, c) both, d) neither
c) both
Factors in different environmental circumstances that can affect the results of a study: this is what type of independent variable?
Situational variable
A measure of burnout, for example, is more likely to be reflected by a measure of perceived job stress than of vocabulary, and the opposite is true of a measure of intelligence. This is an example of _____ validity.
Content
A researcher performs a two sample t-test and finds statistical significance at alpha p<0.05, and therefore rejects the null hypothesis. However, when presenting results, their PI asks if both samples were normally distributed - the answer is no. This researcher does not have ______ ______ validity in their results.
Statistical conclusion validity
Which Pearson correlation coefficient result best demonstrates divergent evidence for construct validity? a) -1 b) -0.68, c) 0.48, d) 0.081
d) 0.081
There may be 100 participants at the start of the study and only 60 at the end. This is a problem known as ____.
Attrition/subject mortality