Construct Validity
A measure has this type of validity if it is subjectively considered to be a plausible operationalization of the conceptual variable in question.
What is face validity?
This is the magnitude or size of an experimental treatment.
What is effect size?
The features of the experiment that inadvertently lead participants to respond in a particular manner.
What are demand characteristics?
When conducting research in this mode, external validity is more important than internal validity.
What is generalization mode?
An attempt to organize certain data and specific relations among variables within a specific portion of a larger theory.
What is a hypothesis?
To test this type of reliability, we could ask two observers to rate the same participants at the same time and then compute r to see how correlated the two observers’ ratings are.
What is inter-rater reliability?
When the p value of an inferential test is less than .05, we say the result is this.
What is statistically significant?
This threat to internal validity involves the participants getting better results on the dependent measures due to completing the same measure multiple times.
What is testing?
If a survey is not representative, then researchers will not be able to draw valid conclusions about this group.
What is a population?
This is when someone seeks to answer research questions by observing behavior in the real world.
What is naturalistic observation?
This type of reliability is computed after measuring the same set of participants on the same measure at least twice.
What is test-retest reliability?
This inferential statistical test compares the means of two groups in a between-subjects experiment.
What is an independent samples t-test?
A threat to internal validity that can occur if experimental participants from different groups drop out of the experiment at different rates.
What is attrition?
This biased sampling technique was used by all the research groups in this class.
What is convenience sampling?
An experiment includes 90 participants: 30 of each are randomly assigned to one of the three treatment to one of the three treatment conditions. To analyze the group mean differences between these levels, a _____ is conducted.
What is a one-way ANOVA for independent samples?
This type of validity evaluates whether the measure under consideration is associated with a concrete behavioral outcome that it should be associated with, according to the conceptual definition.
What is criterion validity?
Descriptive statistics summarize these two aspects of a set of data.
What are central tendency and spread?
Order effects are only a threat to the internal validity of this type of experiment.
What is within-subjects?
A larger sample is not necessarily more representative. This matters more.
What is how the participants were sampled?
A measurement scale with a true zero is called this.
What is ratio?
This correlation-based statistic sees if measurement scales have internal reliability.
What is Cronbach’s alpha?
If an experiment finds that two groups are statistically different from each other, but that difference is meaningless in the real world, we say it lacks this kind of significance.
What is practical significance?
Selection effects only are a threat to the internal validity of this type of experiment.
What is between-subjects?
This random sampling technique involves choosing a random number and then selecting every nth person in the population to be in the sample.
What is systematic sampling?
Decreasing your probability level (e.g., setting it at .01 instead of .05) decrease the chance of committing this type of error
What is a Type I error?