More on Validity & Reliability
Of the different ways to empirically test construct validity (criterion, discriminant, convergent): Your friend Dominic is complaining about having to take the Graduate Record Examination (GRE), a test that is required to go to graduate school and is similar to the ACT and SAT. He complains, “Tests like the GRE don’t really measure how well people actually do in graduate school.” Dominic is questioning the test's...
What is criterion validity?
Naomi is studying the effect of popularity on academic success for her research methods project. To do this, she has elementary school students rate how popular each member of their class is. She then uses this information to rank the students on popularity. Her scale of measurement in how she transformed the data is _____________.
What is ordinal?
What is the Methods section?
Not an advantage of within-groups designs
What is an order effect?
Type of quasi-experimental design in which there are different participants at each level of the independent variable and they are tested only once
What is a nonequivalent control group design?
Before using a measure in her study, Dr. Rodriquez analyzes the data she gets from her students. She looks at the relationship between each of the individual questions. She sees that participants who agree with Question 1 also agree with Question 3 and disagree with Question 2. This is a test of ________ reliability.
What is internal reliability?
Measuring the same variables in at least two points in time is the hallmark of this type of correlational study design?
What is a longitudinal study?
The section of a research article that will give you information about whether there were main effects or interactions in a factorial study
What is the Results section?
Type of threat when participants perform better on the posttest than the pretest because they have had practice
What is a testing threat?
A study in which a practioner or researcher observes behavior for an extended period before beginning a treatment or intervention
What is a stable-baseline design?
Cronbach's alpha is a statistic used to test this type of reliability.
What is internal reliability?
APA style abbreviation for probability
What is the p value?
The term used for publication of original research results for the first time
What is an empirical research article?
Type of threat to validity when only a certain kind of participant drops out of the study, thus skewing the data
What is an attrition threat?
The type of study design you would use when you can’t do a true experiment, have one or only a few participants and participants are treated separately
What is a small-N design?
When researchers work in this testing mode, they are usually designing correlational or experimental research to investigate support for a theory
What is theory-testing mode?
At Time 1, caffeine predicts sleep levels at Time 2, this is a type of correlation.
What is a cross-lag correlation?
What is the file-drawer problem?
When a measuring instrument changes over time (this could be an observational measurement as well as a computer)
What is an instrumentation threat?
Number of independent variables in a 2 x 3 x 2 design
What is three (3)?
"Can we generalize from our results with 9th and 10th graders in this sample to other students" represents an interrogation of which type of validity?
What is external validity?
Of .55, -.55, .75 or -.76, the strongest correlation
What is -.76?
The HARKING acronym stands for this problem in preparing a study for publication
When researchers' expectations influence their interpretation of results
What is observer bias?
Type of factorial design where one independent variable is manipulated as independent-groups and the other is manipulated as within-groups
What is a mixed factorial design?