Validity & realism, 1
This phrase refers to the degree of certainty you can have that your IV is the cause of any changes in your DV
What is internal validity?
This phrase refers to the degree of confidence you can have that your result applies to other times, other populations, or other situations
What is external validity?
What is mediation?
A statistical result that suggests the presence of an effect (rejects the null hypothesis) when no such effect exists in the broader population
What is a false positive?
This is the tendency for people to think they "knew something all along" once they see the correct answer
What is hindsight bias?
This is the degree to which your experimental situation looks like a situation in the real world
What is mundane realism?
A phenomenon in which a participant's behavior or response changes because of how it is being measured
What is reactivity?
A causal model in which a third variable intervenes to alter the strength or direction of the IV's effect on the DV
What is moderation?
An approach to statistical analysis in which you try many different variations of a test (with & without covariates, with and without outliers, etc.) until you get a significant result
What is p-hacking?
This is the tendency to want to reduce an entire domain to one level of analysis, e.g., thinking of psychological processes only in terms of brain activity
What is "greedy reductionism"?
The degree to which your experimental situation evokes the mental process you are actually interested in (e.g., attention, memory), regardless of whether it is "engaging" or looks like real life
What is psychological realism?
These are the types of dependent variables that Roy Baumeister, Kathleen Vohs and David Funder argue are too prevalent in social psychology
What are self-report and implicit/reaction time measures? (also acceptable: "self-reports and finger movements")
The effect of one independent variable on the DV, disregarding the effect of any other independent variables in the interaction
What is a main effect?
A set of standards that can include practices like (1) making data publicly available, (2) preregistering hypotheses, (3) giving access to full materials, etc.
What are open science practices?
According to Lilienfeld, this is the confusion laypeople have about the distinction between professions like social worker, psychiatrist, and research psychologist
What is "confusion between psychologists and psychotherapists"?
This is a technique for measuring psychological processes in participants' everyday lives (in other words, tracking them as they are "walking" around)
What is ambulatory assessment?
The degree to which your experimental situation is absorbing, vivid, and engages the attention of participants
What is experimental realism?
The overall interplay between two or more IVs in a model, specifically indicating whether the relationship between one IV and the DV differs across levels of the other IV
What is an interaction effect?
One of the two pillars of credibility discussed by Simine Vazire, specifically that which ensures that statistical analyses are sound, research practices are strong, and errors are corrected
What is "quality control"?
This is the unfortunate trend for figures like Dr. Phil or Psychology Today columnists to have a larger mainstream impact than actual academic psychologists
What is the "problematic public face of psychology"?
This is the quality that Dana Dunn praises, indicating that experimentation can be valuable if it shows us what is *possible* rather than what is *typical.* (In other words, even if a study lacks external validity.)
What is "external invalidity"?
This is a technique for capturing brief samples of a participant's auditory environment, for instance, their conversations or whether they are outside
What is the Electronically Activated Recorder (EAR)?
The effect of one IV in an interaction *specifically at one level of the other IV*
What is a simple effect?
A model for publishing in which researchers get their study design and analyses approved for publication *before* collecting the data
What is a registered report journal?
This is the tendency that people have to think that science is a more trustworthy source of answers when they see science that supports their pre-existing beliefs, and to discredit science when it does not
What is "the scientific impotence excuse"?