Experimental Design I
In this type of experiment, all participants see all conditions
What is a within-subjects design?
This phrase has been used in the textbook and in class to describe the process of searching through the literature by reading the references of a paper you find, then reading the references of that paper, and so on.
What is "treeing"?
This is the principle that respects individuals, and which dictates that subjects should be informed of the risks and benefits of an experiment before they participate.
What is informed consent?
This was the subject of the paper that sparked a new wave of attention on methods and replicability of results.
What is ESP? (or predicting the future)
This is a variable that is present in an experiment, related to an independent variable, and not measured or considered, such that it could be mistaken for a dependent variable.
What is a confound?
In within-subjects designs, these effects emerge if the sequence in which participants experience the independent variable(s) affect the values of the dependent variable(s).
What are order effects?
This is the name for the search engine you can use through the UNR library to find PDF copies of articles.
What is OneSearch?
This was an infamous study that did not allow participants access to the cure for their disease, conducted in Tennessee for years after the cure for the disease was known.
What is the Tuskeegee syphilis study?
This is one solution that has been proposed to help with the replicability crisis, in which scientists describe their planned experiments before they carry them out.
What is pre-registration?
This results when subjects all score near the maximum possible on some metric (e.g. a test or survey), and makes it difficult to differentiate between conditions based on the test or survey.
What is a ceiling effect?
"Mortality" (or subjects dropping out of an experiment before it is complete) is a threat to what kind of validity?
What is internal validity?
This is a measure used by Google that quantifies how many publications that a researcher has with more than a certain number of citations.
This is the name for the group of people who review experimental protocols to make sure they are in line with ethical guidelines.
What is the Institutional Review Board?
The process of running many analyses on the same dataset until some result comes back with p < 0.05 is referred to as this.
What is "p-hacking" (or "data-dredging")
This is the name for the variable that is manipulated in an experiment
What is the Independent Variable?
This is the best kind of experimental design to use to study interactions between multiple variables.
What is a factorial design?
These are two of the top (most impactful) multi-disciplinary journals in all of science.
What are Nature and Science?
This is the term for wholesale making up of data.
What is fabrication?
Cohen's d is computed as difference in means between two samples divided by the pooled standard deviations, and is a measure of this.
What is effect size?
The likelihood that you will find an effect that does exist, given your sample size, is know as this.
What is statistical power?
A 2x2x2 design has this many experimental conditions.
What is 8?
This is a type of review article that adds additional analysis (for example, of effect sizes) across published results.
What is a meta-analysis?
Most ethical problems in research are caught by this group of people.
Who are grad students, lab members, or principal investigators?
Changing a hypothesis after the data have been collected in order to better align the hypothesis with significant effects in the data is known as this.
What is HARKing (Hypothesizing after results are known)
This is the phrase that refers to how an IV or DV is implemented in a given experiment.