Experimental Design I
Literature searching
Human subjects & ethics
Replicability
Experimental Design II (vocabulary)
100

In this type of experiment, all participants see all conditions

What is a within-subjects design?

100

This phrase has been used in the textbook and in class to describe the process of searching through the literature by reading the references of a paper you find, then reading the references of that paper, and so on. 

What is "treeing"? 

100

This is the principle that respects individuals, and which dictates that subjects should be informed of the risks and benefits of an experiment before they participate.

What is informed consent?

100

This was the subject of the paper that sparked a new wave of attention on methods and replicability of results.

What is ESP? (or predicting the future)

100

This is a variable that is present in an experiment, related to an independent variable, and not measured or considered, such that it could be mistaken for a dependent variable.

What is a confound?

200

In within-subjects designs, these effects emerge if the sequence in which participants experience the independent variable(s) affect the values of the dependent variable(s).

What are order effects? 

200

This is the name for the search engine you can use through the UNR library to find PDF copies of articles.

What is OneSearch?

200

This was an infamous study that did not allow participants access to the cure for their disease, conducted in Tennessee for years after the cure for the disease was known.

What is the Tuskeegee syphilis study?

200

This is one solution that has been proposed to help with the replicability crisis, in which scientists describe their planned experiments before they carry them out.

What is pre-registration?

200

This results when subjects all score near the maximum possible on some metric (e.g. a test or survey), and makes it difficult to differentiate between conditions based on the test or survey.

What is a ceiling effect?

300

"Mortality" (or subjects dropping out of an experiment before it is complete) is a threat to what kind of validity? 

What is internal validity?

300

This is a measure used by Google that quantifies how many publications that a researcher has with more than a certain number of citations.

What is an H index?
300

This is the name for the group of people who review experimental protocols to make sure they are in line with ethical guidelines.

What is the Institutional Review Board?

300

The process of running analysis after analysis on the same dataset until some result comes back with p < 0.05 is referred to as this. 

What is "p-hacking" (or "data-dredging")
300

This is the name for the variable that is manipulated in an experiment

What is the Independent Variable?

400

This is the best kind of experimental design to use to study interactions between multiple variables.

What is a factorial design?

400

These are two of the top (most impactful) multi-disciplinary journals in all of science.

What are Nature and Science?

400

This is the name for the document generated in the 1970s that laid out principles for ethical conduct of human subjects research.

What is the Belmont report?

400

This is the approximate fraction of results in psychology journals that appear to replicate well

What is 40-50%?

400

This results when subjects all score near the bottom or minimum on a test or survey.

What is a floor effect?
500

A 2x2x2 design has this many experimental conditions.

What is 8?

500

This is a type of review article that adds additional analysis (for example, of effect sizes) across published results.

What is a meta-analysis?

500

This is the name of the most notorious data fabricator in recent history in psychology.

Who is Dierdrick Stapel?

500

This is the name for wholesale making-up of data.

What is fabrication?

500

This is the phrase that refers to how an IV or DV is implemented in a given experiment.

What is an operational definition?