Causal Inferencing
Research Design
Methodological Madness
Problems with Participants
Documentation & Planning
100

This terms refers to a study that correctly identifies a causal inference for its study population.

What is Validity (internal Validity)?

100

This research design is ideal for causal inferences.

Randomized Clinical Trial

100

This threat to internal validity occurs when the length of the study affects participant performance.

What is Maturation?

100

This threat to internal validity occurs when one study group stops trying because they think they're worse off than the other.

What is Resentful Demoralization?

100

This is a reason to document relating to the ability for others to see all steps you took in your analysis.

What is Scheduling?

200

This term refers to an experiment that correctly identifies a causal inference for those outside it's study population.

What is Generalizability (External Validity)?

200

This research design contains repeated observations of variables over time.

What is a Longitudinal Study?

200

This term refers to when some external event invalidates a study.

What is History?

200

This threat to internal validity occurs when one group tries harder to overcome their disadvantaged resources.

What is Compensatory Rivalry?

200

This is a reason to document relating to the ability for others to see all steps you took in your analysis.

What is Transparency?

300

This causal requirement states X and Y must be correlated for X to cause Y.

What is the Relationship requirement?

300

This research design consists of data from a single point in time.

What is cross sectional?

300

This phenomena occurs when a high performing group becomes closer to average over time.

What is Regression to the Mean?

300

This threat to internal validity occurs if the study participants are incentivized for the study to come to a certain conclusion.

What is Design Contamination?

300

This is a reason to document relating to the ability for others to recreate your analysis?

What is Reproducibility?

400

This requirement states X must come before Y for X to cause Y.

What is the Temporal Antecedence requirement?

400

This research design is used when there are two groups but they are NOT randomly divided.

What is a Natural Experiment?

400

This threat to internal validity occurs if the two comparison groups are too dissimilar to be compared.

What is Selection Bias?

400

This threat to internal validity occurs if participants perform better on the second test just because they looked up the answers after taking the first test.

What is Testing?

400

These are tools you can use to help with documentation (name one).

What are Microsoft Projects, Microsoft Teams, Trello, or Shared Folders?

500

This requirement states something else can't be responsible for causing Y to show X caused Y

What is the Lack of Alternative Explanation requirement?

500

This research design is used when there are two groups but they ARE randomly split by the researcher.

What is a Randomized Clinical Trial?

500

This threat to internal validity occurs when a survey changes too many times throughout the duration of the study period.

What is Instrumentation?

500

This threat to internal validity occurs if participants leave the study at differing rates throughout the duration of the experiment.

What is Survivorship Bias?

500

This is the act of evaluating how hard or easy a task is relative to how low or high of an impact it will have.

What is Prioritization?

M
e
n
u