Association Claims
All about Statistical Validity
Name that Study Design!
Potential Experimental Problems
Interrogate that Claim!
100

associations that involve exactly 2 measures variables

What are bivariate correlations?

100

The strength of an association; indicates how important a study is by telling us how accurate the prediction is

What is effect size?

100

each participant is presented with all levels of the independent variables

What is within-groups/within-subjects design?

100

When different types of participants are systematically in different groups

What are selection effects?

100

To interrogate this validity, you would ask: "To whom or what can the causal claim generalize?"

What is external validity?

200
The graph used when one variable of the bivariate correlation is categorical

What is a bar graph?

200

Helps us determine how likely it is that the correlation in our study is due to chance

What is statistical significance?

200

participants are randomly assigned to at least 2 different groups and are tested on the key dependent variable twice: once before and once after exposure to the independent variable

What is pretest/posttest design?

200

When participants later responses are systematically affected by their earlier ones

What are order effects?

200

To interrogate this validity, you would ask, "how well are the variables measured and manipulated?"

What is construct validity?

300

The two most important validities to verify for association claims

What are construct and statistical?
300

Used to determine statistical significance

What is the p-value?

300

participants are exposed to all levels of the independent variable at roughly the same time, and a single preference is the dependent variable

What is concurrent measures design?

300

When another variable accidentally varies systematically along with the independent variable

What are design confounds?

300

To interrogate this validity, you would ask "Are there alternative explanations for the outcome?"

What is internal validity?

400

Used to compare means

What is a t-test?

400

Extreme scores that cause the association to seem greater or less than it truly is 

What are outliers?

400

participants are randomly assigned to different levels of the independent variables and testes on the dependent variable just once

What is post-test only design?

400

when an experimental treatment continues to affect a participant long after the treatment is administered

What are carry-over effects?

400

To interrogate this validity, you would ask, "how well do the data support the causal claim?"

What is statistical validity?

500

Evaluates the strength of an association as weak, moderate, or strong

What is Cohen's D?

500

When the full range of variables is not included in the study, making the association look weaker than it already is

What is restriction of range?

500

Used in experimental research in order for different experimental conditions to be observed while being able to control for individual difference by matching similar subjects or groups with each other.

What is matched groups design?

500

Participants' performance on the variable of interest may improve simply from repeating the activity rather than from any study manipulation imposed by the research

What are practice effects?

500

The validity most important to interrogate for causal claims.

What is internal validity?