Test Analysis Type
Reliability & Validity
Reading the Results
Vocab
Keep on Toes
100

Comparing a population mean + Standard Devation to a sample mean.

What is a z-test

100

Variables that unintentionally influence the outcome of a study.

What are Confounding Variables? 

100

t(29) = 3.12, p = .004, where the same participants were measured twice

What is a paired-samples t-test showed a statistically significant difference between mean A and mean B scores

100

The three different ways to describe
what is happening at the center of the dataset

What is central tendency 

100

A subset of the population you are interested in studying.

What is a sample

200

Comparing just the population mean to a sample mean. No population SD given. 

What is an one-sample t-test

200

Is the consistency of a measurement (ex: cluster of arrows hitting the same spot on a target)

What is reliability 

200

A result reported as r = −.46, p = .002

What is a statistically significant negative correlation? 

200

The amount of spread or compressed there is the dataset.

What is variability 

200

Definition of a hypothetical construct in which we tie the construct to a set of observable procedures. We do this both for our independent variables and our dependent variables

What is an Operational Definition 

300

Comparing two sample means together (between subjects)

What is an Independent t-test 

300

The extent to which a test measures what it claims to measure. 

(ex: accuracy, arrows hitting the center of the target)

What is validity 

300

t(58) = −2.41, p = .063 comparing two different groups

An independent-samples t-test revealed a non-statistically significant difference between the two groups.

300

The probability of finding a significant effect given that the null is false.

What is Power

300

A type of manipulation in which subjects are placed in one (or more) groups. One group receives one level of experimental manipulation, and the other receives another level of manipulation.

What is a between-subjects manipulation?

400

Comparing two sample means together (within subjects)

What is a Paired samples t-test

400

Correlated measurements from a sample of people who completed two different forms of the same test.

(ex: class of 26' taking the Major Fields Test. Half of the students take type A, and the others take type B)

What are Alternate Forms Reliability 

400

F(2, 57) = 6.88, p = .002

What is an ANOVA with a statistically significant difference among the three groups

400

The probability level used by researchers to indicate the cut off probability level (highest value) that allows them to reject the null hypothesis

What is the alpha level (ex: less than.05)

400

Subjects act as their own control. Researchers do not need to worry about their subjects differing on an extraneous variable between the experimental and the control conditions

What is a within-subject manipulation?

500

Used to compare 3 or more sample means together. (Hint: uses f-stat between/within) 

What is an ANOVA

500

The extent to which the results of a study can be generalized to a larger population, as well as to other situations 

What is external validity 

500

Look at the board!

What is the main effect for cog load/distraction type

500

When you reject the null hypothesis when there isn't an effect.

When you fail to reject the null hypothesis when there is an effect 

what is...

Type 1: False Pos

Type 2: False Neg

500

A standardized score of any normally distributed data set in which the mean of the scores is 0 and the standard deviation of the scores is 1

What is a z-score?