Sampling
Reliability
Validity
Levels of Measurement
Stats
100

This is the entire group of interest targeted by a research study.

What is the population?

100

This is when a researcher administers the same measure to the sample participants on two occasions.

What is test-retest reliability?

100

This is how well an instrument measures what it is intended to measure.

What is validity?

100

This level of measurement  uses a ranking system based on some characteristic.

What is ordinal measurement?

100

This summarizes the average deviation of values from the mean.

What is the standard deviation?

200

These are sampling strategies in which researchers select elements by random methods.

What is probability sampling?

200

This is when a researcher has the same observers independently apply the measure to see if scores are consistent across raters.

What is interrater (or inter-observer) reliability?

200

This is the extent to which scores on a measure are a good reflection of the "gold standard".

What is criterion validity?

200

This is the lowest level of measurement.

What is nominal measurement?

200

This is when the peak of a frequency distribution is off center.

What is a skewed distribution?

300

This is a sampling strategy in which the researchers select every kth case from a list.

What is systematic sampling?

300

This is an assessment of consistency across items in a measure.

What is internal consistency?

300

This is whether "on the face of it" the instrument appears to be measuring the target construct.

What is face validity?

300

This level of measurement has a true zero.

What is ratio level of measurement?

300

A correlation coefficient of 1.0 is referred to as this.

A perfect correlation. 

400

This is the difference between population values and sample values (i.e., average age of a population versus a sample).

What is sampling error?

400

This is the consistency of a measure.

What is reliability?

400

This is the extent to which an instrument’s content adequately captures the construct.

What is content validity?

400

This level of measurement is used to measure IQ.

What is interval level data?

400

This tells you the magnitude of a relationship between two variables. 

What is an effect size?

500

This is an estimate of how large a sample should be to test a hypothesis.

What is a power analysis?

500

This is a reliability coefficient of 0.80 or greater.

What is high internal consistency reliability?

500

This is the degree to which an instrument is measuring the construct it purports to measure (usually done through hypothesis testing).

What is construct validity?

500

This is considered the highest level of measurement.

What is ratio level of measurement?

500

This type of error happens when a researcher rejects a null hypothesis that is true.

What is a type I error?