Data Vocabulary
Sampling Strategies
Studies vs. Experiments
Bias and Experimental Design
Statistical Potpourri
100

The entire group of individuals (people, animals, or things) that a researcher wants to obtain information about.

What is population?

100

A sampling method where every individual—and every possible group of individuals—has an equal chance of being chosen.

What is a Simple Random Sample (SRS)?

100

The key action distinguishing an experiment from an observational study.

What is deliberately imposing a treatment?

100

The type of statistical bias that occurs when certain groups in the population are systematically left out of the sampling process.

What is undercoverage bias?

100

An inactive or fake treatment, such as a sugar pill, given to a control group in medical experiments. 

What is a placebo?

200

The memory trick taught in class pairs samples with statistics, while populations are paired with these usually unknown numerical summaries.

What are parameters?

200

Selecting a random starting point and then choosing every k^{\text{th}} individual, such as pulling every 50th bag off a conveyor belt.

What is systematic sampling?

200

The major advantage of a well-designed experiment over an observational study regarding variable relationships.

What is proving cause and effect (causation)?

200

The pillar of experimental design that uses chance mechanisms (like pulling numbers from a hat or using an RNG) to assign subjects to groups.

What is randomization (or random assignment)?

200

Question wording such as "Do you agree with the mayor's selfish decision..." introduces this specific form of bias.

What is response bias?

300

In statistics, a bare number like 42 is meaningless without this crucial element that answers the "Who, What, Why, When, Where, and How".

What is context?

300

Dividing a population into homogeneous subgroups based on a shared characteristic (like grade level) and taking an SRS from every group.

What is stratified random sampling?

300

Hidden variables in observational studies that prevent researchers from proving causation because they influence the response.

What are confounding variables?

300

The type of bias created when a chosen individual refuses to participate or cannot be contacted.

What is nonresponse bias? 


300

The primary design principle violated when testing one group of runners on an indoor track and another group outdoors on a hilly trail.

What is control?

400

In a study where a principal surveys 150 students during lunch out of 2,000 total students, the group of 150 represents this.

What is the sample?

400

Dividing a population into heterogeneous "mini-populations," randomly selecting a few whole groups, and surveying everyone inside those chosen groups.

What is cluster sampling?

400

A study comparing toddlers who were breastfed versus formula-fed is classified as observational rather than an experiment for this primary reason.

What is the mothers chose the feeding method (the researcher did not impose/assign the treatment)?

400

The principle of experimental design that requires using enough experimental units in each group to distinguish real effects from chance variation. 

What is replication? 

400

Setting up a table outside a cafeteria or approaching shoppers near a mall bench are examples of this convenient, yet highly biased, sampling method.

What is convenience sampling?

500

If a quality control manager calculates an average lifespan of 9,850 hours from a tested group of 100 LED bulbs, this specific value of 9,850 hours is classified as this type of numerical summary.

What is a statistic?

500

Large-scale professional studies use this process, which combines multiple sampling methods across successive stages.

What is multistage sampling?

500

The main reason a researcher would choose an observational study over an experiment when investigating harmful behaviors like smoking.

What is ethical restrictions (or observing natural settings)?

500

The phenomenon where subjects alter their behavior simply because they know they are being actively watched by an observer.

What is the Hawthorne effect?


500

In an experiment measuring antacid dissolution times using Cold, Room Temperature, and Hot water, the three water conditions represent these.

What are the treatments?