SURVEY BASICS
WHAT'S WRONG WITH THIS QUESTION?
WHO'S IN YOUR SAMPLE?
SAMPLING & SURVEY SMARTS
SURVEY SMARTS
100

The overall method used to systematically collect self-report information from participants.

 What is a survey?

100

“My professor is knowledgeable and supportive.”
 

 What is a double-barreled question?

100

The entire group about whom a researcher ultimately wants to draw conclusions.
Answer: What is the target population?

 What is the target population?

100

A researcher places the names of all eligible students into a computer program and randomly selects 100 participants.

What is simple random sampling?

100

Before launching a survey to the full sample, a researcher gives it to a small group to identify confusing questions and technical problems.

Answer: What is pilot testing?

200

A collection of questions or items presented to participants as part of a research study.

 What is a questionnaire?

200

“Don't you agree that universities should provide better mental health services?”
Answer: What is a leading question?


 What is a leading question?

200

The individuals who actually participate in the research study.

 What is the sample?

200

A researcher selects every 10th name from a student roster after choosing a starting point.

What is systematic sampling?

200

Participants answer questions in ways they believe will make them look better or more socially acceptable.

What is social desirability bias?

300

A set of related items designed to measure a psychological construct such as anxiety, depression, or self-esteem.

 What is a scale?

300

“How often do you exercise?” The researcher never defines “exercise” or gives a timeframe.

 What is an ambiguous question?

300

A professor sends a survey only to students in her own classes because they are easy to reach.

 What is convenience sampling?

300

A researcher divides students into master's and doctoral groups and randomly samples from each group.

What is stratified sampling?

300

This refers to whether a psychological measure produces sufficiently consistent scores.

 What is reliability?

400

One statement rated from Strongly Disagree to Strongly Agree is technically called this.

 What is a Likert-type item?

400

“Why do graduate students fail to seek counseling when they need it?” This question assumes that counseling was needed and that students failed to obtain it.

What is a loaded or assumptive question?

400

A researcher studying trauma therapists intentionally recruits only licensed therapists with at least five years of trauma-treatment experience.

Answer: What is purposive sampling?

400

Participants report less illegal drug use when questioned face-to-face than when completing the same questions anonymously online. The administration method has produced this phenomenon.

Answer: What are mode effects?

400

This type of validity asks whether survey items adequately cover all important aspects of the construct being measured.

 What is content validity?

500

A researcher creates 10 questions about sadness and claims the questions measure the entire construct of depression. This type of validity should be a major concern.

 What is construct validity?

500

“I don't disagree that professors shouldn't avoid giving extensions.”

 What is a double negative?

500

People who choose to complete an online survey may be systematically different from people who see the invitation but decide not to participate.
Answer: What is self-selection or volunteer bias?

 What is self-selection or volunteer bias?

500

Clue: Before sending a newly developed survey to 500 participants, a researcher gives it to 15 people similar to the target population to identify confusing wording, technical problems, and completion time.

 What is pilot testing?

500

A researcher promises participants that their identities will be known to the research team but will not be disclosed to others. This is different from anonymity.

 What is confidentiality?

M
e
n
u