Stats -Test 3-Part 2- Survey research -d.n.

Types of Questions

100

• _________ =  questions on a questionnaire may apply to only some respondents and not others.
• - whether a person answers it depends on—is contingent on—his or her answer to the filter question.

contingency question 

200

_________= is one whose answer determines which question the respondent goes to next.

filter question 

300

_______ = elicit subjective data: What happened today? How did your family cope after moving to Los Angeles?

open-ended question

400

________ = e.g. It asks about both the "number" and the "fairness," and a person might feel differently about each.

double barreled question

- we would want to split this into 2 parts

500

Who is the best cohort ever?

Class of 2020, 3 Year Program

Types of Interviews

100

_____ are verbally administered questions

Interviews

200

____type of interview is:

•Least structure

•Interview guidelines include topics of interest without formal (verbatim) questions

•Interviewer skilled in forming high quality questions and prompting follow-ups

•Gather information regarding the respondent’s living conditions, family, employment, schooling, socioeconomic status, attitudes toward smoking, leisure activities, vacation preferences, stress management, health status

Un-Standardized interview

300

____ Type of Interview

•Similar to Non-scheduled standardized except the interviewer asks the questions in order (no skipping around)

•Considering the regimented implementation, trained paraprofessionals can administer this form of surveys

• less cost, higher sample size, more uniformity, more reliability

Scheduled Standardized Interview

400

_____________ interview = less structure than schedule- standardized but more than standardized

• Specific questions provided
• Interviewer can prompt for further details
• Interview has random access privileges – upon completing current question, may ask the next question or skip directly to a question that the conversation has drifted to (ultimately, ask all questions)
• Requires moderately skillful interviewer

Nonscheduled-standardized interview

500

Double-barreled- Problems with Types of Questions

• double barreled question = e.g. It asks about both the "number" and the "fairness," and a person might feel differently about each.

Surveys

100

This is a method for asking questions to gather information on a population (board or selective sample)

--> The interviewer asks questions in-person or phone

•Experimental / quasi-experimental

•Conducive to a wide array of questions (e.g., facts, attitudes, opinions)

•Single or multidimensional (one or several dependent variables: attitude, honesty, mood)

SURVEY --> An interviewer asks questions in-person or phone

200

1. Why would an open-ended question would be appropriate for a survey? What are the advantages?

1. An open-ended question would be good when, you are looking for subjective data, e.g. "What happened today?", "How did your family cope after moving to Los Angeles?"

Open-Ended Advantages:

•Highly detailed

•Can provide critical insights

•Responses can span beyond the question(s) asked

300

2. Why wouldn't an open-ended question would be appropriate for a survey? what are the disadvantages?

2. We wouldn't want to use open-ended questions if we are looking for objective data, e.g •Age:  31    •Handedness:Left /Right; Close-ended questions elicit objective data

Open-Ended Disadvantages:

•Time consuming to answer and analyze

•Smaller sample size (potentially less generalization; lower external validity)

•Risks in-completion

•Costly

•Complex analysis

•Longer, more verbose write-up

400

• Problems with Surveys in General

• Surveys produce about a 2% – 20% response rate
• Interviews (more labor intensive) produce about a 90% response rate

500

1.Are you currently enrolled as a student?  ¨Yes    ¨No (if NO skip to #4)

2.How many units are you enrolled in? _____

3.What degree are you currently working toward?  ¨Bachelor’s    ¨Master’s

4.What is your opinion of the campus WIFI service?

    ¨Unsatisfactory    ¨Satisfactory    ¨Excellent    ¨N/A

•Questions 2 and 3 are ____questions.

Contingency questions- 

•Preserves time, patience, precision, filter questions

Wild Card

100

This is Self-administered pencil & paper (in-person / mail), email, internet

Questionnaire

200

Can close-ended questions lead to a more  comprehensive responses?

YES! Close-ended (quantitative) / Open-ended (qualitative) questions can paradoxically, close-ended questions can elicit more comprehensive responses;  checkbox labels can cue recall, compared to a blank (open-ended) text prompt.

• What types of movies do you enjoy? __________________________________
•  What types of movies do you enjoy? (check all that apply)

300

These issues relate to what?

Responses limited to the information that s/he remembers:

• Who are your instructors this semester?
• What was your 8th grade English teacher
• Responses limited to information that s/he is willing to disclose (social desirability):
• Have you ever been to the Acme store?
• Have you ever stolen anything from the Acme store?
• Responses vulnerable to (un)intentional errors / omissions:
• Did you take aspirin today?
• How many times have you taken aspirin in the last year?

Surveys

400

Advantages of Interviews

Interview Advantages

•Assess respondent’s comprehension of question

•Clarify questions

•Prompt / probe for further (qualitative) details

•Less missing data

•Set a viable (unrushed) tempo

•Control the sequence of questions / avoid previewing questions

•Validate identify of respondent

•Control environment / less distractions

•Conducive to less structured forms of inquiry (e.g., Unstandardized, Non-scheduled standardized)

•Include responses and may record observational cues of overall behavior or reaction(s) to various questions: •Body language, •Facial expression(s), •Voice tone, •Attitude, •Hesitation(s) / tempo

500

Interview Disadvantages

•Time consuming

•Costly

•Lower sample size (compromises external validity)

•Interviewer bias

•Interviewer variability (within and between interviewers); can impact responses

•If in-person, limits geographical diversity

Wild Card

100

• This is Self-administered pencil & paper (in-person / mail), email, internet
• Can be administered in-person (e.g., clipboard, postal mail, internet)
• Question may be quantitative, qualitative, or mixed (both)
• Identity of respondent may include name or ID code
• Administration style may be confidential or anonymous

Questionnaire 

200

Questionnaire Disadvantages

-Require literacy

-Require mailing address (difficult to include homeless / transients)

-No opportunity to clarify ambiguous instructions, questions, response options

-Miss nonverbal / physical cues

-Cannot verify that the intended person responded to the survey

-Cannot account for (distracting) environment while responding

-Respondent may browse the (entire) questionnaire at any point

-Typically, unable to gather data on non-response questions; less of a problem with computer administered surveys

300

Questionnaire Advantages

• More economical than interviews
• Prompter than interviews (parallel vs. serial)
• Geographically diverse sample (can enhance external validity)
• If administered anonymously, can facilitate more truthful disclosures especially on sensitive topics
• Neutralizes potential interview bias / reactivity

400

Telephone Survey Advantages

Telephone Survey Advantages

•More economical than in-person surveys

•Prompter than in-person surveys

•Easier supervision compared to deploying staff to conduct interviews remotely

500

Telephone Survey Disadvantages

- Less economical than mail or online surveys

•Slower than online surveys

•May require multilingual interviewers (á costs)

•Must be brief (< 20 minutes)

•Requires simplified instructions

•No visual cues

•Phone bias (not everyone has a phone)

•â answer & call return rates (unfamiliar caller ID, telemarketers, scams, etc.)