Qualitative Designs
What are the 5 major types of qualitative designs.
1) Qualitative Design
2)Ethnographic Design
3)Phenomenological Design
4)Narrative Inquiry
5) Grounded Theory
What is an unique set of designs that can be qualitative or quantitative?
Case Studies
What is a dependent variable?
A variable of interest to you and the one that is commonly "measured" in a quantitative study.
What is contribution analysis
An alternative way to examine a program's influence on an anticipated outcome
When are mixed method designs useful?
When you want to evaluate both process and outcomes
What are Questions that explore a program's implementation or processes leading to anticipated or unanticipated outcomes?
Qualitative Study Designs
What makes the set of designs used in a case study unique?
Groups of people or a program(s) within certain types of situations, organizations, or communities, in other words "cases."
What is an independent variable?
Is the program, intervention, or policy you are implementing to influence a desired outcome.
What are the 5 steps in a contribution analysis that is listed in figure 5.5?
input, program activities, outputs, short-term outcomes, long-term outcomes
In table 5.2 what are the three major types of designs and what is the purpose and use for them?
Qual > quant --> use qualitative methods to design a subsequent quantitative study
QUAL + QUANT or QUANT + QUAL --> Perform qualitative and quantitative study simultaneously to acquire a detailed understanding of a phenomenon or process
Quant > qual --> Conduct a quantitative study and use qualitative methods to gain a deeper understanding of the data, participants, or program
In program evaluation, _____ approach is useful when you are trying to gain a rich understanding of the context in which a program is embedded.
What are the two multiple ways that a case study can be designed?
Single-case design
Multiple-case designs
What is Table 5.1 helping us understand/summarize
basic designs for quantitative studies commonly used in program evaluations.
What can internal and external factors influence
An evaluator's ability to draw generalizable conclusions from quantitative studies.
This level of complexity in evaluation studies forces us to do what?
Who will build relationships with participants and use rigorous data collection methods to gain a thorough understanding of participants' lived experiences?
Evaluator
When is a single-case design appropriate?
What is the summary of quantitative study designs used to determine?
The efficacy or effectiveness of programs
What are typical internal threats to validity?
Variations in how a program is implemented, characteristics of participants (such as previous knowledge or experiences related to the dependent variable or selection bias), or shared knowledge between an intervention and control group.
Systems thinking and developmental approaches are used to evaluate what?
The complexity associated with solving many of today's social issues and problems.
What theory is useful for understanding processes and relationships among multiple constructs or ideas?
When is multiple-case design typically used?
They are used to study how a phenomenon does or does not vary across contexts.
In box 5.1 there are 10 steps in designing a survey, what are they?
1) define the population you wish to study
2) determine a sampling frame
3) determine the questions you would like answered by the survey (these are not the survey items)
4) determine the number of surveys needed to draw any inferences about a population
5) design the survey
6) pilot the survey on a small sample
7) make necessary adjustments and deliver your survey to the larger sample
8) perform at least two follow-up requests to get survey completion/participation
9) analyze and interpret data
10) draw conclusions and make recommendations
What are the external factors that threaten the validity of a study's findings?
They are those that are external to the study and influence the dependent variable of interest.
A basic decision tree for selecting an evaluation study design.