Formative Eval
What is the main purpose of formative evaluation?
To improve a program before full implementation by providing feedback on design, feasibility, and readiness.
Name one reason stakeholders should be engaged in evaluation.
They increase relevance, buy-in, and use of evaluation findings.
What is the purpose of a Theory of Change (TOC)?
To clarify how and why a program is expected to work by mapping activities to outcomes and impacts.
What is the purpose of process evaluation?
To assess how a program is being implemented, ensure it is delivered as intended, and provide context for interpreting outcomes.
What are two reasons it is crucial to evaluate public health programs?
Accountability and transparency; evidence-based decision-making (others: continuous improvement, resource allocation, policy development, equity, knowledge generation).
Name one type of information collected during a formative evaluation.
Needs of the target population, program context, resources, feasibility, or implementation processes.
What is a challenge of engaging stakeholders in evaluation?
Conflicting interests, power imbalances, or lack of time/commitment.
Name one type of outcome included in a TOC.
Cognitive, behavior, health, environment
What are the components of Reach in process evaluation as discussed in this class?
Recruitment
Refusal
Attrition
Distinguish between the positivist and constructivist approaches to evaluation.
Answer: Positivist = scientific method, objectivity, quantification, causal inference.
Constructivist = acknowledges subjectivity, complexity, multiple perspectives.
What is the role of an evaluability assessment in formative evaluation?
To determine whether a program is ready for evaluation, clarify goals and logic, and assess feasibility.
How does stakeholder involvement influence evaluation questions?
Stakeholders help ensure evaluation questions are relevant, practical, and aligned with real program needs.
Why is it important to assess assumptions in a TOC?
Because assumptions explain the conditions necessary for change; if they are wrong, the TOC may not hold true.
Give an example of a process evaluation indicator for Dose Delivered - with denominator.
Example: Number of educational sessions delivered ÷ number of sessions planned.
Internal vs. external evaluators: name one advantage and one limitation of each.
Internal = better knowledge of context and trust, but less objectivity/conflict of interest.
External = more expertise and objectivity, but costly and less connection with program/community.
Give one benefit of conducting a formative evaluation before program implementation.
Helps identify strengths and weaknesses early, ensures resources are used effectively, and increases the likelihood of program success.
Distinguish between the conventional and participatory approach to stakeholder engagement.
Conventional = evaluator-led, stakeholders mainly provide information.
Participatory = collaborative, stakeholders actively shape questions, methods, and interpretation.
What considerations should be made when setting the timing of outcomes in a TOC?
Consider how quickly change can realistically occur, the resources available, and external/contextual factors that may influence timing.
What is the difference between Fidelity and Satisfaction
Fidelity = the extent to which the program was implemented as designed.
Satisfaction = participants’ perceptions of the quality or value of the program.
According to the 2011 USAID Evaluation Policy, what was one major improvement made to strengthen global health evaluations?
Required systematic, high-quality evaluations; integrated monitoring & evaluation into all program stages; emphasized transparency, learning, and accountability.
True/False – Formative evaluation results are primarily used to judge program effectiveness.
False — formative evaluation is for program improvement, not to judge overall program effectiveness.
Provide an example of a stakeholder role and explain why it is important in evaluation.
Example: Program staff — provide knowledge about implementation, which ensures the evaluation reflects reality and produces actionable findings.
This outcome is vague:
"By the end of the program, participants will improve their physical activity.”
Reformulate it into a SMART outcome (Specific, Measurable, Achievable, Relevant, and Time-bound).
A SMART version might be:
“By the end of the program, 70% of participants will report engaging in at least 150 minutes of moderate physical activity per week, as measured by weekly activity logs.”
Formulate a numerator and denominator for an indicator of Dose Received for nutritional workshops
Example for Dose Received (nutritional workshops):
Numerator = number of participants who attended the two cooking sessions.
Denominator = total number of participants expected to attend the two cooking sessions.
What is one principle of participatory evaluation?
Evaluators and stakeholders share decision-making, build ownership of results, and address power and bias in evaluation