Engage Stakeholders
Describe the Program
Focus the Evaluation Design
Gather Credible Evidence
Justify Conclusions & Ensure Use
100

This initial task focuses on gathering information about who stakeholders are and how they may be impacted by the project

What is stakeholder identification?

100

A visual roadmap of a program's inputs, activities, outputs, and outcomes

What is a logic model?

100

Broad, open-ended questions that establish the boundaries for the evaluation by stating what aspects of the program will be addressed

What are evaluation questions?

100

The persons, documents, or observations that provide information for the evaluation

What are data sources?

100

This Framework step involves analyzing the evidence, making claims about the program based on analysis and comparing the evidence against stakeholder values

What is justifying conclusions?

200

The specific persons who are in a position to do or decide something regarding the program

What are primary users?

200

The changes that result from the program’s activities and outputs, often in a sequence  expressed as short-term, intermediate, and long-term

What are outcomes?

200

A term for articulation of an evaluation’s intent that can help to prevent premature decision-making regarding how the evaluation should be conducted

What is evaluation purpose?

200

Measurable information used to determine if a program is implementing their program as expected and achieving their outcomes

What are indicators?

200

Actions to consider as a result of an evaluation

What are recommendations?

300

Essential to build among stakeholders to drive involvement and success of evaluations

What is trust?

300

The graphic symbols used to convey the inter-relationship of program activities and outcomes on a logic model

What are arrows?

300

A type of evaluation design that uses random assignment to compare the effect of a program on one group with an otherwise equivalent group that did not receive the program

What is experimental design?

300

Data collection procedures should also protect _____

What is confidentiality?

300

Communicating evaluation procedures or lessons learned to relevant audiences in a timely and consistent manner

What is dissemination?

400

Approach involving stakeholders, particularly the participants in a program or those affected by a given policy, in specific aspects of the evaluation process

What is participatory approach?

400

A term for the program's level of maturity (pilot/planning, early implementation, mature program); this should be considered when developing the logic model and focusing the evaluation design

What is a program's stage of development?

400

A type of evaluation that seeks to answer a variety of questions, such as the fidelity to an original design, quality of implementation, or general operating practices

What is process/implementation evaluation?

400

Use of multiple sources or methods to confirm the accuracy and reliability of the gathered evidence

What is triangulation?

400

Refers to the support users need after receiving evaluation results that can help prevent lessons learned from becoming lost or ignored in the process of decision-making

What is follow-up?

500

Technique that helps identify stakeholders and their level of influence on the project and its evaluation

What is stakeholder mapping/brainstorming?

500

This term is often used interchangeably with a logic model; it is a diagram or written description of the strategies, actions, conditions and resources that facilitate change and achieve outcomes

What is a theory of change?

500

A term for when the evaluation aims to determine the direct role of program activities in producing the outcomes of interest

What is causal attribution?

500

Verification of data from different sources/methods to enhance its reliability and accuracy

What is cross-validation?

500

Which three evaluation standards most directly apply to Step 6 of the framework?

What is utility, propriety, and accuracy?