Applied PM&E Review Game

Day #1

100

What chapter of the ADS speaks to MEL at USAID?

Chapter 201

200

How does USAID operationalize adaptive management?

CLA

300

Name 2 institutionalized mechanisms USAID uses for adaptation.

Portfolio Reviews
Mid-Course Stocktaking

400

What measures progress towards expected outputs and outcomes of strategies, projects or activities?

Performance Indicator

500

What are USAID's Program Cycle Principles?

1. Use Evidence Based Decision Making

2. Learn and Manage Adaptively

3. Ensure Local Ownership

4. Use a Range of Approaches

Day #2

100

What measures factors outside control of USAID that have potential to affect achievement of results?

Context Indicator

200

What MEL Plan is associated with the Intermediate Result (IR)-Level?

PMEL Plan

300

"# of farmers trained" is what kind of indicator?

Output Indicator

400

What are USAID's Characteristics of Good Indicators

Objective
Practical
Useful for Management Decisions
Direct
Attributable to USAID
Timely
Adequate

500

"Description," "Plan for Data Collection," "Targets and Baseline," and "Data Quality Issues" are key sections of what USAID document?

PIRS

Day #2

100

What are USAID's Data Quality Standards?

VIPRT

200

Identify 2 Pros and 2 Cons of using a survey as a data collection instrument.

Pros:
High Representation
Convenient Data Gathering
Good Statistical Significance
Little or no Observer Subjectivity
Precise Results

Cons:
Inflexible Design
Not Ideal for Controversial Issues
Possible Inappropriateness of questions
Survey Fatigue
Lying

300

Name 4 things you should consider when selecting targets for your indicator.

Life cycle of the activity
Output vs. Outcome
Stakeholder Expectations
Historical data trends
Achievement of similar programs
Research findings
Assessments done
Seek opinion of experts

400

When is a DQA required?

Indicator is reported externally

Every 3 years or within 12 months if indicator is new

500

Comparing indicator data up and down the result chain is called _______.

Vertical Comparison

Day #2

100

Name USAID's Evaluation Principles.

-Integrated into project/activity/strategy design.
-Unbiased
-Relevant
-Based on best methods
-Oriented to reinforce local ownership
-Transparent

200

What type of questions do a Performance Evaluation answer? 

Descriptive
Normative
Cause and Effect

300

What are USAID's Evaluation Requirements?

1. 1 Evaluation Per Project
2. 1 Impact Evaluation per pilot, if feasible
3. 1 Whole-of-Project Evaluation per CDCS

400

What can be conducted to determine the extent to which a project or activity is ready for an evaluation?

Evaluability Assessment

500

What is an Impact Evaluation?

Rigorously defined counterfactual

Day #3/ Day #4

100

Evaluation Purpose = __________________.

USE and USERS!

200

What type of designs would you use for an Impact Evaluation?

Experimental
Quasi-Experimental

300

What type of Evaluation at USAID uses a Non-Experimental Design?

Performance Evaluation

400

What is required to procure an external evaluation at USAID?  

SOW

500

What are the 8 key components of an Evaluation SOW?

Purpose

Summary Info
Background
Evaluation ?s
Design & Methodology
Team
Schedule/Logistics
Budget