Day #1
What chapter of the ADS speaks to MEL at USAID?
What measures factors outside control of USAID that have potential to affect achievement of results?
Context Indicator
VIPRT
Name USAID's Evaluation Principles.
-Integrated into project/activity/strategy design.
-Unbiased
-Relevant
-Based on best methods
-Oriented to reinforce local ownership
-Transparent
Evaluation Purpose = __________________.
USE and USERS!
How does USAID operationalize adaptive management?
CLA
What MEL Plan is associated with the Intermediate Result (IR)-Level?
PMEL Plan
Pros:
High Representation
Convenient Data Gathering
Good Statistical Significance
Little or no Observer Subjectivity
Precise Results
Cons:
Inflexible Design
Not Ideal for Controversial Issues
Possible Inappropriateness of questions
Survey Fatigue
Lying
What type of questions do a Performance Evaluation answer?
Descriptive
Normative
Cause and Effect
Experimental
Quasi-Experimental
Portfolio Reviews
Mid-Course Stocktaking
"# of farmers trained" is what kind of indicator?
Output Indicator
Life cycle of the activity
Output vs. Outcome
Stakeholder Expectations
Historical data trends
Achievement of similar programs
Research findings
Assessments done
Seek opinion of experts
What are USAID's Evaluation Requirements?
1. 1 Evaluation Per Project
2. 1 Impact Evaluation per pilot, if feasible
3. 1 Whole-of-Project Evaluation per CDCS
What type of Evaluation at USAID uses a Non-Experimental Design?
Performance Evaluation
What measures progress towards expected outputs and outcomes of strategies, projects or activities?
Performance Indicator
What are USAID's Characteristics of Good Indicators
Objective
Practical
Useful for Management Decisions
Direct
Attributable to USAID
Timely
Adequate
When is a DQA required?
Indicator is reported externally
Every 3 years or within 12 months if indicator is new
Evaluability Assessment
What is required to procure an external evaluation at USAID?
SOW
What are USAID's Program Cycle Principles?
1. Use Evidence Based Decision Making
2. Learn and Manage Adaptively
3. Ensure Local Ownership
4. Use a Range of Approaches
"Description," "Plan for Data Collection," "Targets and Baseline," and "Data Quality Issues" are key sections of what USAID document?
PIRS
Comparing indicator data up and down the result chain is called _______.
Vertical Comparison
What is an Impact Evaluation?
Rigorously defined counterfactual
Summary Info
Background
Evaluation ?s
Design & Methodology
Team
Schedule/Logistics
Budget