Transparency
Required Evaluations
Potpourri
Impact Evaluations
PO or TO
100
What are the two stages in the conduct of an evaluation where there is a “presumption of openness” (i.e., we share information with others)
(1)When a design is agreed upon, and (2) when the evaluation report is completed
100
What are the two types of projects that are required to be evaluated?
(1) Large Projects (2) Pilot projects (aka, "innovative interventions" or "proofs of concept").
100
What are the typical annexes of an evaluation report?
1. Statement of Work 2. Full description of evaluation methods (if needed) 3. All evaluation tools (questionnaires, checklists, discussion guides, etc.) 4. List of sources of information (key informants, documents reviewed, etc.) 5. Statements of differences (if applicable) 6. Disclosures of conflict of interest.
100
How many impact evaluations are required to be completed per CDCS Development Objective?
None. CDCS policy requires missions to identify at least one impact evaluation opportunity per DO, but they are not required to complete one per DO.
100
Manages, in most cases, external evaluations
Program office
200
What is a "statement of differences" and who is allowed to write one?
A statement appended to the evaluation report regarding any significant unresolved differences of opinion on the part of funders, implementer, and/or members of the evaluation team.
200
For each of the two types of projects required to be evaluated, what are the types of evaluation that should be conducted?
1. For large projects: either performance or impact evaluation 2. For pilot projects: impact evaluation (if feasible, otherwise performance evaluation
200
True or False: "Performance" evaluations must evaluate the performance of the implementer.
False: Performance evaluations may address: - What a particular project or program has achieved; - How it is being implemented; - How it is perceived and valued; - Whether expected results are occurring; and - Other questions pertinent to program design, management, and operational decision-making.
200
Which level of result in a Results Framework is more likely to be an appropriate focus of an impact evaluation? (1) Development Objective level, or (2) IR level
(2) IR level
200
Typically initiates and leads the drafting of the evaluation SOW
Technical Office
300
What are the allowed reasons to not publicly release an evaluation report?
1. Disclosure of the findings would impair foreign assistance objectives 2. Disclosure would involve releasing proprietary information owned by third parties 3. Disclosure of information could put individual safety at risk or release private personal information
300
For evaluations that are conducted to meet the “large project” requirement, which of the following is true: 1. Each of the project's implementing mechanisms is required to be evaluated with a separate evaluation report. 2. Only a single evaluation report is required, but it must address the entire project and each of its implementing mechanisms. 3. Only a single evaluation report is required and it may address whatever evaluation question the mission wants to ask about the project or its constituent parts.
3. Only a single evaluation report is required and it may address whatever evaluation question the mission wants to ask about the project or its constituent parts.
300
Can USAID staff participate in an external evaluation and who is allowed to lead an "external evaluation"?
An evaluation team may be predominantly composed of USAID staff. However, evaluation teams for external evaluations will always be led by an independent expert outside USAID, with no fiduciary relationship with the implementing partner.
300
Which of the following are true: 1. Impact evaluations are any evaluation that address cause and effect questions. 2. Impact evaluations can include experimental or rigorous quasi-experimental designs. 3. Impact evaluations must include a randomized control group. 4. Impact evaluations should not include qualitative methods.
2. Impact evaluations can include experimental or rigorous quasi-experimental designs.
300
Organizes Peer reviews of evaluation SOWs and draft reports
Program office
M
e
n
u