Program Monitoring and the Development of a Monitoring System
Constructive Outcome Evaluation
The Experimentation Evaluation Approach to Outcome Evaluation
Holistic and Theory Driven Approach
100
Assess programmatic problems quickly and provide remedial strategies
What is constructive process evaluation?
100
Periodic collection of info
Stats on implementation and outcomes
Doesn’t provide in depth info
Not intended to replace process monitoring
What is program monitoring?
100
format assessment to determine whether a program has a desirable effect on its stated goal or outcome
What is conclusive outcome evaluation?
100
extent to which a study can provide accurate information about whether an intervention has produced observed effects on outcomes.
What is internal validity?
100
assesses the effect that an intervention has when conditions are ideal.
Rigorous methods, controlling independent variables
What is efficacy evaluation?
200
Concern for accountability among internal and external stakeholders and assesses how well program has been implemented
What is Conclusive process evaluation?
200
The scope of data collection is narrow.
The depth of data collection is shallow - basic information gathered
What is process monitoring?
200
Improve program outcomes
What is Constructive outcome evaluation
200
The worst type of evaluation design
What is one-group posttest only
200
assesses intervention effects in the real world.
What is effectiveness evaluation?
300
helpful when program has numerous goals and activities
What is concept mapping?
300
the periodic collection of information about the outcomes of a program.
What is outcome monitoring?
300
Specific, measurable, attainable, relevant, time restricted
What is Smart goals?
300
whether or not the evaluation results can be generalized to other contexts.
What is external validity?
300
“factors used by stakeholders to enable an intervention to work, or enhance its effectiveness in the real world.”
What is adjuvants
400
determine if intervention implemented in fields is the same as the original program plan intended
What is intervention fidelity evaluation?
400
To show progress, communicate with people interested in the program, or for internal management task-
What is outcome monitoring?
400
Are you looking forward to Christmas break?
Yes No (Type of evaluation?)
What is simple?
400
design is characterized by multiple observations before and after an intervention.
O1 O2 O3 O4 O5 X O6 O7 O8 O9 O10
What is interrupted time series design?
400
Causal mechanisms
Implementation process when assessing the effect of a program.
What is Theory-driven outcome evaluation?
500
Theory driven process that assess how the major components of the program are being implemented in the field
What is hybrid process?
500
Combines the strengths of both process(gathering of data client’s receive) and outcome monitoring (gather outcomes) approaches into a single data collection, storage, management, analysis and reporting system.
What is program monitoring system?
500
Determine whether a rigorous evaluation is warranted for a program
What is evaluability assessment?
500
design adds a non-randomized comparison group to the one-group pretest-posttest design.
What is non-equivalent comparison group
500
Provide stakeholders with an understanding of whether a program is reaching its goals
Document how and why a program succeeds or fails