Program Evalution
Process Evaluation
Outcome Evaluation
Strengths and Weaknesses of Program Evaluation
Practical Considerations and Common Problems
100
What is program evaluation?
A research design and analysis that evaluates specific characteristics of a program within an agency.
100
What is process evaluation?
Process evaluation is a research design and analysis that evaluates specific characteristics of a program within an agency.
100
What measures the overall effectiveness of a program: “Did the program accomplish what it set out to do?”
What is an Outcome Evaluation
100
Name one strength of the program evaluation
flexible, simple to conduct
100
Should an evaluator be clear about which program they are evaluating? Why or why not?
Yes, it is very important because many inexperienced evaluators get bogged down in the process by not being clear about what they are evaluating. One common example is when someone attempts to evaluate an entire agency. Rather, it is encouraged to select one program or service within an agency to focus on.
200
What are the two types of program evaluation?
Process and Outcome Evaluations
200
What are the three main goals of process evaluation?
A process evaluation (an internal audit) has three main goals: to construct a program description, to provide program monitoring, and to assess the quality of services being provided.
200
Who requests/conducts an outcome evaluation?
A regulatory or grant-funding system outside the agency (e.g., a grantor)
200
Name two potential problems of program evaluations
timing, inapplicable questions
200
What is the role of an objective auditor (or evaluator)?
Measure and report ALL findings.
300
What is a process question?
How is the program operating?
300
What is quality assurance?
Quality assurance is a means of determining the level of satisfaction of both services for consumers and programmatic issues for staff.
300
What does the MOST standard stand for?
Measurable, Observable, Specific, Timelined
300
How were questions selected for CHOICE program evaluation?
Focus group
300
What is the first thing you should consider for evaluations?
The program you are evaluating
400
What is a result-focused question?
Is the program accomplishing its intended results?
400
What is program description and program monitoring?
Program description is simply an attempt to delineate the setup, routines, and consumer characteristics of a program. Program monitoring is used to examine what happens after people receive services from a program, e.g. tracking utilization of services over time and the effect of services on individual functioning.
400
What does a specific objective state?
What outcome is expected for how many consumers
400
What is an unbiased examination of program objectives?
an unbiased assessment measures if the stated objectives were achieved
400
What is not included in this role of an objective auditor (or evaluator)?
Do not speculate as to why objectives were met or not, or what recommendations should be unless the administrator requests.
M
e
n
u