Process Evaluation
This is the basic function of a Process Evaluation.
What is Map the actual Process that takes place in detail.
When clients in a local government community building program leave with a positive change in their attitudes towards their neighborhoods and increased participation in community events, it is an example of this.
What are program outcomes or benefits?
This type of evaluation takes place in the early years of a program.
What is a formative evaluation?
This type of theory drives the evaluation process.
What is the theory of change?
What evaluators used to use when we need to quickly and easily get lots of information from people in a non-threatening way.
What are questionnaires or surveys?
Process evaluation is a useful tool when you have questions about this
What is efficiency or accuracy of service delivery?
This type of analysis is related to program evaluation, but tends to focus on overall outcomes in monetary terms.
What is cost-benefit analysis?
These are a few things that you should ask yourself prior to starting a program evaluation
What is the goal?
Who are the stakeholders?
What do they want to know?
What is the background context?
How many/much resources do I have to work with?
In an evaluation of a program to promote social bonds, a group of clients who showed up early at an AA meeting were all given a questionnaire on the program's ability to make it easier to make friends. Others who showed up late didn't have time to complete the questionnaire. This is an example of this kind of program evaluation methodological problem.
What is selection bias?
The data collection methods you would use when you want to fully understand someone's impressions or experiences or learn more about their short answers to questionnaires.
What are interviews?
In a Process Evaluation, you would start with examining this
What is the program design or plan?
When you are tired and bummed out and have a ton of work to do: Pasta or Pizza?
Pasta
Before a program is started, one might want to take this step in order to be sure that any change you ultimately see is valid and reliable.
What is conduct a pre-test?
These usually large organizations often require independent, rigorous evaluation methodology in order to understand if their investment in programs have been worth it.
What are Non-profits, foundations, charities.
When you view the operations of a program step by step as it is running, often as part of a process evaluation.
What is observation?
Best dance song ever (hint its a fall month and before you all were born....)
What is September by Earth Wind and Fire in 1978?
An increase in the use of protective gear by farm workers in order to avoid injuries is this particular type of change/outcome.
What is a behavioral outcomes?
Measurements are used in evaluation designs at different times of the program. Measurement done after the completion of the program is a __________
What is a posttest?
This level of government rarely does evaluation
What is local, and often state government...
When you want to explore a topic in depth through a small group discussion, especially when you want to understand how people react to each others' opinions.
What are focus groups?
Process evaluations are focused on the fidelity of following the first part of a _______ model or program plan.
Logic
In program evaluations, outcomes are often described in these three ways.
What are short-term, medium term, and long term?
This type of design offers the greatest control over the various factors that may influence the results by using random assignment to experimental and control groups with measurement of both.
What is experimental design?
These are some of the principles of the American Evaluation Association
Professionalism
Use of Data
Focus on Value of Data to the program
Competence
Honesty
This is a key step in designing an evaluation if you intend to focus and report on personal information about customers and clients.
What is obtaining informed consent?