The Basics
Definition of program evaluation.
Systematic method for collecting, analyzing, and using information to answer questions about projects, policies and programs, particularly about their effectiveness and efficiency.
Definition of CBPR.
Research conducted by and for those most directly affected by the issue, condition, situation, or intervention being studied or evaluated.
Term characterizing an evaluation when it is carried out by a third-party (consulting firm, university researcher/faculty, etc.).
External Evaluation
Considered the father of modern epidemiology.
John Snow
You’ve got to hand it to this tropical tree.
Palm
This evaluation type helps us understand cost and to find ways to reduce program costs.
Economic Evaluation
Communicates the procedures or lessons learned from the evaluation to relevant audiences in a timely, unbiased, and consistent fashion.
Dissemination Plan
This includes the surrounding condition of an organization and/or program and its community, including geography, history, politics, culture, and social environment.
The Context of the Evaluation
In medical diagnosis, the proportion of patients with disease who test positive for the condition.
Sensitivity (a.k.a. true positive)
Where would you find the Sea of Tranquility?
The Moon
Measures program effect in the target population by assessing the progress in the outcomes or outcome objectives that the program is to achieve.
Outcome Evaluation
The 4 standards used in a good evaluation
Utility, Feasibility, Accuracy, and Propriety
This involved mutual respect and some understanding and acceptance of how others see the world, which is crucial to the functioning of evaluators. Needed by an evaluator.
Cultural Sensitivity
The Hawthorne Effect
The alteration of behavior by the subjects of a study due to their awareness of being observed
Which word goes before cheese, beans and quartet?
String
This type of evaluation is best when you need information that will be difficult for anyone outside the community or population to get.
Participatory Evaluation
The difference between process indicators and outcome indicators.
Process Indicators => Activity and Output Items, Quantity of trainings provided to staff (hand-washing tutorial).
Outcome Indicators => Outcomes (results) Quantified behavior change targeted by training (number of hand washers).
Establishing and respecting this concept, which limits access or places restrictions on certain types of information is not only good for ethical, practical, and legal reasons, but also helps to gather better data.
Confidentiality
Construct referring to the belief that an important person or group of people will or will not approve and support a particular behavior.
Subjective Norms
Now an iconic American instrument, it originated from West Africa as a “banjar” that was made from a hollowed-out gourd, a few horsehair strings, an animal skin and a stick.
The Banjo
Evaluation ensuring that a program or program activity is feasible, appropriate, and acceptable before it is fully implemented.
Formative Evaluation
List three people that should be involved in CBPR.
--People most affected by the issue or intervention under study.
--Other members of the affected population.
--Decision-makers.
--Academics with an interest in the issue or intervention in question.
--Health, human service, and public agency staff and volunteers.
--Community members at large.
Term given to evaluations whose disadvantages include less experienced individuals carrying out the evaluation and perhaps risking a perception of bias.
Internal Evaluation
This, as it so happens, makes the poison.
The Dose
Who makes it, has no need of it.
Who buys it, has no use for it.
Who uses it can neither see nor feel it.
What is it?
A Coffin