Scenarios
The directors of a food bank which typically serves local families have begun to notice an increase in the number of calls inquiring about food product/household items for their families. They decide to begin a community study to evaluate whether this problem truly exists. What type of study are they planning to conduct?
Needs Assessment
This helps to see if a program is needed and a potential solution for the need
Needs Assessment
What types of change are there?
1. Knowledge, 2. Feeling, Awareness, Attitudes, 3. Behavior
Analytical procedure that determines the COSTS of the program and COMPARES it to MONETARY VALUE of the OUTCOMES achieved; an exact dollar amount is determined to produce an outcome
Cost Benefit Analysis
Client satisfaction survey results, client intake forms, financial statements
Process Evaluation
The child study team at an elementary school within district has been conducting individualized educational program meetings as part of their interventions to help give children the proper accommodations in the classroom. They believe they are effective in reducing the number of complications for children in the classroom but have no systematic evidence. They decide to conduct a study to evaluate the effectiveness of IEP meetings to reduce the number of complications in the classroom. What type of study are they planning to conduct?
Outcomes Evaluation
Formative/process evaluation
Defines or specifies a program's objectives so that the measurement of each objective is possible
Operationalization
What are the different types of ways need can be defined by different perspectives?
Normative, Felt, Expressed, Relative
Public forums, focus groups, surveys, key informants
Needs Assessments
The funder for a community-based agency that provides referrals to resources in the community wants to know whether the program is using the money they provide effectively and whether the value of the outcomes is greater than the money they used to create/run the program. What type of study would need to be conducted to get this type of information?
Cost-Benefit Analysis
Is it worth it?
Cost-Efficiency
Weigh the outcomes against the costs and determine if the costs are justifiable; is it worth continuing with the program?
Cost-Efficiency
What information should one have before conducting a cost-benefit ratio of a program?
monetary values of benefits, indirect costs, direct costs, discount rate/present value benefit
Pre-post evaluations, follow-up data
Outcomes Evaluation
An agency began a shelter for homeless residents who were living in the community but lacked housing. They are being asked by stakeholders/funders to show how much it costs to house and then find adequate housing for a homeless individual after one year. What type of study do they need to conduct to get this type of information?
Cost-Effectiveness
Does the program work?
Outcome evaluation
What are the two types of Cost-Efficiency Analysis
Cost-Benefit & Cost-Effectiveness
What are the four types of need (perspectives)?
Normative, Felt, Expressed,Relative
direct costs, indirect costs, monetary value of benefits
Outcome Evaluation
An intensive outpatient program (IOP) that promotes itself as providing Dialectical Behavioral Therapy (DBT) has recently had huge staff turnover and is concerned that the therapists may not all be providing the desired manualized DBT treatment. They want to assess the how each therapist is adhering to the manual of the treatment program. What type of study do they need to conduct to get this information.
Process Evaluation
What does SMART mean?
Specific, measurable, achievable, realistic and timebound
Analytical procedure that assesses the COSTS of the program in RELATION to its OUTCOMES
Cost Effectiveness