Show:
Definitions
Evaluation Design Framework
Tools and Techniques for Strengthening the Basic Evaluation Design
Experimental and Quasi-Experimental Designs
Evaluation Purpose and Context
100
Selecting a sample from a statistical population where there is an equal chance of being assigned to the intervention group or to the comparison group.
What is random sampling?
100
The design options available have become limited.
What is the result of a late start to the evaluation?
100
This model defines the cause-effect relationships through which a program is intended to achieve its objectives, and tests some of the critical assumptions on which the success of the program depend.
What is the program theory model?
100
Another name for true randomized experimental designs (3 words).
What are randomized control trials (RCTs)?
100
Finding out if the program complies with its own goals.
What is the purpose of an evaluation?
200
An ongoing evaluation of a program with the help of managers and program planners.
What is a formative evaluation?
200
A drawback to using secondary survey data, because important info about the characteristics of the project beneficiaries will be missing.
What is the omitted variable problem (or the issue of unobservables)?
200
Examples of this type of data are previous surveys, project documents, school attendance records, use of health care centres.
What is secondary data?
200
An example of this type of validity is how generalizable the results of the anti-bullying workshop presented to Grade 9 students at one high school in Richmond Hill is to a high school in Regent Park.
What is external validity?
200
Internal evaluator and external consultants.
Who conducts the evaluation?
300
Quantitative, Qualitative, Mixed Methods
What are the three evaluation methods?
300
This option is used when the evaluators of the anti-bullying workshop presented only to 73 Grade 9 students, give these same 73 students and 58 Grade 12 students at the same high school a survey before the workshop takes place.
What is Option A?
300
The professional association representing Child and Youth Care Practitioners in Ontario.
What is the OACYC?
300
An example of this type of validity is ensuring that outcomes on social skills building are due to the anti-bullying workshop presented to Grade 9 students at a high school in Regent Park and not due to another variable, like a new community centre built across the street from the high school.
What is internal validity?
300
Examples are United Way; Ontario Ministry of Community and Social Services; Covenant House; homeless youth.
Who are clients (or stakeholders)?
400
The overall assessment of the merit, worth and significance of a program.
What is a summative evaluation?
400
Sunday December 6th at 11:59pm.
When is the Evaluation Plan 2 due?
400
Examples of this design type include analyzing the quality of outpatient services for adolescents with bipolar disorder at Sunnybrook, or understanding the cultural characteristics of Chinese-Canadian youth accessing mental health services at the Shoniker Clinic in Scarborough.
What are quasi-experimental designs?
400
20% of our grade in this course.
What is attendance/participation (or group presentations) worth?
400
The type of data received from a self-report questionnaire that 73 Grade 9 students completed before attending the anti-bullying workshop.
What is baseline data (or pretest)?
500
Leslie Yaffa
Who is our professor?
500
A control group is used to see what would happen to a population if they did not participate in the program or receive its services.
What is a statistical counterfactual?
500
Independent estimates obtained from a single data collection method can be strengthened if they can be independently confirmed from two or more independent sources.
What is triangulation?
500
In a quasi-experimental design, this potential problem arises when the comparison group is selected separately from the project group.
What is selection bias?
500
Examples of these data types include, Statistics Canada; the National Longitudinal Survey of Children and Youth; results from a CAMH study on substance use and wellness.
What is secondary data?