Culturally Competent Evaluation
Assess your self-awareness. Engage stakeholders that reflect the diversity of the community. Lay clear ground rules. Create a diverse advisory team.
How to engage stakeholders?
This provides basic accountability. This provides evidence to show if the goals and objectives of the program were met.
What is performance monitoring evaluation?
This is any person or group who is interested in the program being evaluated or the results of the evaluation.
What is a stakeholder?
What? Who? and When?
What questions do Quantitative data collection methods answer?
assess cultural self-awareness, engage with diverse stakeholders of the community, lay ground rules, build trust, create a diverse advisory team
How to engage stakeholders?
fundamental to other forms of learning, cross-cutting, active and dynamic (hands on engagement and interactions), developmentally salient
What are the 4 FOLD skills theoretical criteria?
This is active and put together for the intended audience. It must have clear numerical data.
What is structure and style?
Clarify the stakeholders ideas of the program and what is known about the social and historical context of the program. Showcase community strengths and assets.
How to describe the program to be evaluated?
This is about the implementation of the program and is what the Parent Educator can easily have an effect on.
What is a process/formative evaluation?
The markers of progress toward the change you hope to make.
What are indicators?
Why? and How?
What questions do Qualitative methods of data collection answer?
give stakeholders' perspectives, acknowledge the historical and social context of the program, spotlight community strengths and assets
How to describe the program?
curiosity, creativity, self-regulation, executive function, critical thinking, perspective taking, internal representations of self
What are FOLD skills?
This is how the report of the program results will be used. The reporter should know this beforee putting the report together.
What is function?
Evaluation questions reflect the stakeholders' values and aspects of how culture might influence the evaluation have been considered.
How to focus the evaluation design?
This reflects the changes made in parents, children, and the community. It shows what was learned and the impact of the program.
What is an outcome/summative evaluation?
A systematic process of collecting and analyzing data and communicating what was learned honestly.
What is evaluative thinking?
surveys, tests and assessments
What are examples of Quantitative methods?
questions reflect stakeholders' concerns, think about how culture impacts the design of the evaluation and the collecting instruments, adapt the data collection procedures to the stakeholders being sure to represent multiple perspectives
How to focus the evaluation design and gather credible evidence?
Skills that are generally not included in measurement even though they are incredibly important to boader development
What are FOLD skills?
These items provide the key to how the report is structured. The audience should be chosen before the preparation of the report.
What is Scope and Audience?
Use multiple perspectives and factor in cultural and linguistic distinctions when deciding how to collect data.
How to gather credible evidence?
This is done during the planning phase of a program. It looks at the needs of the community and focuses on how to meet those needs with the program being designed.
What is a needs assessment?
Describes a program clearly and in detail to support understanding and evaluation. Identifies intended rsults and determines the resources, inputs, and activities required to achieve the intended results.
What is a logic model?
interviews, focus groups, observations, review of artifacts and documents
What are examples of Qualitative methods?
Analyze the data with stakeholders, interpret together what it means, make judgements and recommendations based on the collective interpretation of the data, keep in mind cultural influence and that a variety of voices are heard not just the most powerful
How to justify conclusion?
DRDP, GOLD, WSS, COR Advantage
What are KEP-Approved assessments for Early childhood based on the ECIPS?
This is the support data with graphics and pictorial displays. Do not get too techie or detailed.
What is the Content?
Be sure many diverse stakeholders' voices are heard and involved in the data analysis and the recommendations for change so that the changes are specific to the needs of the stakeholders.
How to justify conclusions and ensure the use of the evaluation?
Level 1-Preimplemention tier; Level 2-Accountability tier; Level 3-Program clarification tier; Level 4-Progress toward objectives tier; Level 5-Program impact tier
What is the 5 tiered approach to program evaluation that will help decide the evaluation used?
There should be 3-5 of these. They should answer who, what, when, why, and how. They should be responsive to funders and speak to the goals of the program like implementation, accountability, or achievement.
What are evaluation questions?
Who is the data collector, how can we engage traditionally excluded groups? Will there be anonymity? What is the level of confidentiality? Will you need consent?
What are some considerations when choosing what method(s) of data collection will be used?
An advisory committee consisting of diverse stakeholders makes recommendations, be sure the evaluation results are tailored to the stakeholders' needs, facilitate the use of the data gathered, check back in with the progress of the recommendations
How to ensure the use of the evaluation findings and share the lessons learned?
where it is done, what is assessed, how it is done, and who does it
What are the differences between authentic assessment and conventional assessment?
This is the best way to present the information and keep the audience attending.
What is format?