Ch. 12 Implementation
Ch. 13 Evaluation Approaches
Ch. 14 Evaluation Designs
Ch. 15 Data Analysis and Reporting
Zini and Paige Articles
100
1) How can program planners reduce their liability? 2) What is the difference between confidentiality and anonymity? How does the HIPAA rule apply?
What is 1) be aware of liabilities, select certified instructors, good judgement, inform participants, medical clearance 2) confidentiality= planners aware of identity and won't reveal anonymity= no one can relate info to identity HIPAA= sets national standards for protection of identity/misuse of health information
100
1) When would it be more appropriate to use an external evaluator over an internal evaluator?
What is 1) objective review, insure unbiased review and need new perspective
100
1) What are the fundamental differences between formative and process evaluation?
What is formative= occurs before start, helps ensure program elements developed, justification, evidence, capacity and resources process= looks back and sees what went well and what went poorly, fidelity, dose, recruitment, response
100
1) What are some guidelines for presenting data in an evaluation report? How might the report be enhanced?
What is Guidelines: use graphic methods of presenting numerical data, built the results/discussion section of evaluation, make each table/figure self explanatory, consider providing both tables/graphs for same data, give some instruction on how to read graphs enhanced: give key stakeholders advance info or the findings, maintain anonymity, use sensitivity to avoid judging, and choose ways to report the eval findings as to meet the needs of diverse stakeholders
100
The Purpose and Methods of the Paige article are
What is present overview of Kaiser Permanente Community Funds and provide lessons by using methods of a research funded project to look at sustainable development and social determinants of health
200
1) What are the primary ethical considerations for health educators and what are the fundamental principles that underpin these philosophies? 2) What is negligence? What is the difference between an act of omission and an act of commission?
What is 1)respect for persons (dignity/autonomy), beneficence (max benefits w/ minimizing harm), justice (fair treatment) *Belmont report: ethical principles and guidelines for the protection of human subject research 2) Failing to act in a reasonable manner, omission= not doing something when you should, commission= doing something you should not be doing
200
1) How can feedback from an evaluation used in program planning?
What is 1) can provide baseline data, can improve new and existing programs, can ensure results will be less bias, and provide answers to many questions
200
1) What is the difference between cost-benefit and cost-effectiveness analysis? Which is more appropriate for use in health promotion programs?
What is 1) cost benefit= looks at how resources can best be used cost effectiveness= quantifies the effects of a program in monetary terms *cost effective more appropriate for HPP b/c $ value does not have to be placed on outcomes of program
200
1) What is the difference between statistical significance and program significance?
What is 1) stats= refers to whether the observed diff b/n 2 or more groups are real or not program= measures the meaningfulness of a program regardless of stat significance
200
The graphs and significant findings for Paige include
What is a logic model, social determinants of health and grant goals for graphs and collaboration with grantees and people outside of cohort, strong relationships with target communities, relationship between grantees and NWHF and organizations philosophy and social determinants of health
300
1) What are the types of financial audits conducted? 2) In Human Resources, the PADS acronym stands for what?
What is 1) external (conducted by qualified independent accountant usually once a year) and internal (frequent/ongoing conducted by employee of the organization not responsible for accounting practices) 2) Planning (define), Acquisition (hire), Development (train), and Sanction (discipline, rewards, safety)
300
1) What different types of information could an evaluation provide for the various stakeholders?
What is 1) if health conditions are met, if a program is effective, accountability, additional funding, support, scientific base
300
1) How do experimental, quasi-experimental, and nonexperimental design differ? When might one be used over the other?
What is 1) a) experimental= offers greatest control over confounding variables, involves random assignment to experimental and control groups w/ measurement of both, produces most interpretable b) quasi-experimental= no random assignment, results in interpretable/supportive evidence, comparisons made on experimental and comparison groups c) non experimental= w/o use of comparison or control group, little control over factors that affect validity
300
1)How are bivariate and multivariate data analyses used in evaluation? 2)Explain the concepts of hypothesis testing, level of significance, Type I error, and Type II error.
What is 1) used to study more than one variable simultaneously and look at strength/direction/relationship of results *t-test (Bi) multiple regression (multi) 2)hypothesis testing= common way to state evaluation questions, null= not observed diff b/n two groups, alternative= no diff b/n groups *p less than or equal to 0.05 (TRUE DIFFERENCE) Type 1- most problematic, alpha, failing to reject when null hypothesis is true type 2- failing to reject when the null hypothesis is not true (beta)
300
The purpose and methods of Zini include
What is assess changes due to educational intervention program in dental care, gingival health, plaque levels and behavioral changes by methods, 30 minute presentation, gathered sociodemographic/economic data and dental cleaning examination
400
1)Name and briefly describe the five phases of implementation presented. 2)Briefly, describe how each of the 5 planning timetables can be used. 3)What are the three major categories of resources that need to be managed during implementation?
What is 1) adoption of program (ensure relevant product), identify/prioritize tasks (timetable), establish system of management (assemble/use resources), putting plans into action (pilot testing/phasing in), and ending or sustaining a program (how long to run a program) 2) basic timeline (put key activities in order), task development (specific times, can use 2 years), Gantt chart (shows planned time frame/when completed), PERT (uses detailed explanation), critical path method (similar to PERT, provides graphs) 3) technical, financial, human
400
1) Give an example of a question that could be answered in a process evaluation, impact evaluation, and outcome evaluation. 2) What are some of the more common problems associate with or barriers to effective evaluations?
What is 1) process= what key components of an intervention are effective? impact= what are the intended outcomes of the program? outcome= what is the ultimate goal or product of the program? 2) Problems: fairness to build evaluation, inadequate resources, restrictions that limit data collection, intervention strategies
400
1) Review the Figure 14.3 Evaluation Designs; what are some considerations in the selection of an evaluation design presented in this chapter?
What is considerations include how much time do you have, financial resources, how many participants included in evaluation, in what ways can validity be increased, do you have access to a comparison group?
400
1)What is the difference between descriptive statistics and inferential statistics? 2)What are some types of univariate data analyses used in evaluation? When would these be used?
What is 1) descriptive= used to organize, summarize and describe characteristics of a group, inferential= concerned w/ relationships and causality to make generalizations about a pop. based on findings 2) univariate (one variable at a time) summary counts, measures of central tendency, used to determine whether scores from groups are similar or spread apart
400
Graphs and statistically significant findings from Zini include
What is demographic/socioeconomic data, baseline and six months dental examination, and findings of originally 8.7 to 6.7 teeth missing, 78% demonstrated good oral habits but improvement in good habits for maintaining oral hygiene and decrease in accumulation of biofilm and severe chronic periodontitis
500
1)What are logic models? Why are they used? What are the major components of logic models? 2)What is meant by the term implementation? 3)What is pilot testing and what is the purpose of conducting one?
What is 1) visual way to present/share understanding of relationships, why- communicate purpose, describe actions, reference point, components- inputs , outputs, outcomes 2) converting plans/goals/objectives into action through structures of new programs 3) tryout during program development using small group, allows planners to work out any bugs before program is offered and validates work
500
1) What are two basic purposes of program evaluation? 2) What are the two broad categories of evaluation and how do they relate to the two purposes of program evaluation?
What is 1) improve program implementation, to inform policy decisions 2) formative= quality assessment/program improvement, begins when programs are developed (quality) summative= determining effectiveness, informs policy makers of decisions
500
1) What are internal and external validity and what are common threats to it?
What is a) internal= degree to which changed measured applies to the program, threats include maturation, testing and mortality b) external= the extent to which the results of a study can be generalized/extended to others, threats include people, places and time
500
1)What are some common problems with evaluations, and how can these problems be reduced or overcome? 2)What is meant by the term “data management?”
What is 1) inadequate documentation of methods, results and data analysis, reduction includes evaluation should be well designed, contain complete background/description of program, thorough explanation, and discussion 2) organization of collected data so it can be analyzed and interpreted, must code, clean and organize using a usuable format
500
Zini was focused on this issue while Paige was focused on this problem
What is oral hygiene among elderly living in community and rest homes for Zini while Paige was health initiative in the NWHF and successful components of program planning
M
e
n
u