Evaluation Types
Data Quality
All Things Designs
Samples
Evaluation Errors
100
Evaluation that occurs at a program's end.
What is Summative?
100
Caused by participants skipping a page, not responding to or being unable to answer the question
What is missing data?
100
Gathering data forward in time.
What is Prospective design?
100
Each person has a chance of being selected.
What is Probability, or Random?
100
When the process of participants in both a pre- and post-test alters the post-test data.
What is the testing effect?
200
Collect data about health problems of a specific group prior to a program design or implementation.
What is Community needs assessment
200
Occurs when an instrumental tool may be flawed
What is reliability
200
Extent to which the design is flawed.
What is Bias?
200
Members of rare subgroups within a popualtion that are not readily identifiable in commonly available lists.
What is "Hard-to-reach populations?"
200
When changes or alternation in data collection occurs between the pre- and post-test.
What is instrumentation?
300
Answes the question: "Did the program make a difference?"
What is Effect?
300
When a tool measures what it wants to measure.
What is validity?
300
How flaws affect the ability to generalize the findings to other populations.
What is External validity?
300
Selecting participants based on a specific characteristic which ir proportional to to the population at large.
What is Quota sample?
300
The loss of participants over time due to their dropping out of the evaluation.
What is attrition?
400
Compares previous outcomes of other programs relating to the same health problem to determine which program approach had the most effect
What is Meta-Evaluation
400
When responses, mood, knowledge, or physiological parameters change day to day.
What is data error related to participant reliability?
400
If flaws affect the ability to say an intervention made a difference?
What is Internal validity?
400
Asking current evaluation participants who have a specific characteristics to nominate others who have the same characteristic.
What is a Snowball sample?
400
When program participants differ significantly from those not in the program.
What is selection bias?
500
A type of formative evaluation that generates data at the beginning of program implementation to plan, revise, or improve program.
What is Process Evaluation?
500
What to do if missing data follows a systematic pattern:
What is review data analysis plan.
500
When participants receive the program prior to baseline data collection.
What is Retrospective design?
500
A sampling technique generally done in outcome assessments that allows for specific comparison of differences between program participants and non-participants.
What is a non-probability sample?
500
When evaluators wrongly assume that group characteristics apply to all individuals in the group.
What is ecologic fallacy?