Reliability and Validity of Measures
Units of Analysis
Levels of measurement
Sources of Data in Program Evaluations
Surveys
100
A word or phrase that conveys the meaning of a constituents of the logic model
What is Constructs
100
The cases that are the main focus of an evaluation
What is Unit of Analysis
100
the most basic level of measurement, where the variable consists of two or more mutually exclusive categories
What is nominal
100
Agency records, governmental databases, client records are all examples of this type of data
What is existing
100
This is considered the principle means of collecting information in needs assesments
What is a survey
200
The procedures used to translate a contract into observable data
What is Measurement
200
The three principal levels of measurement
What is nominal, ordinal, and interval/ratio
200
a level of measurement where the variable is a set of categories that are ranked on some underlying dimension
What is ordinal
200
A set of connected causal relationships is alas known as
What is a causal chain
200
surveys that focus on people typically measure these type of constructs
What is mental
300
The extent to which a measurement instrument produces consistent results over repeated applications
What is Reliability
300
Statistical methods that are used for interval/ratio data
What is Parametric Statistics
300
A level of measurement where there is a unit of measurement, where the values of the variable are all equal intervals but there is no natural zero value in the scale
What is Interval level of measurement
300
This type of measurement uses measures of output to measure an outcome
What is proxy measurement
300
Questions asked in survey are also called
What is stimuli
400
The instrument that implements the procedures we use to translate a construct into observable data
What is Measurement instrument
400
A level of measurement where the values of the variable are all equal intervals and there is a natural zero value in the scale
What is Ratio measures
400
The most basic measurement procedure
What is classification
400
some consider this the most important starting point for data in program evaluations
What is the evaluator
400
This type of response bias can occur in surveys that focus on "undesirable" attitudes and behaviors
What is social desirability response bias
500
The extent to which a measuring instrument measures what it is intended to measure
What is Validity in Measurement
500
Statistical methods that allow for the simultaneous assessment of the influence of two or more independent variables on one or more dependent variables
What is Multivariate statistical analysis
500
"counting" type of measures
What is interval and ratio
500
This type of evaluative approached pioneered by Michael Quinn Patton, focuses on the utilization of evaluation results by stakeholders
What is a utilization focused evaluation
500
Bamberger, Rugh, Church, and Fort developed this approach to evaluation, where evaluators must make do with small budgets and short time frames
What is shoestring evaluation