Evaluation/Evaluand re: the scenario 1 "The Coordination Project"
Organizational Culture
Stake Holder Culture
100
This is the major ethical concern raised in "Scenario 1 (Coordination Project)"
What is Validity
100
The subject/focus of an evaluation, typically a program or system rather than a person.
What is the Evaluand
100
The associate director argues that these are the people that have "Lived with this project most intimately"
Who are the staff of participating programs and agencies.
100
This includes values, beliefs, history, and traditions that shape the local context of professional practice
What is Organizational Culture
100
The diversity dimensions of race, ethnicity, gender, religion, and social class addressed in THIS principle are relevant to both providers and consumers in this scenario.
What is the Competence Principle
200
Operationalization that is too narrow, omitting important dimensions
What is Construct Underrepresentation
200
The extent to which an assessment accurately measures what it is intended to measure.
What is validity
200
The associate director frames the evaluation as "working relationships among agencies involved" and argues this should only involve staff contribution. However, examining THIS reveals multiple constituencies are impacted
What is the LOGIC behind the service coordination
200
Understanding these is a prerequisite to valid inference and judgement concerning the coordination project.
What organizational variables
200
This principle is explicit in addressing evaluators responsibility to understand and respect differences among all program participants, which includes evaluation participants and program participants
What is The Respect for People Principle
300
The "Coordination Project" scenario is fundamentally about this due to the associate directors request to omit consumer perspective and culture from the evaluation.
What is construct underrepresentaion
300
In research design this is a process of defining the measurement of a phenomenon that is not directly measurable, though its existence is indicated by other phenomena.
What is operationalization
300
What are the attitudes of staff members towards one another? towards consumers? Does the staff share the associate directors contempt for consumers? How is power distributed among agencies? Is there differential turnover in administration and staff across agencies? These questions are examples this.
What organizational variables
300
Providers race, economic back ground, professional training and experience are all pieces of THIS
What is Stake Holder Culture
400
failures of omission
What is construct underrepresentation
400
the degree to which a test measures what it claims, or purports, to be measuring." This is one of three main types of validity evidence, alongside content validity and criterion validity.
What is Construct Validity
400
An evaluation that omits THIS may itself exert harm by reinforcing the powerlessness of the neglected and abused youth.
What is Consumer Perspective
400
What are the attitudes of staff members towards one another? towards consumers? What is the history of stability vs. restructuring among the agencies? How is power distributed among agencies? Is there differential turnover in administration and staff across agencies? These questions are markers of and help the evaluator to learn this.
What is organizational culture
400
family composition, sexual orientation, age, disability, financial support and financial exploitation are all are important components of these.
diversity variables
500
This is a great example which shows how ethics and validity are related. This illustrates well how ethical and methodological issues intertwine.
What is "The Coordination Project" Scenario.
500
A guiding principle for evaluators. States that "Evaluators respect the security, dignity, and self-worth of respondents, program participants, clients, and other evaluation stakeholders.
What is the "Respect for People" principle
500
There is no way to exclude consumer input from social service program, especially child protective services, because of an evaluators commitment to this principle
What is the principle of Responsibilities for General and Public Welfare.
500
Understanding THIS sets the context for understanding working relationships among the agencies involved.
What is Organizational Culture
500
THIS reveals potential evaluation questions regarding helping the consumer and that are essential to valid inference and judgement concerning the coordination project.