Evaluation
Research
Kinds of studies
Stupid Things Molly Made Us Learn
Mixed Methods
100

what is evaluation?

“a systematic process by which the value, effectiveness, or significance is determined and can be applied to a range of processes, programs, policies, products, and personnel” (p. 1)

100

what is research?

“systematic investigation, including research development, testing, and evaluation, designed to develop or contribute to generalizable knowledge”

100

what is an efficiency study?

investigation of a practice under ideal settings

ex. lab with controlled environment

100

what was Oliver for Halloween this year?

EXIT sign

100
what is qualitative data?
  • Answers the why and how behind an action:


  • Qualities and characteristics
  • Nominal (country, gender race)
  • Ordinal (economic status)
  • Binary (positive or negative, up or down)
200

Evaluation Goal

  • “to judge merit or quality as determined by the interests of various stakeholders, such as funding agencies” (p. 1)
  • view the work that is being conducted with a different lens and a broader perspective than that of researchers
200

Research Goal

“to contribute to a body of knowledge and theory in. a field”

200

what is an effectiveness study?

investigation of whether a practice is effective

200

what is CITI?

  • Make sure people are trained and know the benefits, pros, ethics of working with human subjects
  • Dedicated to serving the training needs of college and university, healthcare institutions, tech and research to foster integrity and professional advancement of their learners
200

what is quantitative data?

  • Answers what and how many questions

  • Discrete – whole, concrete numbers
  • Continuous – complext numbers (height, weight, water temp, Likert scale)
300

what is program evaluation? What is assessment evaluation?

program: Program evaluation is a systematic method for collecting, analyzing, and using information to answer questions about projects, policies and programs, particularly about their effectiveness and efficiency

assessment: idk 

300

for research you need _____ from adults and ______ from children

consent, assent

300

dissemination studies 

investigation of whether an effective practice can be implemented at a large scale by practioner in real-world conditions

300

3 Key Principles of the Belmont Report

beneficence, respect of person, justice

300

quantitative pros

  • Data collection occurs quickly
  • Randomized samples
  • Reliable and repeatable info
  • Generalize findings
  • Anonymous
  • Perform the research remotely
  • Large sample
400

Barriers to Evaluation

  • Funding
  • Time and technical skills (diverting limited program resources for clients)
  • Concerned that evaluation activities will inhibit timely accessibility to services or compromise the safety of clients
  • Evaluation can necessitate alliances between historically separate community groups
400

What is one reason for the research - practice gap?

inadequate practioner training

poor fit between treatment requirements and existing structures

insufficient administrative support

practioner resistance to change

400

implementation studies

investigation of whether an effective practice can be implemented at a large scale by practioner in real-world conditions

400

what is a tech report and what is and isn't included?

def: short written brief about research study and results – clear, concise, used for business people and politicians

includes:

  • Subject
  • Purpose
  • Main point
  • Background info
  • Importance
  • Forecast organization of the proposal

Does not include:

  • Jargon
  • Numerical results
400

qualitative con

time consuming

500

what is an example of a program that could be evaluated? What is an example of an assessment that could be evaluated?

varies

500

Barriers to Research

funding

consent and assent

cultural barriers - need cultural expert

500
Name 2 features and 1 way you can mess up implementation science

features: capable of empowering practioners to implement an EBP, EBP components are clearly defined, Training methods that effectively teach practioners to implement the EBP with fidelity, Organizational support for implementation, Leadership throughout the organization

Misses: implementing ineffective practice, poor leadership in an organization, implementing harmful interventions, implementing unevaluated interventions


500

What do each of the Principles of the Belmont Report mean?


Beneficence - Does benefit outweigh the risk

 

Respect of person - Vulnerable populations for consent

Justice - Does every person have a fair shot at control and experimental group

500

qualitative pros

  • Affordable
  • Requires smaller sample size
  • Specific insight into development
  • Details of personal choice and use individual choices
M
e
n
u