Research Methods
ATRA Standards of Practice
Evaluation Methods
Assessment
Designing Projects
100

The process of using evaluation and/or research to improve something or add to body of knowledge

What is Systematic Inquiry

100

How many standards are there in the ATRA Standards of Practice

What is 12

100

What is the purpose of evaluation

What is: (any of the following)

To make decisions or to postpone decisions

●To improve services/programs

●To show value of services

●Determine accountability

●To assess/establish a baseline

●To comply with external standards

●Assess if reached goals or not

●Funding, Program/Staff Justification or Elimination

●Public Relations

100

Observations should be used as a form of assessments when the evaluator/research is interested in:

What is person's actual behavior

100

evaluation while a program is happening

What is formative evaluation

200

The various ways you can collect data

What are surveys, observations, interviews....
200

The three parts of each standard

What is structure, criteria, process

200

A representation of a total population is called

What is Sample

200

a measurement characteristic,  and asks, "does the measurement tool being used measure what it is supposed too?"

What is Validity

200

Confidentiality, Privacy, Coercion are examples of what in designing a research project

What is Ethical Issues

300

data that can be measured along a continuum

What is continuous data

300

The purpose of ATRA Standards of Practice

  • Provides a guide to achieve QUALITY outcomes valued by the patients/clients and other stakeholders

  • Is a BENCHMARK of a profession and has an ethical and legal basis

  • Guides and directs professional practice- assures quality consistency or practice

  • Protects consumer from potential harm

300
  • Invite people to DESCRIBE experiences in their own words

  • Used to describe what happens

  • Will show responses in the actual words of the individuals

  • Concerned at discovering new phenomenon or developing theory

  • Data collection emerges

What is qualitative data

300

a measurement characteristic, and asks, "how stable is the assessment over time?"

What is Reliability

300

In an experimental design, the variable being tested

What is the DEPENDENT variable

400

Explain when you should NOT evaluate something.  

you don't intend to make changes; You don't have power to make changes; 

400

Defines and measures the parameters of practice (ex- facilities and resources)

What is Structure Criteria

400
  • Measures something

  • Easiest to measure results of intervention/program

  • Converts words to numbers

  • Typically follows standard procedures of rigor related to instruments used

  • Provides set answers for individuals to choose from (yes/no, likert scale, etc.)

What is Quantitative Data

400

Inter-rater reliability is calculated for which type of assessment?

What is observation

400

Who, What, When, Where, Why, How, 

What are questions you should ask when planning a project.

500

A critical step in data analysis where you organize the variables used in a measurement instrument to collect data (i.e. questionnaire, survey, etc).

What is coding data

500

Defines and measures achievement or change in patient’s/client’s condition (Ex: improved functional level, health, etc.)

What is the Outcome Criteria

500

is a formal protocol that has specific rules that must be followed.  Documents patterns of behavior during specified period of time.

What is a behavioral observation

500
  • Systematic procedures for observing behavior or measuring attitudes that offer a limited range of answers, usually related to some kind of numbering system (Burlingame & Blaschko, 2010, p. 14)

  • Have an established procedure for selecting who is assessed, how it is given, how it is scored & interpreted

  • Has been tested for reliability/validity

What is a Standardized Test/Assessment

500

Inputs, Activities, People Involvement, Reactions, KASA Outcomes, Practice Change, End Results

What is the 7 levels of program results