Kirkpatrick
Data
Survey Best Practices
Learning Objectives
Grab Bag
100

The 4 Levels in Kirkpatrick's Evaluation Model.

What are Reaction, Learning, Behavior, Results?

100
The 2 types of Data that can be collected.
What is Quantitative and Qualitative?
100

This is the part of the survey where demographic questions should go.

What is the end?

100

Using Learning Objectives can help measure this Evaluation Level.

What is Level 2?

100

This is the group you start with when evaluating a course.

What are the stakeholders?

200
The level to which all courses should be evaluated.
What is level 1 and 2?
200
This is an example of a tool that can collect Quantitative Data at Level 2.
What is (quiz, assessment, rubric, checklist, etc.)
200

This is recommended number of answer choices for multiple choice questions.

What is 5?

200

The 3 parts of a Learning Objective.

What are performance, criteria, condition?

200

This is one reason why it is important to evaluate your training.

What is (improve training, demonstrate value to stakeholders, support evidence-based decisions, or maximize organizational results.

300
The amount of time you should wait in-between measuring level 2 and level 3.
What is 3-6 months?
300
This is an example of a tool that can collect Qualitative Data at Level 3.
What is (focus groups, interviews, qualitative questions on surveys, email follow-up, job observations, etc.)
300
Open or Closed, this is the type of question that is easier to analyze.
What is closed?
300

The criteria of a learning objective answers this question.

What is 'How Well'?

300
The FSI/SPAS Curriculum Standards are based on the ADDIE model, ADDIE stands for this.
What is Analysis, Development, Design, Implementation, Evaluation?
400
The phrase used to describe the sequence of information gathering from level 1 to level 4.
What is the Chain of Evidence?
400
The process of developing answers to questions through the examination and interpretation of data.
What is Data Analysis?
400

This is one (of many) things you should leave out of survey questions to ensure simple language.

What is (jargon, double negatives, contractions, or 2 part questions)?

400

This is the part of speech used to define the performance in a learning objective.

What is an action verb?

400
This is what ROE stands for.
What is Return on Expectations?
500
The new term added to Level 4 of the New World Kirkpatrick Level.
What is Learning Indicators?
500
This is a tool that can help you analyze data.
What is Excel, SPSS, NVivo, R Project, Tableau
500

This is the term used to describe a question that influences the participant's answer through the wording.

What is biased?

500
"Correctly" or "with 100% accuracy" are words that might be used to describe this part of a learning objective.
What is criteria?
500
We can show that training contributes to success, we cannot show that training__________ success.
What is causes?
M
e
n
u