ISD & QI
Explain how the quality phrase "integrate quality in all phases" is similar to evaluation in the ISD Model.
Evaluation is an ongoing process that continually checks the product's quality. This is present in each phase of the process and within each of the other functions.
What are the two different types of lesson objectives?
Level of Learning Lesson Objectives (Cognitive, Affective) and Criterion-Referenced Objectives (Psychomotor)
What are the two major types of operational evaluation?
Internal and External
Name all the phases in the Air Force ISD Model.
Analysis, Design, Development and Implementation
In which phase do we determine if our students really need our course?
Analysis
Why is a customer focus necessary in the ISD process?
The gaining unit/work center can help us understand what is needed for the student to do the job. Courseware developers should consult with the work center to determine instructional requirements and to get feedback on how successful the instruction was.
NOTE: Sometimes the customer may not know what they need and it is our job as educators to figure that out and provide it.
Explain what Internal Evaluations are.
Internal evaluation is internal to the organization. It is designed to measure and give feedback on the effectiveness and quality of the instructional process. It begins with the implementation of the instruction and continues until the instruction is taken offline. It consists of items such as test scores, student critiques, instructor comments, and management monitoring of the delivery.
What type of evaluation are you performing if you send a supervisor a survey asking how the course helped their workers perform their jobs?
External evaluation
Name all the functions in the Air Force ISD Model
Management, support, administration, delivery and evaluation
In which phase do you start writing test items?
Design
Quality requires you to know your mission. How will knowing your mission aid in the ISD process?
One must know what the mission is before they can collect data on the mission. The collected data is the basis for your subsequent design, development, and implementation. The mission and job analysis data will guide your ISD efforts.
Explain what external evaluations are.
External evaluation takes place after the instruction is complete. The data in this evaluation comes from the field. It provides feedback on how well the instruction enabled the students to perform the jobs or tasks. It may be gathered by questionnaires, telephone interviews, field visit observations, etc.
RISKY WAGER: Why is evaluation depicted as the hub of the ISD Model?
Evaluation is an ongoing function of the ISD process. It takes place in all phases and is a part of each of the other functions. It occurs throughout the life cycle of the lesson.
What is the "hub" of the Air Force ISD Model?
Evaluation
This is the phase where we start to teach the course under real-world situations.
Implementation
Quality managers and ISD developers must manage by fact. How is this term applicable to the ISD process?
To design and develop a curriculum, one must use the facts gathered in the analysis phase. These facts will guide one's efforts. Also, one should not change courseware once it is online unless the facts support that change.
RISKY WAGER: Name the three parts of a Criterion Referenced Objective.
Performance, Condition, Standard
How can we tell if our instruction has been successful?
Students should be able to perform the lesson objective(s)
RISKY WAGER: The outer most ring around the model represents "constraints". What does this mean?
All processes operate within constraints. These may include money, facilities, number of instructors available, time, and equipment. One must consider each of these when using the ISD model.
RISKY WAGER: As a supervisor, you may monitor one of your instructors to determine if they are following the lesson plan. What phase of ISD are you in?
Implementation
RISKY WAGER: Why is teamwork a requirement during the ISD process?
An instructional program can not be designed and developed in a vacuum. The design team must be in constant touch with the work center and evaluation offices to ensure the training matches the performance requirements of the job.
Why do you write your test questions during the design phase?
We write test items at this point to ensure we measure what the student is supposed to be able to do. If we wait until after the instruction, we tend to only test the things that were taught. If you forgot or didn't have time to cover certain areas, you will most likely not include them in your test if you write it after the fact.
Explain the relationship between validation and evaluation?
Validation is a subset of evaluation. It is a chance to determine if the lesson is doing what is supposed to do prior to implementation. One receives feedback through individual and small group tryouts during the analysis, design, and development phases and operational tryouts as the last step of the development phase.
What are the three categories of learning that people usually need to perform a job?
Affective (feeling), Cognitive (thinking), and Psychomotor (doing)
This is the phase where we do a final validation of our instruction
Development