The degree to which evidence and theory support the interpretations of test scores by the proposed users.
What is validity?
100
To determine whether one type of lesson works better than another, we use this type of research methodology.
What is experimental design?
100
(Calculate)
Mean Treatment group = 40
Mean of Control = 30
Standard deviation for both groups is 10. Give the effect size and tell whether it's a small, medium, or large effect.
1 large
100
Evaluating learned material in a new situation.
What is transfer?
100
Tests that include both retention and transfer items.
What is multilevel posttest?
200
When each test is scored the same way, regardless of scorer.
What is objectivity?
200
The correct way to assign participants to a control group or experimental group in a true experimental design.
What is random assignment?
200
The process of computing average effect size over many experimental comparisons.
What is meta-analysis?
200
A student learns to multiple double-digit numbers (e.g., 34x26), and you give a test asking them to solve the following: 293 x 34.
What is near transfer?
200
Questions asking descriptive details about participants (e.g., age, gender).
What are demographic characteristics?
300
Consistency of test scores
What is reliability?
300
True/false: The following is a good example of a randomized controlled experiment:
Half the students in my master's class were randomly assigned to complete an online module before coming to class. The other half did the readings and wrote reflections on them. At the end of the semester, the mean scores of the two groups on a comprehensive final exam were compared.
True
300
The treatment and control groups differ on an important variable. Plus--what is the solution for this?
What is confounding variable?
Solution: Statistically control for the confounding variable.
300
Learning fragmented knowledge that is retained in the short term for good performance on a retention test.
What is rote learning?
300
When the effects of an instructional method depend upon the characteristics of the learner. (Bonus--give an example from your organization.)
What is an aptitude treatment interaction?
400
Students take a test at one time and then take it at a later time, and the two scores are highly correlated.
What is test-retest reliability?
400
This type of research design allows for multiple variables to be studied as possible effects on the treatment outcome.
What is a factorial experiment?
400
Concluding that there is an effect when there is not.
What is Type I error?
400
When a student learns something deeply, integrating it with his/her prior knowledge, and is able to do well on tests of both retention and transfer.
What is meaningful learning?
400
Some instructional methods are more effective for low-knowledge learners than for high-knowledge learners. (Bonus--give an example from your organization.)
What is the expertise reversal effect?
500
A score that shows how you stand in relation to others who took the test.
What is a norm-referenced score?
500
A measure of the strength of a treatment effect.
What is effect size?
500
There are not enough learners in each experimental group, so the treatment shows no effect.
What is inadequate sample size?
500
Interviewing learners after a test gives this kind of data.
What is qualitative data?
500
Measuring the wrong variable, using the wrong instrument, or overtesting.