Validity or Reliability?
Keeping a consistent testing environment is an example of ____________ in assessment.
what is "reliability"
Which of the following would be considered the BEST synonym for the term "reliability" in assessment?
a. consistency
b. trustworthiness
c. accuracy
d. dependability
what is "consistency"
Which of the following would be considered the BEST synonym for the term "validity" in assessment?
a. consistency
b. trustworthiness
c. accuracy
d. dependability
what is "accuracy"
How well a new quality of life measure correlates with an existing quality of life measure?
construct validity
Ensuring that a rubric for a formal assessment is assessing based on skills that were actually practiced and discussed through informal assessments is an example of _______________ in assessment.
what is "validity"
What is the term used to describe the method in which teachers decide to provide the students with the same assessment a second time around?
what is "test-retest reliability"
For a test to have good psychometric qualities, should reliability or validity be tested first?
Reliability
A patient who is functioning at a high level on a measurement scale shows little improvement on a follow-up test. This is an example of
the ceiling effect
Scenario: All 7th grade ELA teachers are using the same rubric to grade a narrative essay assessment. When the teachers get together, after grading and providing feedback, their evaluations and results should be similar.
Is this an example of reliability or validity in assessment?
what is "reliability"
A math teacher provides different versions of the same test to his students.
What type of reliability is the focus of this scenario?
what is "alternate-form reliability"
Minimal detectable difference
MDC or MDD
In a sample of 20 infants, birthweights are measured. The 95% CI for this distribution is 6.2 to 7.4. What does this mean?
We are 95% confident that the population mean for birthweight is between 6.2 and 7.4 lbs
A science teacher provides knowledge questions at the end of each week, based on the week's learned content.
She is concerned with tracking the ____________ of the assessments.
reliability
A teacher provides students with a reflection assignment, after they complete a project. The students are asked to provide feedback on the assignment.
What part of reliability is the teacher interested in, in this scenario?
What is "internal consistency reliability evidence"
The error that occurs consistently during measurement always results in an overestimate of score
Systematic error
Type II error
a type II error is committed when we do not reject the null hypothesis when it is false
An English teacher wants to move beyond true/false and multiple choice questions on assessments. Instead, she is going to measure students based on the critical thinking skills that they have been practicing all unit and that she has been encouraging from her students.
The teacher is mainly focused on the ________ of this assessment.
validity
What type of reliability is this?
what is "inter-rater reliability"
Teachers would like to compare test results to those of a school who has different demographics and in a different area of the county. What type of validity is being exercised here?
The more serious type of error to consider when planning studies
Type I