Measurement Error and Reliability
The difference between the true value of a variable versus what is measured.
What is measurement error?
The decision that a tool is accurately measuring a construct or question. For example, math tests, physical fitness test, pilot test.
What is face validity?
The sampling that relies on complete randomization and requires a sampling frame.
The type of threat to internal validity when a researcher is testing for 12-weeks the effect of creatine on performance, but creatine produces stomach upset in the participant during the 10th week.
What is history or maturation effect?
The measure of central tendency that gives you the average of scores.
The consistent error in measurement of the concept/outcome.
What is systematic error?
The extent/level to which a measurement tool captures all aspects of the construct being tested/measured. For example, NFL or NBA combine, Medical Board Exam.
What is content validity?
The type of sampling in which you obtain a list of Freshmen, Sophomore, Juniors and Seniors at St. Mary's and randomly selected 50 of each to compare their college experience.
The threat to validity when a participant performs better on the second test when compared to the frist test.
What is testing or instrumentation effect?
The type of curve/distribution when the mean, mode, and median are equal to one another.
What is a normal curve/distribution?
The error in measurement of a variable that is inconsistent and without a pattern.
What is random error?
The level of validity of a person's driving ability when only the written portion of a driver's test is taken.
What is low content validity?
The type of sampling where you select every 7th person that enters the school library to fill out a questionnaire.
What is systematic random sampling?
The type of threat where vegan, omnivore, and carnivore participants are selected to study the effects of a vegan diet.
What selection and attrition effects?
The type of curve/distribution when the data collected is on the lower end of the X-axis when compared to the higher end of the X-axis.
What is a Positively Skewed Distribution?
The same results given by a measurement instrument regardless of population, participant, settings, or conditions.
What is reliability?
The components of criterion validity.
What are predictive and concurrent validity?
The main distinction of sampling in that participants randomly selected.
What probability sampling?
The type of study design that yields the most attrition effect.
What is a longitudinal study?
The measure of central tendency that will be skewed by outliers/extreme scores?
What is the mean?
The type of reliablity that yields consistent measurements, regardless of which scientist is using the instrument.
What is Interrater or Interobserver Reliability?
The type of validity in which participants answer similarly on a traditional test and a newly created test.
What is concurrent validity?
Selecting participants for a study who are readily available to participate in the study.
What is convenience sampling?
History & Maturation; Testing & Instrumentation; Selection bias; Attrition; Participant bias; Experimenter Bias
What threats to internal validity?
What is the mode?
The type of instrument reliability that yields consistent data on the same participant regardless of the day or time the data is collected. For example, a force-plate, blood pressure cuff, 6-minute walk test.
What is Test-Retest Reliability?
The ability of a new measurement tool to achieve results that are comparable or better than those achieved by an old, existing measurement tool.
What is predictive validity?
The ability to have a sample that are representative of the entire population of interest.
What is quota sampling?
The threat to internal validity that results in participants fail to give a “true response” because they know the purpose of the study.
What is participant bias?
The measure of central tendency most commonly used when the data set has extreme scores.
What is the median?
The type of reliability that is produced by asking questions about the same variable using more than one question.
What is internal consistency reliability?
The college entrance exam that is stated to have good predictive validity.
What is the SAT?
The practicality, efficiency, cost, and application of obtaining 100 participants versus 100,000 participants for a study .
What is a sample versus the population?
The type of study design that has a large amount of participant or experimenter bias.
What is a qualitative study?
The type of curve when there more data is found on the higher end of the X-axis when compared to the the lower end of the X-axis.
What is a negative distribution/curve?
The inferential test that is used with quota sampling to determine if there are differences between groups on a particular dependent variable.
What is a T-test or ANOVA?
The study design that increases the amount of internal validity.
What is a double-blind study?
The type of distribution where the mode is found on the lower end of the X-axis.
What is a positive distribution/curve?