Validity: General ?'s
This guides the design, implementation, and interpretation of a study.
What is VALIDITY?
Two threats to statistical conclusion validity
What are FISHING & LOW POWER?
This threat occurs when changes occur within the participants due to development or healing
What is MATURATION?
External validity reflects this
What is REAL WORLD PRACTICE?
Most participants are new to the job at the time of the pre-test. A month later, their productivity has improved as a result of time spent working in the position.
What is MATURATION?
Accuracy of the conclusions drawn from the statistical analysis of a study
What is STATISITCAL CONCLUSION VALIDITY?
This is the type of error made when a researcher searches data for interesting findings that go beyond the initial hypotheses
What is TYPE I ERROR?
This type of threat to internal validity occurs when the intervention leader encourages the control group to improve to equal the intervention group
What is the COMPENSATORY EQUALIZATION OF TREATMENT?
What is REPLICATION?
Participants showed higher productivity at the end of the study because the same test was administered. Due to familiarity, or awareness of the study’s purpose, many participants achieved high results.
What is TESTING/PRACTICE/ORDER EFFECTS?
When the conclusions drawn from the results are accurate and true
What is INTERNAL VALIDITY?
This is the type of error made when a difference or relationship exists but there is not enough statistical power to detect it
What is TYPE II ERROR?
When strategies are used to encourage attendance and participation this type of threat to internal validity is protected against
What is ATTRITION/MORALITY?
This threat to external validty can cause the sample not to represent the population
What is SAMPLING ERROR?
Because participants are placed into groups based on their initial scores, it’s hard to say whether the outcomes would be due to the treatment or statistical norms.
What is REGRESSION TO THE MEAN?
The extent to which the results of a study can be applied to other people and other situations
What is EXTERNAL VALIDITY?
This is what the p value must be before we conclude there is a statistically significant difference or there is a statistically significant relationship
What is p is less than alpha?
If there is not random assignment and the groups that result are unequal on important characteristics, this results in this threat to internal validity
What is ASSIGNMENT/SELECTION?
A way to protect for this threat to external validity is to ensure that the researchers are sensitive to real-world practice
What is POOR ECOLOGICAL VALIDITY?
20% of participants provided unusable data. Almost all of them were from Group C. As a result, it’s hard to compare the two treatment groups to a control group.
What is ATTRITION?
What is EXTERNAL VS. INTERNAL VALIDITY
This is the threat that we protect against by using statistical methods to adjust for multiple analyses
What is FISHING?
This is when extreme scores change and move towards the mean with repeated testing
What is REGRESSION TO THE MEAN?
This is the name for a type of study that has conditions that are reflective of real-world practice
Both groups in a study had improved pain tolerance with the kinesiotaping and the placebo taping conditions, but not the control condition. What threat does the placebo taping condition protect against?
What is the HAWTHORNE EFFECT?