Reliability Tests Definition
when you repeat the same test on the same sample at a different point in time. You use it when you are measuring something that you expect to stay constant in your sample.
Test Re-Test Method
A team of researchers observe the progress of wound healing in patients. To record the stages of healing, rating scales are used, with a set of criteria to assess various aspects of wounds. The results of different researchers assessing the same set of patients are compared, and there is a strong correlation between all sets of results
Interrater reliability
City of Birth is what type of variable?
Nominal
Empirical association, temporal order and non-spuriousness are criterion of what?
Causal Explanation
a validity test in which a person's judgement validates a measure based on its appearance and appropriateness
Face Validity
measures the degree of agreement between different people observing or assessing the same thing. You use it when data is collected by researchers assigning ratings, scores or categories to one or more variables, and it can help mitigate observer bias.
Interrater reliability
Suppose researchers would like to measure the internal consistency of a particular test that has 100 questions all related to introverted personality traits. The first step in this test would to be to split the test in half based on odd-numbered and even-numbered questions.
Split-Half Reliability
Which type of variable has no true zero?
Interval
The term used to describe a negative state of Indigenous knowledge that wrongly portrays Indigenous people as lacking and empty of knowledge systems.
Datum Nullius
a validity test in which a knowledgeable person's judgment validates a measure by concluding that it covers the range of the concept
content validity
Compares the degree of association between the scores from two different operational measures of the same concept. The greater the similarity, the more reliable the instrument.
The cross-test
You devise a questionnaire to measure the IQ of a group of participants (a property that is unlikely to change significantly over time).You administer the test two months apart to the same group of people, but the results are significantly different, so the test-retest reliability of the IQ questionnaire is low.
Test Re-Test Method
Which continuous variable has a true zero?
Ratio
An explicit, working definition of a concept, resembling a dictionary definition
Conceptual Definition
A validity test that examines the degree to which a measurement instrument can predict a future behaviour or event
Predictive Validity
a measure used to assess the internal consistency or reliability of a test or measurement instrument by dividing it into two halves or subsets of items, and the scores on each half are compared.
Split-Half Reliability
In a psychological assessment setting, suppose a psychologist wants to measure individuals’ anxiety levels using two parallel forms of an anxiety questionnaire. Form X and Form Y are developed, each consisting of 20 items assessing anxiety symptoms.
The psychologist administers Form X to a group of 100 participants and Form Y to a separate group of 100 participants. The scores obtained on both forms are then analyzed to determine reliability
Cross-test
Measuring language proficiency is an example of what variable?
Ordinal
A number of studies have found that there is a correlation between higher rates of breast cancer and higher levels of fat consumption at the population level. However, the relationship disappears when these studies are analyzed at the individual level. This is an example of what?
Ecological Fallacy
A validity test that determines whether two concepts differ from one another as predicted by theory
Discriminant Validity
This reflects the idea of power, inequity and exploitation as it relates to data collection. There is growing research that shows harmful data practices targeting people of colour in North America.
Data Colonialism