Tests
This is a measure that requires individuals to complete a cognitive task by responding to a standard set of questions.
What is a test?
This is a major type of data collection used in quantitative studies, which does not rely on self-reports.
What is observation?
This is a form of data collection in which specific questions are asked orally and participants’ responses are recorded, verbatim and/or summarized (in person, by phone, or through digital portals such as Zoom).
What is an interview?
This is the ability or capacity of a measure to identify and discriminate differences.
What is sensitivity?
This contains written prompts or questions that are used to obtain an individual’s perceptions, attitudes, beliefs, values, perspectives, and/or dispositions (on paper or in electronic format).
What is a questionnaire?
This is when individual scores are compared with the scores of a well-defined norming group of others who have taken the same test.
What is a norm-referenced interpretation?
This is a type of error that occurs because of the background, expectations, or frame of reference of the observer.
What is observer bias?
These questions give the participant predetermined choices from which an answer is selected.
What is a structured question?
This type of measure would make it much less likely to find the signal: significant relationships or differences.
What is an insensitive measure?
This is a progressive series of gradations.
What is a scale?
These tests have set procedures for administration and scoring, directions specify the procedures for giving the test, time allowed to answer the questions, and materials that can be used by the participants and other conditions.
What are standardized tests?
This occurs when the observer has knowledge of one or more aspects of the study, and this knowledge affects subsequent observations.
What is contamination?
These questions, which are used in both quantitative and qualitative studies, do not have predetermined, structured choices.
What is a semi-structured question?
“Off the shelf” tests are previously prepared with good technical evidence and often standardization; “locally developed” are constructed by the researcher and may have greater amounts of this.
What is sensitivity?
This provides the respondent with a number of options from which to choose.
What is a checklist?
This shows how an individual's performance compared with an established level of performance or skill.
What is standards-based interpretation?
This occurs when an observer allows an initial impression about a person or group to influence subsequent observations.
What is the halo effect?
These questions, which are open-ended and broad (a mainstay of qualitative research), are used sparingly in quantitative studies.
What are unstructured questions?
This is the spectrum of measurement for when the trait or construct being measured is assessed directly and completely, without being influenced by other factors.
What is the validity goal?
This tool is used when a respondent is asked to place a limited number of categories into sequential order.
What is a ranked-order item?
This is the most basic standard score which has a mean of 0 and a standard deviation of 1.
What is a z score?
This approach requires the observer both to see relevant behaviors and to make inferences about their meaning.
What is high-inference observation?
These are questions that encourage a desired response and can bias responses.
What is a leading question?
This is used initially to help researchers know if a measure will give you an adequate spread of scores.
What is a pilot test?
This is a response in which respondents write in answers, can provide rich information, especially if there is a need to understand what is paramount or of most importance.
What is a constructed or open-ended response?