Claims & Science
A study where we manipulate at least one variable and measure at least one variable
What is an experiment?
Coffee consumption
A researcher asks participants to rate how anxious they feel on a scale from 1 to 7. This is an example of this measurement method.
What is self-report?
This assesses how generalizable your sample is. If you only have undergraduate students, this may be lacking.
What is external validity?
A researcher assumes that a study’s results apply to everyone, even though nearly all participants are drawn from a narrow group of wealthy, educated people in Western countries. What is this group often called?
WEIRD Sample (western, educated, industrialized, rich, and democratic)
"30% of dogs like the color purple" is an example of what type of claim?
Frequency claim
In a study of whether room temperature affects reading accuracy, the researcher sets the room to 18°C, 22°C, or 26°C. These three values are called this.
A researcher counts how often children interrupt one another during a group activity. This is an example of this measurement method.
Two trained observers independently code the same video. Researchers compare how consistently they assign the same codes. This is the type of reliability being assessed.
What is interrater reliability?
Availability heuristic
This is necessary for a theory to be a good theory and allows it to be disproven
What is falsifiable
In a study, each participant is randomly placed into one of two conditions then completes a memory test. Name the design.
Between-subjects design (posttest only)
A researcher defines "class participation" as the number of times a student asks or answers a question during a 30-minute class. This definition is an example of this.
Operationalization
A new questionnaire intended to measure loneliness correlates strongly with an established loneliness scale. This provides evidence for this type of validity.
What is convergent validity?
You believe that all ducks like the color green, so you only look for studies that report that ducks like the color green. What bias are you engaging in?
Confirmation bias
A study done to ensure your manipulation of variables, experimental design, and general approach works.
What is a pilot study
Every participant completes a task once in silence and once with background noise. The researcher flips a coin to decide which condition comes first. Name the design feature used to reduce order effects.
What is counterbalancing
In IQ score is an example of this kind of data
What is interval data?
This statistic is used to assess internal reliability
What is Cronbach's alpha?
A researcher believes they are less biased than other researchers but fails to recognize their own assumptions shaping how they interpret ambiguous data. Name this bias.
Bias blind spot
The four norms within science and research
Universalism
Communality
Disinterestedness
Organized skepticism
This is one of the advantages of a within-groups design
1. People act as their own control
2. Naturally controls for unsystematic variability
3. Fewer number of participants needed
A researcher measures "creativity" only by how quickly people finish a maze. The maze measure may be precise, but it may not adequately capture the intended concept. Identify the main type of validity concern.
What is construct validity?
These two forms of construct validity are assessed subjectively
Face and Content validity
The three Belmont Principles
Beneficence, Justice, Respect for persons