Type of Research Design
You are studying the impact of eating a healthy lunch on energy levels. You simply stand outside of a salad shop between 12pm and 2pm and ask people about their energy levels. What type of design is this?
Pre-experimental
You are studying the impact of eating a healthy lunch on energy levels. You simply stand outside of a salad shop between 12pm and 2pm and ask people about their energy levels. How would you draw this design?
X O
You are studying the impact of eating a healthy lunch on energy levels. You measure a group of participants' energy levels every hour on the hour from 8am to 4pm and provide a healthy lunch at 11:30am. 30% of participants end up leaving the study early. What internal validity threat are you most concerned about?
Experimental Mortality/Attrition
You are studying the impact of eating a healthy lunch on energy levels. You select a group of participants and let them choose if they want a healthy lunch or unhealthy lunch. What internal validity threat are you most concerned about here?
Selection Effect
In experimental research, what does a rigorous experimental design mean?
The extent to which you can rule out internal validity threats/are confidence that there are no alternative explanations for the effects
You are studying the impact of eating a healthy lunch on energy levels. You measure a group of participants' energy levels every hour on the hour from 8am to 5pm and provide a healthy lunch at 12pm. What type of design is this?
Quasi-experimental - interrupted time series
You are studying the impact of eating a healthy lunch on energy levels. You stand outside of a dining hall between 12pm and 2pm. You ask people as they leave if they had a healthy lunch or an unhealthy lunch and measure their energy levels. How would you draw this?
N Xa O1
N Xb O2
You decide to conduct a longitudinal study over six months to see if consistently eating a healthy lunch has a long term impact. You change the way that you ask about energy levels halfway through your study. Which internal validity threat would you be concerned about here?
Instrumentation
You are studying the impact of eating a healthy lunch on energy levels. You measure a group of participants' energy levels every hour on the hour from 8am to 4pm and provide a healthy lunch at 11:30am. The energy scale makes the participants think more about their energy levels and how this impacts their work performance. What internal validity threat might you be concerned about here?
Testing
You are studying the impact of eating a healthy lunch on energy levels. You measure a group of participants' energy levels every hour on the hour from 8am to 4pm and provide a healthy lunch at 11:30am. 30% of participants end up leaving the study early. What external validity threat are you most concerned about?
Sample attrition
You are studying the impact of eating a healthy lunch on energy levels. You stand outside of a dining hall between 12pm and 2pm. You ask people as they leave if they had a healthy lunch or an unhealthy lunch and measure their energy levels. What type of design is this?
Pre-experimental
You are studying the impact of eating a healthy lunch on energy levels. You measure a group of participants' energy levels every hour on the hour from 8am to 4pm and provide a healthy lunch at 11:30am. How would you draw this design?
O1 O2 O3 O4 X O5 O6 O7 O8 O9
You are studying the impact of eating a healthy lunch on energy levels. You measure a group of participants' energy levels every hour on the hour from 8am to 4pm and provide a healthy lunch at 11:30am. The study is being done by HR monitoring worker energy levels. What is your greatest internal validity threat here?
The Hawthorne Effect
You are studying the impact of eating a healthy lunch on energy levels. You select a group of participants from a particular workplace measuring energy levels every hour on the hour from 8am to 4pm and provide a healthy lunch at 11:30am. You find out that there was a super long boring all staff meeting on this day. What internal validity threat are you the most concerned about here?
History
You complete your study on children's lunch nutrition during Michelle Obama's national healthy eating in schools initiative from the 2010s. What external validity threat might you be concerned about here?
History or timing
You are studying the impact of eating a healthy lunch on energy levels. You select a group of participants and let them choose if they want a healthy lunch or unhealthy lunch. You measure their energy levels before and after lunch. What type of design is this?
Quasi-experimental (non-equivalent comparison group)
You are studying the impact of eating a healthy lunch on energy levels. You select a group of participants and let them choose if they want a healthy lunch or unhealthy lunch. You measure their energy levels before and after lunch. How would you draw this?
N O1 Xa O2
N O3 Xb O4
You are studying the impact of eating a healthy lunch on energy levels. You measure a group of participants' energy levels every hour on the hour from 8am to 4pm and provide a healthy lunch at 11:30am. You find that participants' energy levels go down throughout the day overall - which internal validity threat are you most concerned could be the cause of this?
Maturation
You are studying the impact of eating a healthy lunch on energy levels. You take participants and they are randomly given a brown bag lunch that is either empty (no lunch at all), a healthy lunch or an unhealthy lunch and you measure their energy levels after lunch. You learn that the participants shared their lunches with the participants who were not given a lunch. Which general internal validity threat are you most concerned about here?
Design Contamination
You are studying the impact of eating a healthy lunch on energy levels. You measure a group of participants' energy levels every hour on the hour from 8am to 4pm and provide a healthy lunch at 11:30am. The study is being done by HR at a crisis unit and workers are required to take a one-hour break for lunch. Extra staff are included on this day to ensure that workers are able to take a break. What external validity threat might be of concern here?
Unique program features
You are studying the impact of eating a healthy lunch on energy levels. You take participants and they are randomly given a brown bag lunch that is either empty (no lunch at all), a healthy lunch or an unhealthy lunch and you measure their energy levels before and after lunch. What type of design is this?
True experiment.
You are studying the impact of eating a healthy lunch on energy levels. You take participants and they are randomly given a brown bag lunch that is either empty (no lunch at all), a healthy lunch or an unhealthy lunch and you measure their energy levels before and after lunch. How would you draw this?
R O1 Xa O2
R O3 Xb O4
R O5 O6
In your study, you decide to specifically sample people who have the lowest energy levels to start with and then randomly assign them to a healthy or unhealthy lunch. What internal validity threat would you be most concerned about here?
Statistical Regression
You are studying the impact of eating a healthy lunch on energy levels. You take participants and they are randomly given a brown bag lunch that is either empty (no lunch at all), a healthy lunch or an unhealthy lunch and you measure their energy levels after lunch. The researcher behaves in such a way that the participants think they know what the researcher thinks will happen and answer accordingly. What TWO threats would you be concerned about here?
Subject Expectancy effect & Experimenter Effect
You collected your sample by posting fliers around asking for volunteers to participate in a study promoting healthy eating. What external validity threat might you be concerned about here?
Unique Sample