Tech
True/False - Computer simulations can predict real-world behavior with certainty.
False - While powerful tools, the scientific certainty and reliability of simulations depends on its limitations and assumptions.
True/False - Ethnography requires at least six months of observation to be valid.
False - The duration depends on research goals and context.
True/False - When studying digital divide issues for marginalized communities, quantitative methods provide more actionable insights than qualitative methods.
ANSWER: False - Complex social issues often require mixed methods to understand both patterns and lived experiences.
True/False - In studying how Bumble algorithms affect match quality, excluding users who delete and reinstall apps multiple times provides cleaner data.
ANSWER: False - This would create significant sampling bias by excluding important user behaviors and coping mechanisms. Research should examine all usage patterns to understand the full user experience.
True/False - When conducting ethnographic research on why cats always sit on laptops during Zoom meetings, the researcher must maintain the same distance from all cats.
ANSWER: False - In ethnographic research, maintaining rigid physical distances can actually interfere with observing natural behavior. The goal is to minimize disruption of the natural setting while documenting authentic behaviors and interactions. Distance should be determined by the context and what allows for optimal observation without significantly altering subject behavior.
Your startup claims their new "AI coffee maker" learns users' preferences over time. Choose the best research method combination:
Methods: Computer Simulation, Field Experiment, Experience Sampling
ANSWER: Field Experiment + Experience Sampling
WHY: Field experiment allows testing in real households while experience sampling captures immediate user reactions and preference changes over time. Computer simulation would be less valuable as actual user behavior is key.
Which research method would best study "How will Marx's aim in candy throwing improve over time?"
Field experiment or Experience sampling (to track progress and immediate outcomes)
Research Question: "Does playing 'The Sims' increase empathy for different socioeconomic experiences?"
Methods: Lab Experiment, Survey, Focus Group
ANSWER: Lab Experiment + Focus Group
WHY: Lab setting measures empathy changes while focus groups explore deeper understanding and group discussions reveal collective insights.
Research Question: "Does the distance from Red Square to the nearest Starbucks correlate with students' likelihood of making it to their 8:30 AM Lab?"
Methods: Experience Sampling, Field Experiment, Survey
ANSWER: Experience Sampling + Field Experiment WHY: Track real-time attendance patterns while experimentally varying coffee availability routes. Plus, who really fills out surveys at 8:30 AM?
Research Question: "Does listening to Taylor Swift's 'Anti-Hero' on repeat actually make debugging code more effective?"
Methods: Lab Experiment, Experience Sampling, Focus Group
ANSWER: Lab Experiment + Experience Sampling WHY: Lab experiments provide controlled conditions to measure debugging performance with and without music, controlling for code complexity and other variables. Experience sampling captures real-time cognitive and emotional states during debugging sessions, providing insight into how music affects problem-solving processes. This combination allows for both controlled performance metrics and ecological validity through in-situ data collection.
True/False - Field experiments in tech user research should be conducted in person.
Many tech field experiments can be conducted remotely or through digital platforms.
True/False - When conducting a diary study of user behavior, inconsistent entry timing automatically invalidates the data.
ANSWER: False - Irregular entries can provide insights about natural usage patterns and engagement levels.
True/False - In interview studies with low-income communities about AI access, identical question sets should be used for all participants to ensure validity.
ANSWER: False - Questions may need cultural adaptation while maintaining conceptual equivalence.
Research Question: "Does adding 'iSchool' to a student's tinder bio increase their match rate compared to just listing 'UW'?"
Methods: Field Experiment, Survey, Experience Sampling
ANSWER: Field Experiment + Experience Sampling
WHY: Field experiment compares match rates between different bios while experience sampling captures real-time data about quality of matches. Plus, surveys would just capture post-ghosting rationalizations!
Research Question: "Are plants growing better in Seattle because they're emotionally invested in Frasier reruns?"
Methods: Field Experiment, Case Study, Interview Study
WHY: Field experiments allow for controlled comparison of plant growth under different conditions while maintaining a natural environment. Case studies provide detailed examination of specific plant growth patterns over time, accounting for multiple variables like light, temperature, and sound exposure. This combination enables both broad comparative analysis and deep understanding of specific growth patterns and environmental factors.
Research Question: "How does a microwave's anticipatory beeping (30 seconds before done) affect people's likelihood of letting food finish cooking?" Methods: Lab Experiment, Field Experiment, Survey
ANSWER: Field Experiment + Lab Experiment WHY: Field experiment captures natural behavior in homes, while lab experiments can control for variables like food type and measure exact timing differences. Surveys would rely too heavily on self-reporting.
Research Question: "Does the sound of mechanical keyboards in shared offices increase or decrease nearby workers' productivity?"
Methods: Field Experiment, Computer Simulation, Experience Sampling
ANSWER: Field Experiment + Experience Sampling WHY: Natural office environment plus real-time productivity tracking. Simulation couldn't capture complex social and acoustic factors.
Research Question: "How does autocomplete in email clients perpetuate gender stereotypes in professional communication?"
Methods: Interviews, Computer Simulation, Case Study
ANSWER: Interviews + Case Study WHY: Analyze actual autocomplete suggestions and their impacts through specific organizational cases. Simulation wouldn't capture real-world complexity.
Research Question: "Is there a statistically significant relationship between the number of stickers on students' laptop and their chances of getting an internship?"
Methods: Case Study, Ethnography, Interview
ANSWER: Case Study + Content Analysis
WHY: Follow specific students' journeys while analyzing their sticky note content and placement strategies. The ethnography would take too long - internship season will be over!
Research Question: "Do students who watch Euphoria have better project management skills?"
Methods: Ethnography + Experience Sampling
WHY: Ethnography enables long-term observation of team dynamics and management practices in their natural context, revealing patterns in leadership styles and team interactions. Experience sampling provides systematic data about real-time decision-making and leadership behaviors. Together, these methods capture both the broader cultural context and specific instances of management behavior while controlling for various team dynamics.
True/False - Design-based research should be completed before any user testing can begin.
False - Design-based research is iterative and often incorporates user feedback throughout the process.
True/False - In design-based research, reaching saturation in user feedback likely indicates the optimal design solution has been found.
ANSWER: False - Saturation might indicate limited user diversity or design constraints rather than optimal solutions.
True/False - When studying algorithmic bias, researchers must maintain complete objectivity by avoiding any intervention in observed discrimination.
ANSWER: False - Ethical research often requires addressing harmful biases when discovered.
True/False - In a study comparing how students use ChatGPT versus traditional methods for completing INFO assignments, a mixed-methods approach using both quantitative and qualitative data would reduce research validity.
False - Mixed-methods research can enhance validity through methodological triangulation, providing both statistical data about tool usage patterns and rich qualitative insights into student decision-making and learning processes.
True/False - In technology research, the Hawthorne Effect can be eliminated by using purely automated data collection.
ANSWER: False - Even automated collection can affect behavior if participants know they're being monitored.