EXPERIMENT
The variable that the researcher manipulates in an experiment is known as this.
What is the "Independent Variable"?
This Survey Flow tool divides participants into experimental groups for A/B testing.
What is the "Randomizer"?
A manager tests whether a new ad increases purchase intention. SPSS shows:
Mean = 4.5
p = 0.012 for the ad effect
What does this result indicate?
What is "Statistically Significant"?
This chart type is best for comparing categories such as sales by product.
What is a "Bar Chart"?
Before starting a study on stress levels in students, you explain to participants what they’ll do, any risks involved, and that they can leave anytime.
What is the "Consent Form"?
The main outcome or response that the experiment measures is known as this.
What is the "Dependent Variable"?
A manager wants to ask customers, “Why did you cancel your subscription?”
However, this follow-up question should appear only if the customer selects “I canceled my subscription” in the previous item.
Which Qualtrics feature should the manager use to make the follow-up question appear only when relevant?
What is "Display Logic"?
A company compares two website designs. SPSS shows:
Mean A = 1.2
Mean B = 1.3
p = 0.41
What conclusion should be drawn?
What is "Statistically Non-Significant"?
Your marketing team wants to show how the total website traffic is split between mobile, desktop, and tablet users.
Which chart clearly shows each segment’s share of the total?
What is a "Pie Chart"?
A researcher secretly records shoppers’ behavior in a store to see who buys certain products.
Ethical or unethical?
What is "Unethical"?
A marketing team is testing two versions of an ad. To avoid bias, they want to make sure every participant in their online experiment has the same probability of seeing either Ad A or Ad B.
Name the procedure, the team should use to assign participants to conditions?
What is "Random Assignment"?
During a customer satisfaction survey, a manager notices that respondents often skip the key question “How satisfied are you with our service?”
To prevent missing data and ensure everyone answers this question before moving on, the manager enables a specific setting in Qualtrics.
Which setting did the manager turn on?
What is "Force Response"?
A marketing agent runs an A/B test and collects data from all potential customers. Questions include:
“Would you like to try this example?” (outcome variable)
“How often do you take care of your skin?” (predictor)
Gender and age (demographics)
What analysis should go first?
What is "Descriptive Statistics"?
Descriptive Statistics: Summarize demographic variables (gender, age) and skin care frequency.
You need to track monthly sales over the past two years to see whether there’s an upward or downward trend.
Which visualization is best for this?
What is a "Line Chart"?
An online experiment includes a consent form, but participants are not told that their data will be shared with advertisers.
Ethical or unethical?
What is "Unethical"?
This is unethical practice because data sharing must be disclosed.
A researcher tests a new product message. Group 1 sees Message A and Group 2 sees Message B, but no participant sees both.
What type of experimental design is the researcher using?
What is a "Between-Subjects Experiment"?
A marketing analyst is building the A/B testing to verify reactions to a new advertising campaign. She plans to include the following three questions:
How likely are you to sign up for the service after seeing this ad?
How often do you shop for similar products each month?
What is your age?
Which question should she place first?
What is the "Dependent Variable"?
The dependent variable (Question 1) should go first.
A skincare brand runs a campaign test:
New ad increases purchase intention for women but decreases it for men.
SPSS reports means for women and men, p < 0.05 for the interaction.
What type of statistical finding is this?
(DOUBLE POINT)
What is "Statistical Interaction"?
When designing a sales performance dashboard, you want the CEO to immediately notice the highest-performing region.
Where should you place this key chart?
(DOUBLE POINT)
What is the "Top Left"?
This ethical principle requires researchers to protect participants’ data so that no one outside the research team can access or identify them.
What is "Confidentiality"?
A manager has volunteers evaluate two different customer service videos back-to-back. The volunteers rate the second video lower because they are tired and bored after watching the first one.
What problem is affecting the results?
(DOUBLE POINT)
What is an "Order Effect"?
A company runs an A/B test to compare two promotional messages:
Ad A: Shown mostly in the morning
Ad B: Shown mostly at night
After the test, Ad B appears to perform better. However, the data scientist realizes that customers who browse at night tend to be younger and more discount-driven, while morning visitors are older and buy less frequently.
Because the testing schedule was not controlled, it is unclear whether the higher performance of Ad B is due to the message or simply the time of day and the type of customer online at that time.
What is the mistake in this experiment, and why does it make the results less valid?
What is the "Confound"?
A brand tests ad type (A vs B) and email timing (morning vs evening) on purchase intention. SPSS shows:
Ad A works better in the morning but worse in the evening, while Ad B shows the opposite pattern.
Interaction p < 0.05
What is the interpretation?
(DOUBLE POINT)
What is "Significant Interaction"?
Your dashboard includes a lot of detailed numbers like individual product costs, profit margins, and raw sales data.
Where should you position this supporting information?
(DOUBLE POINT)
What is the "Bottom Section"?
A marketing analyst tests 12 different segmentation models. Only 3 models show a significant effect of the new ad campaign, while 9 show no effect. The analyst reports only the 3 significant models in the final presentation and does not mention the others, claiming the campaign “consistently improves engagement.”
Ethical or unethical?
(DOUBLE POINT)
What is "Unethical"?
This is unethical because selectively reporting only supportive analyses misleads stakeholders and violates research transparency.