Why do we test?
Tools
Measuring Impact
Common Pitfalls
Misc.
100

The method of comparing two or more variants of webpage(s) against each other to determine which one performs better.

What is A/B Testing?

100

The 4 primary tools used for testing.

What are Analytics, Target, PowerPoint, and Jira?

100

The timeframe used when tracking a live test.

What is Rolling Dates?

100

An outcome that tests negative but has a real impact.

What is a false negative?

100

The restaurant which inspired our eBiz brick walls design.

What is Buffalo Wild Wings?

200

The year that A/B testing spiked in interest for business. 

What is 2010?

200

The most common Adobe Analytics visualization used when testing.

What is a Fallout?

200

The percentage of sample size needed to use the inconclusive strategy.

What is 40%?

200

Unclear insights occur from this particular testing pitfall.

What is testing too many elements at once?

200

This 2020 Documentary about tech experts from Silicon Valley sound the alarm on the dangerous impact of social networking

What is The Social Dilemma 

300

We must do this in order to prove a hypothesis for our membership journeys, whether right or wrong. 

What is Define a Goal?

300

The 2 types of Experience Composers in Adobe Target.

What are the Form Composer and Visual Composer?

300

The 2 most common types of testing goals.

What are engagement and conversion?

300

A strategy using testing insights to further optimize our solutions.

What is an iterative process?

300

The year AAA was founded.

What is 1902?

400

The first importance in testing that allows teams likes us to collect data in results and understand certain behaviors.

What are Data Driven Decisions?

400

The 3 possible statuses that can be used on your PowerPoint test slide.

What are Upcoming, In Progress, and Completed?

400

The minimum confidence required when determining a winner.

What is 95%?

400

The number of research resources recommended in order to continue an iteration process.

What is more than 1?

400

The location (City and State) of AAA National Headquarters.

What is Heathrow, Florida?

500

The four core tenets of E-business testing approach.

What is Listen, Response,
Experiment, and Persistence?

500

A Jira ticket’s Activity Start Date is delayed by this number of days once its status is set to A/B Test is Live.

What is 1 day?

500

The act of turning off a test before meeting sample size.

What is Failing Fast?

500

Four metrics mentioned during the session that can be used to measure a test.

What are conversion, engagement, visitation, and error message frequency?

500

The founder and first chairman of AAA.

Who is Augustus Post?