A/B Testing
True or False: A/B testing should target only specific metrics.
True. Each experiment should target one or more specific metrics like engagement with a particular piece of content or conversion rate. We want clear success and failure conditions for the experiment.
What does KPI stand for?
Key Performance Indicator
T or F: Analytics give us one of our clearest opportunities to quantitatively demonstrate the value of our work
Truuuuuuue
Should you have an iPhone or an Android?
Not Android.
What is Raising Canes named after?
A golden retriever. Currently on Raising Cane the third.
What is the A and the B stand for in A/B testing?
Think of the 'A' in A/B testing as the experimental control and 'B' as the change we are interested in evaluating.
What causes a tag to fire off, sending data to a system such as Google Analytics?
Events could be page loads, button clicks, page scrolls, etc. In Tag Manager, you define triggers to listen for those events and specify when tags should fire.
Why should we track user behavior?
To gauge the impact of different marketing activities, signal significant changes in user behavior that may warrant further investigation.
What does it mean to have an adaptive layout?
It means to adjust content to fit across devices, including phones, tablets, or desktops. A responsive design is crucial to deliver a consistent experience regardless of the device.
How long does it take to drive to the closest Raising Cane's by the office?
7 minutes
How could using A/B testing help us sell more work to our clients?
Compare recent solutions to legacy solution. Ease internal budget conversations b/c they're more eager to continue doing work with us seeing they'll make more net profit if they do
What are session replay tools?
They record some or all user sessions while hiding sensitive inputs.
What's the benefit of session replay tools?
They allow the business and DevOps teams to go back in time and see exactly how the user interacted with the site and what they encountered.
What is a mock up?
Mock ups show end users what an app will look like and incorporate practical functionality.
How many Cane's Sauces can you order on the mobile app at a time?
100
Name an A/B testing vendor
Name a tracking vendor
Name an analytics vendor.
What is an emulator?
An emulator is used to duplicate your application, including hardware, operating systems, and functionality, to run tests.
What's the name of the most popular combo meal on the menu?
Caniac Combo
Give an example of something you could test with A/B testing.
Which marketing material option is more engaging
Whether different background colors affect revenue
Whether making a guest checkout button more prominent increases conversion (sales)
What is source attribution?
Using a tag or something similar that adds context for reporting how the user was guided to a destination. Did the user come from an ad click? An email campaign? Another product page's list of other products they might like?
In Vincent Yates' story, how much money did he save on making a change to a barely noticeable background shade on ads?
$20 million 🤑
Difference between native and hybrid development.
Native app development is intended to run on only one specific platform versus hybrid apps designed to run on multiple platforms (Android and iOS).
What is one of the jobs founder Todd Graves did for seed money?
Banks didn't offer start-up money, so he started working 90 hours a week as a boilermaker in Los Angeles. He then learned from a coworker that if he worked on fishing boats up in Alaska, he could make even more money.