POC
What is a POC?
Turning a feature on at a percentage
What is a feature rollout?
The ______ holds all of the configurations for features and experiments launched via Optimizely’s SDK’s.
What is the datafile?
No need to commit to a sample size, timeline or MDE, check results at any time. Controls for false discoveries from multiple comparisons automatically.
What are the benefits of Sequential Testing?
The part of the platform that is a central hub for collaboration.
What is Program Management?
Leading the technical part of the evaluation and involving other technical peers in a sales cycle only when necessary.
What is our role in a POC?
Deploy features behind “off” flags, then give marketers or PMs the ability to turn on the feature independent of a new deploy.
What is a dark launch?
These provide a set of methods to create feature rollouts, A/B tests, feature variables, and feature tests within your application. They are stateless, have no latency, and are open source.
What are the benefits of SDKs?
The likelihood that the difference in conversion rates between a given variation and the baseline is not due to chance.
What is statistical significance?
How audience conditions are built and segmentation of results is possible.
What are attributes?
The act of finding a mutually agreed upon and achievable action plan to prove the product works.
What is POC scoping?
The places where feature flags fit into the software development life cycle
What are Monitor, Build, QA, Code Release?
Decisions are made locally against the datafile, which means there is no _____.
What is latency?
____ _____ _____ ____ enables you to include as many variations and metrics in your experiments, without increasing test duration or error rate
What is False Discovery Rate Control?
An algorithm that shortens experiment duration & maximizes insight.
What is Stats Accelerator?
The document that can be copied and used to keep a POC on track and organized.
Technical Validation document.
Add parameterized variables to feature flags to update features in real time, without a code push or app update. Variables can also be used to A/B test variations of features.
What is remote configuration?
Optimizely Full Stack uses the _______ _______ to ensure consistent user bucketing across devices.
What is the MurmurHash function?
Once a variation reaches statistical significance, the ______ _______ always lies entirely above or below 0.
What is the confidence interval?
An algorithm that avoids cost of sub-optimal experiences.
What is multi-armed bandit?
The criteria that a potential customer needs to prove before they feel comfortable moving forward.
What are the POC objectives?
Polling method or webhooks.
What are the ways to update the datafile?
Start with a smaller percentage of experiment traffic allocation and scale upwards over time.
What is the proper way to allocate traffic in order to ensure consistent experimentation bucketing logic?
If more visitors see the variation but conversions decrease, your experiment will probably take more time. This will cause the _____ _____ estimate to increase.
What is "visitors remaining"?
The 4 fields required to send an event to the Events API
What are Account ID, Visitor ID, Timestamp & Event ID & Name?