Optimizely Web Experimentation FAQs
- Optimizely Web Experimentation
File a support ticket if you have questions that are not covered here.
Note
Visit Optimizely Web Experimentation questions on Stack Overflow to post a discussion and see what others are talking about.
What is Optimizely Web Experimentation?
Optimizely Web Experimentation is an experimentation platform that lets you experiment on a channel or device with an internet connection. Products include Optimizely Web Experimentation and Optimizely Personalization.
Is Optimizely Web Experimentation compatible with single-page apps (SPAs) and responsive websites?
Yes, Optimizely Web Experimentation offers enhanced support for SPAs and responsive websites.
Is jQuery required?
jQuery is not required for Optimizely Web Experimentation. After you transition, you can remove jQuery for a smaller, faster snippet. You can keep jQuery in the snippet if you use it in custom code (like project JS or experiment JS) and do not have your own version you can reference.
How do I build an experiment?
What is the difference between campaigns, experiments, experiences, and variations?
Campaigns, experiments, experiences, and variations are terms related to Optimizely testing. In general, campaigns have experiences and experiments have variations.
- Campaigns – The framework for organizing your strategy in Optimizely Personalization. A campaign takes some content on your site, like the promotions on your homepage, and changes content for different audiences. Read about Personalization campaigns.
- Experiment – Optimizely's term for an A/B, multivariate, or multi-page test. You might also see experiments called "tests" or "campaigns." See Experiment Types: AB, Multivariate, and Multi-page.
- Experiences – The different personalized versions of your site that you create for visitors based on the page they are visiting and the audiences they qualify for. Learn more about Personalization experiences. When you are not sure what type of experience works best for an audience, you can test experiences with Experimentation in Personalization campaigns.
- Variations – The alternate versions of your site that you test against your original in Optimizely Web Experimentation. Learn how to create and change variations in your experiments.
I am having trouble logging into my account. What should I do?
See Login issues for guidance and contact details if troubleshooting does not resolve the problem.
How do I find my experiment or campaign ID?
You can find the IDs in the API Names options when you edit a campaign. See Find IDs for API calls for more information.
What is the difference between multivariate testing (MVT) and running multiple experiments?
Multivariate testing uses the same core mechanism as A/B testing but compares a higher number of variables to reveal more information for how these variables interact. It is similar to multiple A/B tests being layered on top of each other.
Testing all possible combinations of a multivariate test is also called full factorial testing and is why multivariate testing is recommended only for sites that have a substantial amount of daily traffic. Obtaining meaningful data from the test takes longer when there are more variations that need to be tested. See Experiment types: A/B, multivariate and multi-page for more information.
Running multiple A/B tests on one or more pages lets your hypothesis reach statistical significance more quickly unless your site has a high amount of daily traffic.
How does Optimizely Web Experimentation count conversions?
Optimizely Web Experimentation counts conversions based on unique visitors to your page. If the same user triggers a conversion multiple times, it is counted as one conversion and one visitor.
If the visitor does not trigger the conversion goal the first time they visit the site but does so during a subsequent visit while the experiment is still running, the experiment counts the conversion.
See How Optimizely Experimentation counts conversions for more information.
How updated are my results?
Results are available within 5 to 10 minutes of Optimizely Web Experimentation receiving the data. See Data freshness to learn more.
How do I set up 2-step verification?
2-step verification increases account security. Your account is protected even if your password is compromised as you have to enter a code sent to your mobile phone.
If you are an administrator for the account, you can require account-level 2-step verification for all account collaborators.
See Manage collaborators for more details.
What is the difference between publishing and starting an experiment or campaign?
Publishing an experiment saves a new experiment or changes an existing experiment, but starting an experiment exposes a published experiment to the specified audience.
See Differences among publish, start, and pause for more details.