New A/B Results page
New A/B Results page overview
The new A/B Results page incorporates advanced statistical features (like CUPED , advanced outlier management , Frequentist fixed horizon , and Bayesian stats engines ) and in-depth data explorations with an ability to annotate and save the explorations. The results page has two tabs, each with a different goal Summary tab – Get a quick read of your experiment and make a decision.
New A/B Results page Summary tab
The Summary tab is where you get a quick read of your experiment and make a decision. It gives you an overview of how your experiment variations perform against your selected experiment metrics.
New A/B Results page Explore tab
The Explore tab lets you explore your experiment data and save the explorations you create. Segment the results by user attribute or behavior, filter to a date range, and narrow the view to specific metrics or variations.
New A/B Results page Diagnostics tab
Use the Diagnostics tab to confirm that an experiment reaches users and records conversions before you trust its results. The tab shows the raw decision and conversion events behind the experiment and checks the integrity of its data.
Guardrail alerts
Guardrail alerts let you configure metric alerts that protect business-important metrics during an experiment. Each alert watches a metric you choose and notifies you when a variation moves that metric past a threshold you define, relative to the baseline.
Outlier management
Outliers are extreme values that can distort your experiment results. A few extreme values pull the average off-center, inflate variance, and delay a statistically significant result.