Optimizely's experiment health status
Optimizely's automatic sample ratio mismatch detection
Optimizely Web Experimentation Optimizely Performance Edge Optimizely Feature Experimentation Optimizely Full Stack (Legacy) A sample ratio mismatch (SRM) occurs when the traffic distribution between variations in a Stats Engine A/B experiment https //www. optimizely.
Imbalance detected: What to do if Optimizely's automatic SRM detection alerts you to an imbalance in your Stats Engine A/B test
Optimizely Web Experimentation Optimizely Personalization Optimizely Performance Edge Optimizely Feature Experimentation Optimizely Full Stack (Legacy) A sample ratio mismatch (SRM) occurs when the traffic distribution between variations in a Stats Engine A/B experiment becomes severely imbalanced because of an implementation issue. This imbalance may lead to experiment degradation and, in extreme cases, inaccurate results.
Possible causes for traffic imbalances
Optimizely Web Experimentation Optimizely Performance Edge Optimizely Feature Experimentation Optimizely Full Stack (Legacy) The determination of a traffic imbalance by Optimizely Experimentation's automatic sample ratio mismatch (SRM) detection system is a symptom of various data quality issues. Implementation errors and third-party bots are the most common culprits behind experiment imbalances.
Take action now: SRM detected experiment health
Optimizely Web Experimentation Optimizely Performance Edge Optimizely Feature Experimentation Optimizely Full Stack (Legacy) A SRM detected experiment health on the Optimizely Experiment Results page means that your A/B test has failed a traffic imbalance check. The patterns of visitor assignments to variations in your experiment must be investigated to identify the problems.
Good experiment health
Optimizely Web Experimentation Optimizely Performance Edge Optimizely Feature Experimentation Optimizely Full Stack (Legacy) When Experiment Health on your experimentation results page displays Good , it means that your Stats Engine experiment has the desired status. The experiment's health status alerts you to untrustworthy experiment results on time.