2023 Feature Experimentation release notes
11 min
Subscribe to updates on this page using the notification and RSS feed options.
The following is a cumulative list of enhancements and major bug fixes in each Optimizely Feature Experimentation release.
Because Optimizely Feature Experimentation releases new features and fixes as soon as they are ready, this list will update regularly.
December
New feature
- Released automatic SRM detection.
- Every customer needs to quickly identify problems and protect their experiments from unintended traffic imbalances. Optimizely now automatically runs SRM detection tests embedded within your Stats Engine A/B experiments. When the Optimizely detector finds unusual imbalances in visitor traffic to an experiment's variations, it identifies the severity and then sends out an in-product notification. You can now detect experiment problems early and without manual effort. See Optimizely's experiment health status documentation section.
November
- Released webhooks for all environments, not just the primary environment.
- Also released an update where only the updated environment's datafile is revised. For example, if you update the development environment, Optimizely will only create new datafile revisions for that development environment.
- Released the ability to schedule changes to your rule's audience.
October
Improvements
Released platform enhancement enabling you to deliver feature flag and experiment changes to your end-users significantly faster (~90% average performance improvement, based on initial Production data).
New features
- Released the ability to schedule changes to your flags and rules.
- Released the ability to have multiple experiments per flag.
August
Collaboration was released
Collaboration is designed to help teams manage their experiment ideation, planning, and hypothesis-creation process more effectively. Learn more and create your first hypothesis by following the Get started with Collaboration guide.
Feature Experimentation API improvements
- Two new API endpoints were released to the Optimizely Feature Experimentation API.
- You can now run API calls directly from the developer API reference documentation.
May
Breaking change SDK releases
The Advanced Audience Targeting integration with Optimizely Data Platform (ODP) for the following Feature Experimentation SDKs is now in beta:
New API added to the SDK's OptimizelyUserContext
- fetchQualifiedSegments() this API will retrieve user segments from the ODP server. The fetched segments will be used for audience evaluation. The fetched data will be stored in the local cache to avoid repeated network delays.
- When an OptimizelyUserContext is created, the SDK will automatically send an identify request to the ODP server to facilitate observing user activities.
New APIs added to the SDK's OptimizelyClient
- sendODPEvent() – customers can build and send arbitrary ODP events that will bind user identifiers and data to user profiles in ODP.
- createUserContext() – (For server-side SDKs only) – with anonymous user IDs, user-contexts can be created without a userId. The SDK will create and use a persistent VUID specific to a device when userId is not provided.
Additional releases
- The Optimizely Feature Experimentation Flutter SDK is now in General Availability
- Advanced Audience Combinations is now in General Availability
Bug Fixes
- Fixed an error where Cross-project events do not always appear in all projects metrics.
- Fixed various bugs with change history:
- Fixed a bug that made change history unavailable for certain customers.
- Fixed a bug where change history would return a 403 error.
- Fixed a bug where change history would display Something Went Wrong and not load the change history.
- Fixed a bug where existing rules would show as created instead of updated.
- Fixed a bug where change history did not log the updated rule when the rule was added, updated, or removed from an exclusion group.
- Fixed a bug where deleting a variation or rule also deleted the history of the variation or rule.
- Fixed a bug on the Reports page where updated rule descriptions would not display.
- Fixed a bug where new targeted delivery rules could not be saved.
- Fixed a bug where pages would sometimes not populate when switching between differing project types.
Feature Experimentation API improvements
- Renamed Feature Experimentation REST API from Optimizely Flags API to Optimizely Feature Experimentation API.
- Fixed a bug where the API would incorrectly return 401, 500, and 504 errors.
Additional enhancements
- Updated the API Values page to include Audience IDs of “not” conditions.
- Added a confirmation modal when toggling a flag or rule On or Off.
- Upgraded Agent’s OpenAPI specification schema to version 3.1 with additional improvements to Agent’s error code messages and the descriptions of endpoints. View the updated API documentation.
- Updated the default name created when copying a rule to clarify that the rule is a copy.
March
Enhancements
- Improved the layout of the Flags list for better usability.
- Rules are set as paused on creation, which enables staging rules at scale.
Bug Fixes
- Fixed an issue where the Flags UI dashboard was not loading for some customers.
- Fixed an issue where a 500 error was being reported when trying to change the reporting date range in Program Management.