2024 Feature Experimentation release notes

8 min

Subscribe to updates on this page using the notification and RSS feed options.

Optimizely Feature Experimentation

December

Released event properties, which let you attach additional information to an event to all customers.

November

Released Custom Flags Dashboard to all customers.

October

Released Custom Flags Dashboard to beta.

Released event properties to open beta. See event properties.

September

Released Optimizely Reporting for Experimentation, providing you with dashboards and reports that show key metrics such as experiment velocity, conclusive rate, win rate, and uplift.

Updated the Event Key text field to automatically populate with the Event Name formatted in lowercase, replacing any non-alphanumeric characters with underscores. See Create an event in Optimizely Feature Experimentation using the UI.

August

Began rolling out Flag Lifecycle Management to customers, which helps you view the state of your experiments and targeted deliveries. See Manage flags and Manage rules.

Released granular roles and permissions, which gives you fine-grained access control of the entities in your projects.

Released event properties to beta. Event properties let you filter a created event in Optimizely’s UI based on additional information you have attached to it. When you send events, you can add information about the product or action performed to create a more specific metric when using the event in the experiment results. Contact your Customer Success Manager or sign up for the beta on Optimizely.com. See event properties.

July

Renamed the following Optimizely REST API endpoints to clarify they archive the entities instead of deleting them:

Archive custom event.

Archive an attribute.

Feature Experimentation REST API enhancements

Added variations and metrics to the response for the List Rules endpoint – The /rules endpoint now returns high-level information on variations for flag rules and metrics for A/B tests and multi-armed bandits. For example,

{
        "name": "Repeat Buyers Test",

        // ...

        "variations": {
            "off": {
                "key": "off",
                "name": "Off",
                "percentage_included": 3333,
                "variation_id": 329457
            },
            "repeat_buyers_1": {
                "key": "repeat_buyers_1",
                "name": "Repeat Buyers 1",
                "percentage_included": 3333,
                "variation_id": 373838
            },
            "repeat_buyers_2": {
                "key": "repeat_buyers_2",
                "name": "Repeat Buyers 2",
                "percentage_included": 3334,
                "variation_id": 373839
            }
        },
        "metrics": [
            {
                "event_id": 27053200523,
                "scope": "visitor",
                "aggregator": "unique",
                "winning_direction": "increasing",                 
                "display_title": "addToCart"
            },
            {
                "scope": "visitor",
                "aggregator": "sum",
                "winning_direction": "increasing",
                "display_title": "Overall Revenue"
            }
       ]
}

Updated the API response for the List Reports endpoint – The revision field was previously documented in the API reference but not actually returned by the API. The API response was updated to return the revision field.

Updated documentation for layer_experiment_id – The following API endpoints return the layer_experiment_id field, but it was not consistently documented. Updated the Feature Experimentation API reference to ensure consistency with actual API behavior.

Fetch the Rule for a Ruleset in an Environment

List Rules

Fetch a Rule for a specific experiment\_id

June

Released the ability to sign up for email notifications when Optimizely Experimentation detects a sample ratio mismatch in your running experiments. See Enable email notifications in Optimizely Experimentation.

Updated the /reports endpoint to return tokens for pagination of results as a stand-alone element (previously only included in URLs in response). This makes it easier to programmatically form URLs to request reports from other pages.

Also updated the /reports endpoint to return valid endpoints for fetch_results_api_url and fetch_results_ui_url to fetch experiment results with subsequent API calls.

Released lifecycle management for flags and rules to open beta. This introduces new statutes and makes it easier to see the state of your experiments. See Manage flags and Manage rules.

May

Released the ability to use cross-project events to track events from your Optimizely Web Experimentation projects in your Optimizely Feature Experimentation project. See Cross-project events.

Launched automatic creation of flag variables by brainstorming using Mark (Optimizely Agent Platform).

Renamed and released Advanced Audience Targeting to Real-Time Segments for Feature Experimentation. This lets you use Optimizely Data Platform (ODP) real-time segments to build your Feature Experimentation audiences.

Updated the minimum SDK versions required for migration from Full Stack (Legacy) to Feature Experimentation. See Upgrade to Optimizely Feature Experimentation from Optimizely Full Stack.