AB Tests dashboard

circle-check

The AB Tests dashboard in Didomi CMP analytics enables your organization to view how your configured AB tests are performing against a control. In this article, we will provide a brief overview of the data and visualizations found in the AB Tests dashboard.

To start, click Analytics on the left-hand panel and select the AB Tests card on the subsequent page.


AB Tests dashboard filters

The following filters are available for the AB Tests dashboard:

  • Date aggregation

  • Date

  • Apikey

  • Device type

  • Device OS

  • Platform

  • Domain(s)/ App(s) (Include)

  • Experiment Id

circle-info

Click here for more information on each available filter.

AB Test dashboard data and visualizations

The following tables and visualizations are available for the Exploration dashboard:

circle-info

Review the Didomi CMP metric glossary for more information on metrics found in the dashboards.

Table/Visualization
Description

Live experiments

Lists all active experiments by Experiment Id

First experiement date

The start of the earliest experiment that is included within the periodization

Last experiment date

The start of the latest experiment that is included within the periodization

Domains/MobileApps

Count of domains and mobile apps with experiments

Domains

List of domains that have experiments

Details by domains

View CMP consent scope metrics such as total choices, consent rate, opt-in rate for each domain/mobile app broken down by test and control group

Total choices

Total number of consent choices made by end-user. It covers opt-in and opt out choices.

Control - Consent Rate

Percentage of opt-ins among the choices made by end-users in the control group when the end-user made a choice in the consent notice

Test - Consent Rate

Percentage of opt-ins among the choices made by end-users in the test group when the end-user made a choice in the consent notice.

Consent Rate Lift

Calculates the percentage change in the consent rate between your configured test and control

Consent Rate - Control vs Test group

Represents trend of consent rate for control and test group, respectively, in the configured periodization Note: Intervals on the line graph will be based on your selected date aggregation.

Total Choices - Control vs Test group

Represents trend of total choices for control and test group, respectively, in the configured periodization Note: Intervals on the line graph will be based on your selected date aggregation.

Notices Displayed

Total number of notices displayed across control and test group

Control - Opt-out Rate

Percentage of end-users within the control group who rejects consent for all purposes and vendors

Test - Opt-in Rate

Percentage of end-users in the test group who accepts at least one purpose and one vendor when the consent notice was displayed.

Opt-in Rate Lift

Calculates the percentage change in the opt-in rate between your configured test and control

Opt-in Rate - Control vs Test group

Represents trend of opt-in rate for control and test group, respectively, in the configured periodization Note: Intervals on the line graph will be based on your selected date aggregation.

Total Notices - Control vs Test group

Represents trend of total choices for control and test group, respectively, in the configured periodization Note: Intervals on the line graph will be based on your selected date aggregation.

All data

View all available data regarding the control and test group for each domain/mobile app

Last updated