A/B Test

 

2. Operating Instructions

2.1 Create A/B Test

2.1.1 Create an A/B Test

(1) You can create and manage A/B Test from the [Manage] - [A/B Test] list. 

(2) Select APP and Mediation Unit you want to create A/B Test. 

(3) The effective time of the A/B Test can be selected immediately or at a specified time.

(4) After the A/B Test is created, the configure of the original Mediation Unit will be automatically synchronized to the group with the smallest ID in the A/B Test (for example, if three groups A\B\C are configured, it will be automatically copied to group A). ​​If other groups (B/C) want to synchronize the configure of the original Mediation Unit, you can use the copy function.

2.1.2 Complete the configuration for A/B test groups

After creating an A/B test, you will be automatically redirected to the page for configuring ad units for each A/B test group, where you can complete the configuration of the ad units 

After successfully creating an A/B test, you can also configure ad units for each A/B test group in Application - Mediation Unit.

 

 

 

2.2 View the A/B Test List and A/B Test Data

Enter the Management - A/B Test page, and you can see all the ad units that have enabled A/B testing. Select the A/B test you want to observe, and you can view the comparative data of different groups in the current A/B test.

A/B Test support data indicators:

• Est. Revenue
• Est. Revenue/Allocated Devices
• Est. Revenue/Impression Devices
• Allocated Devices
• Impression Devices
• Engage Rate
• Imp/Impression Devices
• Imp/Allocated Devices
• Mediation Unit Requests
• Mediation Unit Request Fill Rate
• Imp.
• Imp. Rate
• Est. eCPM
• Click
• CTR
• isReady
• isReady Rate
• Latency(sec.)

 

2.3 Stop A/B Test 

When you finish an A/B Test, you can select the optimal grouping strategy. After the test ends, the optimal grouping strategy is delivered by default.

For an A/B Test that has ended, you can click [History Settings] to view the advanced settings of different groups under the A/B Test.
Note that the history settings only record the advanced settings of each group before the end of the A/B Test.

 

3. FAQ

(1) How to allocate devices for A/B Test?

If the AB strategy remains unchanged, the device ID will be fixedly assigned to one of the groups. If the strategy changes, such as modifying the volume permissions, the device ID will be reassigned.