All Collections
A/B Testing
A/B Test- Interpretation of data table in Purchasely
A/B Test- Interpretation of data table in Purchasely

Explanation of A/B test data and the visualization

Kirupa avatar
Written by Kirupa
Updated over a week ago

You have created and started a new A/B test for your desired Placement. Once the test is started, it goes live without any further dependency.

18/10/2023- We have improved the way unique viewers are calculated. Prior to this improvement Prior to this improvement, prefetched paywalls were counted, which could alter the value of unique viewers indicated in the A/B test results. Now, its based on the number of PRESENTATION_VIEWED

A/B test data table

  1. Name- of the A/B Test

  2. Name- of the placement in the A/B test

  3. Duration of the A/B test- the start date and the end date( if the A/B test is terminated)

Please note: that if any of your variant has multi step paywalls and those paywalls have purchase buttons then,
So the statistics and revenues are shown for the paywall with which the purchase was made. You will know more about the paywall in Webhook payload or other logs.

  1. Name- of the paywall test variant.

  2. Revenue- the sum of revenue generated by paid subscriptions of the variant.

  3. ARPU- the sum of revenue generated by paid subscriptions (excluding paid trials) and divided by the number of unique viewers

  4. ARPPU- the sum of revenue generated by paid subscriptions (excluding paid trials) and divide by the number of users who paid said subscriptions.
    We don’t divide it by the “Views to paid” metric, because in some cases we don’t have the associated revenues.

    ℹ️The revenue, ARPU and ARPPU are live data and are up to date even if the A/B test was stopped.

  5. Repartition- Weightage of the test variant.

  6. Unique Viewers- the total number of distinctive viewers of the paywall in the subject.

  7. Subscription Started- the total number of users who started their subscription with the regular price (Do not include the free trial or intro price).

  8. Trial Started- the total number of users who started their free trial or intro price or promo code.

  9. Trial Converted- the total number of users who started their free trial/intro price/promo code and converted to the regular price subscription.

  10. Trial Ended- the total number of users whose trial period ended(free trial/intro price/promo code).

  11. View to Paid- the sum of subscriptions started and trials converted.

    The percentage of views to be paid = (Subscription Started+Trial converted)/Unique Viewers.

  12. First Renewal- the total number of users who renewed their subscription while they were in the regular price cycle.

Did this answer your question?