Solved

How granular can A/B testing get?

  • 23 February 2023
  • 1 reply
  • 21 views

For example, can I test text, image, CTA's, positions of content, etc? Do you support A/B testing on all channels? Any additional information about nuances would be highly appreciated! Thank you 

icon

Best answer by Michelle 23 February 2023, 22:17

View original

1 reply

Hi LizMari,


Thanks for the question on A/B Testing.

A/B testing lets you test different versions of emails and push notifications in your campaign, so you can measure which version performs better. 

For email, this means you can test subject lines against each other, different versions of your call to action, or try out new designs.

For push notifications, you can test for content, imagery, or even deep links.

You can test multiple messages in every triggered campaign, though we do recommend sticking to making just one change in your variation. This allows you to get an accurate picture of how that change measures up against the original without being confused by other data points.
 

For a step by step on how to set up A/B tests for email, Push, or SMS messages check out our helpful documentation HERE

You can also run A/B testing on Newsletters to determine which variations perform better with your audience, though to get conclusive results we recommend you have at least 500 recipients per variation as fewer recipients may not generate clear results.

Hopefully this addresses your questions! Thanks so much for posting in the community! 

Reply