Overview
The A/B Testing feature is a simple and fast way to test different mailings on a portion of your list before sending to everyone. You can see the performance (open rate, click-through rate, etc.) and then decide which mailing is the best - and then send that one to the rest of the list. You can use this feature to check if a different subject line would help or to see if a different creative, colors, etc. would be better. Test two or more versions head-to-head or just one message on it’s own to make sure it performs up to expectations before you send it.
How To
To get started with A/B testing, you’ll need to select multiple mailings to compare. You can either create new ones or use existing mailings already in your account.
- Go to the Mailings tab
- Create 1–5 mailings or select existing ones
- Check the boxes next to the mailings you want to test
- Click A/B Testing
After selecting your mailings for A/B testing, you’ll be taken to the scheduling page where you can define how much of your audience will be used for the test. A slider will appear on the right side, allowing you to choose the percentage of your list that will receive the test messages.
- On the Schedule Mailing page, locate the slider on the right
- Adjust the slider to select the test percentage of your list
- The selected portion will receive the A/B test messages
We recommend waiting 24 hours before reviewing results to get an accurate comparison of your A/B test performance. You can then review detailed reports to determine which mailing performed best and send it to the rest of your list.
- Go to the Reports tab
- Select Individual Mailings
- Choose the messages you tested
- Run the report to compare performance side by side
- Select the best-performing mailing
- In the Schedule Remainder section, click Send Now to complete the campaign
If you need a deeper analysis of your A/B test results, you can access detailed reporting for each mailing. This allows you to explore specific engagement metrics and take further actions based on recipient behavior.
- Click the Details section in your report
- View in-depth metrics and performance data
- Use available options to:
- Download opens, openers, or opt-outs
- Review bounce data
- Copy openers to a list for follow-up campaigns
Note: The mailings should differ in some way. You may want to change subject lines, use a second domain, or maybe try out different content to gauge user response.
Comments