You can A/B test 2 Attentive journeys by giving each popup in the test its own sign-up source. Attentive decides which journey a new subscriber enters from the sign-up source they came in through, so a different sign-up source means a different journey. This guide assumes Attentive is already connected. See Integrating Alia with Attentive.
Before you begin
Set up the second journey in Attentive and turn it on. A journey in draft or paused won't send.
Ask Attentive support for a new API sign-up source and connect it to the second journey. Tell them you'll collect emails and phone numbers, that visitors type in their details on your site, and that the messages are marketing.
Note the new Sign up source ID. It's at the bottom of the Sign-up Units page in Attentive.
Sign-up units made for Attentive's own popups don't accept subscribers from Alia, so the new source must be an API source.
Add a variant to your campaign
In Alia, go to Campaigns and open the campaign you want to test.
Select Add test variant. Alia copies your live popup into Drafts.
Make any other changes you want to test in the new variant, such as a different offer.
đĄ Tip: To have Lia build the new variant for you, select the arrow next to Add test variant, then Build variant with Lia.
Send the variant to the new sign-up source
Leave your live popup on your default sign-up source. Change only the new variant.
Open the new variant in the popup editor.
With nothing selected, go to the Integration settings tab.
Expand Attentive settings.
Enter the new Sign up source ID.
Select Save.
The section shows Using default settings until you change something. If you've connected more than one Attentive account, each account has its own Attentive settings for section, so set the new ID in the right one.
đĄ Note: A popup's Integration settings apply the first time Alia sends a visitor to Attentive. If that visitor later signs up through another popup, Alia keeps the first popup's sign-up source. To make sure every signup from a form uses the new source, set the Sign up source ID in that form's own Attentive settings instead.
Start the A/B test
On the campaign, check that the new variant shows Ready under Drafts. If it shows Not ready, open it and select Mark as ready.
Select Start new A/B test.
In the New A/B test window, enter a Title, such as "Attentive journey test â welcome A vs B".
Check that Control is your original popup.
Leave Equal traffic split on for a 50/50 split, or turn it off to enter your own percentages.
Select Start test. If the campaign isn't live yet, select Create and publish or Create and schedule instead.
Starting a test puts every popup in the campaign into it. If there's a draft you don't want in the test, archive it first. Each visitor is assigned to one variant and keeps it for the rest of the test, so they always enter the journey for that variant's sign-up source. For more on setting up and reading tests, see Setting Up A/B Tests in Alia and Reading your A/B test results.
Pick a winner
When you select Pick as winner, the winning popup becomes the campaign's only live popup, and the other variant moves to Drafts. From then on, every signup goes through the winner's sign-up source and journey. If the new variant wins and you want that journey for good, you can keep it as is, or set its sign-up source as your default in Alia.
Frequently asked questions
Signups from my test variant aren't entering the new journey. What should I check?
Open the variant's Integration settings and check that Attentive settings shows the new Sign up source ID. If a form or reward in the popup has its own Attentive settings, that setting is used instead. Then check that the sign-up source is an API source from Attentive support, and that the journey is attached to that exact source and turned on.
Do I need a new sign-up source for every test?
You need one sign-up source per journey. If you test the same 2 journeys again later, you can reuse the same sign-up sources.
Can I test more than 2 journeys at once?
Yes. Add a variant for each journey and give each one its own sign-up source. There's no set limit on the number of variants.
Why do my Alia signup numbers not match Attentive?
Alia counts every form submission. With double opt-in, Attentive only counts subscribers who replied Y, so its number is lower. Compare with SMS opt-ins in your Alia results instead.
Still have questions?
Start a chat from inside the Alia app, or use the chat in our Help Center.
