Skip to main content

15 popup A/B tests to improve performance

15 popup A/B tests that can lift your email and SMS signups, and which ones Smart Tests can run for you.

Written by Rob D

Improving popup performance usually comes down to testing the right things in the right order. Here are 15 A/B tests that can help increase email and SMS signups while keeping the shopping experience smooth.

💡 Tip: Many of these tests can run automatically as a Smart Test. You pick and approve the tests, and Alia runs them one after another, keeps each winner, and moves on. See Setting up Smart Testing in Alia.

1. Prism AI personalization

Prism AI tests different versions of content inside one popup, such as headlines, images, or buttons, and sends more traffic to the ones that perform best. It can learn a different winner for different groups of visitors, such as visitors from different traffic sources. You create every version, and Prism AI decides which to show to whom.

Don't test Prism AI against no Prism AI straight away. Let it learn first, then test the optimized popup against your standard popup.

2. Smart Trigger

Smart Trigger watches how a visitor behaves on your store and opens the popup when they look likely to sign up. It works alongside your usual triggers. A common setup is a time delay for the first showing, with Smart Trigger giving likely buyers another chance after they close the popup. Test Smart Trigger on vs off on its own, separately from other changes.

Smart Test: Smart Trigger. See Setting up Smart Triggering.

3. Headline wording

Small headline changes can make a real difference. Examples:

  • "Want 10% off?"

  • "You've got an exclusive discount"

  • "You've got a special discount"

  • "Claim your mystery discount"

  • "Unlock your offer"

  • "Claim your discount"

Aim for clarity and curiosity in your brand's voice. Mix different openings ("You've got", "Claim", "Unlock") with different offers (a mystery discount, the stated amount, an exclusive discount).

Smart Test: Header and button copy suggests mystery, exclusive, and special variants for you to review.

4. First-screen format

The first screen has a big effect on conversion. Formats to test:

  • Email first

  • Yes/no question

  • Mini quiz

  • Spin to win

  • Scratch off

  • Mystery box or pick a card

  • Plinko

Different audiences respond to different levels of engagement. Smart Test: First step variants.

5. Mini-quiz questions

Mini quizzes can increase engagement and collect useful preference data. Try different questions:

  • "What are you shopping for today?"

  • "Who are you shopping for today?"

  • "What's your skin type?"

  • "Which product category interests you most?"

These often suit beauty, apparel, and wellness stores.

6. Popup design

Keep the same offer and structure, and change the design. Things to test:

  • Layout, such as the image on the left or right, or top or bottom

  • How prominent the offer text is

  • Fullscreen vs not fullscreen

  • Mobile layout

  • Visual hierarchy

Smart Test: Different templates.

7. Urgency and countdown timers

Urgency can encourage shoppers to act sooner. Examples:

  • "Limited time offer"

  • "Today only"

  • "Offer ends soon"

This works best with a strong offer and a clear button. Try adding a countdown timer, and test different lengths.

Smart Test: Countdown timer.

8. Button text

Short, simple button text often performs better. Examples:

  • "Continue"

  • "Activate"

  • "Get my offer"

  • "Claim discount"

  • "Activate discount"

Smart Test: Header and button copy.

9. Fewer ways to close

Fewer choices can mean less friction. Tests to try:

  • Remove the "No thanks" button under the sign-up form or first screen.

  • Keep only the "No thanks" button and remove the X button.

Balance this with a good shopper experience. Smart Test: Remove "No thanks".

10. Close button placement

Small changes to the close button can matter:

  • Left vs right

  • Larger vs smaller

  • Showing it after a short delay

Watch bounce rate and store conversion rate alongside popup results. Smart Tests: X button position and X button delay.

11. Popup timing

Showing the popup at the right moment matters. Test:

  • Different time delays

  • Adding a scroll depth trigger

  • Exit intent

  • Different timing on mobile and desktop

The best timing often depends on traffic source and landing page. Try separate campaigns for different sources, each with its own timing.

Smart Test: Trigger delay finds the best delay for you. See How to set up a time delay test.

12. Product vs lifestyle images

Images can strongly influence signups. Try:

  • Product-only images

  • Lifestyle photos

  • UGC-style images

  • Minimal layouts with no image

13. No images on mobile

On small screens, a simpler popup can work better. Removing images on mobile can reduce clutter, make the text easier to read, and focus attention on the button.

Smart Test: Remove mobile images. See How to set up an A/B test with no mobile images.

14. Background colors

Contrast and readability can affect conversion. Test:

  • Light vs dark backgrounds

  • Higher contrast designs

  • Different accent colors

Stay consistent with your brand.

15. Floating buttons

A floating button gives shoppers another way to sign up without interrupting them. Test:

  • Left vs right placement

  • Different icons

  • Animated styles, such as pulse

  • Different sizes

When testing a floating button, keep Smart Trigger off so you only measure the button.

Tips for reliable results

  • Change one thing at a time, so you know what made the difference.

  • Start with bigger structural tests, then move to wording, design, and timing.

  • Run each test for at least a full week, so weekday and weekend shoppers are both included.

  • Don't edit a variant while its test is running.

See How to A/B test popup vs no popup to measure your popup's overall impact.

Still have questions?

Start a chat from inside the Alia app, or use the chat in our Help Center.

Did this answer your question?