How Can I Test an Offer or Discount?
Find the right way to test a discount, sale, free shipping, free gift or other offer in Shoplift, and whether you need a developer.
Use this page to pick the right test for an offer you have in mind, such as a sitewide sale, a discount code or free shipping. Many offer tests need no developer.
Start with two questions
Are you testing how the offer looks, or the offer itself? A new banner design, a badge on product pages or a different place for the offer tests how it looks. Comparing 20% off with 30% off, or free shipping with no free shipping, tests the offer itself.
Where should visitors see it? An offer can appear on one type of page, such as your product pages, or across your whole store.
Test how an offer looks
In these tests, both groups get the same offer. Only the way the offer is shown changes, so you don't need to change any discount settings in Shopify.
A popup that appears after an action, such as when a visitor is about to leave
Yes
Test the offer itself
In these tests, each group gets a different offer. The right setup depends on how shoppers get the discount: by entering a code, or automatically. "Checkout setup" in the table means a developer adds code so your discount knows which group each visitor is in. See how checkout setup works.
A discount code against no discount
A template or theme test that shows the code to the variant only
No
One discount code against another, such as 10% off against 15% off
A template or theme test that shows each group its own code
No
An automatic discount, such as 20% off sitewide against 30% off sitewide
A template, theme or JavaScript API test, plus checkout setup
Yes
Free shipping, or a different free-shipping threshold
A template, theme or JavaScript API test, plus checkout setup. See Testing shipping thresholds
Yes
A free gift, buy one get one free, or "spend $100, save $20"
A template, theme or JavaScript API test, plus checkout setup
Yes
A subscription discount or a first-order discount
Not supported. A price test can change a subscription product's price, but not its discount percentage. See Subscription price testing
Not applicable
If you can't find your offer here, contact support and describe what you want to test.
How each kind of offer test works
Discount codes shown only to one group
Unless you've limited who can use it in Shopify, Shopify accepts a discount code from anyone who enters it, whichever test group they're in. When only the variant shows the code, almost everyone who uses it will be in the variant.
Create a new code for the variant, and don't share it in emails or on coupon sites while the test runs. If visitors in the original group find the code somewhere else, your results will be harder to read.
To set it up:
In your Shopify admin, create the new discount code for the variant.
Create a template test to show the code on one type of page, or a theme test to show it across your store.
In the variant, use the Shopify theme editor to add a banner or message that shows the new code.
Preview both versions, then launch the test.
The original is your store as it is now. To test one code against another, the original group sees the code your store already shows, such as a 10% welcome code in a banner. Keep it showing on your live store, and show the new code, such as 15% off, in the variant.
Automatic discounts, free shipping and free gifts
Shopify applies these offers to every shopper who meets the offer's conditions. Shopify doesn't know which test group a visitor is in, so on its own it gives both groups the same offer. The test then can't measure a difference between the offers.
To give each group its own offer, your developer adds a small piece of code to your theme that saves the visitor's test group to their cart. Your developer also builds the checkout side, so the offer checks that group: a discount app that can read it, or a custom discount. A discount made in the Shopify admin alone can't tell the groups apart.
To set it up: you create and launch the test, and your developer handles step 3 and the check in step 4.
Create the test that shows each group its offer, such as a template test where your store already shows "20% off" and the variant shows "30% off". Don't launch it yet. The original group keeps your current offer, 20% off here, and the variant gets the new one, 30% off.
Get the variant's ID to your developer, so their code can tell which group each visitor is in. For a template, theme or URL redirect test, copy it from the info tooltip next to the variant's name on the test's draft.
Have your developer set up the variant's offer so it applies only to carts from the variant, make sure your current offer doesn't apply to those carts, and add the code that saves each visitor's group. For a theme test, the code goes in the variant theme too. Keep the variant's offer switched off until all of this is in place.
Launch the test, then check both groups. As soon as the test is live, your developer opens a fresh private browser window, not one used for Shoplift's preview, adds a product to the cart and goes through to the checkout page. Shoplift puts each new visitor in a group at random, so they close all private windows and open a new one until they've seen both groups, and check that each group gets its own offer. If a group gets the wrong offer, pause the test and switch off the variant's offer until your developer fixes it. These few check visits count in the results like any other visits.
For developers: Save the visitor's test group to the cart so a Shopify discount can read it at checkout. See Give each test group its own offer at checkout.
Price tests
A price test changes the price shoppers see and pay for specific products, including at checkout, with no checkout setup. Discount codes and automatic discounts still work during a price test, for both groups.
A price-increase test changes your product's price in Shopify for the length of the test. Before you test a higher price, read Check your store before you price test.
Show an offer to one audience all the time
A personalization shows one version of a template, page or theme to a chosen audience, such as a Klaviyo segment or shoppers from one country. Personalizations can't change prices or apply discounts.
To personalize an offer, set up the discount in Shopify so only the right customers can use it. Then create a personalization that shows the offer's message to that audience.
A personalization has no original group to compare against, so it can't tell you whether the offer works. Test the offer first, then roll out the winner as a personalization.
Read the results of an offer test
Choose revenue per visitor (RPV) as your goal. RPV is the revenue your store earns for each visitor in the test. It shows whether a bigger offer brings in enough extra orders to pay for itself.
Revenue reflects what customers paid. A deeper discount lowers each order's revenue, so it has to win enough extra orders to come out ahead.
Free shipping has a cost of its own. A free-shipping winner still costs you the shipping fees you used to collect. Weigh that against the lift before you keep it.
Shoplift doesn't know your costs. An offer can win on revenue and still cost you margin. Check the winner against your product costs before you keep it.
Common mistakes
Expecting a theme test to change discount settings. A theme test changes your theme only. Discount codes and automatic discounts stay the same for both groups unless your developer adds checkout setup.
Running a sitewide sale during an offer test. A store-wide discount reaches both groups and can hide the difference you're testing. Plan offer tests around your sales calendar.
Using a personalization to test an offer. A personalization shows the offer to everyone in its audience, so there's nothing to compare it with. Use a test first.
Next steps
Related articles
Still need help? Contact support to chat with the Shoplift team in the app, or email help@shoplift.ai. Include your store URL and the name of your test.
Last updated
Was this helpful?