QA Checklist

Want to learn how to effectively QA your test prior to and following launching? Use our in-depth QA checklist to ensure that your tests are all set to launch, and look good once you've set them live.

Pre-launch QA

1. Save your edits in Shopify

Before launching your test, you want to make sure that your edits are saved in Shopify, or else your test may not show the changes you have intended to test

2. Use the "preview in browser" feature

All tests in Shoplift have a "preview in browser" feature, which allows you to easily open up your tested page(s) in a new browser tab. This allows you to ensure that critical functionality works, and that key visuals look as expected.

3. View your tested template on different pages on your store

When you use the preview in browser feature on your variant, you will notice that your URL has a string at the end of it with "?view=[template]".

Template tests leverage Shopify's "alternate templates" feature, which will render a specific template on a given page by appending this "?view" query parameter to the end of your URL.

To view your variant on different pages on your store, simply copy the string (including the question mark) and append it to the different collection, page, or product URLs included in your test.

Post-launch QA

1. Use an incognito browser to get served both test variants

Often times you may want to verify that your test is running as expected following launch. The easiest way to do this is with an incognito browser tab, since the tracking will reset each time you close and reopen your incognito window.

To use an incognito window to get served your test variant and experience the test as if you were one of your website visitors, first open a fresh incognito window in your browser and navigate to your tested page(s).

2. Verify that you are placed in the test

If you are served the variant, depending on the changes you are testing, you will immediately be able to tell because you will see the tested template or theme the moment you navigate to your test page(s) or your site in general.

If you are running a template test, you will be able to see the "?view=[template]" parameter appended to the end of your URL. If you are running a theme test, you will be able to see the Shopify preview parameter (?_ab=0&_fd=0&_sc=1)

However, if you are served the original, it may not be immediately evident that the test is running or that you are placed in the test. To verify this, you will need to check your local storage in your browser to confirm.

• To check your local storage, open the Developer Tools in your browser by clicking View > Developer > Developer Tools, or using Command + Shift + C (on Mac) or Control + Shift + C (on Windows).

• In the window that opens, on the right, you will see different tabs, titled Elements, Sources, Console, and more. There will also be a "more" menu (delineated with double arrows, like ⇉) which will give you other tab options. Click the dropdown and select "Application".

• In the Application tab, you will see a list of items marked "Storage". Click "Local Storage" and then click the name of your website in the list, like "https://mystore.com".

• In the menu on the right, you will see the items in local storage for your website. One of them will be marked "SHOPLIFT_SESSION_mystore.shopify.com".

• Click this, and you will see a list of attributes listed out. At the bottom will be an attribute called visitorTests

• If you are placed in a test, then the value for this attribute will look like [,...], indicating that it is populated with a value.

• Expand the list of values by clicking the small arrow to the left of visitorTests. You will see the list expand and reveal the ID of the test you are placed in.