Scheduling Tests

Overview

Shoplift’s test scheduling feature allows you to plan and manage the timing of your tests to ensure they align with your business needs. You can set tests to launch and end at specific dates and times, or configure them to automatically end when they reach statistical significance.

Scheduling options

Schedule a launch time

Schedule the exact date and time when your test will start collecting data. This can be set in advance to align with marketing campaigns, sales, or other key events.

Schedule an end time

Set a scheduled end date and time for your test. This option is helpful if you want to run tests within a specific time frame or sync them with other business activities.

Schedule a test to automatically end when it reaches significance

Choose to end the test automatically when statistical significance is achieved, ensuring you only gather data as long as it’s meaningful. If you select both a scheduled end time and an automatic end at significance, the test will end based on whichever event occurs first.

Schedule a test

The test scheduler can be accessed from various pages in Shoplift.

Test draft page

On the draft page, you can set a schedule by clicking the Schedule button in the top right, next to the launch button.

You can tell if a test is scheduled by the type of badge that shows up next to the test name:

• "Draft" badge: this test is unscheduled

• "Date and time" badge: this test is scheduled to launch at a specific time

• "Scheduled badge": this test has multiple schedule options set

Test list page

On the test list page, from the Live or Draft tabs, you can set a schedule by clicking the Actions button (the three dots) to reveal the actions dropdown list. You will see various scheduling options depending on your tests current schedule:

• Schedule test: opens the test scheduler so you can set a schedule

• Edit schedule: opens the test scheduler so you can edit a schedule

• Remove schedule: quickly removes a set schedule from a test

If a test has a schedule, a separate Edit schedule button will be displayed next to the Actions button so you can easily distinguish which tests are and are not scheduled.

Test report page

On the test report page, you can set a schedule by clicking the Schedule button in the top right, next to the End button.

Once a scheduled end time is set, it will be displayed next to the test start time as long as it remains scheduled.