[V6] Optimize your store with A/B testing

The Conversion and Conversion rate metrics have been temporarily disabled for technical updates. We will improve the accuracy of these metrics and expect them to be available again in the near future.

In this article, we’re going to learn how to apply A/B Testing to compare two versions of your pages against each other to determine which one performs better.

Firstly, you can check this 5-minute video tutorial to get started with the GemPages A/B Testing feature:

How to create an A/B testing campaign

Step 1: From the Gempages Dashboard, click on “A/B Testing” from the left sidebar and select “Create New Campaign.”

Step 2: There will be a pop-up for you to enter the campaign’s name. Hit “Next” when finished.

Step 3: After that, there will be an opened window to show you a list of pages you created previously. Select the Original page and then the Variation page.

Click on “Create” when finished.

Step 4: Next, you will see the summary of the A/B testing campaign you’ve just created. Hit “Start campaign” when finished with all the configurations.

If you want to test the 2 product templates, you will need to assign the product to one template and set it as the Original page. Another template will be set as the Variation page with no product assigned.

To know more about the product assignment, please refer to this article.

Configure the Campaign Settings

Test URL

The Original and Variation page will share the same URL.

Test Duration (days)

In this section, you can choose the duration of the campaign.

Step 1: From the campaign summary, hit the Settings button.

Step 2: Adjust the duration of the campaign and click “Save.”

Traffic percentage

Step 1: From the campaign summary, hit the Pencil icon.

Step 2: Use the slider or enter the number to adjust the percentages. Select “Save” when finished.

Actions

Hit the Eye icon to preview the page, and select the three-dot icon to perform more actions, including rename, edit, or duplicate page.

Campaign status

You can see the status of your campaign in this section.

On hold: The campaign hasn’t started or is being paused temporarily.
Running: The campaign is running.
Completed: The campaign has finished its test duration.

When the campaign is running, it’s recommended not to make any changes to the Original and Variation templates, including editing, turning on/off the Header/Footer, and re-publishing the template.

Campaign report

To enable GemPages to collect the data for the report, you will need to connect GemPages with Google Analytics first. After that, you can check the report from Google Analytics by clicking on the Report button.

The campaign report lists the traffic weight, followed by seven key metrics as below:

Unique Users: The count of visitors to your website, without including any duplication.
Sessions: The number of user sessions on your page. A session is defined as a continuous period of user activity in the browser, where successive events are separated by no more than 30 minutes
Pageviews: The total number of times a page is loaded in the browser (including reloads).
Add to Cart: The total number of times the Add to Cart button is clicked
Add to Cart rate: The total number of Add to Cart divided by the total number of Sessions.
Conversions: The total number of successful transactions (purchases).
Conversion rate: Calculated by dividing the total number of Conversions by the total number of Sessions.

The report will be available for viewing after 24 hours and updated every 30 – 60 minutes, using real-time data from Google Analytics.

If you would like to compare the data between GemPages and Google Analytics, check out this article for detailed instructions.

That’s how you can use the A/B testing to test the potential of each variation to make data-driven decisions that ensure a positive impact.