A/B Testing - Tools

There are different tools that can be used to generate hypothesis and to run the variations, these include −

  • Visual Website optimizer (VWO)
  • Google Content Experiments
  • Optimizely

All these tools are capable to run A/B Tests and to discover the winner, but to perform post analysis these tools should be integrated with Google Analytics.

A/B Testing – Google Analytics

Google Analytics has two options for analyzing the data −

  • Universal Analytics
  • Classic Google Analytics

New Universal Analytics feature permit you to use 20 concurrent A/B Tests sending data to Google Analytics, however the Classic version permits only up to five.


Integrating Optimizely with Google Universal Analytics

To integrate Optimizely in to Universal Google Analytics, first select the ON button on its side panel. Then you must have an available Custom to populate with Optimizely experiment data. Then the tracking code must be placed at the bottom of the <head> section of your pages. Google Analytics integration won't function properly unless the Optimizely snippet is above this Analytics snippet.


Configuration Steps

Optimizely utilizes Universal Google Analytics' "Custom Dimensions" to tag your visitors with the experiments and variations to which they've been included. Configuring Optimizely to begin sending this information to Universal Analytics requires four stages −

Step 1

Add the following JavaScript code to your website wherever the Universal Analytics code exists after the ga('create'...) function fires and before the Universal Analytics ga('send','pageview') function fires and the tracking call is made (see details in the following) −

// Optimizely Universal Analytics Integration
window.optimizely = window.optimizely || [];

Step 2

In the Optimizely Editor, go to Options → Integrations then click on the Universal Analytics checkbox to enable the integration.


Step 3

Select the custom dimension you would like Optimizely to use. You need to ensure that the Custom Dimension should not be in use already by any other part of your site, or by another currently-running Optimizely experiment.

Step 4

Select a Custom Tracker if you are using a custom event tracker other than the default. This will change Optimizely's integration call to utilize the custom tracker rather than the default.


Let us say your site is using the following call −

ga('tracker3.send', 'pageview');

In this case you will be entering tracker3 in specifying a custom tracker field, and Optimizely would integrate with tracker3 rather than the default tracker.

Making a Custom Report using Google Analytics

First step is to sign into your Universal Analytics account and click the Customization tab at the top. You should see a Custom Reports list.


Next is to set up a Custom Report for each experiment that you have integrated Universal Analytics with.

  • Click on the New Custom Report → Enter the report title and add the metric groups you wish to see in the report.

  • To filter this report for only your Optimizely experiment, choose the Custom Dimension you set up previously as one of the Dimension Drilldowns.

  • Include this dimension in the Filters section and utilize a Regex match on the experiment ID for the experiment you want to filter.

  • Click on Save.

Input your Topic Name and press Enter.