At its most basic, A/B testing is a way to compare two versions of something to figure out which performs better. With Contentsquare you can:
- Use A/B test integration segments to perform an analysis
- If you do not have AB integrations with Contentsquare, create your test Segments with Custom or Dynamic Variables
- Set up your Zoning and combine different metrics to really understand how your users are interacting with the content to improve the UX even further
- Build your own custom Dashboards to monitor the performance of your key KPIs over time
How it works
Set up your segment and zoning
1. Set up integration segments
- If you have not yet integrated your A/B third-party tool with Contentsquare, go to the Integrations Catalog to request an integration.
- If you have an A/B integration with Contentsquare, those segments will appear in the analysis context menu's integration segments for you to select while using any feature:
2. Set your dynamic or custom variables
If you do not have a third-party integration tool to integrate with Contentsquare or integration is not yet available, you'll need to use dynamic or custom variables to perform an A/B test.
Your A/B test segments pass through to Contentsquare as dynamic or custom variables. To set them up you can follow these steps:
- Check if your tests are passed through as custom or dynamic variables. You can check what information is passed through to Contentsquare by using Contentsquare Tracking Setup Assistant. Get your extension here
- After its installed, open the extension
- Then, open the dynamic variable drop-down. The drop-down will give you the information about the key, the type and the value of your dynamic variables on the opened url.
3. Set up your Segment
Navigate to the Segments section and chose to create a New segment. A segment creation menu will open:
1. You can create the relevant segments by using the dynamic variable condition
2. Select the key of the variable. This is the name of the dynamic variable. Note that both the custom and the dynamic variables are case sensitive, Ex: ''UX - New Design" ≠ "UX - new design".
3. Choose its type ('number' or 'string'). Number contains a numerical value, string contains a value containing letters
4. Choose its value
5. Give your segment a name and click on Create to save it
Note! If you already have an existing integration, simply select it from the list of available integrations and choose the desired attribute.
| Tip: Select the option Quantify to be automatically redirected to the Impact Quantification module and quickly deep dive into the performance of your segments. |
4. Set up your Zoning
Navigate to the Zoning analysis module and click 'Select a page or page group'
Define which page you want to analyze, click 'Apply' and select 'Advanced set up' in the next window.
In the window that opens, navigate to the AB test analysis tab.
1. Select either 'Variation' or 'Dynamic variable'.
2. Choose the variation or dynamic variable you want to analyze from the drop-down list.
3. Set appropriate device, date range and segment for the test analysis.
4. Click 'Start analysis'
If you don't have an AB test integration
If you don't have a live AB test integration, you can setup your zoning by going through the default setting of creating a zoning by capturing a snapshot from your live website or by capturing a retroactive snapshot from Session Replay.
Learn more about Zoning creation here.
Set up your Dashboards
In Dashboards, you can easily compare the variant to the control on a range of KPIs. To monitor the performance of your A/B test you can create a dashboard to view important metrics at a glance.
- Site-level performance - create widgets with site-level metrics like conversion rate, average cart and bounce rate to understand how the test impacted the KPIs of each population
- Page performance - create widgets with page level metrics such as bounce rate, load time and percentage of visits achieving the test micro goals (e.g., add to bag, reach Checkout)
- Zone performance - create widgets for measuring the usage of the tested content (e.g., click rate of a new Homepage banner)
| Tip: Use these widgets to create Alerts, ensuring you find out quickly whenever something unusual happens. See how to create an alert and a widget. |