Introduction
The Experiments report helps merchants to make data-empowered decisions using the details from A/B Testing experiments. The Searchspring Management Console (SMC) lists an overview of every experiment on your site, both past and present. Click into any one of these experiments to see the full report.
Note: This feature is available on the Advanced and Expert plans. If you're interested in taking advantage of it, please reach out to your customer success manager.
Note: Visualizations (widgets) are sorted in descending order.
Current Campaigns tab
This tab displays all current campaigns with experiments. Campaigns that have had a winner selected will move automatically to the Past Campaigns tab. Click any experiment to see its full report.
The icon columns will show whether or not there was a difference in the experiment's variations in that portion of the campaign (such as banners being different between variations). Mouse over any blue icon to see details.
Campaign
This column lists the name of the campaign, which is also a link directly to that experiment's report.
Context
This column provides details of the context for the campaign, such as "collection_handle: sweaters-sweatshirts", or "collection_handle: mens".
Variations
This column displays how many variations of the campaign are being used in the selected experiment.
Banner
This column denotes if different banners are used for the selected experiment.
Boosts
This column denotes if the selected campaign has different boosts.
Filters
This column denotes if the selected campaign has different filters.
Pinning
This column denotes if the selected campaign has different pinned products.
Personalization
This column denotes if the selected campaign has different personalization.
Date Started
This column provides the date when the experiment started.
Time Left
This column shows how much time is left for the experiment.
If there are no current experiments, you will be directed to your campaigns page to create a new active experiment.
Past Campaigns tab
This tab displays any past campaigns.
Click any campaign name to see the report for that experiment.
Experiments report
This report shows the metrics of performance for each variation during the lifetime of the experiment. If the experiment has been completed, the winning variation will be bolded and highlighted. If you haven't chosen a winner to complete the experiment, you can click Select Winner to make your final selection.
Duration
The date span of the report is set to the duration of the experiment.
Report options
The report has various tools that allow you to easily navigate its data. The kebab menu (three dots) is available at the top of the report and also within the main graph/chart for this report. Simply mouse over a visualization or the chart to see the available options, which may differ for each visualization on the page.
If you decide to download the report or an element of the report (such as a chart or visualization), select "Download" to choose between an .xlsx or .csv export, or choose "Present" to share your screen:
Views Breakdown
This visualization shows the views reported for each variation of the experiment.
Conversions Breakdown
This visualization shows the conversions reported for each variation of the experiment.
Revenue Breakdown
This visualization shows the revenue reported for each variation of the experiment.
Experiment Results
This visualization shows an overview of experiments on your site, both past and present.
Variation
This column describes the variations used in the selected experiment.
Split
This column displays how the variations are split in percentage of presentation to shoppers. In the example shown above, two variations are each shown to 33% of users, while the third variation is shown to 34% of users.
Views
This column denotes how many views the selected variation has received during the experiment.
Transactions
This column lists how many transactions took place with the selected variation.
Revenue
This column displays the revenue from transactions within the selected variation.
Conversion
This column displays the percentage of conversions that occurred within the selected variation.
AOV
This column displays the average order value (AOV) of transactions that occurred within the selected variation.
RPV
This column displays the revenue per visit (RPV) for the selected variation.
Adding a Filter
To add a filter to the report, right-click any variation and click "Filter".
The report will update to reflect the filter applied:
To remove the filter from the report, click the "Clear all" button at the top of the page. This will remove the filter applied and reset the report to its original state.
Comments
0 comments
Article is closed for comments.