Progress of the Experiment

Understand the basics of the statistics we use to give you feedback and learn how to comprehend the results of an experiment.

Do visitors see the same version of the page under test every time they access the site?
Yes. You want to offer a consistent user experience to your visitors. If they see a different page / post every time they access your site they would quickl...
Fri, 13 Mar, 2015 at 5:12 PM
Download Nelio A/B Testing graph reports
You can download the charts and graphs that are displayed in the results of an experiment. Just click on the top-right icon in every chart and a specific me...
Thu, 5 Mar, 2015 at 10:42 AM
How Nelio A/B Testing decides on a winning alternative
A winning alternative in Nelio A/B Testing is the alternative which is most likely to perform better than the original version of your element under test...
Fri, 13 Mar, 2015 at 10:14 AM
How do I check if Nelio A/B Testing is working properly and alternatives are active?
Nelio A/B Testing does not track admin users. Therefore, if you want to check whether Nelio A/B Testing is working or not, the first thing you have to ...
Mon, 26 Sep, 2016 at 8:15 AM
How do I know the status of my experiments?
It may be difficult to interpret the results of a running A/B testing experiment. For that reason you can easily know the status of your experiment by looki...
Fri, 13 Mar, 2015 at 5:12 PM
How long should I run an experiment?
The duration for which you need to run your A/B testing experiments depends on several factors such as follows: The complexity of the experiment. The...
Tue, 3 Mar, 2015 at 9:39 AM
Using email notifications
Nelio A/B Testing will send notifications to the e-mail provided when you registered to the service. In addition to it, you can specify another email addres...
Tue, 3 Mar, 2015 at 12:55 PM
Visitors are not being tracked properly
Several factors affect the way your website visitors are tracked by Nelio A/B Testing. The following are some probable reasons for the discrepancy in the vi...
Fri, 13 Mar, 2015 at 5:28 PM
What is the meaning of the confidence value you provide together with the results? How to interpret it?
The confidence value tells you how “trustable” is the fact that one alternative is better than the other/s. A high confidence value tells you that yo...
Fri, 13 Mar, 2015 at 5:08 PM
What statistical test do you use to compare the alternatives?
Nelio A/B Testing service uses the G-Test. If you are interested, you can read more about G-Test in its Wikipedia page or (much easier to understand for non...
Fri, 13 Mar, 2015 at 5:09 PM