Progress of the Experiment

Understand the basics of the statistics we use to give you feedback and learn how to comprehend the results of an experiment.

Do visitors see the same version of the page under test every time they access the site?
Yes. You want to offer a consistent user experience to your visitors. If they see a different page / post every time they access your site they would quickl...
Tue, 23 Mar, 2021 at 11:53 AM
How Nelio A/B Testing decides on a winning variant
A winning variant in Nelio A/B Testing is the variant which is most likely to perform better than the original version of your element under test (a page, a...
Tue, 23 Mar, 2021 at 11:59 AM
How long should I run a test?
The duration for which you need to run your A/B tests depends on several factors such as follows: The complexity of the test. The more complex the test (m...
Tue, 23 Mar, 2021 at 12:07 PM
What is the meaning of the confidence value you provide together with the results? How to interpret it?
The confidence value tells you how “trustable” is the fact that one variant is better than the other/s. A high confidence value tells you that you can b...
Tue, 23 Mar, 2021 at 12:08 PM
What statistical test do you use to compare the variants?
Nelio A/B Testing service uses the G-Test. If you are interested, you can read more about G-Test in its Wikipedia page or (much easier to understand for non...
Tue, 23 Mar, 2021 at 12:09 PM