A winning variant in Nelio A/B Testing is the variant which is most likely to perform better than the original version of your element under test (a page, a widget, a menu, ...).

Nelio A/B Testing uses the G-test statistic for computing the results of a test. The G-test statistic is a measure of how much overall variation there is from an ideal prediction that you would expect if all versions were the same.


At what confidence do we end the experiment? There is no hard rule, however a common benchmark is 95% confidence. By default, Nelio A/B Testing decides that there is a statistically significant winning alternative, when the confidence level we get from the G-test statistic reaches 95%.