Search for articles…
Running tests
Running tests
Flicker, traffic splits, bandits and winners.
The original page flashes before the variant
A speed or caching plugin is delaying the anti-flicker script. Keep the snippet in the <head> and exclude it from optimisers.
The page stays blank for a few seconds
An optimiser is holding the engine back, so the page only shows when the anti-flicker safety timeout runs out.
Do visitors always see the same variant?
Yes. A returning visitor keeps the variant they were first given, and a new traffic split only applies to new visitors.
How the multi-armed bandit moves traffic
The bandit re-splits traffic as new conversions arrive, sending more visitors to variations doing better while the control keeps 10%.
How is a winner decided?
A Bayesian check runs nightly. A variation wins only when it clears every threshold, and the call can be withdrawn if its lead fades.