Digital product

A/B Test Result Calculator

A pooled z-test on your result, the sample size the test actually needed, the smallest lift your traffic can detect, and an honest warning about the three ways teams routinely fool themselves.

xlsx· v2.0· 84 KB

What you’ll get

  • Enter visitors and conversions for control and variant on Test.
  • Read the confidence level, then the sample-size check beneath it.
  • Planner tells you, before you start, how long a test must run to prove a given lift.
  • Pitfalls covers peeking, multiple variants and the difference between significance and value.
  • 11 tabs, including a live dashboard, a diagnostics read-out and benchmarks
  • Excel workbook with every formula visible and unlocked inputs, so you can change anything
  • Worked examples built in: five filled scenarios you can switch between and edit
  • Yours to keep. Works offline, no subscription, no account needed to open it

Preview

Preview 1