A/B Test Calculator
Determine statistical significance of A/B test results. Calculate z-score, p-value, conversion lift, and whether your variant beats the control at your chosen confidence level.
Inputs
Results
Statistically Significant?
No
Winner
No clear winner
How to Use This Calculator
- Enter the number of visitors and conversions for both the control and variant groups.
- Set your desired confidence level (typically 95%).
- Review whether the result is statistically significant and which variant wins.
- Check the relative lift percentage to assess practical significance beyond statistical significance.
- Only implement the variant if both statistical significance and minimum detectable effect are achieved.
Related Calculators
Confusion Matrix Analyzer
Analyze classification model performance from confusion matrix values. Calculate precision, recall, F1 score, MCC, accuracy, specificity, and more.
Cohort Analysis Calculator
Analyze user cohort retention over time. Calculate monthly retention rates, churn rates, estimated customer lifetime value (LTV), and total cohort revenue.
Outlier Detection Calculator
Detect outliers using IQR bounds, z-score bounds, and modified z-score methods. Determine whether a data point is an outlier using configurable thresholds.
Six Sigma Level Calculator
Calculate sigma level, DPMO, defect rate, and process yield from defects, opportunities, and units. Includes performance level assessment and COPQ estimate.