A/B Testing Dashboard

Interactive statistical learning tool for hypothesis testing

Powered by Purdue University Statistical Methods

Test Configuration

Website Conversion Rate Test

Testing if a new website design improves conversion rates

Group A: Original Design

Conversions: 120 out of 1000

Rate: 12.00%

Group B: New Design

Conversions: 150 out of 1000

Rate: 15.00%

Learning Notes

P-Value: The probability of observing this difference (or more extreme) if there's truly no difference between groups.

Z-Statistic: Measures how many standard errors the observed difference is from zero.

Effect Size: The actual difference between groups, regardless of statistical significance.

Statistical Power: The probability of detecting a true difference when it exists.

Visualization

Test Results

🎉 Statistically Significant! The difference of 3.00% is unlikely due to chance alone (p = 0.0159). We can reject the null hypothesis.

Z-Statistic

2.404

P-Value

0.0163

Effect Size

3.00%

Statistical Power

75.2%

Statistical Details

Hypothesis Test Setup

H₀: p₁ = p₂ (No difference between groups)

H₁: p₁ ≠ p₂ (There is a difference between groups)

Significance Level: α = 0.05

Confidence Interval (95%)

The true difference is likely between 0.55% and 5.45%

Key Metrics

Pooled Proportion: 13.50%

Standard Error: 0.0125

Group A Rate: 12.00%

Group B Rate: 15.00%