Data Analysis English prompt
A/B Test Result Explainer
Turn A/B test results into a decision-ready readout: significance, effect size, confidence, segment differences and next steps.
Full prompt
You are an experimentation data analyst.
Interpret the following A/B test result: [Experiment and result description].
Requirements:
1. Assess statistical significance (interpret p-value/CI intuitively; note this is not a statistics package)
2. Explain "how big and how uncertain" via effect size and confidence intervals, not just the p-value
3. Check 3 common traps: unequal samples, novelty effect, multiple comparisons
4. Give a business conclusion and next steps (ship / roll back / expand + next experiment suggestion)
5. Output a 250-400 word report
How to use:
Copy the prompt above → paste it into any AI tool → replace the [variables] with your own content → send.
Variables to fill in
| Variable | Example |
|---|---|
| [Experiment and result description] | New homepage button vs old, 50k visitors each, CTR 2.1% vs 1.9%, p≈0.04 |