GrowthHackingIdea - A 23.8% lift was wrong. Was yours?

Copy Hackers ran a usual A/B test. After a week, the tool declared a 23.8% lift with 99.6% confidence.

But actually, both the control and the treatment were exactly the same.

Possible reasons worth checking:
1. A tool works incorrectly.
2. Load speed of your site is slow.
3. A code was placed wrong.
4. A test was stopped too early. Significance is not a stopping factor, sample size is.
5. You acquired traffic for a test from “unusual” sources.

Source: copyhackers.com


Cheers,
Charlie Patel ;)



Your friend wants to get access to our invite-only community of growth hackers from companies like Uber, Google, Microsoft, TechStars, Disney, Adobe, Coca-Cola, Amazon, etc.? Here's your personal invitation link for him/her: http://e.growthhackingidea.com/?ref=2145324&a4=1&a5=9

---

Unsubscribe | GrowthHackingIdea / StartupGrowth.com | 1460 Broadway New York, NY 10036