Menu

Post image 1
Post image 2
Post image 3
Post image 4
Post image 5
Post image 6
Post image 7
Post image 8
Post image 9
Post image 10
Post image 11
Post image 12
Post image 13
Post image 14
Post image 15
Post image 16
Post image 17
Post image 18
1 / 18
0

Your email A/B test winner might be lying and it’s costing you

MarTech·Kath Pay·28 days ago
#LCyskPaD
Reading 0:00
15s threshold

Everybody loves a winner, especially a winning test in email marketing. You know the feeling. The winner gives you clarity and confidence. You feel as if you’ve finally figured something out. It’s the holy grail of testing! You ran an A/B test on a campaign, one version outperformed the other, and now you have direction for your next campaign. Job done! Not so fast, dear email marketer. I don’t mean to be a killjoy. I am one of those email thought leaders who has written reams on the value of testing, here in MarTech and elsewhere. But I’ve also warned that the so-called “winner” might tell you only part of the story. You’re not done when the test is run! If you take your test results at face value, without questioning how they happened or what they really mean, you might end up making decisions that feel data-driven but could lead your email program in the wrong direction. The illusion of certainty A/B testing gives us seemingly definitive answers to important questions. That’s one reason why we trust it.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More