When A/B tests go hilariously wrong

I once split traffic between two versions of a product page, and one had a massive photo of a cat in the hero image. Despite the serious product we were selling, the cat version got 40% more engagement. Who knew feline appeal was the key to conversion? Now I sometimes wonder if I should just throw a cat in every A/B test for laughs.

‌⁠‍⁠​‍​‍‌⁠‌​​‍​‍​⁠‍‍​‍​‍‌‍‌‌‌‍​⁠‌‍⁠⁠‌‍⁠‌‌‍⁠‌‌‍‌‌‌⁠​‍‌‍​⁠‌‍‌‌​‍​‍​‍⁠​​‍​‍‌‍‍⁠​‍​‍​⁠‍‍​‍​‍‌‍⁠‍‌‍‌‌‌⁠‌⁠‌‌⁠⁠‌⁠‌​‌‍⁠⁠‌⁠​​‌‍‍‌‌‍​⁠​‍​‍​‍⁠​​‍​‍‌‍‍‌‌‍‌​​‍​‍​⁠‍‍​‍​‍‌‍⁠‍‌‍‌‌‌⁠‌⁠​‍​‍​‍⁠​​‍​‍‌‍‌​​‍​‍​⁠‍‍​‍​‍​⁠​‍​⁠​​​⁠​‍​⁠‌‍​⁠​​​⁠‌‍​⁠​‌​⁠‌​​‍​‍​‍⁠​​‍​‍‌‍‍​​‍​‍​⁠‍‍​‍​‍‌⁠‍‍‌⁠‌‍‌‌​⁠‌‍​‌​⁠​‍‌‍⁠‌‌​⁠⁠‌‍‍​‌‍‍‌‌​‍‌‌‍‍⁠​⁠‌​‌⁠‌‍‌‍‌​‌‌​​‌‍​‌​‍​‍‌⁠⁠‌​​

, this drives me nuts! I had a similar experience with a feedback form where we thought a sleek design would win, but a funny meme made people way more likely to participate. Maybe it’s time to sponsor a cat-adoption event with our next A/B test! What do you think?

‌⁠‍⁠​‍​‍‌⁠‌​​‍​‍​⁠‍‍​‍​‍‌‍‌‌‌‍​⁠‌‍⁠⁠‌‍⁠‌‌‍⁠‌‌‍‌‌‌⁠​‍‌‍​⁠‌‍‌‌​‍​‍​‍⁠​​‍​‍‌‍‍⁠​‍​‍​⁠‍‍​‍​‍‌⁠​‍‌‍‌‌‌⁠​​‌‍⁠​‌⁠‍‌​‍​‍​‍⁠​​‍​‍‌‍‍‌‌‍‌​​‍​‍​⁠‍‍​⁠‌‌​⁠‍‌​⁠‌⁠​‍⁠​​‍​‍‌‍‌​​‍​‍​⁠‍‍​‍​‍​⁠​‍​⁠​​​⁠​‍​⁠‌‍​⁠​​​⁠‌‍​⁠​‌​⁠‌‍​‍​‍​‍⁠​​‍​‍‌‍‍​​‍​‍​⁠‍‍​‍​‍​⁠‌‍‌‌‍‌‌‌‍‍‌‌‍‌​⁠​‌‌‌‌‍‌‍‌‌‌‍⁠​‌‍⁠‌‌​⁠‍‌⁠‍​‌​​⁠‌‍‍​‌‌​‌‌⁠‍‍‌‍⁠⁠​‍​‍‌⁠⁠‌​​