How many A/B tests should you run? What are other key learnings?
www.barronernst.com
This is the last part of my four part series on A/B testing. Part 1, Part 2, and Part 3 are linked here. Should A/B testing be limited to two different versions of an idea? Is there an optimal number? A/B testing doesn’t need to be limited to two ideas at all. You can certainly have multiple variants of a specific idea. If you have a couple of different versions of a similar test, and you can run them easily against one another, that’s fine. The key is that you’re not changing too many variables at once. I’ll use a very simple example. If you’re going to test both button color and button copy at the same time, realize that those are two distinct and different variables and you’re going to need to control for that when you run tests.
How many A/B tests should you run? What are other key learnings?
How many A/B tests should you run? What are…
How many A/B tests should you run? What are other key learnings?
This is the last part of my four part series on A/B testing. Part 1, Part 2, and Part 3 are linked here. Should A/B testing be limited to two different versions of an idea? Is there an optimal number? A/B testing doesn’t need to be limited to two ideas at all. You can certainly have multiple variants of a specific idea. If you have a couple of different versions of a similar test, and you can run them easily against one another, that’s fine. The key is that you’re not changing too many variables at once. I’ll use a very simple example. If you’re going to test both button color and button copy at the same time, realize that those are two distinct and different variables and you’re going to need to control for that when you run tests.