I’m continuing some short videos about A/B Testing and how to improve it at your company. The transcripts for the video are below: How many rounds of testing should a company plan for before they are successful? I never advise companies that they need to plan for a certain number of rounds of testing. I actually focus more on a few specific key principles. One is it’s really important to have a system in place that enables your company to run a high volume of tests. If you run one or two tests a month, your likelihood of success is really low. Most times a test has a 10-20% success rate. So what you need to start being able to do is run more tests and have a higher velocity of output of tests to really get anything successful happening through the pipeline. I’d say secondarily though, when you do start to see success, figure out what made those tests successful. So let’s say you run 10 tests, and you have two that are successful, you want to then focus on why were those two tests successful. What about those tests made them successful? What changes did you make that customers responded to? Did it do more than just improve a metric at the top of the funnel and actually translate to a purchase or to retention? And if you are feeling good about the results after asking those questions, maybe it’s time to double down in those areas.
Establishing a Culture of A/B Testing
Establishing a Culture of A/B Testing
Establishing a Culture of A/B Testing
I’m continuing some short videos about A/B Testing and how to improve it at your company. The transcripts for the video are below: How many rounds of testing should a company plan for before they are successful? I never advise companies that they need to plan for a certain number of rounds of testing. I actually focus more on a few specific key principles. One is it’s really important to have a system in place that enables your company to run a high volume of tests. If you run one or two tests a month, your likelihood of success is really low. Most times a test has a 10-20% success rate. So what you need to start being able to do is run more tests and have a higher velocity of output of tests to really get anything successful happening through the pipeline. I’d say secondarily though, when you do start to see success, figure out what made those tests successful. So let’s say you run 10 tests, and you have two that are successful, you want to then focus on why were those two tests successful. What about those tests made them successful? What changes did you make that customers responded to? Did it do more than just improve a metric at the top of the funnel and actually translate to a purchase or to retention? And if you are feeling good about the results after asking those questions, maybe it’s time to double down in those areas.