When it comes to product development, experimenting badly is worse than not experimenting at all. As one of the most powerful tools available to product teams, when done right experimentation allows teams to iterate gradually and validate ideas with data. While experimentation is increasingly becoming a staple of most product teams, many are struggling to do it right.
During this talk, Jon Noronha, Senior Director of Product Management at Optimizely, will share his blueprint for avoiding the experimentation mistakes and faulty A/B testing habits that can lead product teams down the wrong path. He’ll discuss common errors, along with tips for avoiding these pitfalls, including: choosing metrics that correlate with business success, ways to avoid getting tricked by statistics, and how successful companies approach product experimentation today, with examples taken directly from his career working on teams like Microsoft’s Bing division.