Michael Curran is Director of Platform & Foundations Data Science at Instacart, where he supports and leads data science teams focused on Expy (experimental design), Carrot AI, Fraud, Pricing and Payments.

Experimentation at Scale in the Tech Industry: Lessons I Have Learned

This talk revisited experimentation fundamentals and explained how experiments with millions (or billions) of observations coupled with small effect sizes mandated rethinking basic experimental design and analysis. Curran shared real examples from industry and recapped the challenges that were faced.