Bio: Cuky Perez is a data scientist manager at Airbnb where she has gained extensive experience A/B testing new tools for our hosts & leading a team of data scientists in charge of supporting our new products & features. Prior to Airbnb, she was an assistant professor teaching students the art of experimental designs & data analysis at the University of Washington in Seattle.
Title: Online Experimentation at Airbnb
Abstract: In this presentation I will discuss how at Airbnb we have solved some of the pitfalls & challenges of A/B testing. For instance: what can we do when simple random assignment does not guarantee balanced characteristics across treatment & control conditions? Can we reduce the time it takes for an A/B test to reach enough statistical power? How do we assure that teams make decisions based on rigorous evidence & protect against p-hacking, for example?