Happy December All! This month we haveRafe Colburn, manager of the data eng team at Etsy, talking about their journey to Kafka.
Short description:
Three years ago, at Etsy our analytics data pipeline was built around a pixel hosted on Akamai, FTP uploads, and Amazon EMR. We're in the last steps of migrating to a data ingestion pipeline based on Kafka. This talk will cover all of the crazy things we had to do to rebuild our data pipeline without disrupting our ongoing analytics work, as well as the tradeoffs we've made in building these systems. In this talk you'll learn how Etsy built its original analytics capabilities cheaply and quickly, and what we had to do to increase its robustness as the business became more reliant upon it.
About the Speaker:
Rafe Colburn is the manager of the Data Engineering team at Etsy, which is responsible for instrumentation of the Etsy site, the analytics data pipeline, Etsy's internal Hadoop infrastructure, data warehousing, and our custom internal analytics tools.
7:00 PM - Pizza and Beer
7:30 PM - Talk begins