Schedule:

6:30 - Doors & Food
7:00 - Talk 1
7:45 - Talk 2
8:30 - Wrap & Chat

**Talk 1: Data Pipeline Infrastructure at Meetup with Fewer Nightmares: Running Apache Airflow on Kubernetes**

Speaker:
Chengzhi Zhao, Data Engineer @ Meetup

Abstract:
The talk will cover an overview of data pipeline infrastructure at Meetup, the challenges of using custom Scala scripts scheduled via cron before Airflow was introduced. We will chat on what is Airflow & reasons we choose Airflow as a key framework of our data infrastructure, & use cases that Airflow orchestrates complex jobs for multiples teams at Meetup. Then we will dive deeper on Airflow architecture, Airflow deployment process & Airflow on Kubernetes. Lastly, we will share some lessons learned & what's next for data pipeline infrastructure at Meetup.

**Talk 2: Airflow at Scale on K8s**

Speaker:
Adam Boscarino, Senior Data Engineer @ DigitalOcean

Abstract:
This talk will cover the DigitalOcean Data Engineering team's journey from scattered cron jobs to a scalable data pipeline tool in Airflow. It will focus on scaling via Celery, using the Kubernetes Pod Operator for different workloads, working with multiple teams on Airflow, & using dynamic DAGs for common pipelines.