Learn More about Apache Airflow Including Production Use Case on GCP.
Top Caserta consultants share, in technical detail, how to define and configure Airflow pipelines to create workflows that are maintainable, versionable, testable, and collaborative.
In this 50-minute webinar you will learn best practices to create Airflow directed acyclic graphs (DAGs) of tasks, enforcing relationships and dependencies. The talk covers constructing Airflow pipelines with Spark based ETL, a Google Storage Data Lake, and a Big Query Data Warehouse.
The stage will be shared by Dallas S. Simpson, Director of Data Engineering at SoulCycle and Dovy Paukstys, a senior consult at Caserta, who will share his experience and lessons learned using Airflow on their internal GCP Data Analytics Platform project.
Data architects, data engineers and data scientists alike will enjoy the contents of this talk.
Watch Apache Airflow Webinar
Want more Airflow Tips & Tricks? Check out Dovy Paukstys in-depth guide to getting around Airflow like a ninja.
UPDATE: We apologize for any confusion around the mispronunciation of Acyclic, pronounced as Acyrilic during a portion of the webinar. Please disregard this and note DAG stands for Directed Acyclic Graph.