In this series, a full Extract, Load, Transform pipeline is built from the ground up, using Airflow 2.0’s newest and straightforward syntax.

Content

  1. Airflow 2.0 installation (on a Raspberry Pi)
  2. A simple DAG
  3. Getting started with Task Groups
  4. Building an ETL pipeline
  5. BONUS: Transforming data in Apache Spark