In this series, a full Extract, Load, Transform pipeline is built from the ground up, using Airflow 2.0’s newest and straightforward syntax.
Content
- Airflow 2.0 installation (on a Raspberry Pi)
- A simple DAG
- Getting started with Task Groups
- Building an ETL pipeline
- BONUS: Transforming data in Apache Spark