Data Engineering With GCP Chapter 4 Part 2: Airflow Scheduling, Idempotency, and Sensors
In the first part we got Cloud Composer running, wrote our first DAGs, and learned operators. This second part covers the stuff that separates beginner Airflow code from production-ready pipelines: variables, idempotent tasks, backfilling, sensors, and dataset-driven scheduling.