Finishing Data Pipelines With Apache Airflow: Key Takeaways
Book: Data Pipelines with Apache Airflow
Authors: Bas Harenslak, Julian deRuiter
ISBN: 9781617296901
Twenty-five posts later, I have read the whole book. Here is where I landed.
Data orchestration
Pipeline Orchestration With Airflow, DAGs, and Data Transformations
This is Part 2 of Chapter 7, continuing from batch and streaming basics.
In Part 1, we covered how batch and streaming pipelines move data around. But here is the thing: having a pipeline is one thing. Making sure all its parts run in the right order, at the right time, without you babysitting it? That is orchestration. And this is where Chapter 7 gets really practical.