KubernetesPodOperator: Running Airflow Tasks on Kubernetes
Data Pipelines with Apache Airflow by Bas Harenslak and Julian deRuiter (ISBN: 9781617296901)
Previous: Running Airflow Tasks in Containers (Part 1) | Next: Airflow Best Practices (Part 1)
Data Pipelines with Apache Airflow by Bas Harenslak and Julian deRuiter (ISBN: 9781617296901)
Previous: Running Airflow Tasks in Containers (Part 1) | Next: Airflow Best Practices (Part 1)
Data Pipelines with Apache Airflow by Bas Harenslak and Julian deRuiter (ISBN: 9781617296901)
Previous: Testing Airflow DAGs (Part 2) | Next: Running Airflow Tasks in Containers (Part 2)
If you are working with data today, you can’t really ignore containers. They have become the standardized unit for how we develop, ship, and deploy software. But why do we care so much about them in the big data world?