Testing Airflow DAGs: Integrity Checks, CI/CD, and Mocking
Data Pipelines with Apache Airflow by Bas Harenslak and Julian deRuiter (ISBN: 9781617296901)
Previous: Building Custom Airflow Components (Part 2) | Next: Testing Airflow DAGs (Part 2)
Ci cd
CI/CD, Pipeline Serialization, and Hayhooks for Zero-Boilerplate Deployment - Chapter 7 Part 2
In Part 1 we built a FastAPI app, Dockerized it, and locked it down with API keys. That is the “maximum control” path. It works great, but it requires a lot of boilerplate. Part 2 covers two things: automating the whole thing with CI/CD, and a completely different approach that makes most of that boilerplate disappear.
FastAPI, Docker, and Securing Your NLP Endpoints - Chapter 7 Part 1
Chapter 7 of Laura Funderburk’s book is where the rubber meets the road. You built a RAG pipeline in Chapter 6. Now you need to ship it. Get it out of a notebook and into something that real users can hit with HTTP requests.