Monitor performance issues & errors in your code

Apache Airflow Open-Source Workflow with Python

Episode #330, published Fri, Aug 20, 2021, recorded Thu, Aug 5, 2021

If you are working with data pipelines, you definitely need to give Apache Airflow a look. This pure-Python workflow framework is one of the most popular and capable out there. You create your workflows by writing Python code using clever language operators and then you can monitor them and even debug them visually once they get started.

Stop writing manual code or cron-job based code to create data pipelines check out Airflow. We're joined by three excellent guests from the Airflow community: Jarek Potiuk, Kaxil Naik, and Leah Cole.

Watch this episode on YouTube
Play on YouTube
Watch the live stream version

Links from the show

Jarek Potiuk:
Kaxil Naik: @kaxil
Leah Cole: @leahecole

Airflow site:
Airflow on GitHub:
Airflow community:
Helm Chart for Apache Airflow:
Airflow Summit:
Astronomer Registry (Easy to search for official and community Providers):
Airflow Loves Kubernetes talk:
Watch this episode on YouTube:
Episode transcripts:

--- Stay in touch with us ---
Subscribe to us on YouTube:
Follow Talk Python on Mastodon: talkpython
Follow Michael on Mastodon: mkennedy

Want to go deeper? Check out our courses

Episode sponsored by
Ads served ethically
Talk Python's Mastodon Michael Kennedy's Mastodon