Airflow on Kubernetes: Get started in 10 mins
mlambertiHow to run Airflow on Kubernetes? Kubernetes is a popular open-source container orchestration system widely used in the industry. It…
How to use the ShortCircuitOperator in Airflow
The ShortCircuitOperator in Apache Airflow is simple but powerful. It allows skipping tasks based on the result of a condition. There…
How to use Airflow templates and macros
Templates and Macros in Apache Airflow allow passing data to your DAGs at runtime. Imagine that you want to execute…
How to use the DockerOperator
Do you wonder how to use the DockerOperator in Airflow to kick off a docker image? Or how to run…
How to use the BranchPythonOperator
Are you looking for a way to choose one task or another? Do you want to execute a task based…
Airflow Variables: The Ultimate Guide
Airflow Variables are easy to use but easy to misuse as well. In this tutorial, you will learn everything you…
Airflow Sensors: What you need to know
Airflow Sensors are one of the most common tasks in data pipelines. Why? Because a Sensor waits for a condition…
DuckDB: Getting started for beginners
DuckDB is an in-process OLAP DBMS written in C++ blah blah blah, too complicated. Let’s start simple, shall we? DuckDB…
Getting started with Airflow in 10 mins
At the end of this introduction to Airflow, you will be all set for getting started with Airflow. You will…
Airflow TaskGroup: All you need to know!
An Airflow TaskGroup helps make a complex DAG easier to organize and read. Airflow taskgroups are meant to replace SubDAGs,…