Hands-On Big Data Online Courses

Effective Learning Through Practice

Last Posts

airflow taskflow api

Airflow Taskflow API: The Guide

Airflow Taskflow is a new way of writing DAGs at ease. As you will see, you need to write fewer lines than before to obtain the same DAG. That helps to make DAGs easier to build, read, and maintain. The

Read More »
dynamic_task_mapping

Dynamic Task Mapping in Apache Airflow

Dynamic Task Mapping is a new feature of Apache Airflow 2.3 that puts your DAGs to a new level. Now, you can create tasks dynamically without knowing in advance how many tasks you need. This feature is for you if

Read More »
airflow_task_group

Airflow TaskGroups: All you need to know!

Airflow TaskGroups have been introduced to make your DAG visually cleaner and easier to read. They are meant to replace SubDAGs which was the historic way of grouping your tasks. The problem with SubDAGs is that they are much more

Read More »