Hands-On Big Data Online Courses

Effective Learning Through Practice

Last Posts

dynamic_task_mapping

Dynamic Task Mapping in Apache Airflow

Dynamic Task Mapping is a new feature of Apache Airflow 2.3 that puts your DAGs to a new level. Now, you can create tasks dynamically without knowing in advance how many tasks you need. This feature is for you if

Read More »
airflow_task_group

Airflow TaskGroups: All you need to know!

Airflow TaskGroups have been introduced to make your DAG visually cleaner and easier to read. They are meant to replace SubDAGs which was the historic way of grouping your tasks. The problem with SubDAGs is that they are much more

Read More »