The Good and the Bad of Apache Airflow Pipeline Orchestration
AltexSoft
NOVEMBER 7, 2022
It’s also not intended for continuous streaming workflows. However, the platform is compatible with solutions supporting near real-time and real-time analytics — such as Apache Kafka or Apache Spark. After receiving a command from the scheduler, it starts allocating resources for the ongoing job. Airflow executor and workers.
Let's personalize your content