Remove resources intro-streaming-analytics
article thumbnail

The Good and the Bad of Apache Airflow Pipeline Orchestration

AltexSoft

It’s also not intended for continuous streaming workflows. However, the platform is compatible with solutions supporting near real-time and real-time analytics — such as Apache Kafka or Apache Spark. After receiving a command from the scheduler, it starts allocating resources for the ongoing job. Airflow executor and workers.