article thumbnail

A summary of Gartner’s recent DataOps-driven data engineering best practices article

DataKitchen

A better ETL tool? Pick some other hot tool? His team is already on Azure and uses ADF, Synapse, PowerBi, and several powerful Azure Data Science tools. This is the equivalent advice for data teams provided to software teams in the classic “Mythical Man Month.”

article thumbnail

The Good and the Bad of Apache Kafka Streaming Platform

AltexSoft

After trying all options existing on the market — from messaging systems to ETL tools — in-house data engineers decided to design a totally new solution for metrics monitoring and user activity tracking which would handle billions of messages a day. How Apache Kafka streams relate to Franz Kafka’s books. Kafka disadvantages.

Kafka 93