Remove 2022 Remove Big Data Tools Remove Kafka Remove Systems
article thumbnail

Data Engineering Annotated Monthly – June 2022

Big Data Tools

How is it possible to support distributed transactions and solve the other complex problems of distributed systems? There are also multiple improvements for streaming support (for Kafka and Kinesis ), along with many other changes. The State of Data Engineering 2022 – I like this kind of content.

article thumbnail

Data Engineering Annotated Monthly – June 2022

Big Data Tools

How is it possible to support distributed transactions and solve the other complex problems of distributed systems? There are also multiple improvements for streaming support (for Kafka and Kinesis ), along with many other changes. The State of Data Engineering 2022 – I like this kind of content.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Data Engineering Annotated Monthly – May 2022

Big Data Tools

If you haven’t found your perfect metadata management system just yet, maybe it’s time to try DataHub! The most notable change in the latest release is support for streaming, which means you can now ingest data from streaming sources. Pulsar Manager 0.3.0 – Lots of enterprise systems lack a nice management interface.

article thumbnail

Data Engineering Annotated Monthly – May 2022

Big Data Tools

If you haven’t found your perfect metadata management system just yet, maybe it’s time to try DataHub! The most notable change in the latest release is support for streaming, which means you can now ingest data from streaming sources. Pulsar Manager 0.3.0 – Lots of enterprise systems lack a nice management interface.

article thumbnail

Data Engineering Annotated Monthly – January 2022

Big Data Tools

DolphinScheduler 2.0.3 — Apache DolphinScheduler is described on its own website as a “distributed and easy-to-extend visual workflow scheduler system.” Kafka: Add range and scan query over kv-store in IQv2 — The name of this KIP speaks for itself. 7 Must-Know Data Buzzwords in 2022 — It’s important to know trends.

article thumbnail

Data Engineering Annotated Monthly – January 2022

Big Data Tools

DolphinScheduler 2.0.3 — Apache DolphinScheduler is described on its own website as a “distributed and easy-to-extend visual workflow scheduler system.” Kafka: Add range and scan query over kv-store in IQv2 — The name of this KIP speaks for itself. 7 Must-Know Data Buzzwords in 2022 — It’s important to know trends.

article thumbnail

Data Engineering Annotated Monthly – April 2022

Big Data Tools

Kafka was the first, and soon enough, everybody was trying to grab their own share of the market. In the case of RocketMQ, their attempt is very interesting because, unlike Kafka and Pulsar, RocketMQ is closer to traditional MQs like ActiveMQ (which isn’t really surprising, seeing how it’s based on ActiveMQ).