Remove introducing-current-next-generation-of-kafka-summit
article thumbnail

Data Engineering Annotated Monthly – June 2022

Big Data Tools

There are also multiple improvements for streaming support (for Kafka and Kinesis ), along with many other changes. Hi, I’m Pasha Finkelshteyn , and I’ll be your guide today through this month’s news. I’ll offer my impressions of recent developments in the data engineering space and highlight new ideas from the wider community.

article thumbnail

Data Engineering Annotated Monthly – June 2022

Big Data Tools

There are also multiple improvements for streaming support (for Kafka and Kinesis ), along with many other changes. Hi, I’m Pasha Finkelshteyn , and I’ll be your guide today through this month’s news. I’ll offer my impressions of recent developments in the data engineering space and highlight new ideas from the wider community.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Optimizing Kafka Streams Applications

Confluent

With the release of Apache Kafka ® 2.1.0, Kafka Streams introduced the processor topology optimization framework at the Kafka Streams DSL layer. In what follows, we provide some context around how a processor topology was generated inside Kafka Streams before 2.1, Kafka Streams topology generation 101.

Kafka 90
article thumbnail

Apache Kafka Rebalance Protocol for the Cloud: Static Membership

Confluent

Static Membership is an enhancement to the current rebalance protocol that aims to reduce the downtime caused by excessive and unnecessary rebalances for general Apache Kafka ® client implementations. This applies to Kafka consumers, Kafka Connect, and Kafka Streams. Take a Kafka consumer, for example.

Kafka 21
article thumbnail

Shoulder Surfers Beware: Confluent Now Provides Cross-Platform Secret Protection

Confluent

For Apache Kafka ® , in which services read configuration files on startup, the question arises: how should you protect these secrets? introduces a simple solution for secret encryption. Generate the master encryption key based on a passphrase. Before Confluent Platform 5.3, Confluent Platform 5.3 How Secret Protection works.

Kafka 12