Data Engineering Podcast

JANUARY 5, 2020

How has the tight coupling with Kafka impacted the direction and capabilities of Debezium? Pulsar, Bookkeeper, Pravega)? What are some of the design tensions that exist in the Debezium community between acting as a simple pipe vs. adding functionality for interpreting/aggregating/formatting the information contained in the changesets?

Database 100

Database Kafka PostgreSQL MySQL 100

Data Engineering Podcast

MAY 15, 2022

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. How do you approach the build vs. buy problem and quantify the tradeoffs? How do you approach the build vs. buy problem and quantify the tradeoffs?

Data Lake 100

Data Lake Building BI Architecture 100

Data Engineering Podcast

NOVEMBER 18, 2018

How does Flink compare to other streaming engines such as Spark, Kafka, Pulsar, and Storm? What are the comparative challenges of working with bounded vs unbounded streams of data? How does Flink compare to other streaming engines such as Spark, Kafka, Pulsar, and Storm? How is Flink architected?

Process 100

Process Scala Google Cloud Kafka 100

Data Engineering Podcast

DECEMBER 4, 2022

types of organizations/teams who are adopting real-time consumers of real-time data locations in data/application stacks where real-time needs to be integrated challenges (technical/infrastructure/talent) involved in adopting/supporting streaming/real-time lessons learned working with early customers that influenced design/implementation of Materialize (..)

Data Lake 100

Data Lake MongoDB MySQL Data Warehouse 100

Data Engineering Podcast

AUGUST 3, 2021

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Data Lake 130

Data Lake Data Warehouse Hadoop Architecture 130

Data Engineering Podcast

AUGUST 6, 2022

an image vs. an audio file, etc.) an image vs. an audio file, etc.) What are some of the characteristics of vector embeddings that might make them immune or susceptible to confusion of similarity across different source data types that share some implicit relationship due to specifics of their vectorized representation?

Machine Learning 100

Machine Learning Database MySQL PostgreSQL 100

Big Data Tools

AUGUST 3, 2021

Rack-aware Kafka streams – Kafka has already been rack-aware for a while, which gives its users more confidence. However, a part of Kafka called Kafka Streams, a stream processing framework and a competitor to other streaming solutions, is currently not rack-aware. Articles This section is about inspiration.

Data Engineering 52

Data Engineering Data Engineer Engineering Big Data Tools 52