Data Engineering Podcast

JUNE 17, 2017

In this episode Justin Cunningham joins me to discuss the decisions they made and the lessons they learned in the process, including what worked, what didn’t, and what he would do differently if he was starting over today. Can you start by giving an overview of your pipeline and the type of workload that you are optimizing for?

Data Pipeline 100

Data Pipeline Kafka Business Intelligence Architecture 100

Data Engineering Podcast

NOVEMBER 26, 2019

Your host is Tobias Macey and today I’m interviewing Ted Kaemming and James Cunningham about Snuba, the new open source search service at Sentry implemented on top of Clickhouse Interview Introduction How did you get involved in the area of data management? How have you found the operational aspects of Clickhouse?

Data Warehouse 100

Data Warehouse Building PostgreSQL Kafka 100

Data Engineering Podcast

APRIL 19, 2020

Eventador is a managed platform designed to let you focus on using the data that you collect, without worrying about how to make it reliable. This was an interesting inside look at building a business on top of open source stream processing frameworks and how to reduce the burden on end users.

Building 100

Building PostgreSQL MongoDB SQL 100

Data Engineering Podcast

DECEMBER 9, 2018

Summary Apache Spark is a popular and widely used tool for a variety of data oriented projects. With the large array of capabilities, and the complexity of the underlying system, it can be difficult to understand how to get started using it. How does it compare to some of the other streaming frameworks such as Flink, Kafka, or Storm?

Scala 100

Scala MySQL Kafka Hadoop 100

Data Engineering Podcast

AUGUST 24, 2020

LinkedIn has gone through several iterations on the most maintainable and scalable approach to metadata, leading them to their current work on DataHub. I’m working with O’Reilly on a project to collect the 97 things that every data engineer should know, and I need your help. Can you describe how DataHub is architected?

Metadata 100

Metadata Management Kafka Data Engineering 100

Data Engineering Podcast

FEBRUARY 11, 2018

In this episode the founders of TimescaleDB, Ajay Kulkarni and Mike Freedman, discuss how Timescale was started, the problems that it solves, and how it works under the covers. They also explain how you can start using it in your infrastructure and their plans for the future. What impact has the 10.0

PostgreSQL 100

PostgreSQL NoSQL Google Cloud MongoDB 100

Data Engineering Weekly

MARCH 26, 2023

Come and hear talks from companies like StarTree, Confluent, LinkedIn, DoorDash, Imply, and Uber on how they are advancing the state-of-the-art in user-facing analytics delivered instantly. If you follow Data Engineering Weekly, We actively talk about data contracts & how data is a collaboration problem, not just an ETL problem.

Data Engineering 52

Data Engineering Data Engineer Engineering Lambda Architecture 52