Data Engineering Podcast

APRIL 7, 2024

In this episode Artyom Keydunov, creator of Cube, discusses the evolution and applications of the semantic layer as a component of your data platform, and how Cube provides speed and cost optimization for your data consumers. Try Starburst Galaxy today, the easiest and fastest way to get started using Trino, and get $500 of credits free.

Data Lake 162

Data Lake High Quality Data BI Data Workflow 162

Data Engineering Podcast

APRIL 21, 2024

In this episode he shares the technical challenges that he and his team have overcome in integrating AI into their product, as well as the benefits and features that it provides to their customers. Can you describe how I would use Shortwave for managing the workflow of evaluating, planning, and promoting my podcast episodes?

Data Lake 173

Data Lake High Quality Data Data Pipeline Machine Learning 173

Data Engineering Podcast

FEBRUARY 18, 2024

In this episode Dain Sundstrom, CTO of Starburst, explains how the combination of the Trino query engine and the Iceberg table format offer the ease of use and execution speed of data warehouses with the infinite storage and scalability of data lakes. Don't miss out on our only event this year! Promo Code: depod20 Starburst : ![Starburst

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

ThoughtSpot

JANUARY 10, 2023

In season 3, we published 24 new episodes, expanded to include video on YouTube, and generated 962 minutes of actionable content. We drink our own champagne at ThoughtSpot and dove into the listener data to analyze your favorite Data Chief episodes of 2022. Find the six rules and listen to the full episode here. THANK YOU!

Recruitment 52

Recruitment Food Data Data Science 52

Data Engineering Podcast

JANUARY 6, 2019

In this episode Brock Noland and Jordan Birdsell from PhData explain how Kudu is architected, how it compares to other storage systems in the Hadoop orbit, and how to start integrating it into you analytics pipeline. __init__ Episode Pandas Podcast.__init__

Data Analytics 100

Data Analytics Hadoop Kafka Media 100

Data Engineering Podcast

FEBRUARY 4, 2024

In this episode Yingjun Wu explains how it is architected to power analytical workflows on continuous data flows, and the challenges of making it responsive and scalable. In this episode Yingjun Wu explains how it is architected to power analytical workflows on continuous data flows, and the challenges of making it responsive and scalable.

SQL 173

SQL Data Lake High Quality Data Data Pipeline 173

Data Engineering Podcast

MARCH 10, 2024

Starburst Logo]([link] This episode is brought to you by Starburst - a data lake analytics platform for data engineers who are battling to build and scale high quality data pipelines on the data lake. The link that bridges the gap between data lake and warehouse capabilities is the catalog.

Data Lake 147

Data Lake High Quality Data Data Pipeline Architecture 147

Data Engineering Podcast

APRIL 14, 2024

In this episode Oren Eini, CEO and creator of RavenDB, explores the nuances of relational vs. non-relational engines, and the strategies for designing a non-relational database. The default association with the term "database" is relational engines, but non-relational engines are also used quite widely.

Non-relational Database 147

Non-relational Database Relational Database Database Designing 147

Data Engineering Podcast

MARCH 17, 2024

In this episode Gleb Mezhanskiy, founder and CEO of Datafold, discusses the different error conditions and solutions that you need to know about to ensure the accuracy of your data.

Database 147

Database Data Lake High Quality Data Data Workflow 147

Data Engineering Podcast

SEPTEMBER 10, 2023

In this episode Nick Schrock, creator of Dagster, shares his perspective on the state of data orchestration technology and its application to help inform its implementation in your environment. Orchestrators are centralized utilities that control the execution and sequencing of interdependent operations. Datafold : ![Datafold]([link]

BI 208

BI SQL Data Machine Learning 208

Data Engineering Podcast

MARCH 24, 2024

In this episode Pete Hunt, CEO of Dagster labs, outlines these new capabilities, how they reduce the burden on data teams, and the increased collaboration that they enable across teams and business units. Email hosts@dataengineeringpodcast.com ) with your story. Email hosts@dataengineeringpodcast.com ) with your story.

Data Lake 162

Data Lake High Quality Data Hadoop Data Pipeline 162

Data Engineering Podcast

OCTOBER 15, 2023

In this episode Eric Sammer discusses why more companies are including real-time capabilities in their products and the ways that Decodable makes it faster and easier. In this episode Eric Sammer discusses why more companies are including real-time capabilities in their products and the ways that Decodable makes it faster and easier.

Process 182

Process Building SQL BI 182

Data Engineering Podcast

JANUARY 13, 2019

In this episode the TimescaleDB CEO Ajay Kulkarni and CTO Michael Freedman stop by to talk about their 1.0 In this episode the TimescaleDB CEO Ajay Kulkarni and CTO Michael Freedman stop by to talk about their 1.0 Summary The past year has been an active one for the timeseries market.

Database 100

Database PostgreSQL SQL MongoDB 100

Data Engineering Podcast

FEBRUARY 25, 2024

In this episode he explains how he used the combination of Apache Arrow, Flight, Datafusion, and Parquet to lay the foundation of the newest version of his time-series database. Over the decades of research and development into building these software systems there are a number of common components that are shared across implementations.

Database 162

Database Technology Data Lake High Quality Data 162

Data Engineering Podcast

DECEMBER 24, 2017

In this episode Sean T. In this episode Sean T. Summary Data oriented applications that need to operate on large, fast-moving sterams of information can be difficult to build and scale due to the need to manage their state. He explains the motivation for building Wallaroo, how it is implemented, and how you can start using it today.

Kafka 100

Kafka Python Data Pipeline Data Engineering 100

Data Engineering Podcast

SEPTEMBER 3, 2023

In this episode Adrian Brudaru explains how it works, the benefits that it provides over other data integration solutions, and how you can start building pipelines today. In this episode Adrian Brudaru explains how it works, the benefits that it provides over other data integration solutions, and how you can start building pipelines today.

Data Integration 162

Data Integration BI SQL Python 162

Data Engineering Podcast

JANUARY 7, 2024

In this episode he illuminates the landscape of problems that we are faced with and how his research is aimed at helping to solve these problems. In this episode he illuminates the landscape of problems that we are faced with and how his research is aimed at helping to solve these problems.

Data Process 147

Data Process Process Data Lake High Quality Data 147

Data Engineering Podcast

OCTOBER 29, 2023

In this episode Tanya Bragin shares her experiences as a product manager for two major vendors and the lessons that she has learned about how teams should approach the process of tool selection. Summary Databases are the core of most applications, whether transactional or analytical. Go to [materialize.com]([link] today and get 2 weeks free!

Database 189

Database BI SQL Machine Learning 189

Data Engineering Podcast

MARCH 31, 2024

In this episode Maayan Salom explores the approach that she has taken to bring observability, enhanced testing capabilities, and anomaly detection into every step of the dbt developer experience. While there are numerous products available to provide that visibility, they all have different technologies and workflows that they focus on.

Project 130

Project Data Lake High Quality Data Data Workflow 130

Data Engineering Podcast

NOVEMBER 26, 2023

In this episode Tobias Macey shares his thoughts on the challenges that he is facing as he prepares to build the next set of architectural layers for his data platform to enable a larger audience to start accessing the data being managed by his team.

Architecture 147

Architecture Data Lake High Quality Data SQL 147

Data Engineering Podcast

MARCH 3, 2024

Colleen Tartow has worked across all stages of the data lifecycle, and in this episode she shares her hard-earned wisdom about how to conduct an AI program for your organization. In order to make those promises a reality there is a substantial amount of strategy and investment required. Don't miss out on our only event this year!

Programming 162

Programming Data Lake High Quality Data Data Pipeline 162

Data Engineering Podcast

MARCH 18, 2017

In this episode Eyal Gutkind explains how Scylla was created and how it differentiates itself in the crowded database market. In this episode Eyal Gutkind explains how Scylla was created and how it differentiates itself in the crowded database market.

Database 100

Database Data Engineering Data Engineer Architecture 100

Data Engineering Podcast

FEBRUARY 11, 2024

In this episode Andrew Jefferson explains the complexities of building a robust system for data sharing, the techno-social considerations, and how the Bobsled platform that he is building aims to simplify the process. There are numerous business rules and regulatory concerns that need to be applied.

Data Lake 147

Data Lake High Quality Data Government Data Pipeline 147

Data Engineering Podcast

DECEMBER 31, 2018

In this episode Tom Kaitchuk explains how Pravega simplifies storage and processing of data streams, how it integrates with processing engines such as Flink, and the unique capabilities that it provides in the area of exactly once processing and transactions.

Lambda Architecture 100

Lambda Architecture Process Data Process Kafka 100

Data Engineering Podcast

DECEMBER 16, 2018

In this episode Christian Heinzmann, Head of Data Warehousing at Grubhub, discusses the various requirements for data pipelines and how the overall system architecture evolves as more data is being processed. Summary Every business needs a pipeline for their critical data, even if it is just pasting into a spreadsheet.

Data Pipeline 100

Data Pipeline Data Lake Data Warehouse Python 100

Data Engineering Podcast

OCTOBER 9, 2018

In this episode the CEO of MemSQL describes how the company and database got started, how it is architected for scale and speed, and how it is being used in production. In this episode the CEO of MemSQL describes how the company and database got started, how it is architected for scale and speed, and how it is being used in production.

PostgreSQL 100

PostgreSQL BI Data Warehouse Machine Learning 100

Data Engineering Podcast

DECEMBER 9, 2018

In this episode he helps to make sense of what Spark is, how it works, and the various ways that you can use it. In this episode he helps to make sense of what Spark is, how it works, and the various ways that you can use it.

Scala 100

Scala MySQL Kafka Hadoop 100

Data Engineering Podcast

SEPTEMBER 30, 2018

In this episode Chris Groskopf explains the platform they have built to consume large varieties and volumes of public data for constructing a graph for serving to their customers. This is a great episode to listen to for ideas on how to organize a data engineering organization.

Building 100

Building Data Lake AWS Machine Learning 100

Data Engineering Podcast

FEBRUARY 18, 2018

In this episode Will McGinnis discusses the opinions that he has gained from experience on how data teams can play to their strengths to the benefit of all. In this episode Will McGinnis discusses the opinions that he has gained from experience on how data teams can play to their strengths to the benefit of all.

Data Science 100

Data Science Data Engineering Data Engineer Data Pipeline 100

Analytics Vidhya

NOVEMBER 26, 2023

In this Leading with Data episode, explore the analytics landscape with Dr. Swati Jain, a seasoned leader boasting over two decades of experience. From her unforeseen foray into analytics to steering EXL Analytics’ India business, Dr. Jain imparts invaluable insights into the ever-evolving world of data science.

Data Science 214

Data Science Data Analysis Data Data Engineering 214

Data Engineering Podcast

APRIL 8, 2018

In this episode Christopher Bergh discusses ways that you can start adding reliability and speed to your workflow to deliver results with confidence and consistency. In this episode Christopher Bergh discusses ways that you can start adding reliability and speed to your workflow to deliver results with confidence and consistency.

Manufacturing 100

Manufacturing Machine Learning Data Engineering Data Engineer 100

Data Engineering Podcast

NOVEMBER 5, 2023

In this episode Lukas Fittl shares some hard-won wisdom about the causes and solution of many performance bottlenecks and the work that he is doing to shine some light on PostgreSQL to make it easier to understand how to keep it running smoothly. When an application is slow, there is a good probability that the database needs some attention.

PostgreSQL 147

PostgreSQL Data Lake High Quality Data SQL 147

Data Engineering Podcast

JUNE 10, 2018

In this episode Peter Mattis, the co-founder and VP of Engineering at Cockroach Labs, describes the architecture that underlies the database, the challenges they have faced along the way, and the ways that you can use it in your own environments today.

PostgreSQL 100

PostgreSQL NoSQL Relational Database SQL 100

Data Engineering Podcast

AUGUST 12, 2018

In this episode James Meickle discusses his recent experience building a new installation of Airflow. In this episode James Meickle discusses his recent experience building a new installation of Airflow. He points out the strengths, design flaws, and areas of improvement for the framework.

PostgreSQL 100

PostgreSQL AWS Python Data Science 100

Data Engineering Podcast

APRIL 14, 2018

In this episode he discusses his experiences working as a data engineer in industry and at the USDS, his motivations and methods for creating a newsleteter, and the insights that he has gleaned from it. This led to his creation of the Hadoop Weekly newsletter, which he recently rebranded as the Data Engineering Weekly newsletter.

Data Engineering 100

Data Engineering Data Engineer Engineering Hadoop 100

Data Engineering Podcast

JUNE 25, 2023

In this episode Toby Mao explains how it works, the importance of automatic column-level lineage tracking, and how you can start using it today. __init__ Episode The intro and outro music is from The Hug by The Freak Fandango Orchestra / CC BY-SA Sponsored By: Rudderstack : ![Rudderstack]([link]

Data Engineering 225

Data Engineering Data Engineer Python Engineering 225

Data Engineering Podcast

OCTOBER 21, 2018

In this episode they discuss their motivation for creating the project, the challenges and benefits of maintaining such a checklist, and how you can start using it today. So give it a listen and if you like what you hear, be sure to check out the other episodes at pythonpodcast.com Interview Introductions How did you get introduced to Python?

Data Science 100

Data Science Software Engineer Software Engineering Python 100