Data Engineering Podcast

MARCH 31, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. Validate consistency between source and target at any scale, and receive alerts about any discrepancies. Learn more about Datafold by visiting dataengineeringpodcast.com/datafold.

Project 130

Project Data Lake High Quality Data Data Workflow 130

Data Engineering Podcast

MARCH 24, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Dagster offers a new approach to building and running data platforms and data pipelines. Contact Info Twitter LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Data Lake 162

Data Lake High Quality Data Hadoop Data Pipeline 162

Data Engineering Podcast

MARCH 3, 2024

Colleen Tartow has worked across all stages of the data lifecycle, and in this episode she shares her hard-earned wisdom about how to conduct an AI program for your organization. Go to dataengineeringpodcast.com/starburst and get $500 in credits to try Starburst Galaxy today, the easiest and fastest way to get started using Trino.

Programming 162

Programming Data Lake High Quality Data Data Pipeline 162

Data Engineering Podcast

MARCH 17, 2024

In this episode Gleb Mezhanskiy, founder and CEO of Datafold, discusses the different error conditions and solutions that you need to know about to ensure the accuracy of your data. Go to dataengineeringpodcast.com/starburst and get $500 in credits to try Starburst Galaxy today, the easiest and fastest way to get started using Trino.

Database 147

Database Data Lake High Quality Data Data Workflow 147

Snowflake

APRIL 11, 2024

Snowflake Copilot: Your AI-powered SQL assistant Since the private preview announcement at Snowday in November 2023, Copilot has taken a major leap forward in its public preview release (limited availability in AWS US regions – see docs for details). To gain access, contact your Snowflake account team.

SQL 134

SQL AWS Data Analysis High Quality Data 134

Data Engineering Podcast

FEBRUARY 25, 2024

In this episode he explains how he used the combination of Apache Arrow, Flight, Datafusion, and Parquet to lay the foundation of the newest version of his time-series database. Go to dataengineeringpodcast.com/starburst and get $500 in credits to try Starburst Galaxy today, the easiest and fastest way to get started using Trino.

Database 162

Database Technology Data Lake High Quality Data 162

Data Engineering Podcast

JUNE 25, 2023

In this episode Toby Mao explains how it works, the importance of automatic column-level lineage tracking, and how you can start using it today. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management RudderStack helps you build a customer data platform on your warehouse or data lake.

Data Engineering 225

Data Engineering Data Engineer Python Engineering 225

Data Engineering Podcast

MARCH 10, 2024

In this episode Alex Merced explains how the branching and merging functionality in Nessie allows you to use the same versioning semantics for your data lakehouse that you are used to from Git. Join us at the top event for the global data community, Data Council Austin. Want to see Starburst in action?

Data Lake 147

Data Lake High Quality Data Data Pipeline Architecture 147

Data Engineering Podcast

DECEMBER 24, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. What motivated to write a book about how to manage Kafka in production? If you've learned something or tried out a project from the show then tell us about it!

Kafka 245

Kafka Data Lake High Quality Data SQL 245

Data Engineering Podcast

JANUARY 28, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. Go to dataengineeringpodcast.com/starburst and get $500 in credits to try Starburst Galaxy today, the easiest and fastest way to get started using Trino. for the prroduct?

Data Lake 147

Data Lake Building High Quality Data AWS 147

Data Engineering Podcast

FEBRUARY 4, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. Contact Info yingjunwu on GitHub Personal Website LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

SQL 173

SQL Data Lake High Quality Data Data Pipeline 173

Data Engineering Podcast

JANUARY 7, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. Go to dataengineeringpodcast.com/starburst and get $500 in credits to try Starburst Galaxy today, the easiest and fastest way to get started using Trino.

Data Process 147

Data Process Process Data Lake High Quality Data 147

Data Engineering Podcast

JANUARY 21, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. Contact Info LinkedIn @Tasso on Twitter Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? When is a CDP the wrong choice?

Data Lake 147

Data Lake High Quality Data NoSQL Data Warehouse 147

Data Engineering Podcast

FEBRUARY 11, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. Your host is Tobias Macey and today I'm interviewing Andy Jefferson about how to solve the problem of data sharing Interview Introduction How did you get involved in the area of data management?

Data Lake 147

Data Lake High Quality Data Government Data Pipeline 147

Knowledge Hut

APRIL 24, 2024

If you are using version 5.0 Let us check out the key changes and newly added features included in React Navigation 6.0: You will later learn about the integration comparison. Usage of React Native Navigation Let us explore further and have a look at the usage of React Native Navigation: 1. Verses React Navigation 5.0,

Coding 52

Coding Certification Python Programming Language 52

Data Engineering Podcast

MAY 14, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management RudderStack helps you build a customer data platform on your warehouse or data lake. Contact Info LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Data Lake 147

Data Lake Machine Learning Data Warehouse AWS 147

Data Engineering Podcast

MAY 28, 2023

Ghalib Suleiman has been on both sides of this equation and joins the show to share his hard-won wisdom about how to start and grow a data team in the early days of company growth. How much does the hiring manager/interviewer need to know about those concepts to evaluate skill? RudderStack also supports real-time use cases.

Data Lake 162

Data Lake Machine Learning Data Warehouse Education 162

Data Engineering Podcast

FEBRUARY 26, 2023

Summary There has been a lot of discussion about the practical application of data mesh and how to implement it in an organization. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Are you tired of dealing with the headache that is the 'Modern Data Stack'? We feel your pain.

Building 147

Building Metadata Machine Learning Data Integration 147

The Pragmatic Engineer

MARCH 30, 2023

Disclaimer: I worked at Uber, Lyft's US competitor, between 2016-2020. As always, I aim to remain independent in my analysis: I hold no positions in any of the companies mentioned in this article, and have not been paid to write about any of the companies. To get full issues twice a week, subscribe here.

Software Engineer 285

Software Engineer Software Engineering Retail Media 285

Data Engineering Podcast

JULY 2, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. Contact Info LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? Closing Announcements Thank you for listening!

Machine Learning 130

Machine Learning Data Engineering Data Engineer Engineering 130

Data Engineering Podcast

SEPTEMBER 10, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. Learn more about Datafold by visiting dataengineeringpodcast.com/datafold You shouldn't have to throw away the database to build with fast-changing data.

BI 208

BI SQL Data Machine Learning 208

Data Engineering Podcast

AUGUST 6, 2023

In this episode Barr Moses and Anna Filippova explore that question and provide useful exercises to start answering that in your company. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. How should teams think about measuring data team ROI?

Machine Learning 130

Machine Learning SQL Data Data Engineering 130

Data Engineering Podcast

JULY 16, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. For technologists who are thinking about launching new ventures, what are the key pieces of advice that you would like to share? Can you describe what your concept of a "Datapreneur" is?

SQL 130

SQL Machine Learning Python Data 130

The Pragmatic Engineer

OCTOBER 10, 2023

We don’t frequently have CEOs on The Pragmatic Engineer: in fact, today is the first issue when we’re talking with a CEO – partially – about their CEO job. At this social media startup, we put a lot of work into importing your contacts from Microsoft Messenger. And it was really interesting to work on EC2.

Software Engineer 247

Software Engineer Software Engineering Architecture Media 247

Data Engineering Podcast

JULY 9, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. feature engineering) What role does the tooling of a team have in the ways that they end up thinking about modeling? Can you describe what entity-centric modeling (ECM) is and the story behind it?

Database-centric 130

Database-centric Machine Learning SQL Data Engineering 130

Data Engineering Podcast

OCTOBER 29, 2023

In this episode Tanya Bragin shares her experiences as a product manager for two major vendors and the lessons that she has learned about how teams should approach the process of tool selection. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles.

Database 189

Database BI SQL Machine Learning 189

Data Engineering Podcast

JUNE 17, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management RudderStack helps you build a customer data platform on your warehouse or data lake. There are ongoing conversations about the continued merits of dimensional modeling techniques in modern warehouses.

Data Lake 130

Data Lake Metadata Data Architecture Machine Learning 130

Data Engineering Podcast

MAY 21, 2023

In this episode David Yaffe and Johnny Graettinger share the story behind the business and technology and how you can start using it today to build a real-time data lake without all of the headache. If you've learned something or tried out a project from the show then tell us about it! When is Estuary the wrong choice?

Data Lake 162

Data Lake Machine Learning Kafka Data Warehouse 162

Data Engineering Podcast

FEBRUARY 19, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Hey there podcast listener, are you tired of dealing with the headache that is the 'Modern Data Stack'? If you've learned something or tried out a project from the show then tell us about it! We feel your pain.

IT 147

IT Data Lake Metadata Data Warehouse 147

Data Engineering Podcast

MARCH 5, 2023

To help facilitate the nascent conversation about what constitutes an effective and productive data culture, the team at Data Council have dedicated an entire conference track to the subject. Head over to dataengineeringpodcast.com/timextender where you can do two things: watch us build a data estate in 15 minutes and start for free today.

Building 147

Building Database Design Metadata Machine Learning 147

FreshBI

DECEMBER 30, 2023

Contact us to start a conversation today! Learn more Our Latest Blogs About FreshBI Operating throughout USA and Canada, FreshBI is a boutique Microsoft Partner using Power BI to unlock the value trapped in your data so that your business can succeed. Contact Us

BI 105

BI Raw Data Banking Consulting 105

Knowledge Hut

APRIL 10, 2024

If you are a web developer or a frontend developer, you probably already know about the javascript library ReactJS. It is one of the most popular and widely used frontend libraries for building single page applications (SPAs). We will also answer some of the most frequently asked questions (FAQs) about React Router.

Python 52

Python Coding Designing Algorithm 52

Data Engineering Podcast

APRIL 9, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management RudderStack helps you build a customer data platform on your warehouse or data lake. What about companies that don't have the capacity to run a full data infrastructure? RudderStack also supports real-time use cases.

Data Lake 147

Data Lake Data Warehouse Machine Learning Data 147

Data Engineering Podcast

APRIL 16, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management RudderStack helps you build a customer data platform on your warehouse or data lake. If you've learned something or tried out a project from the show then tell us about it! RudderStack also supports real-time use cases.

Business Intelligence 147

Business Intelligence Building Data Lake BI 147

Data Engineering Podcast

JUNE 11, 2023

Summary Data engineering is all about building workflows, pipelines, systems, and interfaces to provide stable and reliable data. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management RudderStack helps you build a customer data platform on your warehouse or data lake.

Project 130

Project Building Data Lake Machine Learning 130

Data Engineering Podcast

SEPTEMBER 17, 2023

In this episode Brian Platz explains how JSON-LD can be used as a shared representation of linked data for building semantic data products. Learn more about Datafold by visiting dataengineeringpodcast.com/datafold Introducing RudderStack Profiles. Learn more about Datafold by visiting [dataengineeringpodcast.com/datafold]([link] today!

Building 189

Building BI SQL Python 189

Data Engineering Podcast

AUGUST 13, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. Contact Info LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? Closing Announcements Thank you for listening!

Data Pipeline 130

Data Pipeline BI SQL Business Intelligence 130