Data Engineering Podcast

JANUARY 21, 2024

Summary Databases and analytics architectures have gone through several generational shifts. A substantial amount of the data that is being managed in these systems is related to customers and their interactions with an organization. Find simplicity in your most complex projects with Miro.

Data Lake 147

Data Lake High Quality Data NoSQL Data Warehouse 147

Data Engineering Weekly

NOVEMBER 13, 2022

It moved from the speculation to the data engineers understanding the benefit of it and asking when we can get the implementation soon. I met many data leaders about Data Contracts, my project Schemata, and how the extended version we are building can help them create high-quality data. Not Endless DAGs!

Data Engineering 52

Data Engineering Data Engineer Engineering Kafka 52

Monte Carlo

MAY 17, 2023

Upstream Code Impacting Data Systems It’s not just SQL queries that can create data quality problems. Another data team caught data freshness and volume issues caused by a bad code merge upstream. The issue was with a Lambda that took data from S3 and pushed it into Snowflake.

Data 52

Data Data Pipeline Data Engineering Data Engineer 52

Monte Carlo

MAY 17, 2023

Upstream Code Impacting Data Systems It’s not just SQL queries that can create data quality problems. Another data team caught data freshness and volume issues caused by a bad code merge upstream. The issue was with a Lambda that took data from S3 and pushed it into Snowflake.

Data Pipeline 52

Data Pipeline Data Data Engineering Data Engineer 52