Data Engineering Podcast
MAY 26, 2024
Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. Powered by Trino, the query engine Apache Iceberg was designed for, Starburst is an open platform with support for all table formats including Apache Iceberg, Hive, and Delta Lake.
Data Engineering Podcast
JULY 3, 2022
In order to quickly identify if and how two data systems are out of sync Gleb Mezhanskiy and Simon Eskildsen partnered to create the open source data-diff utility. If you’re a data engineering podcast listener, you get credits worth $5,000 when you become a customer.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Monte Carlo
MAY 14, 2024
Delta Lake : Released by Databricks in 2019, Delta Lake was created to bring reliability and robustness to data lakes, incorporating ACID (Atomicity, Consistency, Isolation, Durability) transactions into Apache Spark to maintain data integrity across complex transformations and updates.
Knowledge Hut
SEPTEMBER 25, 2023
As an Azure Data Engineer, you will be expected to design, implement, and manage data solutions on the Microsoft Azure cloud platform. You will be in charge of creating and maintaining data pipelines, data storage solutions, data processing, and data integration to enable data-driven decision-making inside a company.
Knowledge Hut
MARCH 28, 2024
Role Level Intermediate Responsibilities Design and develop data pipelines to ingest, process, and transform data. Implemented and managed data storage solutions using Azure services like Azure SQL Database , Azure Data Lake Storage, and Azure Cosmos DB. GDPR, HIPAA), and industry standards.
Data Engineering Podcast
JANUARY 1, 2022
In the same way that application performance monitoring ensures reliable software and keeps application downtime at bay, Monte Carlo solves the costly problem of broken data pipelines. Start trusting your data with Monte Carlo today! To what extent do speed benchmarks inform decisions for modern data teams?
Ascend.io
DECEMBER 11, 2023
When data starts piling up from all corners — including cloud APIs , cloud warehouses , on-premises databases , and data lakes — that’s when you really start feeling the need for efficient data orchestration. So, why is data orchestration a big deal?
Expert insights. Personalized for you.
130 
Let's personalize your content