Data Engineering Weekly

FEBRUARY 19, 2023

The blog discusses fairness in ML and demonstrates why high accuracy doesn’t mean the algorithm is fair. The blog mostly focuses on how it optimizes the batch pipeline using Airflow and BigQuery. The blog compares the features available from Apache Hudi, Iceberg & DeltaLake.

Data Engineering 52

Data Engineering Data Engineer Engineering Google Cloud 52

Monte Carlo

SEPTEMBER 12, 2022

Maxime’s experience speaks for itself: He’s the creator of the popular orchestrator Apache Airflow , followed by Apache Superset , as well as CEO and co-founder of Preset , a fast-growing data exploration tool offering AI-enabled data visualization for modern companies. Maxime says.

BI 52

BI Data Governance ETL Tools Data Warehouse 52

Databand.ai

DECEMBER 20, 2022

1) Neelesh Salian Staff Software Engineer at dbt Labs Neelesh has nearly a decade of experience as a software engineer, working at companies like Stitch Fix and dbt Labs. Brian shares advice regularly on his Medium blog and GitHub , as well as on LinkedIn, focusing on topics like data science, data engineering, data strategy, and SQL.

Data Analytics 52

Data Analytics Google Cloud Data Science Data Mining 52

Monte Carlo

MAY 19, 2022

In his seminal 2017 blog post, The Downfall of the Data Engineer , Maxime Beauchemin wrote that the data engineer had the worst seat at the table. Technologies like dbt have also played a role in enabling engineers to curate raw data into an analytics layer. Encouraging data teams to follow procedure is, too.

Generalist 52

Generalist Data Governance Government Metadata 52