Data Engineering Weekly

APRIL 2, 2023

Meta: Presto - A Decade of SQL Analytics at Meta Presto and Kafka are the two systems that greatly impacted data infrastructure in the last decade. Latency & Efficiency Scalability & Reliability Going Beyond Data Analytics use cases [link] Click here to read the paper.

Data Engineering 52

Data Engineering Data Engineer Engineering Pipeline-centric 52

DareData

JULY 29, 2020

We have heard news of machine learning systems outperforming seasoned physicians on diagnosis accuracy, chatbots that present recommendations depending on your symptoms , or algorithms that can identify body parts from transversal image slices , just to name a few. What makes a good Data Pipeline?

Healthcare 52

Healthcare Data Pipeline Medical Pipeline-centric 52

Maxime Beauchemin

JANUARY 20, 2017

The modern data warehouse is a more public institution than it was historically, welcoming data scientists, analysts, and software engineers to partake in its construction and operation. Data is simply too centric to the company’s activity to have limitation around what roles can manage its flow.

Data Engineering 130

Data Engineering Data Engineer Engineering ETL Tools 130