Data Engineering Weekly

APRIL 2, 2023

Latency & Efficiency Scalability & Reliability Going Beyond Data Analytics use cases [link] Click here to read the paper. Twitter: Twitter's Recommendation Algorithm Twitter open-source its recommendation engine code. nHowever, High-Quality Data Creation and Data collaboration going to remain challenging. ","username":"ananthdurai","name":"at-ananth-at-data-folks

Data Engineering 52

Data Engineering Data Engineer Engineering Pipeline-centric 52

Maxime Beauchemin

JANUARY 20, 2017

The modern data warehouse is a more public institution than it was historically, welcoming data scientists, analysts, and software engineers to partake in its construction and operation. Data is simply too centric to the company’s activity to have limitation around what roles can manage its flow.

Data Engineering 130

Data Engineering Data Engineer Engineering ETL Tools 130

Ascend.io

JUNE 8, 2023

Treating data as a product is more than a concept; it’s a paradigm shift that can significantly elevate the value that business intelligence and data-centric decision-making have on the business. Data pipelines Data integrity Data lineage Data stewardship Data catalog Data product costing Let’s review each one in detail.

Pipeline-centric 52

Pipeline-centric Database-centric Data Ingestion Data Pipeline 52

DareData

JULY 29, 2020

We have heard news of machine learning systems outperforming seasoned physicians on diagnosis accuracy, chatbots that present recommendations depending on your symptoms , or algorithms that can identify body parts from transversal image slices , just to name a few. What makes a good Data Pipeline?

Healthcare 52

Healthcare Data Pipeline Medical Pipeline-centric 52