Monte Carlo

JANUARY 23, 2024

Gen AI can whip up serviceable code in moments — making it much faster to build and test data pipelines. Today’s LLMs can already process enormous amounts of unstructured data, automating much of the monotonous work of data science. Those who don’t embrace it will be left behind. John agrees. “

Pipeline-centric 52

Pipeline-centric Database-centric Metadata Unstructured Data 52

Data Engineering Weekly

APRIL 2, 2023

Contribute to the Rudderstack Transformations Library, Win $1000 RudderStack Transformations lets you customize event data in real-time with your own JavaScript or Python code. Latency & Efficiency Scalability & Reliability Going Beyond Data Analytics use cases [link] Click here to read the paper.

Data Engineering 52

Data Engineering Data Engineer Engineering Pipeline-centric 52

DareData

JULY 29, 2020

Odds are that your local hospital, pharmacy or medical institution's definition of being data-driven is keeping files in labelled file cabinets, as opposed to one single drawer. One paper suggests that there is a need for a re-orientation of the healthcare industry to be more "patient-centric". What makes a good Data Pipeline?

Healthcare 52

Healthcare Data Pipeline Medical Pipeline-centric 52

Maxime Beauchemin

JANUARY 20, 2017

The data engineering discipline took cues from its sibling, while also defining itself in opposition, and finding its own identity. Like data scientists, data engineers write code. They’re highly analytical, and are interested in data visualization.

Data Engineering 130

Data Engineering Data Engineer Engineering ETL Tools 130