Monte Carlo

SEPTEMBER 12, 2022

Taking all the data that flowed in from the dozens—if not hundreds—of SaaS products a company uses and piping it into a warehouse, where it could be managed and queried, took a lot of time and energy. The field of data engineering has been growing at a breakneck pace. Plus, he was one of the first data engineers at Facebook and Airbnb.

BI 52

BI Data Governance ETL Tools Data Warehouse 52

Data Engineering Weekly

APRIL 9, 2023

Editor’s Note: One of the Edition talks about Generative AI & Event Tracking and Application Change Management If you notice this week’s edition, most of the article talks about AI, specifically Generative AI. The number of incidents concerning the misuse of AI is rapidly rising. Sign up free to test out the tool today.

Data Engineering 52

Data Engineering Data Engineer Engineering AWS 52

Monte Carlo

SEPTEMBER 12, 2023

The current data stack As an AWS shop, the key components of the Whatnot data stack include Snowflake, dbt Cloud for transformation, Dagster for orchestration, Segment as a customer data platform, Confluent for managed Kafka, Rockset for real time aggregations, and Sigma+Hex for presentation. That’s not the case at Whatnot.

Machine Learning 52

Machine Learning Data Entertainment SQL 52