Data Engineering Weekly

JANUARY 21, 2024

RudderStack is the Warehouse Native CDP, built to help data teams deliver value across the entire data activation lifecycle, from collection to unification and activation. The author summarized the pros and cons of various data team structures in an organization. Visit rudderstack.com to learn more.

Data Engineering 52

Data Engineering Data Engineer Engineering Kafka 52

Towards Data Science

OCTOBER 17, 2023

We ran a $12K experiment to test the cost and performance of Serverless warehouses and dbt concurrent threads, and obtained unexpected results. By: Jeff Chou, Stewart Bryson Image by Los Muertos Crew Databricks’ SQL warehouse products are a compelling offering for companies looking to streamline their production SQL queries and warehouses.

SQL 52

SQL Cloud Data Science AWS 52

Data Engineering Weekly

OCTOBER 23, 2022

Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make it easy to collect data from every application, website, and SaaS platform, then activate it in your warehouse and business tools. Hello Data Friends, Welcome to another edition of Data Engineering Weekly.

Data Engineering 52

Data Engineering Data Engineer Engineering Deep Learning 52

phData: Data Engineering

JULY 12, 2022

Within data engineering , one of the most frequent tasks is modeling data into data marts and data products. Traditionally, if a company wanted to model some data, there were two types of resources available that could accomplish this: data engineers or data analysts. What Is Data Modeling?

SQL 52

SQL Data Engineering Data Engineer Data 52

Data Engineering Weekly

MAY 21, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make collecting data from every application, website, and SaaS platform easy, then activating it in your warehouse and business tools. A couple of thing stands out for me in the blog.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Pipeline 52

AltexSoft

NOVEMBER 7, 2022

You can hardly compare data engineering toil with something as easy as breathing or as fast as the wind. The platform went live in 2015 at Airbnb, the biggest home-sharing and vacation rental site, as an orchestrator for increasingly complex data pipelines. How data engineering works. What is Apache Airflow?

PostgreSQL 52

PostgreSQL Metadata Python MySQL 52

Data Engineering Weekly

DECEMBER 18, 2022

Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make it easy to collect data from every application, website, and SaaS platform, then activate it in your warehouse and business tools. Given the characteristic, are we having a “Big Data” problem?

Data Engineering 52

Data Engineering Data Engineer Engineering Relational Database 52