Data Engineering Podcast

JULY 16, 2021

Summary There is a wealth of tools and systems available for processing data, but the user experience of integrating them and building workflows is still lacking. Raj Bains founded Prophecy to address this need by creating a UI first platform for building and executing data engineering workflows that orchestrates Airflow and Spark.

High Quality Data 100

High Quality Data Data Engineering Data Engineer Coding 100

Towards Data Science

MARCH 29, 2023

If you’re interested in those early days, how I grew my career, and advice for newcomers to data, take a look at my earlier article. In this article, I want to focus on my on-again, off-again relationship with books and reading. Even if you haven’t read any of the books below, you’ve probably at least heard of some of them.

Data Warehouse 66

Data Warehouse BI Healthcare Database 66

Monte Carlo

AUGUST 31, 2023

Your downstream data consumers including product analysts, marketing leaders, and sales teams rely on data-driven tools like CRMs, CXPs, CMSs, and any other acronym under the sun to do their jobs quickly and effectively. But what happens when the data is wrong?

Data Lake 52

Data Lake Data Pipeline Unstructured Data Data Warehouse 52

Workfall

JULY 4, 2023

With DBT, they weave powerful SQL spells to create data models that capture the essence of their organization’s information. DBT’s superpowers include seamlessly connecting with databases and data warehouses, performing amazing transformations, and effortlessly managing dependencies to ensure high-quality data.

Data Warehouse 69

Data Warehouse SQL PostgreSQL Database 69

Monte Carlo

MARCH 28, 2024

A data product, coined by DJ Patil, Former Chief Data Scientist of the United States, has several components, including a product management process, the domain wrapper comprising a semantic layer, business logic and metrics, and access. Simply put, a data product is much more than a dataset alone. Who needs this data?

Data 52

Data High Quality Data Machine Learning Accessible 52

Monte Carlo

APRIL 21, 2022

Adopting a cloud data warehouse like Snowflake is an important investment for any organization that wants to get the most value out of their data. In Snowflake, you can uncover valuable insights about which tables are used, by whom, and how often with the Access History feature (available in Enterprise Edition and higher).

Metadata 52

Metadata Bytes Government Data 52

Monte Carlo

JUNE 23, 2022

At some point in the last two decades, the size of our data became inextricably linked to our ego. We watched enviously as FAANG companies talked about optimizing hundreds of petabyes in their data lakes or data warehouses. We imagined what it would be like to manage big data quality at that scale.

Big Data 40

Big Data Management Machine Learning Data Warehouse 40