DataKitchen

OCTOBER 2, 2023

This lack of control is exacerbated by many people and/or automated data ingestion processes introducing changes to the data. This creates a chaotic data landscape where accountability is elusive and data integrity is compromised. The Hub Data Journey provides the raw data and adds value through a ‘contract.

Data Ingestion 40

Data Ingestion Data Government Datasets 40

DataKitchen

JULY 27, 2023

The Ten Standard Tools To Develop Data Pipelines In Microsoft Azure. While working in Azure with our customers, we have noticed several standard Azure tools people use to develop data pipelines and ETL or ELT processes. We counted ten ‘standard’ ways to transform and set up batch data pipelines in Microsoft Azure.

Data Pipeline 52

Data Pipeline BI Machine Learning Data Preparation 52

DataKitchen

SEPTEMBER 21, 2023

Running these automated tests as part of your DataOps and Data Observability strategy allows for early detection of discrepancies or errors. There are multiple locations where problems can happen in a data and analytic system. What is Data in Use?

Raw Data 70

Raw Data Data Business Intelligence High Quality Data 70

Monte Carlo

AUGUST 30, 2023

Run the test again to validate that the initial problem is solved and that your data meets your quality and accuracy standards. Schedule and automate Just like schema tests, custom data tests in dbt are typically not run just once but are incorporated into your regular data pipeline to ensure ongoing data quality.

SQL 52

SQL Datasets Database High Quality Data 52