DataKitchen

MAY 10, 2024

The Five Use Cases in Data Observability: Effective Data Anomaly Monitoring (#2) Introduction Ensuring the accuracy and timeliness of data ingestion is a cornerstone for maintaining the integrity of data systems. Have all the source files/data arrived on time? Is the source data of expected quality?

Data Ingestion 52

Data Ingestion Transportation High Quality Data Data Schemas 52

DataKitchen

JUNE 19, 2023

Finding problems before your customers know they exist helps your team’s happiness, productivity, customer trust, and customer data success. Given the complicated distributed systems we use to get value from data and the diversity of data, we need a simplifying framework. That idea is the Data Journey.

Data 52

Data Data Validation Utilities High Quality Data 52

Monte Carlo

JANUARY 25, 2023

It can be challenging when a team is expected to take full responsibility for a key data product when there are no guarantees around the upstream data quality. Without clear management of each transformation step stretching back to source systems, teams may be unwilling to bear the responsibility of contracts.

Data Warehouse 52

Data Warehouse Data High Quality Data Metadata 52

Monte Carlo

APRIL 24, 2023

This data ingestion process can be accomplished by either querying the source directly, using upstream systems to publish events, or some combination of the two. There are several out-of-the-box solutions like Fivetran , Airbyte , or Debezium that assist in implementing these approaches.

Data Pipeline 52

Data Pipeline Building Data Ingestion BI 52