Remove improving-stream-data-quality-with-protobuf-schema-validation
article thumbnail

Improving Stream Data Quality with Protobuf Schema Validation

Confluent

The requirements for fast and reliable data pipelines are growing quickly at Deliveroo as the business continues to grow and innovate. We have delivered an event streaming platform which gives strong guarantees on data quality, using Apache Kafka ® and Protocol Buffers. The Need for a Structured Message Format.

Kafka 80
article thumbnail

Data Engineering Weekly #124

Data Engineering Weekly

Contribute to the Rudderstack Transformations Library, Win $1000 RudderStack Transformations lets you customize event data in real time with your own JavaScript or Python code. dbt: State of Analytics Engineering dbt publishes the state of analytical [data???🤔] Unbundling was the talk of the town. 🤔] engineering.

article thumbnail

7 Lessons From GoCardless’ Implementation of Data Contracts

Monte Carlo

At the time, he was one of a very few people using the term “data contract.” Data contracts have since became one of the most discussed topics in data engineering. For posterity, we have preserved Barr’s forward that examines what was then a very nascent trend, but we have also added an updated data contract FAQ as an addendum.