Remove confluent-platform-now-supports-protobuf-json-schema-custom-formats
article thumbnail

Using Change Data Capture for Warehouse Analytics

Picnic Engineering

Introduction We continue our story on the Analytics Platform setup in Picnic. Now we are going to look at the setup for the FCA (automated fulfillment center) pipeline. Thousands of customer orders are prepared here every day in a highly automated manner. Last time , we looked at the internal services data pipeline.

Kafka 52
article thumbnail

Improving Stream Data Quality with Protobuf Schema Validation

Confluent

We have delivered an event streaming platform which gives strong guarantees on data quality, using Apache Kafka ® and Protocol Buffers. Our quickly expanding business also means our platform needs to keep ahead of the curve to accommodate the ever-growing volumes of data and increasing complexity of our systems.

Kafka 80
article thumbnail

Schemas, Contracts, and Compatibility

Confluent

Now you may notice that there is a certain coupling and inversion of responsibility here. Now that the profile change event is published, it can be received by the quote service. Note that the same definitions of fields and types that once defined the REST API are now part of the event schema. Chattanooga, TN” }.

Kafka 110