Rockset

MAY 3, 2022

This blog post discusses data duplication, how it plagues teams adopting real-time analytics , and the deduplication solutions Rockset provides to resolve the duplication issue. Stop Duplication During ETL Jobs Stream-processing ETL jobs is another deduplication method. This involves deduplication during data stream consumption.

Kafka 52

Kafka Data Warehouse Database Data 52

Rockset

MAY 3, 2023

Rockset is a database used for real-time search and analytics on streaming data. In scenarios involving analytics on massive data streams, we’re often asked the maximum throughput and lowest data latency Rockset can achieve and how it stacks up to other databases. lower latency than Elasticsearch for streaming data ingestion.

Data Ingestion 59

Data Ingestion Kafka Database Architecture 59

Rockset

JUNE 6, 2023

In this blog, we’ll walk through how Rockset provides compute-storage separation while making real-time data available to queries. If we add or remove a node from the hot storage layer, the number of collection slices that will change owner while rebalancing will be proportional to 1/N where N is the number of nodes in the hot storage layer.

Metadata 52

Metadata Datasets Architecture Algorithm 52

Confluent

SEPTEMBER 12, 2019

When you finally understand log-structured merge trees, it’s a rewarding feeling. When Apache Kafka ® consumer group rebalancing clicks, you feel good. This is one of those intellectual influences that sometimes passes beyond notice, but it’s something that’s definitely happening with event streaming. Just as one should.

Kafka 9

Kafka ETL System Architecture Retail 9