Lyft Engineering

NOVEMBER 29, 2023

In this particular blog post, we explain how Druid has been used at Lyft and what led us to adopt ClickHouse for our sub-second analytic system. Real-time Ingestion Events from our real-time analytics pipeline were configured to be sent into our internal Flink application, streamed to Kafka, and written into Druid.

Kafka 104

Kafka Data Ingestion Datasets Architecture 104

Rockset

SEPTEMBER 14, 2021

We’re introducing a new Rockset Integration for Apache Kafka that offers native support for Confluent Cloud and Apache Kafka, making it simpler and faster to ingest streaming data for real-time analytics. With the Kafka Integration, users no longer need to build, deploy or operate any infrastructure component on the Kafka side.

Kafka 52

Kafka SQL MongoDB Computer Science 52

Rockset

MARCH 10, 2022

We'll be publishing more posts in the series in the near future, so subscribe to our blog so you don't miss them! A platform such as Apache Kafka/Confluent , Spark or Amazon Kinesis for publishing that stream of event data. Event streaming/stream processing has been around for almost a decade. It’s well understood.

Data Analytics 52

Data Analytics Data Warehouse Medical MySQL 52

Cloudera

JULY 15, 2021

This blog post provides an overview of best practice for the design and deployment of clusters incorporating hardware and operating system configuration, along with guidance for networking and security as well as integration with existing enterprise infrastructure. Introduction and Rationale. Private Cloud Base Overview. Role allocation.

Architecture 102

Architecture Cloud Kafka Hadoop 102

Zalando Engineering

NOVEMBER 29, 2017

Second in our series about the use of Apache Kafka’s Streams API by Zalando This is the second in a series about the use of Apache Kafka’s Streams API by Zalando, Europe’s leading online fashion platform. See Ranking Websites in Real-time with Apache Kafka’s Streams API for the first post in the series.

Kafka 40

Kafka AWS Amazon Web Services Utilities 40

Confluent

APRIL 30, 2019

With the release of Apache Kafka ® 2.1.0, Kafka Streams introduced the processor topology optimization framework at the Kafka Streams DSL layer. This framework opens the door for various optimization techniques from the existing data stream management system (DSMS) and data stream processing literature.

Kafka 90

Kafka Coding Process Bytes 90

LinkedIn Engineering

MAY 9, 2023

Co-Authors: Estella Pham and Guanlin Lu At peak, LinkedIn serves over 1.4 In this blog post we’ll discuss our decision to leverage Couchbase, the challenges that arose, and how we addressed each challenge in our final solution. million member profiles per second. The number of requests to our storage infrastructure doubles every year.

Database 133

Database Project Datasets Designing 133