Monte Carlo

JANUARY 16, 2024

In this blog post, we’ll look at six innovations that are shaping the future of the data warehousing, as well as challenges and considerations that organizations should keep in mind. Zero-copy data sharing 4. At the center of it all is the data warehouse, the lynchpin of any modern data stack. Table of Contents 1.

Data Lake 52

Data Lake Data Warehouse Unstructured Data AWS 52

Picnic Engineering

SEPTEMBER 8, 2022

We continue our story on the Analytics Platform setup in Picnic. In the “Picnic Analytics Platform: Migration from AWS Kinesis to Confluent Cloud” we described why and how we migrated from AWS Kinesis to Confluent Cloud. Our pipeline captures these events and sends them to Confluent Cloud.

Kafka 52

Kafka Metadata AWS Java 52

Rockset

AUGUST 28, 2023

Here we track every click to every product in our webshop, and then ingest this data into Rockset via Confluent Cloud. In this blog, we’ll focus on the API gateway part - be sure to check the AWS documentation on how to create an S3 bucket and the IAM role and policy.

AWS 52

AWS SQL Datasets Metadata 52

ProjectPro

AUGUST 24, 2021

And, out of these professions, this blog will discuss the data engineering job role. 4) Event Data Analysis NYC Open Data is free public data published by New York City agencies and partners. Learnings from the Project: This project will introduce you to the Google Cloud Console.

Data Engineering 52

Data Engineering Data Engineer Coding Project 52

Confluent

MAY 29, 2019

In part 1 , we discussed an event streaming architecture that we implemented for a customer using Apache Kafka ® , KSQL from Confluent, and Kafka Streams. We selected Gradle as our build tool, and wrote a custom Gradle plugin called gradle-confluent to structure and enable this methodology. gradlew composeUp. KSQL primer.

Kafka 94

Kafka Management Bytes SQL 94

Confluent

FEBRUARY 27, 2019

This is important as each platform has different persistence models and APIs, tying you to that vendor’s ecosystem. You can read more about CloudEvents in part 1 of this blog series. High (cold 5 s), (hot 100 ms). Peeking Behind the Curtains of Serverless Platforms, 2018. Event-first FaaS. Native stream processing.

Kafka 109

Kafka AWS Architecture Cloud 109

Confluent

SEPTEMBER 20, 2019

Luckily for on-premises scenarios, a myriad of deployment options are available, such as the Confluent Platform which can be deployed on bare metal, virtual machines, containers, etc. Cloud Memorystore, Amazon ElastiCache, and Azure Cache), applying this concept to a distributed streaming platform is fairly new.

Kafka 21

Kafka Management Cloud AWS 21