Confluent

MAY 29, 2019

In part 1 , we discussed an event streaming architecture that we implemented for a customer using Apache Kafka ® , KSQL from Confluent, and Kafka Streams. In part 3, we’ll explore using Gradle to build and deploy KSQL user-defined functions (UDFs) and Kafka Streams microservices. gradlew composeUp. KSQL primer.

Kafka 95

Kafka Management Bytes SQL 95

Big Data Tools

JULY 13, 2022

If you think I missed something worthwhile, catch me on Twitter and suggest a topic, link, or anything else you want to see. There are also multiple improvements for streaming support (for Kafka and Kinesis ), along with many other changes. In a nutshell, InLong is a SaaS-based streaming platform that scales.

Data Engineering 52

Data Engineering Data Engineer Engineering Kafka 52

Big Data Tools

JULY 13, 2022

If you think I missed something worthwhile, catch me on Twitter and suggest a topic, link, or anything else you want to see. There are also multiple improvements for streaming support (for Kafka and Kinesis ), along with many other changes. In a nutshell, InLong is a SaaS-based streaming platform that scales.

Data Engineering 52

Data Engineering Data Engineer Engineering Kafka 52

Rockset

JANUARY 17, 2020

In this blog we will set up a real-time SQL API on Kafka using AWS Lambda and Rockset. The Kafka set up instructions for the remainder of this tutorial are for Confluent Kafka. Follow the directions below to set it up if you don’t have a Kafka installation to experiment with.

Kafka 40

Kafka SQL AWS Accessible 40

Rockset

OCTOBER 10, 2019

In this blog, we walk through how to build a real-time dashboard for operational monitoring and analytics on streaming event data from Kafka, which often requires complex SQL, including filtering, aggregations, and joins with other data sets. To get this data into Rockset, we’ll first need to create a new Kafka integration in Rockset.

Kafka 52

Kafka SQL Building Data 52

Big Data Tools

JUNE 8, 2022

If you think I missed something worthwhile, catch me on Twitter and suggest a topic, link, or anything else you want to see. On top of that, it’s a part of the Hadoop platform, which created additional work that we otherwise would not have had to do. They need to be configured with configuration files or via the command line.

Data Engineering 52

Data Engineering Data Engineer Engineering Kafka 52

Big Data Tools

JUNE 8, 2022

If you think I missed something worthwhile, catch me on Twitter and suggest a topic, link, or anything else you want to see. On top of that, it’s a part of the Hadoop platform, which created additional work that we otherwise would not have had to do. They need to be configured with configuration files or via the command line.

Data Engineering 52

Data Engineering Data Engineer Engineering Kafka 52

Rockset

APRIL 15, 2022

We'll be publishing more posts in the series in the near future, so subscribe to our blog so you don't miss them! In other words, events that are close in time are written to adjacent disk clusters or partitions. So why are their analytics still crawling through in batches instead of real time? That is called at-least-once semantics.

Analytics Application 52

Analytics Application Data Warehouse Raw Data Kafka 52

ProjectPro

JUNE 29, 2021

Your search for Apache Kafka interview questions ends right here! Let us now dive directly into the Apache Kafka interview questions and answers and help you get started with your Big Data interview preparation! How to study for Kafka interview? What is Kafka used for? What are main APIs of Kafka?

Kafka 40

Kafka Bytes Big Data Java 40

Zalando Engineering

NOVEMBER 22, 2017

Using Apache and the Kafka Streams API with Scala on AWS for real-time fashion insights This piece was originally published on confluent.io The Fashion Web Zalando, Europe’s leading online fashion platform, cares deeply about fashion. For every domain, we mark the other domains that it has links to. Don’t they clog things up?

Kafka 40

Kafka Scala Hadoop Algorithm 40

ProjectPro

AUGUST 24, 2021

And, out of these professions, this blog will discuss the data engineering job role. Nevertheless, that is not the only job in the data world. Data professionals who work with raw data like data engineers, data analysts, machine learning scientists , and machine learning engineers also play a crucial role in any data science project.

Data Engineering 52

Data Engineering Data Engineer Coding Project 52

Confluent

MAY 9, 2019

Yes, we can transact across partitions in Apache Kafka ® , and with traditional database transactions you get many “trust” semantics for free; however, they are pushed down into the database runtime. So far in this series, we have recognized that by going back to first principles, we have a new foundation to work with. Avro or Protobuf ).

Kafka 93

Kafka Pipeline-centric Architecture Database-centric 93

Confluent

JULY 17, 2019

Together, MongoDB and Apache Kafka ® make up the heart of many modern data architectures today. Integrating Kafka with external systems like MongoDB is best done though the use of Kafka Connect. The official MongoDB Connector for Apache Kafka is developed and supported by MongoDB engineers. Free MongoDB Atlas cluster.

MongoDB 21

MongoDB Kafka Medical Database 21

Confluent

SEPTEMBER 26, 2019

In the early days, many companies simply used Apache Kafka ® for data ingestion into Hadoop or another data lake. However, Apache Kafka is more than just messaging. Some Kafka and Rockset users have also built real-time e-commerce applications , for example, using Rockset’s Java, Node.js

Kafka 21

Kafka BI SQL Datasets 21

Cloudera

OCTOBER 17, 2023

Recently, Confluent hosted Current 2023 (formerly Kafka summit) in San Jose on Sept 26th and 27th. This blog is for anyone who was interested but unable to attend the conference, or anyone interested in a quick summary of what happened there. More of a Confluent conference now than a kafka conference.

Database-centric 74

Database-centric Kafka Pipeline-centric Database 74

Confluent

AUGUST 6, 2019

The previous blog post How to Build a UDF and/or UDAF in KSQL 5.0 Now with Confluent Platform 5.3.0, Confluent Platform 5.3.0 Next, add the Maven repositories from Confluent to your ~/.m2/settings.xml discussed some key steps for building and deploying a custom KSQL UDF/UDAF. DarchetypeVersion=5.3.0.

Kafka 17

Kafka Java Coding Project 17