Data Engineering Weekly

NOVEMBER 26, 2023

It’s the end of the year, and there will be a lot of buzz about what the next five years in data engineering might bring. 🤔 Reflecting on the past is crucial; it gives us a solid foundation to understand how trends have evolved and what's worked (or not). Who knows what insights we might uncover?

Data Engineering 70

Data Engineering Data Engineer Engineering Kafka 70

Confluent

JULY 10, 2019

As discussed in part 2, I created a GitHub repository with Docker Compose functionality for starting a Kafka and Confluent Platform environment, as well as the code samples mentioned below. KSQL user-defined functions. While the CASE syntax now available since KSQL 5.2.2 gradlew composeUp. If no match, return 'defaultvalue'.

Kafka 86

Kafka Java Bytes SQL 86

Confluent

AUGUST 13, 2019

Because choosing is hard, you can check out Gwen Shapira’s previous blog post to catch which talks she’s looking forward to the most. We need theory and first principles, but it also helps to know what real engineering teams are doing. New this year, we will inaugurate our very first cohort of Confluent Community Catalysts.

Kafka 19

Kafka Electronics Food Recruitment 19

Confluent

SEPTEMBER 26, 2019

® , Go, and Python SDKs where an application can use SQL to query raw data coming from Kafka through an API (but that is a topic for another blog). explains in more detail why many new integration architectures leverage Apache Kafka instead of legacy tools like RabbitMQ, ETL, and ESB. However, Apache Kafka is more than just messaging.

Kafka 20

Kafka BI SQL Datasets 20

Knowledge Hut

JANUARY 16, 2024

In this comprehensive blog, we delve into the foundational aspects and intricacies of the machine learning landscape. What Is Machine Learning? Embarking on a journey in the highly demanded field of Machine Learning (ML) opens doors to diverse career opportunities.

Machine Learning 98

Machine Learning Engineering Programming Language Algorithm 98

Confluent

MAY 29, 2019

In part 1 , we discussed an event streaming architecture that we implemented for a customer using Apache Kafka ® , KSQL from Confluent, and Kafka Streams. Now in part 2, we’ll discuss the challenges we faced developing, building, and deploying the KSQL portion of our application and how we used Gradle to address them.

Kafka 94

Kafka Management Bytes SQL 94

Confluent

MAY 22, 2019

What protocols do the devices use to communicate? What role will analytics play in future? What follows is an example of such a system, using existing best-in-class technologies. Through the Internet of Things (IoT), it is also connecting humans to the machines all around us and directly connecting machines to other machines.

Kafka 96

Kafka Google Cloud NoSQL Entertainment 96