Data Engineering Digest

The Good and the Bad of Apache Kafka Streaming Platform

AltexSoft

OCTOBER 21, 2022

We describe information search on the Internet with just one word — ‘google’. We ‘photoshop pictures’ instead of editing them on the computer. The technology was written in Java and Scala in LinkedIn to solve the internal problem of managing continuous data flows. Scalability is one of Kafka’s key selling points.

Kafka

Kafka Hadoop ETL Tools Big Data

A Machine Learning Pipeline with Real-Time Inference

Zalando Engineering

FEBRUARY 15, 2021

In 2015 we decided to migrate to Scala and Spark in order to scale better. You can read about this transition on our engineering blog. However, it has a few pain points, namely: It’s highly coupled to Scala and Spark which makes using state of the art libraries (mostly Python) difficult.

Machine Learning

Machine Learning AWS Scala Python

Data Engineering Digest

The Good and the Bad of Apache Kafka Streaming Platform

A Machine Learning Pipeline with Real-Time Inference

Webinars

Stay Connected