Seattle Data Guy

APRIL 25, 2024

As a result, frameworks such as Apache Spark and Apache Flink became popular due to their abilities to handle big data processing… Read more The post Apache Spark Vs Apache Flink – How To Choose The Right Solution appeared first on Seattle Data Guy.

Big Data 147

Big Data Data Process Process Management 147

Data Engineering Weekly

NOVEMBER 26, 2023

The past few months have been a bit of a health hiccup for me 🤒, but hey, I'm all smiles 😊 about how things are turning out. 🤔 Reflecting on the past is crucial; it gives us a solid foundation to understand how trends have evolved and what's worked (or not). Who knows what insights we might uncover?

Data Engineering 70

Data Engineering Data Engineer Engineering Kafka 70

Knowledge Hut

SEPTEMBER 26, 2023

Organisations are constantly looking for robust and effective platforms to manage and derive value from their data in the constantly changing landscape of data analytics and processing. The Microsoft Azure Synapse and Databricks platforms are two strong competitors in this space. What is Azure?

Data Lake 52

Data Lake Database-centric Pipeline-centric Machine Learning 52

Rockset

MARCH 27, 2023

This is part two in Rockset’s Making Sense of Real-Time Analytics on Streaming Data series. In part 1 , we covered the technology landscape for real-time analytics on streaming data. In this post, we’ll explore the differences between real-time analytics databases and stream processing frameworks. With that, let’s dive in.

Database 52

Database Process Scala SQL 52

AltexSoft

JUNE 7, 2021

Hadoop and Spark are the two most popular platforms for Big Data processing. To come to the right decision, we need to divide this big question into several smaller ones — namely: What is Hadoop? To come to the right decision, we need to divide this big question into several smaller ones — namely: What is Hadoop? scalability.

Big Data Tools 98

Big Data Tools Hadoop Big Data Database-centric 98

Big Data Tools

AUGUST 3, 2021

Here’s what’s happening in data engineering right now. Kotlin API for Apache Spark – A year after showing you the first preview, we released version 1.0. Apache Spark already has two official APIs for JVM – Scala and Java – but we’re hoping the Kotlin API will be useful as well, as we’ve introduced several unique features.

Data Engineering 52

Data Engineering Data Engineer Engineering Big Data Tools 52

Big Data Tools

AUGUST 3, 2021

Here’s what’s happening in data engineering right now. Kotlin API for Apache Spark – A year after showing you the first preview, we released version 1.0. Apache Spark already has two official APIs for JVM – Scala and Java – but we’re hoping the Kotlin API will be useful as well, as we’ve introduced several unique features.

Data Engineering 52

Data Engineering Data Engineer Engineering Big Data Tools 52