article thumbnail

Big Data Technologies that Everyone Should Know in 2024

Knowledge Hut

If you want to stay ahead of the curve, you need to be aware of the top big data technologies that will be popular in 2024. In this blog post, we will discuss such technologies. This article will discuss big data analytics technologies, technologies used in big data, and new big data technologies.

article thumbnail

Data Engineering Annotated Monthly – January 2022

Big Data Tools

Furthermore, its interface is not web, but rather a desktop application written in Java (but with a native look and feel). It is another example of an orchestrator, this time written in Java. In this blog post I describe what dbt is and how it can be used while providing readers with several examples of usage.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Data Engineering Annotated Monthly – January 2022

Big Data Tools

Furthermore, its interface is not web, but rather a desktop application written in Java (but with a native look and feel). It is another example of an orchestrator, this time written in Java. In this blog post I describe what dbt is and how it can be used while providing readers with several examples of usage.

article thumbnail

Data Engineering Annotated Monthly – August 2021

Big Data Tools

and Java 8 still exists but is deprecated. How Uber Achieves Operational Excellence in the Data Quality Experience – Uber is known for having a huge Hadoop installation in Kubernetes. This blog post is more about data quality, though, describing how they built their data quality platform. Support for Scala 2.12

article thumbnail

Data Engineering Annotated Monthly – July 2021

Big Data Tools

Here’s what’s happening in data engineering right now. Apache Spark already has two official APIs for JVM – Scala and Java – but we’re hoping the Kotlin API will be useful as well, as we’ve introduced several unique features. Notably, they’ve added experimental support for Java 11 (finally) and virtual tables. Cassandra 4.0

article thumbnail

Data Engineering Annotated Monthly – July 2021

Big Data Tools

Here’s what’s happening in data engineering right now. Apache Spark already has two official APIs for JVM – Scala and Java – but we’re hoping the Kotlin API will be useful as well, as we’ve introduced several unique features. Notably, they’ve added experimental support for Java 11 (finally) and virtual tables. Cassandra 4.0

article thumbnail

Data Engineering Annotated Monthly – August 2021

Big Data Tools

and Java 8 still exists but is deprecated. How Uber Achieves Operational Excellence in the Data Quality Experience – Uber is known for having a huge Hadoop installation in Kubernetes. This blog post is more about data quality, though, describing how they built their data quality platform. Support for Scala 2.12