article thumbnail

Why We Do Scala in Zalando

Zalando Engineering

Leveraging the full power of a functional programming language In Zalando Dublin, you will find that most engineering teams are writing their applications using Scala. We will try to explain why that is the case and the reasons we love Scala. How I came to use Scala I have been working with JVM for the last 18 years.

Scala 40
article thumbnail

ZIO Streams: A Long-Form Introduction

Rock the JVM

He’s a senior developer, who has been working with Scala for a number of years. scala> ll.tail.head val res3: Int = 2 scala> ll val res4: scala.collection.immutable.LazyList[Int] = LazyList ( 1, 2, ) We can see that the first two elements now clearly show! Mark has a lot to share, and this article is a comprehensive piece.

Scala 40
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Forge Your Career Path with Best Data Engineering Certifications

ProjectPro

Whether you are just starting your career as a Data Engineer or looking to take the next step, this blog will walk you through the most valuable data engineering certifications and help you make an informed decision about which one to pursue. Why Are Data Engineering Skills In Demand? Basic understanding of Microsoft Azure.

article thumbnail

Snowflake Architecture and It's Fundamental Concepts

ProjectPro

This blog walks you through what does Snowflake do , the various features it offers, the Snowflake architecture, and so much more. BigQuery charges users depending on how many bytes are read or scanned. Launched in 2014, Snowflake is one of the most popular cloud data solutions on the market.

article thumbnail

100+ Big Data Interview Questions and Answers 2023

ProjectPro

In this blog, we'll dive into some of the most commonly asked big data interview questions and provide concise and informative answers to help you ace your next big data job interview. Metadata for a file, block, or directory typically takes 150 bytes. Spark provides APIs for the programming languages Java, Scala, and Python.

article thumbnail

50 PySpark Interview Questions and Answers For 2023

ProjectPro

PySpark runs a completely compatible Python instance on the Spark driver (where the task was launched) while maintaining access to the Scala-based Spark cluster access. Although Spark was originally created in Scala, the Spark Community has published a new tool called PySpark, which allows Python to be used with Spark.

Hadoop 52
article thumbnail

On Spark, Hive, and Small Files: An In-Depth Look at Spark Partitioning Strategies

Airbnb Tech

Each file has a 150 byte cost in NameNode memory, and HDFS has a limited number of overall IOPS. repartition(5*365, $”date”, $”rand”) Under the hood, Scala will construct a key that contains both your date, and your random factor, something like (<date>, <0–4>). However, there is a cost. Airbnb is hiring!