dbt Developer Hub

MAY 25, 2022

But, at some point, your stakeholder wants to know how each entity is changing over time. However, we cannot just join on the primary key because each table has several rows of history for the same id, all valid across different timespans. How complex can this get? We can do it. Let’s take a look at the math. q) problem!

Datasets 52

Datasets Building BI Coding 52

Cloudera

SEPTEMBER 15, 2022

Today’s platform owners, business owners, data developers, analysts, and engineers create new apps on the Cloudera Data Platform and they must decide where and how to store that data. In this blog post, we will talk about a single Ozone cluster with the capabilities of both Hadoop Core File System (HCFS) and Object Store (like Amazon S3).

Systems 90

Systems Hadoop Metadata Telecommunication 90

Rock the JVM

DECEMBER 5, 2023

In this article my aim is to bridge that gap by showing, step by step, how to solve a concrete problem using many of the new type-level features that Scala 3 provides. The Problem The problem that we are going to solve is inspired by an actual use-case that I had at work. Let’s dig in!

Scala 94

Scala Programming Coding Utilities 94

Rockset

JUNE 6, 2023

In this blog, we’ll walk through how Rockset provides compute-storage separation while making real-time data available to queries. If we could store all data in a shared location accessible by all compute nodes, and still achieve attached-SSD-equivalent performance, we would resolve all the above problems.

Metadata 52

Metadata Datasets Architecture Algorithm 52

DoorDash Engineering

JANUARY 23, 2024

With all of that in mind, we set out to build a new logistics configuration platform that could not only meet today’s demands but could continue to scale well into DoorDash’s future growth. Ideally, we would like to run experiments on ad hoc configurations, but there is no way currently to add them temporarily and in a scalable manner.

Architecture 74

Architecture Metadata Bytes Systems 74

Netflix Tech

DECEMBER 10, 2018

Secondly, we utilize various signals and aggregate data such as understanding of content popularity on Netflix to enable highly relevant ads. Our overall aim is to make our ads on all the external publishing channels resonate well with users and we are constantly experimenting to improve our effectiveness in doing that.

Coding 111

Coding Aggregated Data Utilities Architecture 111

Rockset

FEBRUARY 22, 2024

First, we'll start with some conceptual points about how to think about DynamoDB and the problems that secondary indexes solve. Before we get into use cases and best practices for secondary indexes, we should first understand what DynamoDB secondary indexes are. In this post, we'll look at DynamoDB secondary indexes.

Database 80

Database Relational Database Accessible Accessibility 80

Data Engineering Podcast

JANUARY 28, 2018

In this episode Danielle Robinson and Joe Hand explain how the project got started, how it functions, and some of the many ways that it can be used. It has become one of the largest events for data scientists, data engineers, and data driven businesses to get together and learn how to be more effective.

Data 100

Data Project Electronics Data Management 100

Confluent

SEPTEMBER 13, 2019

If you already know what a Kafka rebalance is, feel free to jump directly to the following section to save time: When do we trigger an unnecessary rebalance? Here, we describe two demo cases: one is an actual rebalance walkthrough, and the other is the high-level state machine. When do we trigger an unnecessary rebalance?

Kafka 21

Kafka Cloud Metadata Process 21

Edureka

JANUARY 12, 2024

But we have narrowed down the list and divided the Full Stack developer interview questions for Freshers, Experienced, and an MCQ list. How to crack full stack Java developer Interview? How many rounds are there in Full Stack developer interview? Also, how do you keep yourself updated about the new trends in the industry?

NoSQL 52

NoSQL Java MongoDB Programming 52

ProjectPro

JUNE 29, 2021

This blog brings you the most popular Kafka interview questions and answers divided into various categories such as Apache Kafka interview questions for beginners, Advanced Kafka interview questions/Apache Kafka interview questions for experienced, Apache Kafka Zookeeper interview questions, etc. How to study for Kafka interview?

Kafka 40

Kafka Bytes Big Data Java 40

ProjectPro

JANUARY 31, 2023

In this blog, we'll dive into some of the most commonly asked big data interview questions and provide concise and informative answers to help you ace your next big data job interview. But the concern is - how do you become a big data professional? How to deploy a Big Data Model? How is Hadoop related to Big Data?

Big Data 52

Big Data Hadoop AWS Relational Database 52

phData: Data Engineering

JULY 18, 2023

To truly understand its potential, we need to explore the benefits it brings, particularly when transitioning from traditional data management structures. Snowflake allows its users to interface with the software without worrying about the infrastructure it runs or how to install it. Why Migrate to a Modern Data Stack?

Data Warehouse 52

Data Warehouse Pipeline-centric Government Data 52