Cloudera

JANUARY 20, 2021

In this last installment, we’ll discuss a demo application that uses PySpark.ML to make a classification model based off of training data stored in both Cloudera’s Operational Database (powered by Apache HBase) and Apache HDFS. As a result, I decided to use an open-source Occupancy Detection Data Set to build this application.

Machine Learning 113

Machine Learning Database Data Science Building 113

Workfall

SEPTEMBER 18, 2023

Pre-filter and pre-aggregate data at the source level to optimize the data pipeline’s efficiency. Adapt to Changing Data Schemas: Data sources aren’t static; they evolve. Account for potential changes in data schemas and structures.

Data Pipeline 93

Data Pipeline Raw Data Data Schemas Healthcare 93

Knowledge Hut

DECEMBER 28, 2023

No Software Load Whether you are working on the cloud or your on-premise system, you’ll need to install some software for database access. If you use an online SQL tool though, all you need is a web browser to access the tool. You can check to see if they have a free version and give it a shot first with some dummy data.

SQL 52

SQL MySQL PostgreSQL Database 52

dbt Developer Hub

FEBRUARY 7, 2022

It includes a set of demo CSV files, which you can use as dbt seeds to test Donny's project for yourself. If not, I’d recommend taking a second to look at Claire Carroll’s README for the original Jaffle Shop demo project (otherwise this playbook is probably going to be a little weird, but still useful, to read).

Data Warehouse 52

Data Warehouse Datasets Data SQL 52

Monte Carlo

APRIL 20, 2023

Overwhelmed data engineers need to have the proper context of the blast radius to understand which incidents need to be addressed right away, and which incidents are a secondary priority. This is one of the most frequent data lineage use cases leveraged by Vox. Here are four data lineage use cases for data access and enablement.

Data Warehouse 52

Data Warehouse BI Data Government 52

Confluent

MAY 28, 2019

The primary cluster: Coordinates primary election among all the Schema Registry instances. Contains the schemas topic, to which primary instances back up newly registered schemas. Confluent Replicator then copies the Kafka schemas topic from the primary cluster to the other cluster for backup. powered by Typeform.

Management 82

Management Kafka Java Certification 82

Monte Carlo

FEBRUARY 6, 2023

As you probably already know if you’re reading this, a data warehouse migration is the process of moving data from one warehouse to another. In the old days, data warehouses were bulky, on-prem solutions that were difficult to build and equally difficult to maintain. What teams will be using your new data warehouse?

Data Warehouse 52

Data Warehouse AWS Data Validation Data 52