Cloudera

JANUARY 20, 2021

In this last installment, we’ll discuss a demo application that uses PySpark.ML to make a classification model based off of training data stored in both Cloudera’s Operational Database (powered by Apache HBase) and Apache HDFS. Training Data in HBase and HDFS. Below is a simple screen recording of the demo application.

Machine Learning 113

Machine Learning Database Data Science Building 113

Workfall

SEPTEMBER 18, 2023

Pre-filter and pre-aggregate data at the source level to optimize the data pipeline’s efficiency. Adapt to Changing Data Schemas: Data sources aren’t static; they evolve. Account for potential changes in data schemas and structures.

Data Pipeline 93

Data Pipeline Raw Data Data Schemas Healthcare 93

Knowledge Hut

DECEMBER 28, 2023

No Software Load Whether you are working on the cloud or your on-premise system, you’ll need to install some software for database access. If you use an online SQL tool though, all you need is a web browser to access the tool. You can check to see if they have a free version and give it a shot first with some dummy data.

SQL 52

SQL MySQL PostgreSQL Database 52

dbt Developer Hub

FEBRUARY 7, 2022

It includes a set of demo CSV files, which you can use as dbt seeds to test Donny's project for yourself. If not, I’d recommend taking a second to look at Claire Carroll’s README for the original Jaffle Shop demo project (otherwise this playbook is probably going to be a little weird, but still useful, to read).

Data Warehouse 52

Data Warehouse Datasets Data SQL 52

Monte Carlo

FEBRUARY 6, 2023

Migrations require support from everyone from data engineers and stakeholders to cross-functional partners in order to be successful, so it’s critically important to get the right people around the table early. What teams will be using your new data warehouse? What will they need access to and when? Is your data structured?

Data Warehouse 52

Data Warehouse AWS Data Validation Data 52

The Modern Data Company

MAY 8, 2023

And by leveraging distributed storage and open-source technologies, they offer a cost-effective solution for handling large data volumes. In other words, the data is stored in its raw, unprocessed form, and the structure is imposed when a user or an application queries the data for analysis or processing.

Data Management 52

Data Management Data Lake Management Data Governance 52

The Modern Data Company

MAY 8, 2023

And by leveraging distributed storage and open-source technologies, they offer a cost-effective solution for handling large data volumes. In other words, the data is stored in its raw, unprocessed form, and the structure is imposed when a user or an application queries the data for analysis or processing.

Data Management 52

Data Management Data Lake Management Data Governance 52