Cloudera

JANUARY 20, 2021

In this last installment, we’ll discuss a demo application that uses PySpark.ML to make a classification model based off of training data stored in both Cloudera’s Operational Database (powered by Apache HBase) and Apache HDFS. Training Data in HBase and HDFS. Below is a simple screen recording of the demo application.

Machine Learning 111

Machine Learning Database Data Science Building 111

Engineering at Meta

FEBRUARY 7, 2023

Instagram maps on Android Actus (from Meta’s New Product Experimentation team) Facebook Crisis Response Facebook check-ins Mapillary ( iOS , Android , Web ) Meta Quest Pro demo finder WhatsApp business directory on Android Fast rendering and up-to-date data We’re now serving several basemaps.

Entertainment 133

Entertainment Transportation Data Schemas AWS 133

Workfall

SEPTEMBER 18, 2023

Pre-filter and pre-aggregate data at the source level to optimize the data pipeline’s efficiency. Adapt to Changing Data Schemas: Data sources aren’t static; they evolve. Account for potential changes in data schemas and structures.

Data Pipeline 93

Data Pipeline Raw Data Data Schemas Healthcare 93

Knowledge Hut

DECEMBER 28, 2023

Compare and sync servers, data, schema, and other components of the database Transaction Rollback Functionality that mitigates the need for short-term backup. You can check to see if they have a free version and give it a shot first with some dummy data. Some SQL tool providers also offer limited demo versions.

SQL 52

SQL MySQL PostgreSQL Database 52

Monte Carlo

OCTOBER 11, 2022

Unbeknownst to you, the training data contains a table with aggregated visitor website data with columns that haven’t been updated in a month. It turns out the marketing operations team upgraded to Google Analytics 4 to get ahead of the July 2023 deadline which changed the data schema.

IT 52

IT Datasets Data Warehouse Data Analysis 52

dbt Developer Hub

FEBRUARY 7, 2022

It includes a set of demo CSV files, which you can use as dbt seeds to test Donny's project for yourself. If not, I’d recommend taking a second to look at Claire Carroll’s README for the original Jaffle Shop demo project (otherwise this playbook is probably going to be a little weird, but still useful, to read).

Data Warehouse 52

Data Warehouse Datasets Data SQL 52

Monte Carlo

FEBRUARY 6, 2023

But just to be safe, here are a few tips: Document your current data schema and lineage. This will be important when you have to cross-reference your old data ecosystem with your new one. But with the right planning—and a few best practices—you’ll be on your way to leveraging a shiny dew cloud data warehouse in no time (ish).

Data Warehouse 52

Data Warehouse AWS Data Validation Data 52