Knowledge Hut

DECEMBER 21, 2023

Senior Data Engineer A senior data engineer is a more advanced position that involves leading the design, building, and data infrastructure maintenance. They are accountable for managing a team of junior data engineers and ensuring the data architecture meets the organization's needs.

Data Engineering 52

Data Engineering Data Engineer Engineering MongoDB 52

Monte Carlo

JUNE 14, 2023

Data transformation dbt – Short for data build tool, is the open source leader for transforming data once it’s loaded into your warehouse. Dataform – Now part of the Google Cloud , Dataform allows you to transform raw data from your warehouse into something usable by BI and analytics tools.

Data Pipeline 52

Data Pipeline Architecture Data Lake Data Warehouse 52

Monte Carlo

MAY 17, 2023

Before data scientists or data analyst can do anything interesting with the data, they often need to spend time verifying the lineage, ensure there aren’t any missing rows, and other general cleaning tasks. System Modernization and Optimization The only constant in data engineering is change.

Data 52

Data Data Pipeline Data Engineering Data Engineer 52

Monte Carlo

MAY 17, 2023

Before data scientists or data analyst can do anything interesting with the data, they often need to spend time verifying the lineage, ensure there aren’t any missing rows, and other general cleaning tasks. System Modernization and Optimization The only constant in data engineering is change.

Data Pipeline 52

Data Pipeline Data Data Engineering Data Engineer 52