article thumbnail

The Rise of the Data Engineer

Maxime Beauchemin

They’re highly analytical, and are interested in data visualization. Unlike data scientists — and inspired by our more mature parent, software engineering  — data engineers build tools, infrastructure, frameworks, and services. The data engineer’s focal point is the data warehouse and gravitates around it.

article thumbnail

Data Quality Engineer: Skills, Salary, & Tools Required

Monte Carlo

These specialists are also commonly referred to as data reliability engineers. To be successful in their role, data quality engineers will need to gather data quality requirements (mentioned in 65% of job postings) from relevant stakeholders.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Running demand forecasting machine learning models at scale

Picnic Engineering

The rich context provided by our Snowflake-powered Data Warehouse enhances their performance, allowing us to create a robust feature set for training. Training these models on our historical demand and assessing their performance is manageable as a one-time project since concepts like data drift are still not a big concern.

article thumbnail

61 Data Observability Use Cases From Real Data Teams

Monte Carlo

Luckily, the data observability solution caught what otherwise would have been an otherwise difficult to detect issue. Mitigate Risk of Data Failures Software engineers are also challenged by system and code issues, but data engineers are faced with the unique challenge of issues within the data itself.

Data 52
article thumbnail

61 Data Observability Use Cases That Aren’t Totally Made Up

Monte Carlo

Luckily, the data observability solution caught what otherwise would have been an otherwise difficult to detect issue. Mitigate Risk of Data Failures Software engineers are also challenged by system and code issues, but data engineers are faced with the unique challenge of issues within the data itself.